2021-04-09T18:08:06.471 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-09T18:08:06.473 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728 --description fs/thrash/{begin ceph-thrash/default clusters/1-mds-1-client-coloc conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_7} tasks/cfuse_workunit_suites_fsstress} --verbose --owner scheduled_yuriw@teuthology --name yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi -- /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728/orig.config.yaml 2021-04-09T18:08:06.522 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-04-09T18:08:06.599 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728 branch: wip-yuri2-testing-2021-04-09-0846-nautilus description: fs/thrash/{begin ceph-thrash/default clusters/1-mds-1-client-coloc conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_7} tasks/cfuse_workunit_suites_fsstress} email: ceph-qa@ceph.io first_in_suite: false job_id: '6031728' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '7.9' overrides: admin_socket: branch: wip-yuri2-testing-2021-04-09-0846-nautilus ceph: cephfs: session_timeout: 300 cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 global: ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd mds ms inject socket failures: 2500 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - not responding, replacing - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(TOO_FEW_PGS\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2021-04-09-0846-nautilus sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b sleep_before_teardown: 0 suite: fs suite_branch: wip-yuri2-testing-2021-04-09-0846-nautilus suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b targets: smithi120.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXEHPdWAHllNm9JstPDUEQaAHw5bdUrzNs98AwbxrULMhv9I8aQXIK2ZWQl6uzjMvhM3wASv5KmimmOvN5Ce4DVAeg4wuQaRJ2EWZv5ZIehFIAOA6HhKv2fS5C9SkiCbkUahlJZjY+r403WLtGwVa04PbNhgGtBm3E0522oj0+qgG0Syw9B5HmtO+SF+DXoFzF+pHtNjKr/MURTPv3T1qeeLtpj2ea4mfO0gIFq5olDiHN45pQeU0bEERErrzLKEMpAwDlkJrFW86Wy/DQ0K3g+GKP07MIrw2DPQmFiCEyebA59NAEnTJ3GYVJdhElQsZ8YL2yBY+ZAurya5tab9O/ smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCs94NYH8h43i81cJu5/Yxf6lTc7sV9j9yQx0Zp/8zyF2BOOq07UUbNhlqSh7tuFMiQLy5krJ0qR29Yws48IR+H4Ozpb/8U8Mzu5/IMAaYocfg5cD4PvvP8i8vOVFyRr7NlS1r0h0ajVQ5m2hvSKqsvIJjIZY6QZlqoRGuKo9CJWO2CMzlzUIJVsZUwnhGvu+IaZqzfBjervmL4HpQ9Gyxhq0K7yz6Jh3Zsj+WZWplMFf2DYOMZoHmGZcreUEyxLLZPTgFtLpXEWg5mqgfGjped5Ng7NqOqbM8QHBD6zFjHzuVXm3T5VNgabxkI3z7/9NzvGLXvTe+1nvO1cVJ0qDpd tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - ceph: null - mds_thrash: null - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology_branch: master teuthology_sha1: 85d61eae4759f46ce21e9a37cd816a7a1a66c9d5 timestamp: 2021-04-09_17:56:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23935 2021-04-09T18:08:06.600 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa; will attempt to use it 2021-04-09T18:08:06.601 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa/tasks 2021-04-09T18:08:06.601 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-04-09T18:08:06.604 INFO:teuthology.task.internal:Checking packages... 2021-04-09T18:08:06.628 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash 'd23cd2d5f486487b0b80655c4e33344f0f97b82b' 2021-04-09T18:08:06.628 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-04-09T18:08:06.629 INFO:teuthology.packaging:ref: None 2021-04-09T18:08:06.630 INFO:teuthology.packaging:tag: None 2021-04-09T18:08:06.630 INFO:teuthology.packaging:branch: wip-yuri2-testing-2021-04-09-0846-nautilus 2021-04-09T18:08:06.630 INFO:teuthology.packaging:sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:08:06.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-yuri2-testing-2021-04-09-0846-nautilus 2021-04-09T18:08:06.778 INFO:teuthology.task.internal:Found packages for ceph version 14.2.19-116.gd23cd2d5 2021-04-09T18:08:06.778 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-04-09T18:08:06.790 INFO:teuthology.task.internal:no buildpackages task found 2021-04-09T18:08:06.790 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-04-09T18:08:06.830 INFO:teuthology.task.internal:Saving configuration 2021-04-09T18:08:06.846 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-04-09T18:08:06.858 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-09T18:08:06.877 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-04-09 17:58:03.561247', 'description': '/home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBF+H8xRI46vY0JmEv2W6yWHdekcPs4JZIjRwXNQM6JCGjSxGr/ccSXCLgdHKFp2hc6d1BWkikCMT2WeZnYhyTQ=', 'os_version': '7.9', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi120.front.sepia.ceph.com'} 2021-04-09T18:08:06.904 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-04-09 17:58:03.561226', 'description': '/home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPst3mZUag3t5OJTt4Rim8IW8rbP/THk7oB6nG4PpegP1z9ub0s0Ry1opGyuBlTNlH9sANMfB0Ck7TIRLgvCEGs=', 'os_version': '7.9', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi134.front.sepia.ceph.com'} 2021-04-09T18:08:06.905 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-04-09T18:08:06.921 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-04-09T18:08:06.922 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-04-09T18:08:06.922 INFO:teuthology.run_tasks:Running task console_log... 2021-04-09T18:08:07.026 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f884bab5950>, signals=[15]) 2021-04-09T18:08:07.027 INFO:teuthology.run_tasks:Running task internal.connect... 2021-04-09T18:08:07.041 INFO:teuthology.task.internal:Opening connections... 2021-04-09T18:08:07.042 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:08:07.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:08:07.118 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:08:07.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:08:07.189 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-04-09T18:08:07.200 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2021-04-09T18:08:07.338 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2021-04-09T18:08:07.339 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2021-04-09T18:08:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux Server" 2021-04-09T18:08:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="7.9 (Maipo)" 2021-04-09T18:08:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel" 2021-04-09T18:08:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora" 2021-04-09T18:08:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:VARIANT="Server" 2021-04-09T18:08:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:VARIANT_ID="server" 2021-04-09T18:08:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="7.9" 2021-04-09T18:08:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Employee SKU" 2021-04-09T18:08:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2021-04-09T18:08:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-04-09T18:08:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/" 2021-04-09T18:08:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-09T18:08:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:08:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-04-09T18:08:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-04-09T18:08:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-09T18:08:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-04-09T18:08:07.386 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2021-04-09T18:08:07.402 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2021-04-09T18:08:07.462 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2021-04-09T18:08:07.462 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2021-04-09T18:08:07.502 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux Server" 2021-04-09T18:08:07.502 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="7.9 (Maipo)" 2021-04-09T18:08:07.502 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2021-04-09T18:08:07.503 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2021-04-09T18:08:07.503 INFO:teuthology.orchestra.run.smithi134.stdout:VARIANT="Server" 2021-04-09T18:08:07.503 INFO:teuthology.orchestra.run.smithi134.stdout:VARIANT_ID="server" 2021-04-09T18:08:07.503 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="7.9" 2021-04-09T18:08:07.504 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Employee SKU" 2021-04-09T18:08:07.504 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2021-04-09T18:08:07.504 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-04-09T18:08:07.504 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2021-04-09T18:08:07.504 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-09T18:08:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:08:07.505 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-04-09T18:08:07.505 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-04-09T18:08:07.505 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-09T18:08:07.506 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-04-09T18:08:07.506 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-04-09T18:08:07.520 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-04-09T18:08:07.535 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-04-09T18:08:07.569 INFO:teuthology.task.internal:Checking for old test directory... 2021-04-09T18:08:07.569 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2021-04-09T18:08:07.574 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2021-04-09T18:08:07.612 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-04-09T18:08:07.623 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-04-09T18:08:07.624 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2021-04-09T18:08:07.653 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2021-04-09T18:08:07.712 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-04-09T18:08:07.767 INFO:teuthology.run_tasks:Running task kernel... 2021-04-09T18:08:07.788 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}} 2021-04-09T18:08:07.790 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-04-09T18:08:07.790 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2021-04-09T18:08:07.832 INFO:teuthology.orchestra.run.smithi120.stdout:3.10.0-1160.24.1.el7.x86_64 2021-04-09T18:08:07.833 INFO:teuthology.task.kernel:Running kernel on smithi120: 3.10.0-1160.24.1.el7.x86_64 2021-04-09T18:08:07.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2021-04-09T18:08:08.981 INFO:teuthology.orchestra.run.smithi120.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T18:08:08.981 INFO:teuthology.orchestra.run.smithi120.stdout: : disabled-repos, subscription-manager 2021-04-09T18:08:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:08:09.156 INFO:teuthology.orchestra.run.smithi120.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2021-04-09T18:08:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:08:09.185 INFO:teuthology.orchestra.run.smithi120.stdout:Loading mirror speeds from cached hostfile 2021-04-09T18:08:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: * epel: download-cc-rdu01.fedoraproject.org 2021-04-09T18:08:10.340 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do 2021-04-09T18:08:10.360 DEBUG:teuthology.orchestra.run.smithi120:> echo no | sudo yum reinstall kernel || true 2021-04-09T18:08:10.561 INFO:teuthology.orchestra.run.smithi120.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T18:08:10.561 INFO:teuthology.orchestra.run.smithi120.stdout: : disabled-repos, subscription-manager 2021-04-09T18:08:10.624 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:08:10.625 INFO:teuthology.orchestra.run.smithi120.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2021-04-09T18:08:10.625 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:08:10.695 INFO:teuthology.orchestra.run.smithi120.stderr:Skipping the running kernel: kernel-3.10.0-1160.24.1.el7.x86_64 2021-04-09T18:08:10.707 INFO:teuthology.orchestra.run.smithi120.stdout:Loading mirror speeds from cached hostfile 2021-04-09T18:08:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: * epel: download-cc-rdu01.fedoraproject.org 2021-04-09T18:08:10.712 INFO:teuthology.orchestra.run.smithi120.stdout:Installed package kernel-3.10.0-1160.el7.x86_64 (from anaconda) not available. 2021-04-09T18:08:10.713 INFO:teuthology.orchestra.run.smithi120.stderr:Error: Nothing to do 2021-04-09T18:08:10.729 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel --last | head -n 1 2021-04-09T18:08:10.922 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-3.10.0-1160.24.1.el7.x86_64 Thu 08 Apr 2021 06:20:34 PM UTC 2021-04-09T18:08:10.923 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1160.24.1.el7.x86_64 2021-04-09T18:08:10.924 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-04-09T18:08:10.924 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2021-04-09T18:08:10.970 INFO:teuthology.orchestra.run.smithi134.stdout:3.10.0-1160.24.1.el7.x86_64 2021-04-09T18:08:10.970 INFO:teuthology.task.kernel:Running kernel on smithi134: 3.10.0-1160.24.1.el7.x86_64 2021-04-09T18:08:10.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2021-04-09T18:08:12.059 INFO:teuthology.orchestra.run.smithi134.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T18:08:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: : disabled-repos, subscription-manager 2021-04-09T18:08:12.261 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:08:12.261 INFO:teuthology.orchestra.run.smithi134.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2021-04-09T18:08:12.262 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:08:12.293 INFO:teuthology.orchestra.run.smithi134.stdout:Loading mirror speeds from cached hostfile 2021-04-09T18:08:12.307 INFO:teuthology.orchestra.run.smithi134.stdout: * epel: download-cc-rdu01.fedoraproject.org 2021-04-09T18:08:13.619 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do 2021-04-09T18:08:13.639 DEBUG:teuthology.orchestra.run.smithi134:> echo no | sudo yum reinstall kernel || true 2021-04-09T18:08:13.837 INFO:teuthology.orchestra.run.smithi134.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T18:08:13.838 INFO:teuthology.orchestra.run.smithi134.stdout: : disabled-repos, subscription-manager 2021-04-09T18:08:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:08:13.899 INFO:teuthology.orchestra.run.smithi134.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2021-04-09T18:08:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:08:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:Skipping the running kernel: kernel-3.10.0-1160.24.1.el7.x86_64 2021-04-09T18:08:13.999 INFO:teuthology.orchestra.run.smithi134.stdout:Loading mirror speeds from cached hostfile 2021-04-09T18:08:14.000 INFO:teuthology.orchestra.run.smithi134.stdout: * epel: download-cc-rdu01.fedoraproject.org 2021-04-09T18:08:14.004 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-3.10.0-1160.el7.x86_64 (from anaconda) not available. 2021-04-09T18:08:14.005 INFO:teuthology.orchestra.run.smithi134.stderr:Error: Nothing to do 2021-04-09T18:08:14.021 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel --last | head -n 1 2021-04-09T18:08:14.211 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-3.10.0-1160.24.1.el7.x86_64 Thu 08 Apr 2021 06:20:34 PM UTC 2021-04-09T18:08:14.212 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1160.24.1.el7.x86_64 2021-04-09T18:08:14.213 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-04-09T18:08:14.213 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-04-09T18:08:14.213 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-04-09T18:08:14.309 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2021-04-09T18:08:14.321 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-04-09T18:08:14.321 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-04-09T18:08:14.382 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2021-04-09T18:08:14.396 INFO:teuthology.run_tasks:Running task internal.base... 2021-04-09T18:08:14.407 INFO:teuthology.task.internal:Creating test directory... 2021-04-09T18:08:14.408 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-04-09T18:08:14.412 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-04-09T18:08:14.454 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-04-09T18:08:14.470 INFO:teuthology.run_tasks:Running task internal.archive... 2021-04-09T18:08:14.506 INFO:teuthology.task.internal:Creating archive directory... 2021-04-09T18:08:14.507 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-04-09T18:08:14.511 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-04-09T18:08:14.571 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-04-09T18:08:14.582 INFO:teuthology.task.internal:Enabling coredump saving... 2021-04-09T18:08:14.583 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-04-09T18:08:14.587 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-04-09T18:08:14.636 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:08:14.638 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:08:14.649 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:08:14.651 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-04-09T18:08:14.652 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-04-09T18:08:14.665 INFO:teuthology.task.internal:Configuring sudo... 2021-04-09T18:08:14.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-04-09T18:08:14.670 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-04-09T18:08:14.724 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-04-09T18:08:14.738 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-04-09T18:08:14.739 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-04-09T18:08:14.744 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-04-09T18:08:14.784 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-04-09T18:08:44.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-04-09T18:08:44.555 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-04-09T18:08:46.594 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-04-09T18:08:46.656 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2021-04-09T18:08:46.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-04-09T18:08:46.713 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-04-09T18:08:47.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-04-09T18:08:47.349 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-04-09T18:08:47.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-04-09T18:08:47.497 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-04-09T18:08:47.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-04-09T18:08:47.551 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2021-04-09T18:08:47.555 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2021-04-09T18:08:47.630 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-04-09T18:08:47.663 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-04-09T18:08:47.710 INFO:teuthology.run_tasks:Running task internal.timer... 2021-04-09T18:08:47.724 INFO:teuthology.task.internal:Starting timer... 2021-04-09T18:08:47.724 INFO:teuthology.run_tasks:Running task pcp... 2021-04-09T18:08:47.776 INFO:teuthology.run_tasks:Running task selinux... 2021-04-09T18:08:47.809 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2021-04-09T18:08:47.909 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: [ OK ] 2021-04-09T18:08:47.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2021-04-09T18:08:48.013 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: [ OK ] 2021-04-09T18:08:48.014 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-04-09T18:08:48.015 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2021-04-09T18:08:48.079 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2021-04-09T18:08:48.080 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2021-04-09T18:08:48.127 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2021-04-09T18:08:48.128 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi120.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2021-04-09T18:08:48.128 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\)' 2021-04-09T18:08:48.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:08:48.184 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\)' 2021-04-09T18:08:48.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-04-09T18:08:48.239 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-04-09T18:08:48.239 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2021-04-09T18:08:48.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2021-04-09T18:08:48.359 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-04-09T18:08:48.375 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-04-09T18:08:48.376 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-04-09T18:08:48.455 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-04-09T18:08:48.457 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-04-09T18:08:49.131 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-04-09T18:08:50.899 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-04-09T18:08:53.522 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-04-09T18:08:53.543 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:53 +0000 (0:00:00.037) 0:00:00.037 ********** 2021-04-09T18:08:53.553 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:53 +0000 (0:00:00.010) 0:00:00.048 ********** 2021-04-09T18:08:55.238 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-04-09T18:08:55.239 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] 2021-04-09T18:08:55.289 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] 2021-04-09T18:08:55.329 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:55 +0000 (0:00:01.776) 0:00:01.824 ********** 2021-04-09T18:08:55.371 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:55 +0000 (0:00:00.041) 0:00:01.865 ********** 2021-04-09T18:08:55.745 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-04-09T18:08:55.747 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:08:55.776 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:55 +0000 (0:00:00.404) 0:00:02.270 ********** 2021-04-09T18:08:55.790 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:08:55.831 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:55 +0000 (0:00:00.054) 0:00:02.325 ********** 2021-04-09T18:08:56.495 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi120.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-04-09T18:08:56.513 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:56 +0000 (0:00:00.682) 0:00:03.008 ********** 2021-04-09T18:08:56.522 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-04-09T18:08:56.545 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:56 +0000 (0:00:00.031) 0:00:03.039 ********** 2021-04-09T18:08:56.623 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-04-09T18:08:56.625 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:08:56.647 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:56 +0000 (0:00:00.102) 0:00:03.141 ********** 2021-04-09T18:08:56.676 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:08:56.699 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:56 +0000 (0:00:00.051) 0:00:03.193 ********** 2021-04-09T18:08:57.155 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:08:57.182 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:57 +0000 (0:00:00.479) 0:00:03.672 ********** 2021-04-09T18:08:57.187 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:08:57.219 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:57 +0000 (0:00:00.040) 0:00:03.713 ********** 2021-04-09T18:08:58.422 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-04-09T18:08:58.424 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "state": "file", "uid": 0} 2021-04-09T18:08:58.462 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:58 +0000 (0:00:01.242) 0:00:04.955 ********** 2021-04-09T18:08:58.469 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "state": "file", "uid": 0} 2021-04-09T18:08:58.494 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:58 +0000 (0:00:00.032) 0:00:04.988 ********** 2021-04-09T18:08:59.134 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-04-09T18:08:59.136 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-04-09T18:08:59.137 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-04-09T18:08:59.162 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-04-09T18:08:59.164 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-04-09T18:08:59.239 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-04-09T18:08:59.245 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-04-09T18:08:59.511 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:59 +0000 (0:00:01.014) 0:00:06.003 ********** 2021-04-09T18:08:59.529 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:08:59 +0000 (0:00:00.020) 0:00:06.024 ********** 2021-04-09T18:09:00.133 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-04-09T18:09:00.135 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] 2021-04-09T18:09:00.260 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-04-09T18:09:00.262 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:00 +0000 (0:00:00.730) 0:00:06.754 ********** 2021-04-09T18:09:01.116 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] 2021-04-09T18:09:01.179 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:01 +0000 (0:00:00.918) 0:00:07.673 ********** 2021-04-09T18:09:01.293 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-04-09T18:09:01.295 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.244251", "end": "2021-04-09 18:09:01.255301", "rc": 0, "start": "2021-04-09 18:09:01.011050", "stderr": "", "stderr_lines": [], "stdout": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "stdout_lines": ["5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232"]} 2021-04-09T18:09:01.318 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:01 +0000 (0:00:00.139) 0:00:07.812 ********** 2021-04-09T18:09:01.538 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-04-09T18:09:01.539 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010369", "end": "2021-04-09 18:09:01.500247", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:09:01.489878", "stderr": "", "stderr_lines": [], "stdout": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "stdout_lines": ["5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232"]} 2021-04-09T18:09:01.561 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:01 +0000 (0:00:00.243) 0:00:08.055 ********** 2021-04-09T18:09:01.641 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-04-09T18:09:01.643 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-04-09T18:09:01.666 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:01 +0000 (0:00:00.105) 0:00:08.161 ********** 2021-04-09T18:09:01.764 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-04-09T18:09:01.765 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:01.795 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:01 +0000 (0:00:00.128) 0:00:08.289 ********** 2021-04-09T18:09:01.870 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-04-09T18:09:01.872 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.338889", "end": "2021-04-09 18:09:01.845311", "rc": 0, "start": "2021-04-09 18:09:01.506422", "stderr": "", "stderr_lines": [], "stdout": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "stdout_lines": ["5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232"]} 2021-04-09T18:09:01.900 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:01 +0000 (0:00:00.105) 0:00:08.394 ********** 2021-04-09T18:09:01.918 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-04-09T18:09:01.919 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:01.942 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:01 +0000 (0:00:00.041) 0:00:08.436 ********** 2021-04-09T18:09:02.073 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-04-09T18:09:02.076 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.115 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:02 +0000 (0:00:00.172) 0:00:08.608 ********** 2021-04-09T18:09:02.137 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-04-09T18:09:02.139 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.021341", "end": "2021-04-09 18:09:02.116119", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:09:02.094778", "stderr": "", "stderr_lines": [], "stdout": "5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232", "stdout_lines": ["5bb5aa76bc3fd5b5b3f6df845aec3bd1f9062232"]} 2021-04-09T18:09:02.162 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:02 +0000 (0:00:00.047) 0:00:08.656 ********** 2021-04-09T18:09:02.226 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.270 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:02 +0000 (0:00:00.107) 0:00:08.764 ********** 2021-04-09T18:09:02.320 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-04-09T18:09:02.323 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-04-09T18:09:02.344 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:02 +0000 (0:00:00.073) 0:00:08.838 ********** 2021-04-09T18:09:02.378 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.402 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:02 +0000 (0:00:00.057) 0:00:08.896 ********** 2021-04-09T18:09:02.441 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-04-09T18:09:02.448 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.483 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:02 +0000 (0:00:00.081) 0:00:08.977 ********** 2021-04-09T18:09:02.570 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:09:02.574 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.575 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.587 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.588 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.599 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-04-09T18:09:02.601 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.637 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:02 +0000 (0:00:00.154) 0:00:09.131 ********** 2021-04-09T18:09:02.652 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:09:02.654 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.656 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.656 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.657 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.657 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAA 2021-04-09T18:09:02.658 INFO:teuthology.task.ansible.out:DAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.663 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.680 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.681 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVN 2021-04-09T18:09:02.683 INFO:teuthology.task.ansible.out:TUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654 2021-04-09T18:09:02.685 INFO:teuthology.task.ansible.out:\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop 2021-04-09T18:09:02.686 INFO:teuthology.task.ansible.out:KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.695 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.696 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.698 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.708 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.709 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.721 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.722 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.733 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.734 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.745 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.747 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.747 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-04-09T18:09:02.747 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.748 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.797 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:02 +0000 (0:00:00.159) 0:00:09.291 ********** 2021-04-09T18:09:02.830 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.831 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:02.836 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.837 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.840 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.842 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.843 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:02.848 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.850 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.851 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.853 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.865 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.877 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.888 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.932 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.934 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.956 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:02 +0000 (0:00:00.159) 0:00:09.451 ********** 2021-04-09T18:09:02.974 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:09:02.976 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.988 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:02.999 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.021 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.032 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.074 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.087 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.098 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.110 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.121 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.170 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:03 +0000 (0:00:00.213) 0:00:09.664 ********** 2021-04-09T18:09:03.204 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:09:03.206 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.215 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.216 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.217 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.220 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.234 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.255 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.256 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.256 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:03.291 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.313 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.315 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:03.326 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.327 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.352 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.354 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:03.365 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.376 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.379 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:03.380 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.381 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:03.392 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.394 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:03.396 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.396 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-04-09T18:09:03.398 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.408 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.420 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.422 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.432 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.444 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.446 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.456 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.458 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f30 2021-04-09T18:09:03.460 INFO:teuthology.task.ansible.out:09adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.468 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.469 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.470 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.471 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.482 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.484 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f 2021-04-09T18:09:03.486 INFO:teuthology.task.ansible.out:88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.494 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.496 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606 2021-04-09T18:09:03.498 INFO:teuthology.task.ansible.out:a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.507 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.509 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.510 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.514 INFO:teuthology.task.ansible.out: skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.516 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.528 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.529 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:03.532 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.546 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f9 2021-04-09T18:09:03.551 INFO:teuthology.task.ansible.out:97d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.561 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.564 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.565 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086 2021-04-09T18:09:03.571 INFO:teuthology.task.ansible.out:ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.581 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.582 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.584 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.598 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.600 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.609 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.610 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.612 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.623 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.623 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.625 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.636 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.637 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.650 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.662 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b971500390 2021-04-09T18:09:03.665 INFO:teuthology.task.ansible.out:2937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.673 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.675 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.675 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.678 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.689 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.691 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.692 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.710 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.712 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.722 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.734 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.745 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.759 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.761 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.771 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.782 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.783 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.793 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.795 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.805 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.806 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.817 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.829 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.841 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.841 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.843 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.845 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.846 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.857 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.869 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.871 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.872 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.873 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.884 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.886 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.895 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.898 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.908 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.910 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.921 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.923 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.934 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.949 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.950 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.951 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.953 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.964 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.966 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.967 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.978 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.983 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.991 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.993 INFO:teuthology.task.ansible.out: skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:03.994 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.006 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.008 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.009 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.020 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.021 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.023 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.033 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.035 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.036 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:04.036 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.048 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.050 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.050 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.051 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.052 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.064 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.066 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.076 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.078 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.079 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.079 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.081 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.083 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.095 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.096 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.107 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.108 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.110 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.121 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.122 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.145 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.153 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.173 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.174 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.176 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.214 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:04 +0000 (0:00:01.042) 0:00:10.707 ********** 2021-04-09T18:09:04.226 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.227 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.229 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.231 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.233 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.237 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.249 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.250 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.251 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.262 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.264 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.277 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.290 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.301 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.312 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.317 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** TASK [Create all admin users with sudo access.] ******************************** skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.352 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:04 +0000 (0:00:00.139) 0:00:10.847 ********** 2021-04-09T18:09:04.365 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.367 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:04.369 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.371 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:04.372 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.374 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.374 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.375 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.385 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.388 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.421 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.422 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.433 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.445 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.456 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.468 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.479 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.491 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.503 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.520 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.526 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.532 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-04-09T18:09:04.540 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.606 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:04 +0000 (0:00:00.253) 0:00:11.100 ********** 2021-04-09T18:09:04.608 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:04.629 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-04-09T18:09:04.634 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.636 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.641 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.761 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:04 +0000 (0:00:00.155) 0:00:11.255 ********** 2021-04-09T18:09:04.812 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:04.846 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:04 +0000 (0:00:00.084) 0:00:11.340 ********** 2021-04-09T18:09:04.876 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-04-09T18:09:04.926 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:04 +0000 (0:00:00.080) 0:00:11.421 ********** 2021-04-09T18:09:05.010 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:09:05.012 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.054 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:05 +0000 (0:00:00.127) 0:00:11.548 ********** 2021-04-09T18:09:05.085 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-04-09T18:09:05.087 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.139 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:05 +0000 (0:00:00.085) 0:00:11.634 ********** 2021-04-09T18:09:05.214 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-04-09T18:09:05.216 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.252 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:05 +0000 (0:00:00.112) 0:00:11.746 ********** 2021-04-09T18:09:05.274 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-04-09T18:09:05.276 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.324 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:05 +0000 (0:00:00.071) 0:00:11.818 ********** 2021-04-09T18:09:05.388 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:05.390 INFO:teuthology.task.ansible.out:TASK [Filter the revoked_users list] ******************************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.438 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:05 +0000 (0:00:00.114) 0:00:11.932 ********** 2021-04-09T18:09:05.514 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-04-09T18:09:05.516 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.564 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:05 +0000 (0:00:00.125) 0:00:12.058 ********** 2021-04-09T18:09:05.626 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:09:05.628 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.628 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.640 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.641 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.652 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.663 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.664 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.680 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.682 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.695 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.705 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.717 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.718 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.729 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.740 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.742 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.753 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.755 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.799 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:05 +0000 (0:00:00.235) 0:00:12.293 ********** 2021-04-09T18:09:05.811 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:05.815 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** 2021-04-09T18:09:05.817 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.818 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.819 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.819 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.824 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.831 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.833 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.834 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.835 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.836 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.847 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.848 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.848 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.849 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.850 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.862 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.864 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.874 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.876 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:05.928 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:05 +0000 (0:00:00.128) 0:00:12.422 ********** 2021-04-09T18:09:05.971 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-04-09T18:09:05.973 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.013 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:06 +0000 (0:00:00.085) 0:00:12.507 ********** 2021-04-09T18:09:06.194 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.205 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.208 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.218 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.251 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.262 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.263 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.273 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.284 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.295 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.306 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.308 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.318 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.328 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.341 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.363 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.365 INFO:teuthology.task.ansible.out: skipping: [smithi134.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.387 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.402 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.413 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.421 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.433 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.444 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.446 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.469 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.490 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.523 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.549 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.556 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.579 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.590 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.612 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.634 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.636 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "53b31205b3cc9729fea6ce5ceab6366ba2fdabc0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2021-04-09T18:09:06.686 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:06 +0000 (0:00:00.673) 0:00:13.181 ********** 2021-04-09T18:09:06.700 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-04-09T18:09:06.702 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.715 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.717 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.740 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.762 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.773 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.797 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.844 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.865 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.877 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.888 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:06.933 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:06 +0000 (0:00:00.246) 0:00:13.427 ********** 2021-04-09T18:09:06.955 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-04-09T18:09:06.960 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => { "msg": "Host smithi120.front.sepia.ceph.com is running RedHat 7.9 (Maipo)" } 2021-04-09T18:09:07.020 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:07 +0000 (0:00:00.087) 0:00:13.514 ********** 2021-04-09T18:09:07.196 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-04-09T18:09:07.199 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml) => {"ansible_facts": {"rhsm_repos": ["rhel-7-server-rpms", "rhel-7-server-optional-rpms", "rhel-7-server-extras-rpms", "rhel-ha-for-rhel-7-server-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"} 2021-04-09T18:09:07.264 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:07 +0000 (0:00:00.243) 0:00:13.758 ********** 2021-04-09T18:09:07.454 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-04-09T18:09:07.456 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:07.489 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:07 +0000 (0:00:00.224) 0:00:13.983 ********** 2021-04-09T18:09:07.776 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-04-09T18:09:07.778 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "53b31205b3cc9729fea6ce5ceab6366ba2fdabc0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2021-04-09T18:09:07.814 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:07 +0000 (0:00:00.325) 0:00:14.309 ********** 2021-04-09T18:09:07.869 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-04-09T18:09:07.871 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.074051", "end": "2021-04-09 18:09:07.846252", "rc": 0, "start": "2021-04-09 18:09:07.772201", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-04-09T18:09:07.916 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:07 +0000 (0:00:00.101) 0:00:14.410 ********** 2021-04-09T18:09:07.955 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-04-09T18:09:07.957 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => { "msg": "Host smithi134.front.sepia.ceph.com is running RedHat 7.9 (Maipo)" } 2021-04-09T18:09:08.002 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:07 +0000 (0:00:00.085) 0:00:14.496 ********** 2021-04-09T18:09:08.068 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-04-09T18:09:08.070 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:08.117 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:08 +0000 (0:00:00.115) 0:00:14.611 ********** 2021-04-09T18:09:08.195 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-04-09T18:09:08.196 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml) => {"ansible_facts": {"rhsm_repos": ["rhel-7-server-rpms", "rhel-7-server-optional-rpms", "rhel-7-server-extras-rpms", "rhel-ha-for-rhel-7-server-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"} 2021-04-09T18:09:08.235 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:08 +0000 (0:00:00.117) 0:00:14.729 ********** 2021-04-09T18:09:08.264 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-04-09T18:09:08.266 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:08.297 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:08 +0000 (0:00:00.062) 0:00:14.791 ********** 2021-04-09T18:09:08.391 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:08.393 INFO:teuthology.task.ansible.out:TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:08.429 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:08 +0000 (0:00:00.131) 0:00:14.923 ********** 2021-04-09T18:09:08.450 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-04-09T18:09:08.453 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:08.475 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:08 +0000 (0:00:00.045) 0:00:14.969 ********** 2021-04-09T18:09:08.477 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:08.660 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:08.698 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:08 +0000 (0:00:00.223) 0:00:15.192 ********** 2021-04-09T18:09:08.805 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-04-09T18:09:08.808 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.060361", "end": "2021-04-09 18:09:08.770642", "rc": 0, "start": "2021-04-09 18:09:08.710281", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-04-09T18:09:08.859 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:08 +0000 (0:00:00.160) 0:00:15.353 ********** 2021-04-09T18:09:08.875 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:08.914 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:08 +0000 (0:00:00.055) 0:00:15.408 ********** 2021-04-09T18:09:09.009 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-04-09T18:09:09.011 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:09.045 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:09 +0000 (0:00:00.130) 0:00:15.539 ********** 2021-04-09T18:09:09.055 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-04-09T18:09:09.057 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-04-09T18:09:09.110 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:09 +0000 (0:00:00.064) 0:00:15.604 ********** 2021-04-09T18:09:09.166 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-04-09T18:09:09.168 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:09.203 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:09 +0000 (0:00:00.092) 0:00:15.697 ********** 2021-04-09T18:09:09.299 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:09.346 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:09 +0000 (0:00:00.143) 0:00:15.840 ********** 2021-04-09T18:09:09.357 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-04-09T18:09:09.359 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:09:09.361 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:09:09.401 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:09 +0000 (0:00:00.054) 0:00:15.895 ********** 2021-04-09T18:09:09.471 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-04-09T18:09:09.473 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:09.508 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:09 +0000 (0:00:00.106) 0:00:16.002 ********** 2021-04-09T18:09:09.575 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-04-09T18:09:09.583 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2021-04-09T18:09:09.609 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:09 +0000 (0:00:00.101) 0:00:16.103 ********** 2021-04-09T18:09:09.642 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-04-09T18:09:09.644 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:09.677 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:09 +0000 (0:00:00.067) 0:00:16.171 ********** 2021-04-09T18:09:09.868 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-04-09T18:09:09.876 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-04-09T18:09:09.909 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:09 +0000 (0:00:00.232) 0:00:16.403 ********** 2021-04-09T18:09:10.067 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-04-09T18:09:10.069 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:09:10.106 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:10 +0000 (0:00:00.197) 0:00:16.600 ********** 2021-04-09T18:09:10.275 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-04-09T18:09:10.277 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2021-04-09T18:09:10.308 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:10 +0000 (0:00:00.201) 0:00:16.802 ********** 2021-04-09T18:09:11.618 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-3.noarch providing /root/.ansible/tmp/ansible-moduletmp-1617991750.59-yLdba0/katello-ca-consumer-latest.noarchPhrrLD.rpm is already installed"]} 2021-04-09T18:09:11.651 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:11 +0000 (0:00:01.342) 0:00:18.145 ********** 2021-04-09T18:09:11.669 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-3.noarch providing /root/.ansible/tmp/ansible-moduletmp-1617991750.79-vgPA_J/katello-ca-consumer-latest.noarchg45KZp.rpm is already installed"]} 2021-04-09T18:09:11.693 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:11 +0000 (0:00:00.042) 0:00:18.187 ********** 2021-04-09T18:09:12.544 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "4a68bf238bc0f5c253db5c3e544b53f300b954a5", "dest": "/etc/yum/vars/releasever", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/yum/vars/releasever", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 3, "state": "file", "uid": 0} 2021-04-09T18:09:12.545 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "4a68bf238bc0f5c253db5c3e544b53f300b954a5", "dest": "/etc/yum/vars/releasever", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/yum/vars/releasever", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 3, "state": "file", "uid": 0} 2021-04-09T18:09:12.575 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:12 +0000 (0:00:00.880) 0:00:19.068 ********** 2021-04-09T18:09:12.617 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:12 +0000 (0:00:00.040) 0:00:19.111 ********** 2021-04-09T18:09:13.436 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-04-09T18:09:13.438 INFO:teuthology.task.ansible.out:fatal: [smithi120.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2021-04-09T18:09:13.484 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:13 +0000 (0:00:00.866) 0:00:19.978 ********** 2021-04-09T18:09:13.491 INFO:teuthology.task.ansible.out:fatal: [smithi134.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2021-04-09T18:09:13.534 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:13 +0000 (0:00:00.049) 0:00:20.028 ********** 2021-04-09T18:09:13.660 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-04-09T18:09:13.662 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-04-09T18:09:13.706 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:13 +0000 (0:00:00.172) 0:00:20.200 ********** 2021-04-09T18:09:13.717 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-04-09T18:09:13.757 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:13 +0000 (0:00:00.050) 0:00:20.251 ********** 2021-04-09T18:09:20.132 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-04-09T18:09:20.134 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-04-09T18:09:20.185 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:20 +0000 (0:00:06.420) 0:00:26.672 ********** 2021-04-09T18:09:20.382 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-04-09T18:09:20.425 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:20 +0000 (0:00:00.246) 0:00:26.919 ********** 2021-04-09T18:09:21.210 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-04-09T18:09:21.212 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.311128", "end": "2021-04-09 18:09:21.184515", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:09:20.873387", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2021-04-09T18:09:21.233 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:21 +0000 (0:00:00.808) 0:00:27.727 ********** 2021-04-09T18:09:21.413 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-04-09T18:09:21.414 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:21.452 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:21 +0000 (0:00:00.219) 0:00:27.946 ********** 2021-04-09T18:09:21.746 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-04-09T18:09:21.753 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:21.822 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:21 +0000 (0:00:00.369) 0:00:28.316 ********** 2021-04-09T18:09:22.230 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-04-09T18:09:22.232 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:09:22.277 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:22 +0000 (0:00:00.453) 0:00:28.769 ********** 2021-04-09T18:09:22.310 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-04-09T18:09:22.312 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-04-09T18:09:22.416 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:22 +0000 (0:00:00.141) 0:00:28.910 ********** 2021-04-09T18:09:22.791 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-04-09T18:09:22.793 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-04-09T18:09:22.847 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:22 +0000 (0:00:00.430) 0:00:29.341 ********** 2021-04-09T18:09:22.855 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:09:22.862 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:22.890 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:22 +0000 (0:00:00.042) 0:00:29.384 ********** 2021-04-09T18:09:23.701 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-04-09T18:09:23.703 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.278503", "end": "2021-04-09 18:09:23.658040", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:09:23.379537", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2021-04-09T18:09:23.740 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:23 +0000 (0:00:00.849) 0:00:30.233 ********** 2021-04-09T18:09:23.940 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-04-09T18:09:23.942 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:23.979 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:23 +0000 (0:00:00.239) 0:00:30.473 ********** 2021-04-09T18:09:24.204 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-04-09T18:09:24.206 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:24.239 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:24 +0000 (0:00:00.260) 0:00:30.734 ********** 2021-04-09T18:09:24.385 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-04-09T18:09:24.387 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-04-09T18:09:24.414 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:24 +0000 (0:00:00.174) 0:00:30.908 ********** 2021-04-09T18:09:24.577 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:09:24.579 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:24.600 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:24 +0000 (0:00:00.186) 0:00:31.094 ********** 2021-04-09T18:09:24.887 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-04-09T18:09:24.894 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:01.530591", "end": "2021-04-09 18:09:24.855882", "rc": 0, "start": "2021-04-09 18:09:23.325291", "stderr": "", "stderr_lines": [], "stdout": "rhel-7-server-rpms", "stdout_lines": ["rhel-7-server-rpms"]} 2021-04-09T18:09:24.954 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:24 +0000 (0:00:00.352) 0:00:31.446 ********** 2021-04-09T18:09:25.297 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-04-09T18:09:25.299 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-7-server-rpms"]}, "changed": false} 2021-04-09T18:09:25.329 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:25 +0000 (0:00:00.370) 0:00:31.818 ********** 2021-04-09T18:09:25.666 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-04-09T18:09:25.668 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:25.695 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:25 +0000 (0:00:00.371) 0:00:32.189 ********** 2021-04-09T18:09:26.201 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-04-09T18:09:26.203 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-04-09T18:09:26.232 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:26 +0000 (0:00:00.534) 0:00:32.723 ********** 2021-04-09T18:09:26.766 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-04-09T18:09:26.768 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-04-09T18:09:26.798 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:26 +0000 (0:00:00.568) 0:00:33.292 ********** 2021-04-09T18:09:26.808 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-04-09T18:09:26.810 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:01.537367", "end": "2021-04-09 18:09:26.744531", "rc": 0, "start": "2021-04-09 18:09:25.207164", "stderr": "", "stderr_lines": [], "stdout": "rhel-7-server-rpms", "stdout_lines": ["rhel-7-server-rpms"]} 2021-04-09T18:09:26.859 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:26 +0000 (0:00:00.060) 0:00:33.353 ********** 2021-04-09T18:09:27.139 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-7-server-rpms"]}, "changed": false} 2021-04-09T18:09:27.188 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:27 +0000 (0:00:00.329) 0:00:33.682 ********** 2021-04-09T18:09:27.438 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:27.556 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:27 +0000 (0:00:00.367) 0:00:34.050 ********** 2021-04-09T18:09:27.926 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-04-09T18:09:27.951 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:27 +0000 (0:00:00.395) 0:00:34.445 ********** 2021-04-09T18:09:28.113 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-04-09T18:09:28.122 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-04-09T18:09:28.160 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:28 +0000 (0:00:00.208) 0:00:34.653 ********** 2021-04-09T18:09:29.282 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-04-09T18:09:29.284 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-04-09T18:09:29.331 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:29 +0000 (0:00:01.167) 0:00:35.820 ********** 2021-04-09T18:09:30.834 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-04-09T18:09:30.864 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:30 +0000 (0:00:01.537) 0:00:37.358 ********** 2021-04-09T18:09:32.371 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-7-server-rpms", "--enable=rhel-7-server-optional-rpms", "--enable=rhel-7-server-extras-rpms", "--enable=rhel-ha-for-rhel-7-server-rpms"], "delta": "0:00:02.666050", "end": "2021-04-09 18:09:32.337381", "rc": 0, "start": "2021-04-09 18:09:29.671331", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-7-server-rpms' is enabled for this system.\nRepository 'rhel-7-server-optional-rpms' is enabled for this system.\nRepository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.\nRepository 'rhel-7-server-extras-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-7-server-rpms' is enabled for this system.", "Repository 'rhel-7-server-optional-rpms' is enabled for this system.", "Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.", "Repository 'rhel-7-server-extras-rpms' is enabled for this system."]} 2021-04-09T18:09:32.406 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:32 +0000 (0:00:01.542) 0:00:38.901 ********** 2021-04-09T18:09:32.707 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-04-09T18:09:32.708 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-04-09T18:09:32.740 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:32 +0000 (0:00:00.333) 0:00:39.235 ********** 2021-04-09T18:09:33.132 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-04-09T18:09:33.133 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:09:33.166 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:33 +0000 (0:00:00.425) 0:00:39.660 ********** 2021-04-09T18:09:34.020 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-04-09T18:09:34.022 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-04-09T18:09:34.370 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-04-09T18:09:34.372 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-7-server-rpms", "--enable=rhel-7-server-optional-rpms", "--enable=rhel-7-server-extras-rpms", "--enable=rhel-ha-for-rhel-7-server-rpms"], "delta": "0:00:03.098725", "end": "2021-04-09 18:09:34.338017", "rc": 0, "start": "2021-04-09 18:09:31.239292", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-7-server-rpms' is enabled for this system.\nRepository 'rhel-7-server-optional-rpms' is enabled for this system.\nRepository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.\nRepository 'rhel-7-server-extras-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-7-server-rpms' is enabled for this system.", "Repository 'rhel-7-server-optional-rpms' is enabled for this system.", "Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.", "Repository 'rhel-7-server-extras-rpms' is enabled for this system."]} 2021-04-09T18:09:34.401 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:34 +0000 (0:00:01.235) 0:00:40.895 ********** 2021-04-09T18:09:34.719 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-04-09T18:09:34.721 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-04-09T18:09:34.765 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:34 +0000 (0:00:00.359) 0:00:41.254 ********** 2021-04-09T18:09:34.768 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-04-09T18:09:34.769 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-04-09T18:09:34.809 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:34 +0000 (0:00:00.049) 0:00:41.304 ********** 2021-04-09T18:09:35.106 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-04-09T18:09:35.108 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:09:35.144 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:35 +0000 (0:00:00.334) 0:00:41.638 ********** 2021-04-09T18:09:35.519 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-04-09T18:09:35.521 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "state": "file", "uid": 0} 2021-04-09T18:09:35.928 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-04-09T18:09:35.929 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-04-09T18:09:36.069 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-04-09T18:09:36.076 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "state": "file", "uid": 0} 2021-04-09T18:09:36.096 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:36 +0000 (0:00:00.951) 0:00:42.590 ********** 2021-04-09T18:09:36.218 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-04-09T18:09:36.221 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:36.247 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:36 +0000 (0:00:00.151) 0:00:42.741 ********** 2021-04-09T18:09:36.353 INFO:teuthology.task.ansible.out: 2021-04-09T18:09:36.355 INFO:teuthology.task.ansible.out:TASK [common : Get the current timezone] *************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:36.391 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:36 +0000 (0:00:00.144) 0:00:42.886 ********** 2021-04-09T18:09:36.484 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-04-09T18:09:36.485 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-04-09T18:09:36.509 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:36 +0000 (0:00:00.117) 0:00:43.003 ********** 2021-04-09T18:09:36.527 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:36.550 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:36 +0000 (0:00:00.041) 0:00:43.044 ********** 2021-04-09T18:09:36.732 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-04-09T18:09:36.734 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:36.759 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:36 +0000 (0:00:00.209) 0:00:43.254 ********** 2021-04-09T18:09:36.868 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-04-09T18:09:36.870 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:36.879 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:36.881 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:36.903 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:36 +0000 (0:00:00.143) 0:00:43.397 ********** 2021-04-09T18:09:37.112 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-04-09T18:09:37.114 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:37.135 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:37 +0000 (0:00:00.231) 0:00:43.629 ********** 2021-04-09T18:09:37.255 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-04-09T18:09:37.257 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:37.307 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:37 +0000 (0:00:00.172) 0:00:43.801 ********** 2021-04-09T18:09:37.394 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi120.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "state": "file", "uid": 0} 2021-04-09T18:09:37.429 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:37.461 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:37 +0000 (0:00:00.153) 0:00:43.954 ********** 2021-04-09T18:09:37.601 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-04-09T18:09:37.604 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:37.623 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:37 +0000 (0:00:00.162) 0:00:44.117 ********** 2021-04-09T18:09:37.758 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-04-09T18:09:37.761 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:37.780 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:37 +0000 (0:00:00.157) 0:00:44.274 ********** 2021-04-09T18:09:38.033 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-04-09T18:09:38.035 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "state": "file", "uid": 0} 2021-04-09T18:09:38.074 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:38 +0000 (0:00:00.292) 0:00:44.567 ********** 2021-04-09T18:09:38.186 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:38.221 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:38 +0000 (0:00:00.147) 0:00:44.715 ********** 2021-04-09T18:09:38.362 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-04-09T18:09:38.365 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:38.397 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:38 +0000 (0:00:00.176) 0:00:44.891 ********** 2021-04-09T18:09:38.566 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-04-09T18:09:38.568 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:38.603 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:38 +0000 (0:00:00.206) 0:00:45.097 ********** 2021-04-09T18:09:38.718 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-04-09T18:09:38.720 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:38.768 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:38 +0000 (0:00:00.164) 0:00:45.262 ********** 2021-04-09T18:09:39.000 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-04-09T18:09:39.002 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:39.014 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:39.016 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-04-09T18:09:39.058 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:39 +0000 (0:00:00.290) 0:00:45.552 ********** 2021-04-09T18:09:39.241 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-04-09T18:09:39.243 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:39.285 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:39 +0000 (0:00:00.227) 0:00:45.780 ********** 2021-04-09T18:09:39.476 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-04-09T18:09:39.479 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:39.522 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:39 +0000 (0:00:00.236) 0:00:46.016 ********** 2021-04-09T18:09:39.541 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-04-09T18:09:39.543 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.546048", "end": "2021-04-09 18:09:39.500323", "rc": 0, "start": "2021-04-09 18:09:37.954275", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:09:39.576 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:39 +0000 (0:00:00.054) 0:00:46.071 ********** 2021-04-09T18:09:39.659 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-04-09T18:09:39.662 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:39.697 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:39 +0000 (0:00:00.120) 0:00:46.191 ********** 2021-04-09T18:09:39.861 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-04-09T18:09:39.864 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:39.892 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:39 +0000 (0:00:00.195) 0:00:46.387 ********** 2021-04-09T18:09:40.034 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-04-09T18:09:40.036 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:40.066 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:40 +0000 (0:00:00.173) 0:00:46.560 ********** 2021-04-09T18:09:40.832 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-04-09T18:09:40.834 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-50.el7.x86_64 providing krb5-workstation is already installed"]} 2021-04-09T18:09:40.882 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:40 +0000 (0:00:00.816) 0:00:47.376 ********** 2021-04-09T18:09:41.054 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-04-09T18:09:41.056 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:41.079 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:41 +0000 (0:00:00.194) 0:00:47.571 ********** 2021-04-09T18:09:41.228 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-04-09T18:09:41.230 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:41.255 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:41 +0000 (0:00:00.177) 0:00:47.749 ********** 2021-04-09T18:09:41.360 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-04-09T18:09:41.362 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:41.393 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:41 +0000 (0:00:00.136) 0:00:47.885 ********** 2021-04-09T18:09:41.527 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.209505", "end": "2021-04-09 18:09:41.500297", "rc": 0, "start": "2021-04-09 18:09:40.290792", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:09:41.575 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:41 +0000 (0:00:00.183) 0:00:48.069 ********** 2021-04-09T18:09:41.585 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-04-09T18:09:41.587 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:41.614 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:41 +0000 (0:00:00.039) 0:00:48.108 ********** 2021-04-09T18:09:42.362 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-04-09T18:09:42.395 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:42 +0000 (0:00:00.781) 0:00:48.889 ********** 2021-04-09T18:09:42.418 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-50.el7.x86_64 providing krb5-workstation is already installed"]} 2021-04-09T18:09:42.484 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:42 +0000 (0:00:00.089) 0:00:48.978 ********** 2021-04-09T18:09:42.630 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:42.689 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:42 +0000 (0:00:00.204) 0:00:49.183 ********** 2021-04-09T18:09:42.859 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:42.891 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:42 +0000 (0:00:00.201) 0:00:49.385 ********** 2021-04-09T18:09:43.149 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:43.192 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:43 +0000 (0:00:00.301) 0:00:49.686 ********** 2021-04-09T18:09:43.393 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:09:43.431 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:43 +0000 (0:00:00.238) 0:00:49.925 ********** 2021-04-09T18:09:44.325 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-04-09T18:09:44.398 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:09:44 +0000 (0:00:00.955) 0:00:50.892 ********** 2021-04-09T18:10:17.822 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-04-09T18:10:17.824 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2021-04-09T18:10:17.864 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:17 +0000 (0:00:33.466) 0:01:24.358 ********** 2021-04-09T18:10:19.106 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:10:19.109 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-04-09T18:10:19.873 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-04-09T18:10:20.004 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-04-09T18:10:20.007 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2021-04-09T18:10:20.073 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:20 +0000 (0:00:02.209) 0:01:26.567 ********** 2021-04-09T18:10:20.609 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi134.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-04-09T18:10:20.643 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:20 +0000 (0:00:00.568) 0:01:27.136 ********** 2021-04-09T18:10:21.033 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-04-09T18:10:21.038 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:10:21.128 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:21 +0000 (0:00:00.486) 0:01:27.622 ********** 2021-04-09T18:10:21.714 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:10:21.716 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-04-09T18:10:22.141 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi134.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-04-09T18:10:22.492 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:10:22.494 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-04-09T18:10:22.924 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-04-09T18:10:22.926 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-04-09T18:10:23.288 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-04-09T18:10:23.290 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-04-09T18:10:23.356 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:23 +0000 (0:00:02.227) 0:01:29.850 ********** 2021-04-09T18:10:23.777 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-04-09T18:10:23.779 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:10:23.867 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:23 +0000 (0:00:00.511) 0:01:30.361 ********** 2021-04-09T18:10:24.840 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-04-09T18:10:24.842 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-04-09T18:10:25.288 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-04-09T18:10:25.347 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:25 +0000 (0:00:01.479) 0:01:31.840 ********** 2021-04-09T18:10:25.589 INFO:teuthology.task.ansible.out: 2021-04-09T18:10:25.591 INFO:teuthology.task.ansible.out:TASK [common : Include apt_system vars] **************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:10:25.616 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:25 +0000 (0:00:00.269) 0:01:32.110 ********** 2021-04-09T18:10:25.625 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-04-09T18:10:25.627 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-04-09T18:10:25.888 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-04-09T18:10:25.926 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:25 +0000 (0:00:00.310) 0:01:32.421 ********** 2021-04-09T18:10:26.372 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-04-09T18:10:26.374 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-04-09T18:10:26.397 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:26 +0000 (0:00:00.470) 0:01:32.891 ********** 2021-04-09T18:10:26.432 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-04-09T18:10:26.434 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-04-09T18:10:26.527 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:26 +0000 (0:00:00.129) 0:01:33.021 ********** 2021-04-09T18:10:26.632 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:26.678 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:26.708 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:26.741 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:26.796 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:26 +0000 (0:00:00.268) 0:01:33.290 ********** 2021-04-09T18:10:26.899 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-04-09T18:10:26.901 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:10:26.939 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:26 +0000 (0:00:00.142) 0:01:33.433 ********** 2021-04-09T18:10:27.176 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-04-09T18:10:27.229 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:27 +0000 (0:00:00.290) 0:01:33.723 ********** 2021-04-09T18:10:27.743 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi120.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-04-09T18:10:27.782 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:27 +0000 (0:00:00.553) 0:01:34.277 ********** 2021-04-09T18:10:28.033 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi120.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:28.069 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:28.145 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:28.201 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:28.250 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:28 +0000 (0:00:00.466) 0:01:34.743 ********** 2021-04-09T18:10:32.918 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-04-09T18:10:32.921 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2021-04-09T18:10:32.980 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:32 +0000 (0:00:04.731) 0:01:39.474 ********** 2021-04-09T18:10:33.342 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-04-09T18:10:33.348 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:10:33.373 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:33 +0000 (0:00:00.393) 0:01:39.867 ********** 2021-04-09T18:10:34.274 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2021-04-09T18:10:34.310 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:34 +0000 (0:00:00.936) 0:01:40.804 ********** 2021-04-09T18:10:34.540 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-04-09T18:10:34.543 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-04-09T18:10:34.626 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:34 +0000 (0:00:00.315) 0:01:41.120 ********** 2021-04-09T18:10:34.643 INFO:teuthology.task.ansible.out: 2021-04-09T18:10:34.670 INFO:teuthology.task.ansible.out:TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-04-09T18:10:34.672 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:10:34.677 INFO:teuthology.task.ansible.out: 2021-04-09T18:10:34.796 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:34 +0000 (0:00:00.170) 0:01:41.290 ********** 2021-04-09T18:10:35.850 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-04-09T18:10:35.853 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-04-09T18:10:35.917 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:35 +0000 (0:00:01.121) 0:01:42.411 ********** 2021-04-09T18:10:36.096 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-04-09T18:10:36.099 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-04-09T18:10:36.190 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:36 +0000 (0:00:00.271) 0:01:42.683 ********** 2021-04-09T18:10:36.393 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-04-09T18:10:36.395 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:36.415 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:36.454 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:36 +0000 (0:00:00.265) 0:01:42.949 ********** 2021-04-09T18:10:37.070 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-04-09T18:10:37.072 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:10:37.125 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:37 +0000 (0:00:00.670) 0:01:43.619 ********** 2021-04-09T18:10:37.313 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-04-09T18:10:37.315 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-04-09T18:10:37.421 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:37 +0000 (0:00:00.296) 0:01:43.916 ********** 2021-04-09T18:10:37.626 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-04-09T18:10:37.628 INFO:teuthology.task.ansible.out:fatal: [smithi134.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-04-09T18:10:37.705 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:37 +0000 (0:00:00.284) 0:01:44.200 ********** 2021-04-09T18:10:37.880 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi120.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:37.887 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-04-09T18:10:37.932 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:37 +0000 (0:00:00.226) 0:01:44.426 ********** 2021-04-09T18:10:38.034 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-04-09T18:10:38.036 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:10:38.132 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:38 +0000 (0:00:00.199) 0:01:44.626 ********** 2021-04-09T18:10:38.461 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi120.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:10:38.501 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:38 +0000 (0:00:00.358) 0:01:44.984 ********** 2021-04-09T18:10:39.190 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-04-09T18:10:39.199 INFO:teuthology.task.ansible.out:fatal: [smithi120.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-04-09T18:10:39.264 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:39 +0000 (0:00:00.774) 0:01:45.758 ********** 2021-04-09T18:10:39.416 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-04-09T18:10:39.418 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:10:39.495 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:39 +0000 (0:00:00.226) 0:01:45.985 ********** 2021-04-09T18:10:39.582 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-04-09T18:10:39.584 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-04-09T18:10:39.652 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:39 +0000 (0:00:00.161) 0:01:46.146 ********** 2021-04-09T18:10:40.817 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-04-09T18:10:40.887 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:40 +0000 (0:00:01.235) 0:01:47.381 ********** 2021-04-09T18:10:42.339 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:07:38 UTC", "ActiveEnterTimestampMonotonic": "23561148", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target network.target var-run.mount system.slice basic.target local-fs.target time-sync.target systemd-journald.socket network-online.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:07:38 UTC", "AssertTimestampMonotonic": "23490353", "Before": "getty@tty1.service xdm.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:07:38 UTC", "ConditionTimestampMonotonic": "23490352", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1148", "ExecMainStartTimestamp": "Fri 2021-04-09 18:07:38 UTC", "ExecMainStartTimestampMonotonic": "23561100", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(nul 2021-04-09T18:10:42.342 INFO:teuthology.task.ansible.out:l) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Fri 2021-04-09 18:07:38 UTC] ; stop_time=[n/a] ; pid=1148 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:07:38 UTC", "InactiveExitTimestampMonotonic": "23561148", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "1148", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "n 2021-04-09T18:10:42.344 INFO:teuthology.task.ansible.out:o", "RemainAfterExit": "no", "Requires": "basic.target system.slice", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:07:38 UTC", "WatchdogTimestampMonotonic": "23561129", "WatchdogUSec": "0"}} 2021-04-09T18:10:42.406 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:42 +0000 (0:00:01.518) 0:01:48.900 ********** 2021-04-09T18:10:42.451 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:03:05 UTC", "ActiveEnterTimestampMonotonic": "22755228", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target network.target time-sync.target systemd-journald.socket local-fs.target var-run.mount network-online.target nss-lookup.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:03:05 UTC", "AssertTimestampMonotonic": "22694212", "Before": "shutdown.target multi-user.target xdm.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:03:05 UTC", "ConditionTimestampMonotonic": "22694212", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1122", "ExecMainStartTimestamp": "Fri 2021-04-09 18:03:05 UTC", "ExecMainStartTimestampMonotonic": "22755171", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c / 2021-04-09T18:10:42.454 INFO:teuthology.task.ansible.out:etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_er 2021-04-09T18:10:42.467 INFO:teuthology.task.ansible.out:rors=no ; start_time=[Fri 2021-04-09 18:03:05 UTC] ; stop_time=[n/a] ; pid=1122 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:03:05 UTC", "InactiveExitTimestampMonotonic": "22755228", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "1122", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target system.slice", "Restart": "no", "RestartUSec": "100ms", "Result": "success", 2021-04-09T18:10:42.469 INFO:teuthology.task.ansible.out:"RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-04-09 18:03:05 UTC", "WatchdogTimestampMonotonic": "22755206", "WatchdogUSec": "0"}} 2021-04-09T18:10:42.616 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:42 +0000 (0:00:00.208) 0:01:49.109 ********** 2021-04-09T18:10:43.005 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-04-09T18:10:43.007 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.002106", "end": "2021-04-09 18:10:42.968550", "rc": 0, "start": "2021-04-09 18:10:42.966444", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001913", "end": "2021-04-09 18:10:42.972072", "rc": 0, "start": "2021-04-09 18:10:42.970159", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-04-09T18:10:43.075 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:43 +0000 (0:00:00.460) 0:01:49.570 ********** 2021-04-09T18:10:43.148 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:43 +0000 (0:00:00.072) 0:01:49.642 ********** 2021-04-09T18:10:44.178 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-04-09T18:10:44.180 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-34.el7.x86_64 providing policycoreutils-python is already installed"]} 2021-04-09T18:10:44.215 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:44 +0000 (0:00:01.067) 0:01:50.709 ********** 2021-04-09T18:10:44.339 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-34.el7.x86_64 providing policycoreutils-python is already installed"]} 2021-04-09T18:10:44.364 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:44 +0000 (0:00:00.149) 0:01:50.859 ********** 2021-04-09T18:10:50.381 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-04-09T18:10:50.383 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2021-04-09T18:10:50.404 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:50 +0000 (0:00:06.039) 0:01:56.898 ********** 2021-04-09T18:10:50.434 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2021-04-09T18:10:50.501 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:50 +0000 (0:00:00.096) 0:01:56.995 ********** 2021-04-09T18:10:52.564 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-04-09T18:10:52.566 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-04-09T18:10:52.625 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:52 +0000 (0:00:02.124) 0:01:59.119 ********** 2021-04-09T18:10:52.657 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-04-09T18:10:52.702 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:10:52 +0000 (0:00:00.076) 0:01:59.196 ********** 2021-04-09T18:11:00.852 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-04-09T18:11:00.854 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.590827", "end": "2021-04-09 18:11:00.793858", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:10:53.203031", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-04-09T18:11:00.912 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:00 +0000 (0:00:08.210) 0:02:07.407 ********** 2021-04-09T18:11:00.980 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.703843", "end": "2021-04-09 18:11:00.918290", "failed_when_result": false, "rc": 0, "start": "2021-04-09 18:10:53.214447", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-04-09T18:11:01.098 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:01 +0000 (0:00:00.185) 0:02:07.592 ********** 2021-04-09T18:11:02.085 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-04-09T18:11:02.087 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-04-09T18:11:02.123 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:02 +0000 (0:00:01.025) 0:02:08.617 ********** 2021-04-09T18:11:02.328 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-04-09T18:11:02.352 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:02 +0000 (0:00:00.229) 0:02:08.846 ********** 2021-04-09T18:11:02.710 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-04-09T18:11:02.712 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012018", "end": "2021-04-09 18:11:02.678069", "rc": 0, "start": "2021-04-09 18:11:02.666051", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2021-04-09T18:11:02.737 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:02 +0000 (0:00:00.385) 0:02:09.232 ********** 2021-04-09T18:11:02.799 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.022956", "end": "2021-04-09 18:11:02.776971", "rc": 0, "start": "2021-04-09 18:11:02.754015", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2021-04-09T18:11:02.839 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:02 +0000 (0:00:00.085) 0:02:09.317 ********** 2021-04-09T18:11:03.317 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-04-09T18:11:03.322 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.007556", "end": "2021-04-09 18:11:03.278635", "rc": 0, "start": "2021-04-09 18:11:03.271079", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:11:03.373 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:03 +0000 (0:00:00.549) 0:02:09.867 ********** 2021-04-09T18:11:03.391 INFO:teuthology.task.ansible.out: 2021-04-09T18:11:03.440 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.012768", "end": "2021-04-09 18:11:03.371239", "rc": 0, "start": "2021-04-09 18:11:03.358471", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:11:03.526 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:03 +0000 (0:00:00.152) 0:02:10.020 ********** 2021-04-09T18:11:11.484 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-04-09T18:11:11.486 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.574504", "end": "2021-04-09 18:11:11.452137", "rc": 0, "start": "2021-04-09 18:11:03.877633", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:11:11.508 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:11 +0000 (0:00:07.982) 0:02:18.002 ********** 2021-04-09T18:11:11.618 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.568540", "end": "2021-04-09 18:11:11.588409", "rc": 0, "start": "2021-04-09 18:11:04.019869", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:11:11.674 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:11 +0000 (0:00:00.166) 0:02:18.168 ********** 2021-04-09T18:11:11.991 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-04-09T18:11:11.992 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-04-09T18:11:12.064 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:12 +0000 (0:00:00.389) 0:02:18.558 ********** 2021-04-09T18:11:12.189 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-04-09T18:11:12.215 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:12 +0000 (0:00:00.148) 0:02:18.707 ********** 2021-04-09T18:11:12.387 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-04-09T18:11:12.389 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2021-04-09T18:11:12.489 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:12 +0000 (0:00:00.275) 0:02:18.983 ********** 2021-04-09T18:11:12.599 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2021-04-09T18:11:12.631 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:12 +0000 (0:00:00.142) 0:02:19.125 ********** 2021-04-09T18:11:12.674 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-04-09T18:11:12.676 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-04-09T18:11:12.704 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:12 +0000 (0:00:00.073) 0:02:19.198 ********** 2021-04-09T18:11:12.861 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-04-09T18:11:12.899 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:12 +0000 (0:00:00.195) 0:02:19.394 ********** 2021-04-09T18:11:13.059 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-04-09T18:11:13.061 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}, "rhel-7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "epel_packages": ["cryptopp-devel", "cryptopp", "dbench", "fcgi", "fuse-sshfs", "perl-JSON-XS", "leveldb", "xmlstarlet"], "nfs_service": "nfs-server", "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "xfsprogs-devel", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "lvm2", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "lsof", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "podman", "podman-docker", "python3"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"} 2021-04-09T18:11:13.161 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:13 +0000 (0:00:00.259) 0:02:19.654 ********** 2021-04-09T18:11:13.231 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}, "rhel-7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "epel_packages": ["cryptopp-devel", "cryptopp", "dbench", "fcgi", "fuse-sshfs", "perl-JSON-XS", "leveldb", "xmlstarlet"], "nfs_service": "nfs-server", "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "xfsprogs-devel", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "lvm2", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "lsof", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "podman", "podman-docker", "python3"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"} 2021-04-09T18:11:13.301 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:13 +0000 (0:00:00.139) 0:02:19.793 ********** 2021-04-09T18:11:13.568 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-04-09T18:11:13.574 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-04-09T18:11:13.593 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:13 +0000 (0:00:00.294) 0:02:20.087 ********** 2021-04-09T18:11:13.661 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-04-09T18:11:13.687 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:13 +0000 (0:00:00.093) 0:02:20.180 ********** 2021-04-09T18:11:13.943 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:11:13.996 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:13 +0000 (0:00:00.309) 0:02:20.490 ********** 2021-04-09T18:11:14.032 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-04-09T18:11:14.095 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:14 +0000 (0:00:00.096) 0:02:20.586 ********** 2021-04-09T18:11:14.554 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-04-09T18:11:14.556 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-04-09T18:11:14.578 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:14 +0000 (0:00:00.485) 0:02:21.072 ********** 2021-04-09T18:11:14.615 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-04-09T18:11:14.641 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:14 +0000 (0:00:00.063) 0:02:21.135 ********** 2021-04-09T18:11:14.714 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-04-09T18:11:14.716 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:14.771 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:14 +0000 (0:00:00.129) 0:02:21.265 ********** 2021-04-09T18:11:15.006 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:15.032 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:15 +0000 (0:00:00.261) 0:02:21.527 ********** 2021-04-09T18:11:15.050 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-04-09T18:11:15.052 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:15.126 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:15 +0000 (0:00:00.092) 0:02:21.620 ********** 2021-04-09T18:11:15.274 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:15.354 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:15 +0000 (0:00:00.228) 0:02:21.848 ********** 2021-04-09T18:11:15.763 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-04-09T18:11:15.765 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-04-09T18:11:15.807 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:15 +0000 (0:00:00.453) 0:02:22.302 ********** 2021-04-09T18:11:15.856 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-04-09T18:11:15.891 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:15 +0000 (0:00:00.083) 0:02:22.385 ********** 2021-04-09T18:11:16.917 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-04-09T18:11:16.919 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-04-09T18:11:16.990 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:16 +0000 (0:00:01.099) 0:02:23.484 ********** 2021-04-09T18:11:17.252 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-04-09T18:11:17.290 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:17 +0000 (0:00:00.299) 0:02:23.784 ********** 2021-04-09T18:11:17.424 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-04-09T18:11:17.426 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi134"}, "changed": false} 2021-04-09T18:11:17.478 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:17 +0000 (0:00:00.187) 0:02:23.972 ********** 2021-04-09T18:11:17.607 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi120"}, "changed": false} 2021-04-09T18:11:17.642 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:17 +0000 (0:00:00.164) 0:02:24.137 ********** 2021-04-09T18:11:19.404 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi120.front.sepia.ceph.com", "ansible_hostname": "smithi120", "ansible_nodename": "smithi120"}, "changed": false, "name": "smithi120"} 2021-04-09T18:11:19.484 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:19 +0000 (0:00:01.840) 0:02:25.978 ********** 2021-04-09T18:11:19.499 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi134.front.sepia.ceph.com", "ansible_hostname": "smithi134", "ansible_nodename": "smithi134"}, "changed": false, "name": "smithi134"} 2021-04-09T18:11:19.558 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:19 +0000 (0:00:00.073) 0:02:26.052 ********** 2021-04-09T18:11:20.497 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-04-09T18:11:20.499 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-04-09T18:11:20.573 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:20 +0000 (0:00:01.014) 0:02:27.067 ********** 2021-04-09T18:11:20.590 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-04-09T18:11:20.678 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:20 +0000 (0:00:00.105) 0:02:27.172 ********** 2021-04-09T18:11:21.705 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-04-09T18:11:21.711 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-04-09T18:11:21.802 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:21 +0000 (0:00:01.124) 0:02:28.296 ********** 2021-04-09T18:11:21.842 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-04-09T18:11:21.949 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:21 +0000 (0:00:00.147) 0:02:28.443 ********** 2021-04-09T18:11:22.726 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-04-09T18:11:22.728 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-04-09T18:11:22.814 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:22 +0000 (0:00:00.864) 0:02:29.308 ********** 2021-04-09T18:11:22.879 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-04-09T18:11:22.919 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:22 +0000 (0:00:00.105) 0:02:29.414 ********** 2021-04-09T18:11:24.182 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-04-09T18:11:24.184 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-04-09T18:11:24.208 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:24 +0000 (0:00:01.288) 0:02:30.702 ********** 2021-04-09T18:11:24.271 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-04-09T18:11:24.367 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:24 +0000 (0:00:00.158) 0:02:30.861 ********** 2021-04-09T18:11:24.875 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-04-09T18:11:24.898 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:24 +0000 (0:00:00.530) 0:02:31.391 ********** 2021-04-09T18:11:24.926 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-04-09T18:11:25.113 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:25 +0000 (0:00:00.215) 0:02:31.607 ********** 2021-04-09T18:11:25.758 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-04-09T18:11:25.775 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2021-04-09T18:11:25.835 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:25 +0000 (0:00:00.721) 0:02:32.329 ********** 2021-04-09T18:11:26.136 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2021-04-09T18:11:26.251 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:26 +0000 (0:00:00.416) 0:02:32.745 ********** 2021-04-09T18:11:26.253 INFO:teuthology.task.ansible.out: 2021-04-09T18:11:26.519 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:11:26.521 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-04-09T18:11:26.545 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:26 +0000 (0:00:00.293) 0:02:33.039 ********** 2021-04-09T18:11:27.027 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-04-09T18:11:27.029 INFO:teuthology.task.ansible.out: 2021-04-09T18:11:27.180 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:27 +0000 (0:00:00.635) 0:02:33.674 ********** 2021-04-09T18:11:27.193 INFO:teuthology.task.ansible.out: 2021-04-09T18:11:27.989 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-04-09T18:11:27.990 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-04-09T18:11:28.019 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:28 +0000 (0:00:00.838) 0:02:34.513 ********** 2021-04-09T18:11:28.547 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-04-09T18:11:28.638 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:28 +0000 (0:00:00.619) 0:02:35.132 ********** 2021-04-09T18:11:29.455 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:11:29.458 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-04-09T18:11:29.521 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:29 +0000 (0:00:00.883) 0:02:36.016 ********** 2021-04-09T18:11:30.124 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-04-09T18:11:30.198 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:30 +0000 (0:00:00.676) 0:02:36.692 ********** 2021-04-09T18:11:32.348 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.877267", "end": "2021-04-09 18:11:32.309272", "rc": 0, "start": "2021-04-09 18:11:30.432005", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:11:32.409 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:32 +0000 (0:00:02.210) 0:02:38.903 ********** 2021-04-09T18:11:32.919 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.983315", "end": "2021-04-09 18:11:32.882910", "rc": 0, "start": "2021-04-09 18:11:30.899595", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:11:32.991 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:32 +0000 (0:00:00.582) 0:02:39.485 ********** 2021-04-09T18:11:33.058 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-04-09T18:11:33.063 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:33.162 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:33 +0000 (0:00:00.171) 0:02:39.657 ********** 2021-04-09T18:11:33.518 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:33.543 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:33 +0000 (0:00:00.379) 0:02:40.037 ********** 2021-04-09T18:11:34.758 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-04-09T18:11:34.767 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'rhel-7-fcgi-ceph', 'value': {'name': 'RHEL 7 Local fastcgi Repo', 'baseurl': 'http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e6aba9c9ab05e27255ed430f065502af284a869b", "dest": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "rhel-7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 245, "state": "file", "uid": 0} 2021-04-09T18:11:35.202 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item={'key': 'rhel-7-fcgi-ceph', 'value': {'name': 'RHEL 7 Local fastcgi Repo', 'baseurl': 'http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e6aba9c9ab05e27255ed430f065502af284a869b", "dest": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "rhel-7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 245, "state": "file", "uid": 0} 2021-04-09T18:11:35.659 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e3b44e00721d55ceb436a2b7c0ec58cd5bc39dc9", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 207, "state": "file", "uid": 0} 2021-04-09T18:11:35.690 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:35 +0000 (0:00:02.146) 0:02:42.183 ********** 2021-04-09T18:11:36.274 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-04-09T18:11:36.315 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:36 +0000 (0:00:00.625) 0:02:42.809 ********** 2021-04-09T18:11:36.329 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi120.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e3b44e00721d55ceb436a2b7c0ec58cd5bc39dc9", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 207, "state": "file", "uid": 0} 2021-04-09T18:11:36.482 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:36 +0000 (0:00:00.167) 0:02:42.976 ********** 2021-04-09T18:11:36.807 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-04-09T18:11:36.943 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:36 +0000 (0:00:00.460) 0:02:43.437 ********** 2021-04-09T18:11:37.065 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-04-09T18:11:37.181 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:37 +0000 (0:00:00.236) 0:02:43.674 ********** 2021-04-09T18:11:37.588 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-04-09T18:11:37.590 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:37.653 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:37 +0000 (0:00:00.473) 0:02:44.147 ********** 2021-04-09T18:11:37.703 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-04-09T18:11:37.859 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:37 +0000 (0:00:00.205) 0:02:44.353 ********** 2021-04-09T18:11:38.191 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi134.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:11:38.214 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:11:38.409 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:38 +0000 (0:00:00.550) 0:02:44.903 ********** 2021-04-09T18:11:38.412 INFO:teuthology.task.ansible.out: 2021-04-09T18:11:38.600 INFO:teuthology.task.ansible.out: 2021-04-09T18:11:38.602 INFO:teuthology.task.ansible.out:TASK [testnode : Install GPG] ************************************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:38.703 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:38 +0000 (0:00:00.293) 0:02:45.197 ********** 2021-04-09T18:11:38.808 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-04-09T18:11:38.810 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:38.918 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:38 +0000 (0:00:00.215) 0:02:45.412 ********** 2021-04-09T18:11:39.200 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi120.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:11:39.203 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:11:39.277 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:39 +0000 (0:00:00.358) 0:02:45.771 ********** 2021-04-09T18:11:39.436 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:11:39.438 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:39.464 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:39 +0000 (0:00:00.186) 0:02:45.958 ********** 2021-04-09T18:11:39.799 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-04-09T18:11:39.808 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:39.893 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:39 +0000 (0:00:00.428) 0:02:46.387 ********** 2021-04-09T18:11:40.422 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:11:40.424 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:40.463 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:40 +0000 (0:00:00.564) 0:02:46.951 ********** 2021-04-09T18:11:40.666 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-04-09T18:11:40.668 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-54.el7_8.noarch providing yum-utils is already installed"]} 2021-04-09T18:11:40.709 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:40 +0000 (0:00:00.251) 0:02:47.203 ********** 2021-04-09T18:11:41.804 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-54.el7_8.noarch providing yum-utils is already installed"]} 2021-04-09T18:11:41.928 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:41 +0000 (0:00:01.218) 0:02:48.422 ********** 2021-04-09T18:11:42.343 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-04-09T18:11:42.345 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.770801", "end": "2021-04-09 18:11:42.280846", "rc": 0, "start": "2021-04-09 18:11:41.510045", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-", " : manager", "Loading mirror speeds from cached hostfile", " * epel: download-cc-rdu01.fedoraproject.org", "No unfinished transactions left."]} 2021-04-09T18:11:42.482 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:42 +0000 (0:00:00.554) 0:02:48.976 ********** 2021-04-09T18:11:43.283 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi134.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.023546", "end": "2021-04-09 18:11:43.242642", "msg": "non-zero return code", "rc": 1, "start": "2021-04-09 18:11:43.219096", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-04-09T18:11:43.308 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:43 +0000 (0:00:00.825) 0:02:49.802 ********** 2021-04-09T18:11:43.410 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-04-09T18:11:43.412 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.759374", "end": "2021-04-09 18:11:43.359805", "rc": 0, "start": "2021-04-09 18:11:42.600431", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-", " : manager", "Loading mirror speeds from cached hostfile", " * epel: download-cc-rdu01.fedoraproject.org", "No unfinished transactions left."]} 2021-04-09T18:11:43.491 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:43 +0000 (0:00:00.178) 0:02:49.980 ********** 2021-04-09T18:11:43.826 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-04-09T18:11:43.828 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:43.913 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:43 +0000 (0:00:00.427) 0:02:50.407 ********** 2021-04-09T18:11:44.200 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-04-09T18:11:44.201 INFO:teuthology.task.ansible.out:fatal: [smithi120.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.023325", "end": "2021-04-09 18:11:44.170686", "msg": "non-zero return code", "rc": 1, "start": "2021-04-09 18:11:44.147361", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-04-09T18:11:44.327 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:44 +0000 (0:00:00.413) 0:02:50.821 ********** 2021-04-09T18:11:44.650 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-04-09T18:11:44.652 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:11:44.680 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:44 +0000 (0:00:00.353) 0:02:51.174 ********** 2021-04-09T18:11:55.870 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-175.el7_9.3.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.3 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.3 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.3 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n librados2 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @rhe 2021-04-09T18:11:55.873 INFO:teuthology.task.ansible.out:l-7-server-rpms 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 @rhel-7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-175.el7_9.3 @rhel-7-server-rpms 2.3 M\n qemu-kvm x86_64 10:1.5.3-175.el7_9.3 @rhel-7-server-rpms 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.3 @rhel-7-server-rpms 755 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages (+3 Dependent packages)\n\nInstalled size: 22 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64 1/6 \n Erasing : 10:qemu-img-1.5.3-175.el7_9.3.x86_64 2/6 \n Erasing : 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64 3/6 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/6 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/6 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 6/6 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\nLoaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/6 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 2/6 \n Verifying : 10:qemu-img-1.5.3-175.el7_9.3.x86_64 3/6 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/6 \n Verifying : 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64 5/6 \n Verifying : 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64 6/6 \n\nRemoved:\n librados2.x86_64 1:10.2.5-4.el7 librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n\nDependency Remov 2021-04-09T18:11:55.874 INFO:teuthology.task.ansible.out:ed:\n qemu-img.x86_64 10:1.5.3-175.el7_9.3 \n qemu-kvm.x86_64 10:1.5.3-175.el7_9.3 \n qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.3 \n\nComplete!\n"]} 2021-04-09T18:11:55.985 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:55 +0000 (0:00:11.300) 0:03:02.475 ********** 2021-04-09T18:11:56.553 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-175.el7_9.3.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.3 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.3 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.3 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n librados2 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 @rhel-7 2021-04-09T18:11:56.556 INFO:teuthology.task.ansible.out:-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-175.el7_9.3 @rhel-7-server-rpms 2.3 M\n qemu-kvm x86_64 10:1.5.3-175.el7_9.3 @rhel-7-server-rpms 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.3 @rhel-7-server-rpms 755 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages (+3 Dependent packages)\n\nInstalled size: 22 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64 1/6 \n Erasing : 10:qemu-img-1.5.3-175.el7_9.3.x86_64 2/6 \n Erasing : 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64 3/6 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/6 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/6 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 6/6 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\nLoaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/6 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 2/6 \n Verifying : 10:qemu-img-1.5.3-175.el7_9.3.x86_64 3/6 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/6 \n Verifying : 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64 5/6 \n Verifying : 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64 6/6 \n\nRemoved:\n librados2.x86_64 1:10.2.5-4.el7 librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-175.el7_9.3 2021-04-09T18:11:56.557 INFO:teuthology.task.ansible.out: \n qemu-kvm.x86_64 10:1.5.3-175.el7_9.3 \n qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.3 \n\nComplete!\n"]} 2021-04-09T18:11:56.615 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:11:56 +0000 (0:00:00.633) 0:03:03.109 ********** 2021-04-09T18:12:02.300 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-04-09T18:12:02.308 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "leveldb", "xmlstarlet", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be erased\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be erased\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-28.el7 @rhel-7-server-rpms 24 k\n leveldb x86_64 1.12.0-11.el7 @epel 439 k\n xmlstarlet x86_64 1.6.1-1.el7 @epel 192 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages\n\nInstalled size: 655 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 \n Erasing : boost-random-1.53.0-28.el7.x86_64 2/3 \n Erasing : leveldb-1.12.0-11.el7.x86_64 2021-04-09T18:12:02.310 INFO:teuthology.task.ansible.out: 3/3 \nLoaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\n Verifying : leveldb-1.12.0-11.el7.x86_64 1/3 \n Verifying : boost-random-1.53.0-28.el7.x86_64 2/3 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-28.el7 leveldb.x86_64 0:1.12.0-11.el7 \n xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2021-04-09T18:12:02.398 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:02 +0000 (0:00:05.783) 0:03:08.892 ********** 2021-04-09T18:12:02.763 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "leveldb", "xmlstarlet", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be erased\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be erased\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-28.el7 @rhel-7-server-rpms 24 k\n leveldb x86_64 1.12.0-11.el7 @epel 439 k\n xmlstarlet x86_64 1.6.1-1.el7 @epel 192 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages\n\nInstalled size: 655 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 \n Erasing : boost-random-1.53.0-28.el7.x86_64 2/3 \n Erasing : leveldb-1.12.0-11.el7.x86_64 2021-04-09T18:12:02.765 INFO:teuthology.task.ansible.out: 3/3 \nLoaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\n Verifying : leveldb-1.12.0-11.el7.x86_64 1/3 \n Verifying : boost-random-1.53.0-28.el7.x86_64 2/3 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-28.el7 leveldb.x86_64 0:1.12.0-11.el7 \n xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2021-04-09T18:12:02.807 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:02 +0000 (0:00:00.408) 0:03:09.301 ********** 2021-04-09T18:12:23.768 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7"]}, "msg": "", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-120.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed", "xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed", "gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "parted-3.1-32.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed", "1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", 2021-04-09T18:12:23.770 INFO:teuthology.task.ansible.out:"1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "lsof-4.87-6.el7.x86_64 providing lsof is already installed", "iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs 2021-04-09T18:12:23.771 INFO:teuthology.task.ansible.out:-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed", "podman-1.6.4-29.el7_9.x86_64 providing podman is already installed", "podman-docker-1.6.4-29.el7_9.noarch providing podman-docker is already installed", "python3-3.6.8-18.el7.x86_64 providing python3 is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.3 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.3 for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.3 for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.3 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.3 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies R 2021-04-09T18:12:23.773 INFO:teuthology.task.ansible.out:esolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-175.el7_9.3 rhel-7-server-rpms 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\n qemu-img x86_64 10:1.5.3-175.el7_9.3 rhel-7-server-rpms 704 k\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.3 rhel-7-server-rpms 440 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages (+5 Dependent packages)\n\nTotal download size: 7.3 M\nInstalled size: 22 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 25 MB/s | 7.3 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-28.el7.x86_64 1/7 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/7 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/7 \n Installing : 10:qemu-img-1.5.3-175.el7_9.3.x86_64 4/7 \n Installing : 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64 5/7 \n Installing : 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64 6/7 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 7/7 \nLoaded plugins: fastestmirror, langpacks, priorities, product-id, sub 2021-04-09T18:12:23.775 INFO:teuthology.task.ansible.out:scription-\n : manager\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 2/7 \n Verifying : 10:qemu-img-1.5.3-175.el7_9.3.x86_64 3/7 \n Verifying : boost-random-1.53.0-28.el7.x86_64 4/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Verifying : 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64 6/7 \n Verifying : 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64 7/7 \n\nInstalled:\n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 qemu-kvm.x86_64 10:1.5.3-175.el7_9.3 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-28.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-175.el7_9.3 \n qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.3 \n\nComplete!\n"]} 2021-04-09T18:12:23.865 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:23 +0000 (0:00:21.057) 0:03:30.358 ********** 2021-04-09T18:12:24.497 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7"]}, "msg": "", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-120.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed", "xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed", "gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "parted-3.1-32.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed", "1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed", "python-n 2021-04-09T18:12:24.500 INFO:teuthology.task.ansible.out:ose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "lsof-4.87-6.el7.x86_64 providing lsof is already installed", "iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing 2021-04-09T18:12:24.502 INFO:teuthology.task.ansible.out:ncurses-devel is already installed", "python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed", "podman-1.6.4-29.el7_9.x86_64 providing podman is already installed", "podman-docker-1.6.4-29.el7_9.noarch providing podman-docker is already installed", "python3-3.6.8-18.el7.x86_64 providing python3 is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.3 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.3 for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.3 for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.3 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.3 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n========================================================================= 2021-04-09T18:12:24.504 INFO:teuthology.task.ansible.out:=======\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-175.el7_9.3 rhel-7-server-rpms 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\n qemu-img x86_64 10:1.5.3-175.el7_9.3 rhel-7-server-rpms 704 k\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.3 rhel-7-server-rpms 440 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages (+5 Dependent packages)\n\nTotal download size: 7.3 M\nInstalled size: 22 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 26 MB/s | 7.3 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-28.el7.x86_64 1/7 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/7 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/7 \n Installing : 10:qemu-img-1.5.3-175.el7_9.3.x86_64 4/7 \n Installing : 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64 5/7 \n Installing : 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64 6/7 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 7/7 \nLoaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 2021-04-09T18:12:24.506 INFO:teuthology.task.ansible.out: 1/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 2/7 \n Verifying : 10:qemu-img-1.5.3-175.el7_9.3.x86_64 3/7 \n Verifying : boost-random-1.53.0-28.el7.x86_64 4/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Verifying : 10:qemu-kvm-1.5.3-175.el7_9.3.x86_64 6/7 \n Verifying : 10:qemu-kvm-common-1.5.3-175.el7_9.3.x86_64 7/7 \n\nInstalled:\n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 qemu-kvm.x86_64 10:1.5.3-175.el7_9.3 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-28.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-175.el7_9.3 \n qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.3 \n\nComplete!\n"]} 2021-04-09T18:12:24.535 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:24 +0000 (0:00:00.670) 0:03:31.029 ********** 2021-04-09T18:12:29.871 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-04-09T18:12:29.873 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["leveldb", "xmlstarlet"]}, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n leveldb x86_64 1.12.0-11.el7 epel 161 k\n xmlstarlet x86_64 1.6.1-1.el7 epel 62 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages\n\nTotal download size: 223 k\nInstalled size: 631 k\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 4.5 MB/s | 223 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : xmlstarlet-1.6.1-1.el7.x86_64 2021-04-09T18:12:29.875 INFO:teuthology.task.ansible.out: 1/2 \n Installing : leveldb-1.12.0-11.el7.x86_64 2/2 \nLoaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\n Verifying : leveldb-1.12.0-11.el7.x86_64 1/2 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 2/2 \n\nInstalled:\n leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2021-04-09T18:12:29.927 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:29 +0000 (0:00:05.389) 0:03:36.419 ********** 2021-04-09T18:12:29.930 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:30.218 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["leveldb", "xmlstarlet"]}, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n leveldb x86_64 1.12.0-11.el7 epel 161 k\n xmlstarlet x86_64 1.6.1-1.el7 epel 62 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages\n\nTotal download size: 223 k\nInstalled size: 631 k\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 4.4 MB/s | 223 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : xmlstarlet-1.6.1-1.el7.x86_64 2021-04-09T18:12:30.221 INFO:teuthology.task.ansible.out: 1/2 \n Installing : leveldb-1.12.0-11.el7.x86_64 2/2 \nLoaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\n Verifying : leveldb-1.12.0-11.el7.x86_64 1/2 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 2/2 \n\nInstalled:\n leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2021-04-09T18:12:30.353 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:30 +0000 (0:00:00.412) 0:03:36.832 ********** 2021-04-09T18:12:31.162 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-04-09T18:12:31.164 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2021-04-09T18:12:31.226 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:31 +0000 (0:00:00.888) 0:03:37.720 ********** 2021-04-09T18:12:31.772 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2021-04-09T18:12:31.888 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:31 +0000 (0:00:00.661) 0:03:38.382 ********** 2021-04-09T18:12:31.916 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:12:31.917 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:32.111 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:32 +0000 (0:00:00.223) 0:03:38.605 ********** 2021-04-09T18:12:32.140 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:32.286 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:32 +0000 (0:00:00.175) 0:03:38.780 ********** 2021-04-09T18:12:32.813 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target dbus.service system.slice polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "iptables.service ipset.service shutdown.target ebtables.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld. 2021-04-09T18:12:32.824 INFO:teuthology.task.ansible.out:service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target system.slice", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead 2021-04-09T18:12:32.830 INFO:teuthology.task.ansible.out:", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:12:32.956 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:32 +0000 (0:00:00.561) 0:03:39.450 ********** 2021-04-09T18:12:33.025 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice polkit.service dbus.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "iptables.service ipset.service shutdown.target ebtables.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "Ig 2021-04-09T18:12:33.027 INFO:teuthology.task.ansible.out:noreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target system.slice", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", 2021-04-09T18:12:33.029 INFO:teuthology.task.ansible.out: "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:12:33.177 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:33 +0000 (0:00:00.220) 0:03:39.671 ********** 2021-04-09T18:12:33.960 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi134.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-04-09T18:12:34.067 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:34 +0000 (0:00:00.889) 0:03:40.561 ********** 2021-04-09T18:12:34.068 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:34.088 INFO:teuthology.task.ansible.out:fatal: [smithi120.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} 2021-04-09T18:12:34.100 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:34.101 INFO:teuthology.task.ansible.out:...ignoring 2021-04-09T18:12:34.103 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:34.274 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:34 +0000 (0:00:00.207) 0:03:40.768 ********** 2021-04-09T18:12:37.988 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-04-09T18:12:37.990 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-04-09T18:12:38.030 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:38 +0000 (0:00:03.756) 0:03:44.524 ********** 2021-04-09T18:12:38.036 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:38.050 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-04-09T18:12:38.056 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:38.164 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:38 +0000 (0:00:00.133) 0:03:44.658 ********** 2021-04-09T18:12:38.448 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:38.541 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:38 +0000 (0:00:00.377) 0:03:45.035 ********** 2021-04-09T18:12:38.545 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:38.616 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:38.629 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:38.753 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:38 +0000 (0:00:00.212) 0:03:45.247 ********** 2021-04-09T18:12:38.761 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:39.093 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-04-09T18:12:39.095 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:39.225 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:39 +0000 (0:00:00.472) 0:03:45.720 ********** 2021-04-09T18:12:39.260 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:39.310 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:39 +0000 (0:00:00.084) 0:03:45.804 ********** 2021-04-09T18:12:39.782 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:39.866 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:39 +0000 (0:00:00.556) 0:03:46.361 ********** 2021-04-09T18:12:40.151 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:40.212 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:40 +0000 (0:00:00.345) 0:03:46.706 ********** 2021-04-09T18:12:40.353 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-04-09T18:12:40.358 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:40.378 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:40 +0000 (0:00:00.166) 0:03:46.873 ********** 2021-04-09T18:12:40.776 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:40.862 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:40 +0000 (0:00:00.483) 0:03:47.356 ********** 2021-04-09T18:12:41.005 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-04-09T18:12:41.009 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:41.093 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:41 +0000 (0:00:00.231) 0:03:47.588 ********** 2021-04-09T18:12:41.509 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:41.542 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:41 +0000 (0:00:00.448) 0:03:48.036 ********** 2021-04-09T18:12:41.682 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-04-09T18:12:41.684 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:41.854 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:41 +0000 (0:00:00.312) 0:03:48.349 ********** 2021-04-09T18:12:42.085 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:42.223 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:42 +0000 (0:00:00.337) 0:03:48.686 ********** 2021-04-09T18:12:42.557 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-04-09T18:12:42.653 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:42 +0000 (0:00:00.430) 0:03:49.147 ********** 2021-04-09T18:12:42.890 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:42 +0000 (0:00:00.236) 0:03:49.384 ********** 2021-04-09T18:12:43.377 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-04-09T18:12:43.379 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:43.441 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:43 +0000 (0:00:00.551) 0:03:49.936 ********** 2021-04-09T18:12:43.469 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:43.627 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:43 +0000 (0:00:00.185) 0:03:50.121 ********** 2021-04-09T18:12:43.900 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-04-09T18:12:43.901 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:44.012 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:44 +0000 (0:00:00.385) 0:03:50.506 ********** 2021-04-09T18:12:44.145 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:44.188 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:44 +0000 (0:00:00.168) 0:03:50.675 ********** 2021-04-09T18:12:44.590 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-04-09T18:12:44.592 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:12:44.615 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:44 +0000 (0:00:00.434) 0:03:51.109 ********** 2021-04-09T18:12:44.669 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:12:44.729 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-04-09T18:12:44.833 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:44 +0000 (0:00:00.218) 0:03:51.327 ********** 2021-04-09T18:12:45.187 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-04-09T18:12:45.189 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:45.271 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:45 +0000 (0:00:00.438) 0:03:51.766 ********** 2021-04-09T18:12:45.387 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:45.496 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:45 +0000 (0:00:00.224) 0:03:51.990 ********** 2021-04-09T18:12:45.680 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-04-09T18:12:45.770 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:45 +0000 (0:00:00.274) 0:03:52.265 ********** 2021-04-09T18:12:45.948 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:45 +0000 (0:00:00.177) 0:03:52.442 ********** 2021-04-09T18:12:46.180 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-04-09T18:12:46.182 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:46.270 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:46 +0000 (0:00:00.321) 0:03:52.764 ********** 2021-04-09T18:12:46.529 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:46.563 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:46 +0000 (0:00:00.290) 0:03:53.054 ********** 2021-04-09T18:12:46.630 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:46.653 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:46 +0000 (0:00:00.092) 0:03:53.147 ********** 2021-04-09T18:12:47.147 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:47.181 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:47 +0000 (0:00:00.528) 0:03:53.675 ********** 2021-04-09T18:12:47.404 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-04-09T18:12:47.406 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:47.493 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:47 +0000 (0:00:00.311) 0:03:53.987 ********** 2021-04-09T18:12:47.661 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:47.747 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:47 +0000 (0:00:00.254) 0:03:54.241 ********** 2021-04-09T18:12:48.028 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:48.144 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:48 +0000 (0:00:00.397) 0:03:54.638 ********** 2021-04-09T18:12:48.242 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:48.244 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:48.330 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:48 +0000 (0:00:00.186) 0:03:54.825 ********** 2021-04-09T18:12:48.923 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:48.998 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:48 +0000 (0:00:00.667) 0:03:55.493 ********** 2021-04-09T18:12:49.039 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:49.041 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:49.122 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:49 +0000 (0:00:00.123) 0:03:55.616 ********** 2021-04-09T18:12:49.729 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:12:49.731 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:49.798 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:49 +0000 (0:00:00.675) 0:03:56.291 ********** 2021-04-09T18:12:49.812 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:49.878 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:49 +0000 (0:00:00.081) 0:03:56.372 ********** 2021-04-09T18:12:49.884 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:50.206 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-04-09T18:12:50.208 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:50.241 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:50 +0000 (0:00:00.363) 0:03:56.736 ********** 2021-04-09T18:12:50.401 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:50.616 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:50 +0000 (0:00:00.374) 0:03:57.110 ********** 2021-04-09T18:12:50.845 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-04-09T18:12:50.847 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:50.927 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:50 +0000 (0:00:00.311) 0:03:57.421 ********** 2021-04-09T18:12:51.019 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:51.027 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:51.151 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:51 +0000 (0:00:00.219) 0:03:57.641 ********** 2021-04-09T18:12:51.673 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-04-09T18:12:51.675 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:51.730 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:51 +0000 (0:00:00.583) 0:03:58.224 ********** 2021-04-09T18:12:51.732 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:51.796 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:51.963 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:51 +0000 (0:00:00.233) 0:03:58.457 ********** 2021-04-09T18:12:52.211 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-04-09T18:12:52.224 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:52.236 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:52 +0000 (0:00:00.272) 0:03:58.730 ********** 2021-04-09T18:12:52.593 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:52.673 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:52 +0000 (0:00:00.436) 0:03:59.167 ********** 2021-04-09T18:12:52.822 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-04-09T18:12:52.853 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:53.118 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:53 +0000 (0:00:00.445) 0:03:59.612 ********** 2021-04-09T18:12:53.415 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:53.563 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:53 +0000 (0:00:00.445) 0:04:00.057 ********** 2021-04-09T18:12:53.601 INFO:teuthology.task.ansible.out: 2021-04-09T18:12:53.734 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-04-09T18:12:53.736 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:53.786 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:53 +0000 (0:00:00.223) 0:04:00.281 ********** 2021-04-09T18:12:54.142 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:54.203 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:54 +0000 (0:00:00.410) 0:04:00.692 ********** 2021-04-09T18:12:54.327 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:54.388 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:54 +0000 (0:00:00.190) 0:04:00.883 ********** 2021-04-09T18:12:54.730 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:54.790 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:54 +0000 (0:00:00.401) 0:04:01.285 ********** 2021-04-09T18:12:55.063 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:55.085 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:55 +0000 (0:00:00.294) 0:04:01.579 ********** 2021-04-09T18:12:55.296 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:55.358 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:55 +0000 (0:00:00.272) 0:04:01.851 ********** 2021-04-09T18:12:55.612 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-04-09T18:12:55.614 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:55.639 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:55 +0000 (0:00:00.279) 0:04:02.131 ********** 2021-04-09T18:12:55.862 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:55.976 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:55 +0000 (0:00:00.338) 0:04:02.470 ********** 2021-04-09T18:12:56.278 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:56.315 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:56 +0000 (0:00:00.339) 0:04:02.810 ********** 2021-04-09T18:12:56.521 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:56.652 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:56 +0000 (0:00:00.336) 0:04:03.146 ********** 2021-04-09T18:12:56.937 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-04-09T18:12:56.939 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:57.014 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:57 +0000 (0:00:00.361) 0:04:03.508 ********** 2021-04-09T18:12:57.150 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:57.214 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:57 +0000 (0:00:00.200) 0:04:03.708 ********** 2021-04-09T18:12:57.633 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-04-09T18:12:57.637 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:57.757 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:57 +0000 (0:00:00.542) 0:04:04.251 ********** 2021-04-09T18:12:57.876 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:57.946 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:57 +0000 (0:00:00.189) 0:04:04.440 ********** 2021-04-09T18:12:58.454 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-04-09T18:12:58.456 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:58.502 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:58 +0000 (0:00:00.556) 0:04:04.997 ********** 2021-04-09T18:12:58.601 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:58.689 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:58 +0000 (0:00:00.186) 0:04:05.183 ********** 2021-04-09T18:12:59.016 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-04-09T18:12:59.023 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:59.159 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:59 +0000 (0:00:00.469) 0:04:05.652 ********** 2021-04-09T18:12:59.247 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:59.556 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:59 +0000 (0:00:00.397) 0:04:06.050 ********** 2021-04-09T18:12:59.872 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-04-09T18:12:59.874 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:12:59.907 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:12:59 +0000 (0:00:00.351) 0:04:06.402 ********** 2021-04-09T18:13:00.013 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:00.195 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:00 +0000 (0:00:00.287) 0:04:06.689 ********** 2021-04-09T18:13:00.357 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-04-09T18:13:00.359 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:00.539 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:00 +0000 (0:00:00.311) 0:04:07.001 ********** 2021-04-09T18:13:00.876 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:00.980 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:00 +0000 (0:00:00.468) 0:04:07.470 ********** 2021-04-09T18:13:01.302 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:01.328 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:01 +0000 (0:00:00.350) 0:04:07.820 ********** 2021-04-09T18:13:01.520 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:01.603 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:01 +0000 (0:00:00.277) 0:04:08.097 ********** 2021-04-09T18:13:01.769 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:01.801 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:01 +0000 (0:00:00.196) 0:04:08.294 ********** 2021-04-09T18:13:02.252 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:02.282 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:02 +0000 (0:00:00.480) 0:04:08.775 ********** 2021-04-09T18:13:02.332 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-04-09T18:13:02.334 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:02.489 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:02 +0000 (0:00:00.208) 0:04:08.983 ********** 2021-04-09T18:13:02.930 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:03.041 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:03 +0000 (0:00:00.551) 0:04:09.534 ********** 2021-04-09T18:13:03.116 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-04-09T18:13:03.118 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:03.323 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:03 +0000 (0:00:00.283) 0:04:09.818 ********** 2021-04-09T18:13:03.799 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:03.862 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:03 +0000 (0:00:00.538) 0:04:10.356 ********** 2021-04-09T18:13:03.934 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-04-09T18:13:03.936 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:04.185 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:04 +0000 (0:00:00.322) 0:04:10.679 ********** 2021-04-09T18:13:04.186 INFO:teuthology.task.ansible.out: 2021-04-09T18:13:04.530 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:04.635 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:04 +0000 (0:00:00.449) 0:04:11.129 ********** 2021-04-09T18:13:05.135 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-04-09T18:13:05.137 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:05.198 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:05 +0000 (0:00:00.563) 0:04:11.693 ********** 2021-04-09T18:13:05.308 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:05.549 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:05 +0000 (0:00:00.350) 0:04:12.043 ********** 2021-04-09T18:13:05.640 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-04-09T18:13:05.641 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:05.864 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:05 +0000 (0:00:00.315) 0:04:12.359 ********** 2021-04-09T18:13:06.196 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:06.278 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:06 +0000 (0:00:00.414) 0:04:12.773 ********** 2021-04-09T18:13:06.451 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:13:06.452 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:06.508 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:06 +0000 (0:00:00.227) 0:04:13.000 ********** 2021-04-09T18:13:06.926 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:06.974 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:06 +0000 (0:00:00.467) 0:04:13.468 ********** 2021-04-09T18:13:07.098 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-04-09T18:13:07.099 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:07.194 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:07 +0000 (0:00:00.219) 0:04:13.688 ********** 2021-04-09T18:13:07.673 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:07.698 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:07 +0000 (0:00:00.504) 0:04:14.192 ********** 2021-04-09T18:13:08.920 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-04-09T18:13:08.922 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "secontext": "system_u:object_r:exports_t:s0", "size": 578, "state": "file", "uid": 0} 2021-04-09T18:13:09.025 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:09 +0000 (0:00:01.326) 0:04:15.519 ********** 2021-04-09T18:13:09.507 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "secontext": "system_u:object_r:exports_t:s0", "size": 578, "state": "file", "uid": 0} 2021-04-09T18:13:09.648 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:09 +0000 (0:00:00.623) 0:04:16.142 ********** 2021-04-09T18:13:10.577 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-04-09T18:13:10.579 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nfs-server", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:07:38 UTC", "ActiveEnterTimestampMonotonic": "23841662", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network-online.target tmp.mount proc-fs-nfsd.mount gssproxy.service nfs-config.service local-fs.target nfs-idmapd.service nfs-mountd.service rpcbind.socket system.slice rpc-statd.service rpc-gssd.service -.mount systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:07:38 UTC", "AssertTimestampMonotonic": "23580946", "Before": "rpc-statd-notify.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BoundBy": "nfs-mountd.service nfs-idmapd.service", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:07:38 UTC", "ConditionTimestampMonotonic": "23580946", "ControlGroup": "/system.slice/nfs-server.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "NFS server and services", "DevicePolicy": "auto", "DropInPaths": "/run/systemd/generator/nfs-server.service.d/order-with-mounts.conf", "EnvironmentFile": "/run/sysconfig/nfs-utils (ignore_errors=yes)", "ExecMainCode": "1", "ExecMainExitTimestamp": "Fri 2021-04-09 18:07:38 UTC", "ExecMainExitTimestampMonotonic": "23802477", "ExecMainPID": "1165", "ExecMainStartTimestamp": "Fri 2021-04-09 18:07:38 UTC", "ExecMainStartTimestampMonotonic": "23684595", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=ye 2021-04-09T18:13:10.581 INFO:teuthology.task.ansible.out:s ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd $RPCNFSDARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/bin/sh ; argv[]=/bin/sh -c if systemctl -q is-active gssproxy; then systemctl reload gssproxy ; fi ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd 0 ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nfs-server.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nfs-server.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:07:38 UTC", "InactiveExitTimestampMonotonic": "23581889", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "l 2021-04-09T18:13:10.584 INFO:teuthology.task.ansible.out:oaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nfs-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "yes", "Requires": "nfs-mountd.service system.slice proc-fs-nfsd.mount -.mount network.target", "RequiresMountsFor": "/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "0", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "rpcbind.socket nfs-idmapd.service rpc-statd-notify.service auth-rpcgss-module.service rpc-statd.service nfs-config.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:13:10.695 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:10 +0000 (0:00:01.046) 0:04:17.189 ********** 2021-04-09T18:13:10.945 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nfs-server", "status": {"ActiveEnterTimestamp": "Fri 2021-04-09 18:03:06 UTC", "ActiveEnterTimestampMonotonic": "23024771", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "rpc-statd.service rpc-gssd.service rpcbind.socket -.mount systemd-journald.socket nfs-idmapd.service tmp.mount gssproxy.service proc-fs-nfsd.mount network-online.target system.slice nfs-config.service local-fs.target nfs-mountd.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-04-09 18:03:05 UTC", "AssertTimestampMonotonic": "22777702", "Before": "rpc-statd-notify.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BoundBy": "nfs-idmapd.service nfs-mountd.service", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-04-09 18:03:05 UTC", "ConditionTimestampMonotonic": "22777701", "ControlGroup": "/system.slice/nfs-server.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "NFS server and services", "DevicePolicy": "auto", "DropInPaths": "/run/systemd/generator/nfs-server.service.d/order-with-mounts.conf", "EnvironmentFile": "/run/sysconfig/nfs-utils (ignore_errors=yes)", "ExecMainCode": "1", "ExecMainExitTimestamp": "Fri 2021-04-09 18:03:06 UTC", "ExecMainExitTimestampMonotonic": "22992982", "ExecMainPID": "1134", "ExecMainStartTimestamp": "Fri 2021-04-09 18:03:05 UTC", "ExecMainStartTimestampMonotonic": "22867182", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=ye 2021-04-09T18:13:10.948 INFO:teuthology.task.ansible.out:s ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd $RPCNFSDARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/bin/sh ; argv[]=/bin/sh -c if systemctl -q is-active gssproxy; then systemctl reload gssproxy ; fi ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd 0 ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nfs-server.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nfs-server.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-04-09 18:03:05 UTC", "InactiveExitTimestampMonotonic": "22778335", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "l 2021-04-09T18:13:10.950 INFO:teuthology.task.ansible.out:oaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nfs-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "yes", "Requires": "proc-fs-nfsd.mount system.slice network.target -.mount nfs-mountd.service", "RequiresMountsFor": "/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "0", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "rpc-statd-notify.service nfs-config.service network-online.target auth-rpcgss-module.service rpcbind.socket rpc-statd.service nfs-idmapd.service", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:13:11.101 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:11 +0000 (0:00:00.405) 0:04:17.595 ********** 2021-04-09T18:13:11.441 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-04-09T18:13:11.443 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:11.568 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:11 +0000 (0:00:00.462) 0:04:18.057 ********** 2021-04-09T18:13:11.879 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:11.965 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:11 +0000 (0:00:00.401) 0:04:18.459 ********** 2021-04-09T18:13:12.479 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:12.530 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:12 +0000 (0:00:00.565) 0:04:19.024 ********** 2021-04-09T18:13:12.886 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:12.955 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:12 +0000 (0:00:00.425) 0:04:19.450 ********** 2021-04-09T18:13:13.266 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:13:13.269 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:13.359 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:13 +0000 (0:00:00.403) 0:04:19.853 ********** 2021-04-09T18:13:13.583 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:13.723 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:13 +0000 (0:00:00.363) 0:04:20.217 ********** 2021-04-09T18:13:14.104 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:14.135 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:14 +0000 (0:00:00.409) 0:04:20.626 ********** 2021-04-09T18:13:14.586 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:14.609 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:14 +0000 (0:00:00.477) 0:04:21.104 ********** 2021-04-09T18:13:14.820 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:14.898 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:14 +0000 (0:00:00.288) 0:04:21.392 ********** 2021-04-09T18:13:15.252 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:15.399 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:15 +0000 (0:00:00.498) 0:04:21.890 ********** 2021-04-09T18:13:15.667 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-04-09T18:13:15.670 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:15.786 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:15 +0000 (0:00:00.390) 0:04:22.281 ********** 2021-04-09T18:13:16.107 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:16.263 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:16 +0000 (0:00:00.476) 0:04:22.757 ********** 2021-04-09T18:13:16.619 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:16.737 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:16 +0000 (0:00:00.474) 0:04:23.231 ********** 2021-04-09T18:13:17.115 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:17.184 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:17 +0000 (0:00:00.447) 0:04:23.679 ********** 2021-04-09T18:13:17.581 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-04-09T18:13:17.583 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:17.712 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:17 +0000 (0:00:00.525) 0:04:24.204 ********** 2021-04-09T18:13:18.068 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:18.227 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:18 +0000 (0:00:00.515) 0:04:24.720 ********** 2021-04-09T18:13:18.376 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-04-09T18:13:18.377 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:18.637 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:18 +0000 (0:00:00.410) 0:04:25.130 ********** 2021-04-09T18:13:18.965 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:19.046 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:19 +0000 (0:00:00.409) 0:04:25.540 ********** 2021-04-09T18:13:19.406 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-04-09T18:13:19.408 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:19.483 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:19 +0000 (0:00:00.436) 0:04:25.977 ********** 2021-04-09T18:13:19.986 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:20.053 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:20 +0000 (0:00:00.569) 0:04:26.546 ********** 2021-04-09T18:13:20.182 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-04-09T18:13:20.184 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:20.285 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:20 +0000 (0:00:00.232) 0:04:26.779 ********** 2021-04-09T18:13:20.867 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:20.950 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:20 +0000 (0:00:00.665) 0:04:27.444 ********** 2021-04-09T18:13:21.153 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-04-09T18:13:21.154 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:21.298 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:21 +0000 (0:00:00.331) 0:04:27.776 ********** 2021-04-09T18:13:21.798 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:21.829 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:21 +0000 (0:00:00.547) 0:04:28.323 ********** 2021-04-09T18:13:22.035 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:22.263 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:22 +0000 (0:00:00.433) 0:04:28.757 ********** 2021-04-09T18:13:22.620 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:22.719 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:22 +0000 (0:00:00.456) 0:04:29.213 ********** 2021-04-09T18:13:22.995 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-04-09T18:13:23.000 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:23.041 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:23 +0000 (0:00:00.321) 0:04:29.535 ********** 2021-04-09T18:13:24.531 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:24.578 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:24 +0000 (0:00:01.537) 0:04:31.072 ********** 2021-04-09T18:13:25.186 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-04-09T18:13:25.188 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:25.404 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:25 +0000 (0:00:00.825) 0:04:31.898 ********** 2021-04-09T18:13:25.924 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-04-09T18:13:25.926 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:26.012 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:26 +0000 (0:00:00.607) 0:04:32.506 ********** 2021-04-09T18:13:26.067 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-04-09T18:13:26.070 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:26.355 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:26 +0000 (0:00:00.343) 0:04:32.849 ********** 2021-04-09T18:13:26.770 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-04-09T18:13:26.772 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:26.907 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:26 +0000 (0:00:00.551) 0:04:33.401 ********** 2021-04-09T18:13:27.021 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-04-09T18:13:27.022 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:27.208 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:27 +0000 (0:00:00.300) 0:04:33.702 ********** 2021-04-09T18:13:27.667 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-04-09T18:13:27.670 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:27.790 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:27 +0000 (0:00:00.582) 0:04:34.284 ********** 2021-04-09T18:13:27.886 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-04-09T18:13:27.888 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:28.011 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:28 +0000 (0:00:00.219) 0:04:34.504 ********** 2021-04-09T18:13:29.814 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-04-09T18:13:29.816 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:30.085 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:30 +0000 (0:00:02.074) 0:04:36.579 ********** 2021-04-09T18:13:30.190 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:30.378 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:30 +0000 (0:00:00.293) 0:04:36.873 ********** 2021-04-09T18:13:30.856 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:31.012 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:31 +0000 (0:00:00.629) 0:04:37.502 ********** 2021-04-09T18:13:31.025 INFO:teuthology.task.ansible.out: 2021-04-09T18:13:31.222 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-04-09T18:13:31.224 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:31.445 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:31 +0000 (0:00:00.436) 0:04:37.939 ********** 2021-04-09T18:13:31.447 INFO:teuthology.task.ansible.out: 2021-04-09T18:13:31.898 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:32.056 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:32 +0000 (0:00:00.610) 0:04:38.550 ********** 2021-04-09T18:13:32.315 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:13:32.317 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-04-09T18:13:32.486 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:32 +0000 (0:00:00.430) 0:04:38.980 ********** 2021-04-09T18:13:34.357 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-04-09T18:13:34.485 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:34 +0000 (0:00:01.999) 0:04:40.980 ********** 2021-04-09T18:13:34.566 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-04-09T18:13:34.584 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:34.589 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-04-09T18:13:34.615 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:34.693 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:34.853 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:34.925 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:35.005 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:35.205 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:35 +0000 (0:00:00.719) 0:04:41.699 ********** 2021-04-09T18:13:36.442 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:36.529 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-04-09T18:13:36.626 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:36.729 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:36.792 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:36.850 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:36.872 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-04-09T18:13:37.046 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:37 +0000 (0:00:01.839) 0:04:43.539 ********** 2021-04-09T18:13:38.086 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-04-09T18:13:38.088 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.102988", "end": "2021-04-09 18:13:37.873361", "rc": 0, "start": "2021-04-09 18:13:37.770373", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock"]} 2021-04-09T18:13:38.323 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:38 +0000 (0:00:01.277) 0:04:44.817 ********** 2021-04-09T18:13:41.172 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-04-09T18:13:41.175 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:41.311 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:41 +0000 (0:00:02.988) 0:04:47.805 ********** 2021-04-09T18:13:41.493 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-04-09T18:13:41.495 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.113732", "end": "2021-04-09 18:13:41.315173", "rc": 0, "start": "2021-04-09 18:13:41.201441", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-lock"]} 2021-04-09T18:13:41.555 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:41 +0000 (0:00:00.244) 0:04:48.049 ********** 2021-04-09T18:13:41.565 INFO:teuthology.task.ansible.out: 2021-04-09T18:13:42.063 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-04-09T18:13:42.065 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:42.092 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:42 +0000 (0:00:00.536) 0:04:48.586 ********** 2021-04-09T18:13:42.215 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-04-09T18:13:42.217 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:42.555 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:42 +0000 (0:00:00.462) 0:04:49.048 ********** 2021-04-09T18:13:43.121 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-04-09T18:13:43.123 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:43.209 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:43 +0000 (0:00:00.654) 0:04:49.703 ********** 2021-04-09T18:13:43.556 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:43.579 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:43 +0000 (0:00:00.370) 0:04:50.073 ********** 2021-04-09T18:13:43.592 INFO:teuthology.task.ansible.out: 2021-04-09T18:13:43.973 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-04-09T18:13:43.975 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:44.121 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:44 +0000 (0:00:00.541) 0:04:50.615 ********** 2021-04-09T18:13:44.516 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-04-09T18:13:44.519 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:44.602 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:44 +0000 (0:00:00.481) 0:04:51.096 ********** 2021-04-09T18:13:45.440 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-04-09T18:13:45.443 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:45.481 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:45 +0000 (0:00:00.879) 0:04:51.975 ********** 2021-04-09T18:13:45.835 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-04-09T18:13:45.837 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.170-6.el7.x86_64 providing device-mapper is already installed"]} 2021-04-09T18:13:45.987 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:45 +0000 (0:00:00.505) 0:04:52.481 ********** 2021-04-09T18:13:47.136 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:13:47.138 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item={'block_used': 13831462, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'size_total': 984369086464, 'block_total': 240324484, 'mount': '/', 'block_available': 226493022, 'size_available': 927715418112, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,seclabel,relatime,data=ordered', 'device': '/dev/sda1', 'inode_used': 90206, 'block_size': 4096, 'inode_available': 60964770}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226493022, "block_size": 4096, "block_total": 240324484, "block_used": 13831462, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60964770, "inode_total": 61054976, "inode_used": 90206, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 927715418112, "size_total": 984369086464, "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}} 2021-04-09T18:13:47.280 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:47 +0000 (0:00:01.292) 0:04:53.774 ********** 2021-04-09T18:13:47.330 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-04-09T18:13:47.332 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.170-6.el7.x86_64 providing device-mapper is already installed"]} 2021-04-09T18:13:47.510 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:47 +0000 (0:00:00.230) 0:04:54.005 ********** 2021-04-09T18:13:48.427 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:13:48.437 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'block_used': 13831453, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'size_total': 984369086464, 'block_total': 240324484, 'mount': '/', 'block_available': 226493031, 'size_available': 927715454976, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,seclabel,relatime,data=ordered', 'device': '/dev/sda1', 'inode_used': 90206, 'block_size': 4096, 'inode_available': 60964770}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226493031, "block_size": 4096, "block_total": 240324484, "block_used": 13831453, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60964770, "inode_total": 61054976, "inode_used": 90206, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 927715454976, "size_total": 984369086464, "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}} 2021-04-09T18:13:48.482 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:48 +0000 (0:00:00.971) 0:04:54.976 ********** 2021-04-09T18:13:48.515 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-04-09T18:13:48.517 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005879", "end": "2021-04-09 18:13:48.424185", "rc": 0, "start": "2021-04-09 18:13:48.418306", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:13:48.697 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:48 +0000 (0:00:00.199) 0:04:55.175 ********** 2021-04-09T18:13:49.526 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005869", "end": "2021-04-09 18:13:49.423325", "rc": 0, "start": "2021-04-09 18:13:49.417456", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:13:49.697 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:49 +0000 (0:00:01.015) 0:04:56.191 ********** 2021-04-09T18:13:49.741 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-04-09T18:13:49.745 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'block_used': 13831462, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'size_total': 984369086464, 'block_total': 240324484, 'mount': '/', 'block_available': 226493022, 'size_available': 927715418112, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,seclabel,relatime,data=ordered', 'device': '/dev/sda1', 'inode_used': 90206, 'block_size': 4096, 'inode_available': 60964770}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226493022, "block_size": 4096, "block_total": 240324484, "block_used": 13831462, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60964770, "inode_total": 61054976, "inode_used": 90206, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 927715418112, "size_total": 984369086464, "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:50.102 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:50 +0000 (0:00:00.405) 0:04:56.597 ********** 2021-04-09T18:13:50.600 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'block_used': 13831453, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'size_total': 984369086464, 'block_total': 240324484, 'mount': '/', 'block_available': 226493031, 'size_available': 927715454976, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,seclabel,relatime,data=ordered', 'device': '/dev/sda1', 'inode_used': 90206, 'block_size': 4096, 'inode_available': 60964770}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226493031, "block_size": 4096, "block_total": 240324484, "block_used": 13831453, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60964770, "inode_total": 61054976, "inode_used": 90206, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 927715454976, "size_total": 984369086464, "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:50.785 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:50 +0000 (0:00:00.682) 0:04:57.280 ********** 2021-04-09T18:13:50.931 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-04-09T18:13:51.214 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:51 +0000 (0:00:00.428) 0:04:57.708 ********** 2021-04-09T18:13:51.741 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:13:51 +0000 (0:00:00.526) 0:04:58.234 ********** 2021-04-09T18:13:52.150 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi120.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHP0', 'wwn-0x5000c50091e1af53'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHP0-part1', 'wwn-0x5000c50091e1af53-part1'], 'uuids': ['7884d11b-1a98-41be-b51a-86bec1e24d7d']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1af53', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QHP0', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHP0", "wwn-0x5000c50091e1af53"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHP0-part1", "wwn-0x5000c50091e1af53-part1"], "labels": [], "masters": [], "uuids": ["7884d11b-1a98-41be-b51a-86bec1e24d7d"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHP0", "size": "931.51 GB", "suppor 2021-04-09T18:13:52.155 INFO:teuthology.task.ansible.out:t_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1af53"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:13:52.783 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV', 'wwn-0x5000c50092941659'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1', 'wwn-0x5000c50092941659-part1'], 'uuids': ['7884d11b-1a98-41be-b51a-86bec1e24d7d']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092941659', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XNGV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV", "wwn-0x5000c50092941659"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1", "wwn-0x5000c50092941659-part1"], "labels": [], "masters": [], "uuids": ["7884d11b-1a98-41be-b51a-86bec1e24d7d"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNGV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941659"}}, "skip 2021-04-09T18:13:52.785 INFO:teuthology.task.ansible.out:_reason": "Conditional result was False"} 2021-04-09T18:13:53.816 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-24XeP6-017V-URfF-AtEu-bflH-3hP0-tFn7VO', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400XV400BGN', 'nvme-nvme.8086-50484654363230343030585634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': ['vg_nvme-lv_1', 'vg_nvme-lv_2', 'vg_nvme-lv_3', 'vg_nvme-lv_4', 'vg_nvme-lv_5'], 'partitions': {}, 'model': 'INTEL SSDPEDMD400G4', 'serial': 'PHFT620400XV400BGN', 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.138293", "end": "2021-04-09 18:13:53.768210", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_1", "vg_nvme-lv_2", "vg_nvme-lv_3", "vg_nvme-lv_4", "vg_nvme-lv_5"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-24XeP6-017V-URfF-AtEu-bflH-3hP0-tFn7VO", "nvme-INTEL_SSDPEDMD400G4_PHFT620400XV400BGN", "nvme-nvme.8086-50484654363230343030585634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:52.629917", "stderr": "", "stderr_lines": [], "stdo 2021-04-09T18:13:53.818 INFO:teuthology.task.ansible.out:ut": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:13:54.212 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LdBm1n-ehcq-2S1n-dI22-63Hc-Rgs2-cGGVLe', 'nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN', 'nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': ['vg_nvme-lv_1', 'vg_nvme-lv_2', 'vg_nvme-lv_3', 'vg_nvme-lv_4', 'vg_nvme-lv_5'], 'partitions': {}, 'model': 'INTEL SSDPEDMD400G4', 'serial': 'CVFT62420002400BGN', 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.122232", "end": "2021-04-09 18:13:54.177433", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_1", "vg_nvme-lv_2", "vg_nvme-lv_3", "vg_nvme-lv_4", "vg_nvme-lv_5"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LdBm1n-ehcq-2S1n-dI22-63Hc-Rgs2-cGGVLe", "nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN", "nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:53.055201", "stderr": "", "stderr_lines": [], "stdo 2021-04-09T18:13:54.214 INFO:teuthology.task.ansible.out:ut": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:13:55.425 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4VXsFBIl8jMIXPlMae3Ij02DFtNZ29GcB'], 'uuids': ['c105defb-52e1-4cc0-b8a8-a9e78f191d42']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.044858", "end": "2021-04-09 18:13:55.385184", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4VXsFBIl8jMIXPlMae3Ij02DFtNZ29GcB"], "labels": [], "masters": [], "uuids": ["c105defb-52e1-4cc0-b8a8-a9e78f191d42"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:54.340326", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:13:55.721 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiBhi9luG01HezI0BLl7mTZOO6qXJPHgCh'], 'uuids': ['d2999bdd-64fb-437f-92c1-bee878653b15']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.055634", "end": "2021-04-09 18:13:55.698311", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiBhi9luG01HezI0BLl7mTZOO6qXJPHgCh"], "labels": [], "masters": [], "uuids": ["d2999bdd-64fb-437f-92c1-bee878653b15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:54.642677", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:13:57.018 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ48W9tzwRS2n3CA5DkdWSXuvvtVv3IPV5Z'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.067759", "end": "2021-04-09 18:13:56.985656", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ48W9tzwRS2n3CA5DkdWSXuvvtVv3IPV5Z"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:55.917897", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:13:57.224 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiA2aVKj0gVfUhx0IzQ37mYtx0Oa0yek0e'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.059260", "end": "2021-04-09 18:13:57.199170", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiA2aVKj0gVfUhx0IzQ37mYtx0Oa0yek0e"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:56.139910", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:13:58.556 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4ZGKo3yXxbMrf3OcZADjkBy9n5jENzZlW'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055351", "end": "2021-04-09 18:13:58.426615", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4ZGKo3yXxbMrf3OcZADjkBy9n5jENzZlW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:57.371264", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:13:58.845 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiyPRlBbwc5A1P8VDFHd42BTdg4WiXDSvA'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.046602", "end": "2021-04-09 18:13:58.797477", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiyPRlBbwc5A1P8VDFHd42BTdg4WiXDSvA"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:57.750875", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:14:00.185 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4caC8UmXSIVsc8mBn3otO7GRW1Tk04DPp'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.061180", "end": "2021-04-09 18:14:00.152917", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4caC8UmXSIVsc8mBn3otO7GRW1Tk04DPp"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:59.091737", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:14:00.435 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiT8v8HuqyF7ubgZdHLWUd6S6XFDL5R8t9'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.053416", "end": "2021-04-09 18:14:00.399343", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiT8v8HuqyF7ubgZdHLWUd6S6XFDL5R8t9"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:13:59.345927", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:14:01.867 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ45jnQjijlO18o9TvX2NKYWJRhm7W8kCGg'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.051512", "end": "2021-04-09 18:14:01.828100", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ45jnQjijlO18o9TvX2NKYWJRhm7W8kCGg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:00.776588", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:14:02.049 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:02 +0000 (0:00:10.309) 0:05:08.543 ********** 2021-04-09T18:14:02.138 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiwKNcBpZ1kILcyx3UEGIEbvPLO7C27dCq'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.054675", "end": "2021-04-09 18:14:02.049033", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiwKNcBpZ1kILcyx3UEGIEbvPLO7C27dCq"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:00.994358", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-04-09T18:14:02.362 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:02 +0000 (0:00:00.312) 0:05:08.856 ********** 2021-04-09T18:14:02.771 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-04-09T18:14:02.774 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHP0', 'wwn-0x5000c50091e1af53'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHP0-part1', 'wwn-0x5000c50091e1af53-part1'], 'uuids': ['7884d11b-1a98-41be-b51a-86bec1e24d7d']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1af53', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QHP0', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHP0", "wwn-0x5000c50091e1af53"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHP0-part1", "wwn-0x5000c50091e1af53-part1"], "labels": [], "masters": [], "uuids": ["7884d11b-1a98-41be-b51a-86bec1e24d7d"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHP0", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1af53"}}, "skip 2021-04-09T18:14:02.776 INFO:teuthology.task.ansible.out:_reason": "Conditional result was False"} 2021-04-09T18:14:03.269 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-24XeP6-017V-URfF-AtEu-bflH-3hP0-tFn7VO', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400XV400BGN', 'nvme-nvme.8086-50484654363230343030585634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': ['vg_nvme-lv_1', 'vg_nvme-lv_2', 'vg_nvme-lv_3', 'vg_nvme-lv_4', 'vg_nvme-lv_5'], 'partitions': {}, 'model': 'INTEL SSDPEDMD400G4', 'serial': 'PHFT620400XV400BGN', 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.038943", "end": "2021-04-09 18:14:03.231490", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_1", "vg_nvme-lv_2", "vg_nvme-lv_3", "vg_nvme-lv_4", "vg_nvme-lv_5"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-24XeP6-017V-URfF-AtEu-bflH-3hP0-tFn7VO", "nvme-INTEL_SSDPEDMD400G4_PHFT620400XV400BGN", "nvme-nvme.8086-50484654363230343030585634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:03.192547", "stderr": "110+0 records in\n110+0 records out\n115343 2021-04-09T18:14:03.271 INFO:teuthology.task.ansible.out:360 bytes (115 MB) copied, 0.036118 s, 3.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.036118 s, 3.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:03.434 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV', 'wwn-0x5000c50092941659'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1', 'wwn-0x5000c50092941659-part1'], 'uuids': ['7884d11b-1a98-41be-b51a-86bec1e24d7d']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092941659', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XNGV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV", "wwn-0x5000c50092941659"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1", "wwn-0x5000c50092941659-part1"], "labels": [], "masters": [], "uuids": ["7884d11b-1a98-41be-b51a-86bec1e24d7d"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNGV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941659"}}, "skip 2021-04-09T18:14:03.437 INFO:teuthology.task.ansible.out:_reason": "Conditional result was False"} 2021-04-09T18:14:03.926 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LdBm1n-ehcq-2S1n-dI22-63Hc-Rgs2-cGGVLe', 'nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN', 'nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': ['vg_nvme-lv_1', 'vg_nvme-lv_2', 'vg_nvme-lv_3', 'vg_nvme-lv_4', 'vg_nvme-lv_5'], 'partitions': {}, 'model': 'INTEL SSDPEDMD400G4', 'serial': 'CVFT62420002400BGN', 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.038801", "end": "2021-04-09 18:14:03.895978", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_1", "vg_nvme-lv_2", "vg_nvme-lv_3", "vg_nvme-lv_4", "vg_nvme-lv_5"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LdBm1n-ehcq-2S1n-dI22-63Hc-Rgs2-cGGVLe", "nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN", "nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:03.857177", "stderr": "110+0 records in\n110+0 records out\n115343 2021-04-09T18:14:03.929 INFO:teuthology.task.ansible.out:360 bytes (115 MB) copied, 0.0358188 s, 3.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0358188 s, 3.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:03.940 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4VXsFBIl8jMIXPlMae3Ij02DFtNZ29GcB'], 'uuids': ['c105defb-52e1-4cc0-b8a8-a9e78f191d42']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144228", "end": "2021-04-09 18:14:03.869585", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4VXsFBIl8jMIXPlMae3Ij02DFtNZ29GcB"], "labels": [], "masters": [], "uuids": ["c105defb-52e1-4cc0-b8a8-a9e78f191d42"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:03.725357", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.141432 s, 816 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.141432 s, 816 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:04.508 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiBhi9luG01HezI0BLl7mTZOO6qXJPHgCh'], 'uuids': ['d2999bdd-64fb-437f-92c1-bee878653b15']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144049", "end": "2021-04-09 18:14:04.478913", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiBhi9luG01HezI0BLl7mTZOO6qXJPHgCh"], "labels": [], "masters": [], "uuids": ["d2999bdd-64fb-437f-92c1-bee878653b15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:04.334864", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.141233 s, 817 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.141233 s, 817 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:04.723 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ48W9tzwRS2n3CA5DkdWSXuvvtVv3IPV5Z'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.144205", "end": "2021-04-09 18:14:04.650742", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ48W9tzwRS2n3CA5DkdWSXuvvtVv3IPV5Z"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:04.506537", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.141441 s, 815 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.141441 s, 815 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:05.022 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiA2aVKj0gVfUhx0IzQ37mYtx0Oa0yek0e'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141535", "end": "2021-04-09 18:14:04.989572", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiA2aVKj0gVfUhx0IzQ37mYtx0Oa0yek0e"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:04.848037", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.138785 s, 831 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.138785 s, 831 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:05.298 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4ZGKo3yXxbMrf3OcZADjkBy9n5jENzZlW'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.142679", "end": "2021-04-09 18:14:05.262615", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4ZGKo3yXxbMrf3OcZADjkBy9n5jENzZlW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:05.119936", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.139873 s, 825 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.139873 s, 825 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:05.665 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiyPRlBbwc5A1P8VDFHd42BTdg4WiXDSvA'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.142462", "end": "2021-04-09 18:14:05.641669", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiyPRlBbwc5A1P8VDFHd42BTdg4WiXDSvA"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:05.499207", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.139661 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.139661 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:05.883 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4caC8UmXSIVsc8mBn3otO7GRW1Tk04DPp'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.143913", "end": "2021-04-09 18:14:05.849450", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ4caC8UmXSIVsc8mBn3otO7GRW1Tk04DPp"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:05.705537", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.141107 s, 817 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.141107 s, 817 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:06.176 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiT8v8HuqyF7ubgZdHLWUd6S6XFDL5R8t9'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.143683", "end": "2021-04-09 18:14:06.152536", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiT8v8HuqyF7ubgZdHLWUd6S6XFDL5R8t9"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:06.008853", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.140803 s, 819 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.140803 s, 819 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:06.542 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ45jnQjijlO18o9TvX2NKYWJRhm7W8kCGg'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'PHFT620400XV400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.152273", "end": "2021-04-09 18:14:06.517524", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-jBXfwdgteG25a6w9FEeo8iXMx2jlrnZ45jnQjijlO18o9TvX2NKYWJRhm7W8kCGg"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400XV400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:06.365251", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.149501 s, 772 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.149501 s, 772 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:06.707 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:06 +0000 (0:00:04.343) 0:05:13.200 ********** 2021-04-09T18:14:06.783 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiwKNcBpZ1kILcyx3UEGIEbvPLO7C27dCq'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'holders': [], 'partitions': {}, 'model': None, 'serial': 'CVFT62420002400BGN', 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.142197", "end": "2021-04-09 18:14:06.711122", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-F62A0y5NXGZR0jfuquZFu5MQhQyJUtdiwKNcBpZ1kILcyx3UEGIEbvPLO7C27dCq"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT62420002400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-04-09 18:14:06.568925", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.139362 s, 828 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.139362 s, 828 MB/s"], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:07.068 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:07 +0000 (0:00:00.361) 0:05:13.562 ********** 2021-04-09T18:14:08.069 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-04-09T18:14:08.071 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.077488", "end": "2021-04-09 18:14:07.231962", "rc": 0, "start": "2021-04-09 18:14:07.154474", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:08.110 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:08 +0000 (0:00:01.042) 0:05:14.604 ********** 2021-04-09T18:14:08.423 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.087027", "end": "2021-04-09 18:14:07.638085", "rc": 0, "start": "2021-04-09 18:14:07.551058", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:08.519 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:08 +0000 (0:00:00.409) 0:05:15.013 ********** 2021-04-09T18:14:08.798 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-04-09T18:14:08.801 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.043560", "end": "2021-04-09 18:14:08.744902", "rc": 0, "start": "2021-04-09 18:14:08.701342", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:08.983 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:08 +0000 (0:00:00.463) 0:05:15.477 ********** 2021-04-09T18:14:09.233 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.036793", "end": "2021-04-09 18:14:09.183360", "rc": 0, "start": "2021-04-09 18:14:09.146567", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:14:09.327 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:09 +0000 (0:00:00.344) 0:05:15.821 ********** 2021-04-09T18:14:09.615 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-04-09T18:14:10.132 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:10 +0000 (0:00:00.804) 0:05:16.625 ********** 2021-04-09T18:14:10.236 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:10 +0000 (0:00:00.104) 0:05:16.730 ********** 2021-04-09T18:14:10.345 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-04-09T18:14:10.348 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:10.495 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:10 +0000 (0:00:00.235) 0:05:16.965 ********** 2021-04-09T18:14:10.568 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:10.846 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:10 +0000 (0:00:00.374) 0:05:17.340 ********** 2021-04-09T18:14:10.956 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:11.077 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:11 +0000 (0:00:00.230) 0:05:17.571 ********** 2021-04-09T18:14:11.235 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:11.455 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:11 +0000 (0:00:00.377) 0:05:17.948 ********** 2021-04-09T18:14:11.509 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-04-09T18:14:11.511 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:11.753 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:11 +0000 (0:00:00.298) 0:05:18.247 ********** 2021-04-09T18:14:11.783 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:12.045 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:12 +0000 (0:00:00.292) 0:05:18.539 ********** 2021-04-09T18:14:12.092 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:12.104 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-04-09T18:14:12.105 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:12.296 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:12 +0000 (0:00:00.250) 0:05:18.789 ********** 2021-04-09T18:14:12.375 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:12.639 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:12 +0000 (0:00:00.342) 0:05:19.132 ********** 2021-04-09T18:14:13.073 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-04-09T18:14:13.075 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:14:13.245 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:13 +0000 (0:00:00.607) 0:05:19.739 ********** 2021-04-09T18:14:13.364 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-04-09T18:14:13.527 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:13 +0000 (0:00:00.281) 0:05:20.020 ********** 2021-04-09T18:14:13.630 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-04-09T18:14:13.632 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'block_used': 13831462, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'size_total': 984369086464, 'block_total': 240324484, 'mount': '/', 'block_available': 226493022, 'size_available': 927715418112, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,seclabel,relatime,data=ordered', 'device': '/dev/sda1', 'inode_used': 90206, 'block_size': 4096, 'inode_available': 60964770}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226493022, "block_size": 4096, "block_total": 240324484, "block_used": 13831462, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60964770, "inode_total": 61054976, "inode_used": 90206, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 927715418112, "size_total": 984369086464, "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:13.935 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:13 +0000 (0:00:00.406) 0:05:20.427 ********** 2021-04-09T18:14:13.980 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'block_used': 13831453, 'uuid': '7884d11b-1a98-41be-b51a-86bec1e24d7d', 'size_total': 984369086464, 'block_total': 240324484, 'mount': '/', 'block_available': 226493031, 'size_available': 927715454976, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,seclabel,relatime,data=ordered', 'device': '/dev/sda1', 'inode_used': 90206, 'block_size': 4096, 'inode_available': 60964770}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226493031, "block_size": 4096, "block_total": 240324484, "block_used": 13831453, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60964770, "inode_total": 61054976, "inode_used": 90206, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 927715454976, "size_total": 984369086464, "uuid": "7884d11b-1a98-41be-b51a-86bec1e24d7d"}, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:14.205 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:14 +0000 (0:00:00.272) 0:05:20.699 ********** 2021-04-09T18:14:14.249 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:14.403 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:14 +0000 (0:00:00.197) 0:05:20.897 ********** 2021-04-09T18:14:14.477 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:14.672 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:14 +0000 (0:00:00.269) 0:05:21.166 ********** 2021-04-09T18:14:14.749 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:14:14.752 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:15.064 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:15 +0000 (0:00:00.391) 0:05:21.558 ********** 2021-04-09T18:14:15.220 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:15.585 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:15 +0000 (0:00:00.521) 0:05:22.080 ********** 2021-04-09T18:14:15.656 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:14:15.658 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:15.825 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:15 +0000 (0:00:00.239) 0:05:22.319 ********** 2021-04-09T18:14:15.894 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:16.097 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:16 +0000 (0:00:00.272) 0:05:22.591 ********** 2021-04-09T18:14:16.214 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-04-09T18:14:16.217 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:16.500 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:16 +0000 (0:00:00.403) 0:05:22.994 ********** 2021-04-09T18:14:16.565 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:16.692 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:16 +0000 (0:00:00.192) 0:05:23.187 ********** 2021-04-09T18:14:16.746 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-04-09T18:14:16.748 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:16.811 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:16 +0000 (0:00:00.118) 0:05:23.305 ********** 2021-04-09T18:14:16.947 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:17.122 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:17 +0000 (0:00:00.310) 0:05:23.615 ********** 2021-04-09T18:14:17.218 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-04-09T18:14:17.221 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:17.463 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:17 +0000 (0:00:00.342) 0:05:23.957 ********** 2021-04-09T18:14:17.547 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:17.747 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:17 +0000 (0:00:00.283) 0:05:24.241 ********** 2021-04-09T18:14:19.672 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-04-09T18:14:19.680 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-04-09T18:14:19.861 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:19 +0000 (0:00:02.114) 0:05:26.355 ********** 2021-04-09T18:14:20.037 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-04-09T18:14:20.249 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:20 +0000 (0:00:00.387) 0:05:26.743 ********** 2021-04-09T18:14:22.767 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:22.959 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:23.232 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:23.748 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:23.848 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:24.325 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:24.357 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:24.729 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:24.815 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:24.841 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:24 +0000 (0:00:04.591) 0:05:31.335 ********** 2021-04-09T18:14:25.130 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-04-09T18:14:25.287 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:25 +0000 (0:00:00.446) 0:05:31.781 ********** 2021-04-09T18:14:25.519 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-04-09T18:14:25.662 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:25 +0000 (0:00:00.374) 0:05:32.155 ********** 2021-04-09T18:14:25.871 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-04-09T18:14:25.962 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:25 +0000 (0:00:00.300) 0:05:32.456 ********** 2021-04-09T18:14:25.992 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:26.400 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:14:26.780 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:14:26.805 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:14:26.807 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:27.196 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:14:27.316 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:14:27.319 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:27.651 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:14:27.695 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:14:27.697 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:27.766 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:27.823 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:27 +0000 (0:00:01.861) 0:05:34.317 ********** 2021-04-09T18:14:28.102 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-04-09T18:14:28.168 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-04-09T18:14:28.169 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:28.228 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:28 +0000 (0:00:00.404) 0:05:34.722 ********** 2021-04-09T18:14:28.271 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-04-09T18:14:28.277 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:28.676 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:28 +0000 (0:00:00.448) 0:05:35.171 ********** 2021-04-09T18:14:28.752 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-04-09T18:14:28.755 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:29.048 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:29 +0000 (0:00:00.371) 0:05:35.542 ********** 2021-04-09T18:14:29.111 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-04-09T18:14:29.117 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:29.302 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:29 +0000 (0:00:00.254) 0:05:35.797 ********** 2021-04-09T18:14:29.307 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:29.531 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:29.533 INFO:teuthology.task.ansible.out:TASK [testnode : Mount filesystems] ******************************************** 2021-04-09T18:14:29.534 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:29.536 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:29.756 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:29 +0000 (0:00:00.453) 0:05:36.250 ********** 2021-04-09T18:14:29.767 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:29.823 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:29.838 INFO:teuthology.task.ansible.out:TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-04-09T18:14:29.841 INFO:teuthology.task.ansible.out: ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:14:29.843 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:30.087 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:30 +0000 (0:00:00.330) 0:05:36.581 ********** 2021-04-09T18:14:30.385 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:30.431 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:30 +0000 (0:00:00.341) 0:05:36.922 ********** 2021-04-09T18:14:30.521 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:30.523 INFO:teuthology.task.ansible.out:TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:14:30.581 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:30 +0000 (0:00:00.150) 0:05:37.072 ********** 2021-04-09T18:14:31.001 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:31.002 INFO:teuthology.task.ansible.out:TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:31.031 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:31 +0000 (0:00:00.452) 0:05:37.525 ********** 2021-04-09T18:14:33.604 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-04-09T18:14:33.607 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true} 2021-04-09T18:14:33.735 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:33 +0000 (0:00:02.704) 0:05:40.229 ********** 2021-04-09T18:14:33.820 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true} 2021-04-09T18:14:34.108 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:34 +0000 (0:00:00.372) 0:05:40.602 ********** 2021-04-09T18:14:36.891 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-04-09T18:14:36.894 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-04-09T18:14:36.974 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:36 +0000 (0:00:02.865) 0:05:43.468 ********** 2021-04-09T18:14:37.004 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-04-09T18:14:37.044 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:37 +0000 (0:00:00.070) 0:05:43.539 ********** 2021-04-09T18:14:37.092 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-04-09T18:14:37.094 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:37.233 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:37 +0000 (0:00:00.188) 0:05:43.727 ********** 2021-04-09T18:14:37.336 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:37.471 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:37 +0000 (0:00:00.237) 0:05:43.965 ********** 2021-04-09T18:14:37.587 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-04-09T18:14:37.589 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:37.679 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:37 +0000 (0:00:00.202) 0:05:44.167 ********** 2021-04-09T18:14:37.697 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:37.765 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:37 +0000 (0:00:00.089) 0:05:44.257 ********** 2021-04-09T18:14:37.975 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:14:37.977 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:38.009 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:38 +0000 (0:00:00.246) 0:05:44.503 ********** 2021-04-09T18:14:38.038 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:38.089 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:38 +0000 (0:00:00.080) 0:05:44.583 ********** 2021-04-09T18:14:38.120 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-04-09T18:14:38.123 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:38.183 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:38 +0000 (0:00:00.094) 0:05:44.678 ********** 2021-04-09T18:14:38.207 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:38.279 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:38 +0000 (0:00:00.095) 0:05:44.773 ********** 2021-04-09T18:14:38.329 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-04-09T18:14:38.331 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:38.364 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:38 +0000 (0:00:00.084) 0:05:44.858 ********** 2021-04-09T18:14:38.454 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:38.547 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:38 +0000 (0:00:00.182) 0:05:45.041 ********** 2021-04-09T18:14:38.572 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-04-09T18:14:38.574 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:38.633 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:38 +0000 (0:00:00.085) 0:05:45.127 ********** 2021-04-09T18:14:38.699 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:38.841 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:38 +0000 (0:00:00.208) 0:05:45.336 ********** 2021-04-09T18:14:38.896 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:38.938 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:38 +0000 (0:00:00.096) 0:05:45.432 ********** 2021-04-09T18:14:39.053 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:39.149 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:39 +0000 (0:00:00.209) 0:05:45.641 ********** 2021-04-09T18:14:39.187 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:39.272 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:39 +0000 (0:00:00.124) 0:05:45.766 ********** 2021-04-09T18:14:39.291 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:39.324 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:39 +0000 (0:00:00.051) 0:05:45.818 ********** 2021-04-09T18:14:39.498 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:39.500 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:39.568 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:39 +0000 (0:00:00.244) 0:05:46.063 ********** 2021-04-09T18:14:39.746 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:39 +0000 (0:00:00.177) 0:05:46.240 ********** 2021-04-09T18:14:39.858 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-04-09T18:14:39.860 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:39.992 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:39 +0000 (0:00:00.246) 0:05:46.486 ********** 2021-04-09T18:14:40.057 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:40.131 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:40 +0000 (0:00:00.138) 0:05:46.625 ********** 2021-04-09T18:14:40.237 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-04-09T18:14:40.242 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:40.353 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:40 +0000 (0:00:00.222) 0:05:46.847 ********** 2021-04-09T18:14:40.470 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:40.705 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:40 +0000 (0:00:00.352) 0:05:47.199 ********** 2021-04-09T18:14:40.707 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:41.511 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-04-09T18:14:41.513 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-29.el7_8.2.x86_64 providing ntp is already installed"]} 2021-04-09T18:14:41.600 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:41 +0000 (0:00:00.894) 0:05:48.094 ********** 2021-04-09T18:14:41.807 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-29.el7_8.2.x86_64 providing ntp is already installed"]} 2021-04-09T18:14:41.847 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:41 +0000 (0:00:00.247) 0:05:48.341 ********** 2021-04-09T18:14:41.885 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-04-09T18:14:41.887 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:42.019 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:42 +0000 (0:00:00.172) 0:05:48.513 ********** 2021-04-09T18:14:42.057 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:42.127 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:42 +0000 (0:00:00.105) 0:05:48.619 ********** 2021-04-09T18:14:42.195 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:42.348 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:42 +0000 (0:00:00.222) 0:05:48.842 ********** 2021-04-09T18:14:42.376 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:42.556 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:42 +0000 (0:00:00.208) 0:05:49.050 ********** 2021-04-09T18:14:43.503 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2021-04-09T18:14:43.531 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:43 +0000 (0:00:00.974) 0:05:50.025 ********** 2021-04-09T18:14:43.921 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-04-09T18:14:43.923 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:43.948 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:43 +0000 (0:00:00.414) 0:05:50.440 ********** 2021-04-09T18:14:44.004 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2021-04-09T18:14:44.115 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:44 +0000 (0:00:00.169) 0:05:50.609 ********** 2021-04-09T18:14:44.360 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-04-09T18:14:44.363 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:44.434 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:44 +0000 (0:00:00.319) 0:05:50.929 ********** 2021-04-09T18:14:44.666 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-04-09T18:14:44.668 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target -.mount ntpdate.service sntp.service tmp.mount system.slice systemd-journald.socket basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "Lim 2021-04-09T18:14:44.670 INFO:teuthology.task.ansible.out:itAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "Timeo 2021-04-09T18:14:44.672 INFO:teuthology.task.ansible.out:utStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:14:44.778 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:44 +0000 (0:00:00.343) 0:05:51.272 ********** 2021-04-09T18:14:45.156 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:14:45.158 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-04-09T18:14:45.240 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:45 +0000 (0:00:00.461) 0:05:51.734 ********** 2021-04-09T18:14:45.303 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-04-09T18:14:45.331 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice tmp.mount ntpdate.service systemd-journald.socket -.mount sntp.service syslog.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "Lim 2021-04-09T18:14:45.333 INFO:teuthology.task.ansible.out:itAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "Timeo 2021-04-09T18:14:45.335 INFO:teuthology.task.ansible.out:utStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-04-09T18:14:45.560 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:45 +0000 (0:00:00.320) 0:05:52.055 ********** 2021-04-09T18:14:45.620 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:14:45.622 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:45.776 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:45 +0000 (0:00:00.216) 0:05:52.271 ********** 2021-04-09T18:14:45.842 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:14:45.844 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-04-09T18:14:45.977 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:45 +0000 (0:00:00.190) 0:05:52.462 ********** 2021-04-09T18:14:46.277 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-04-09T18:14:46.280 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:46.365 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:46 +0000 (0:00:00.397) 0:05:52.859 ********** 2021-04-09T18:14:47.154 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-14.el7.noarch providing python-pip is already installed"]} 2021-04-09T18:14:47.328 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:47 +0000 (0:00:00.963) 0:05:53.822 ********** 2021-04-09T18:14:47.614 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:47.722 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:47 +0000 (0:00:00.389) 0:05:54.212 ********** 2021-04-09T18:14:47.850 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-04-09T18:14:47.852 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-14.el7.noarch providing python-pip is already installed"]} 2021-04-09T18:14:47.878 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:47 +0000 (0:00:00.159) 0:05:54.372 ********** 2021-04-09T18:14:47.937 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-04-09T18:14:47.945 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:48.222 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:48 +0000 (0:00:00.344) 0:05:54.716 ********** 2021-04-09T18:14:48.312 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-04-09T18:14:48.315 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:48.452 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:48 +0000 (0:00:00.229) 0:05:54.945 ********** 2021-04-09T18:14:48.499 INFO:teuthology.task.ansible.out: 2021-04-09T18:14:48.720 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:48.773 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:48 +0000 (0:00:00.322) 0:05:55.267 ********** 2021-04-09T18:14:49.101 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-04-09T18:14:49.103 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:14:49.159 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:49 +0000 (0:00:00.383) 0:05:55.651 ********** 2021-04-09T18:14:49.523 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-04-09T18:14:49.630 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:49 +0000 (0:00:00.472) 0:05:56.124 ********** 2021-04-09T18:14:50.563 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-04-09T18:14:50.565 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-04-09T18:14:50.662 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:50 +0000 (0:00:01.032) 0:05:57.156 ********** 2021-04-09T18:14:51.101 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-04-09T18:14:51.215 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:51 +0000 (0:00:00.553) 0:05:57.710 ********** 2021-04-09T18:14:55.159 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 21.0.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 21.0.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-04-09T18:14:55.248 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:55 +0000 (0:00:04.032) 0:06:01.742 ********** 2021-04-09T18:14:55.357 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 21.0.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 21.0.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-04-09T18:14:55.467 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:55 +0000 (0:00:00.218) 0:06:01.961 ********** 2021-04-09T18:14:55.546 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-04-09T18:14:55.547 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:55.627 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:55 +0000 (0:00:00.157) 0:06:02.118 ********** 2021-04-09T18:14:55.728 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:55.790 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:55 +0000 (0:00:00.166) 0:06:02.284 ********** 2021-04-09T18:14:55.842 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-04-09T18:14:55.844 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-04-09T18:14:55.989 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:55 +0000 (0:00:00.199) 0:06:02.484 ********** 2021-04-09T18:14:56.088 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-04-09T18:14:56.196 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:56 +0000 (0:00:00.206) 0:06:02.690 ********** 2021-04-09T18:14:56.474 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-04-09T18:14:56.600 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:56 +0000 (0:00:00.404) 0:06:03.094 ********** 2021-04-09T18:14:56.718 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-04-09T18:14:56.721 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:56.789 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:56 +0000 (0:00:00.186) 0:06:03.281 ********** 2021-04-09T18:14:56.848 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-04-09T18:14:56.994 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:56 +0000 (0:00:00.207) 0:06:03.488 ********** 2021-04-09T18:14:57.087 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-04-09T18:14:57.093 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-04-09T18:14:57.172 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:57 +0000 (0:00:00.177) 0:06:03.666 ********** 2021-04-09T18:14:57.245 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-04-09T18:14:57.247 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:57.357 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:57 +0000 (0:00:00.185) 0:06:03.852 ********** 2021-04-09T18:14:57.509 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-04-09T18:14:57.511 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:57.669 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:57 +0000 (0:00:00.311) 0:06:04.163 ********** 2021-04-09T18:14:57.700 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-04-09T18:14:57.702 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-04-09T18:14:57.806 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:57 +0000 (0:00:00.136) 0:06:04.300 ********** 2021-04-09T18:14:57.957 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-04-09T18:14:57.965 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:58.084 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:58 +0000 (0:00:00.277) 0:06:04.578 ********** 2021-04-09T18:14:58.221 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-04-09T18:14:58.223 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-04-09T18:14:58.298 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:58 +0000 (0:00:00.213) 0:06:04.792 ********** 2021-04-09T18:14:58.686 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-04-09T18:14:58.766 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:58 +0000 (0:00:00.468) 0:06:05.261 ********** 2021-04-09T18:14:58.838 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-04-09T18:14:58.840 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-04-09T18:14:58.957 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:58 +0000 (0:00:00.190) 0:06:05.451 ********** 2021-04-09T18:14:59.178 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-04-09T18:14:59.180 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:59.256 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:59 +0000 (0:00:00.298) 0:06:05.750 ********** 2021-04-09T18:14:59.419 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-04-09T18:14:59.421 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-04-09T18:14:59.447 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-04-09T18:14:59.463 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi120.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-04-09T18:14:59.552 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:59 +0000 (0:00:00.296) 0:06:06.046 ********** 2021-04-09T18:14:59.594 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-04-09T18:14:59.600 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-04-09T18:14:59.684 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:59 +0000 (0:00:00.131) 0:06:06.178 ********** 2021-04-09T18:14:59.716 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:59.889 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:14:59 +0000 (0:00:00.205) 0:06:06.384 ********** 2021-04-09T18:14:59.953 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-04-09T18:14:59.962 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:59.973 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:14:59.999 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:00.023 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:00.043 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:00.135 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:00 +0000 (0:00:00.245) 0:06:06.629 ********** 2021-04-09T18:15:00.319 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi120.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:00.475 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:00 +0000 (0:00:00.340) 0:06:06.969 ********** 2021-04-09T18:15:00.503 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-04-09T18:15:00.505 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi120.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-04-09T18:15:00.561 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-04-09T18:15:00.570 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-04-09T18:15:00.652 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:00 +0000 (0:00:00.176) 0:06:07.146 ********** 2021-04-09T18:15:00.688 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-04-09T18:15:00.690 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:00.809 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:00 +0000 (0:00:00.157) 0:06:07.303 ********** 2021-04-09T18:15:00.948 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-04-09T18:15:00.950 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:00.973 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:01.005 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:01.045 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:01.056 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:01.189 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:01 +0000 (0:00:00.379) 0:06:07.683 ********** 2021-04-09T18:15:01.250 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-04-09T18:15:01.252 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:01.475 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:01 +0000 (0:00:00.286) 0:06:07.970 ********** 2021-04-09T18:15:01.524 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:01.678 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:01 +0000 (0:00:00.201) 0:06:08.172 ********** 2021-04-09T18:15:01.784 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-04-09T18:15:01.792 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:01.913 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:01 +0000 (0:00:00.235) 0:06:08.407 ********** 2021-04-09T18:15:01.979 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-04-09T18:15:01.981 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:02.117 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:02 +0000 (0:00:00.200) 0:06:08.608 ********** 2021-04-09T18:15:02.202 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-04-09T18:15:02.204 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:02.371 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:02 +0000 (0:00:00.255) 0:06:08.864 ********** 2021-04-09T18:15:02.441 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-04-09T18:15:02.443 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:02.584 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:02 +0000 (0:00:00.214) 0:06:09.078 ********** 2021-04-09T18:15:02.619 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:15:02.621 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:02.817 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:02 +0000 (0:00:00.232) 0:06:09.312 ********** 2021-04-09T18:15:02.855 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:02.962 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:02 +0000 (0:00:00.144) 0:06:09.457 ********** 2021-04-09T18:15:03.120 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-04-09T18:15:03.123 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:03.198 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:03 +0000 (0:00:00.235) 0:06:09.692 ********** 2021-04-09T18:15:03.238 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-04-09T18:15:03.240 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:03.395 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:03 +0000 (0:00:00.196) 0:06:09.888 ********** 2021-04-09T18:15:03.410 INFO:teuthology.task.ansible.out: 2021-04-09T18:15:03.480 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:15:03.483 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:03.600 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:03 +0000 (0:00:00.205) 0:06:10.094 ********** 2021-04-09T18:15:03.607 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-04-09T18:15:03.648 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:03.804 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:03 +0000 (0:00:00.198) 0:06:10.293 ********** 2021-04-09T18:15:04.028 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-04-09T18:15:04.032 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:04.141 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:04 +0000 (0:00:00.342) 0:06:10.635 ********** 2021-04-09T18:15:04.262 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:15:04.264 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.007057", "end": "2021-04-09 18:15:04.076245", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-04-09 18:15:04.069188", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:04.329 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:04.353 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:04 +0000 (0:00:00.212) 0:06:10.848 ********** 2021-04-09T18:15:04.600 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-04-09T18:15:04.602 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003216", "end": "2021-04-09 18:15:04.529600", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-04-09 18:15:04.526384", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:04.874 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.006811", "end": "2021-04-09 18:15:04.777625", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-04-09 18:15:04.770814", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:05.014 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003065", "end": "2021-04-09 18:15:04.981787", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-04-09 18:15:04.978722", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:05.143 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003296", "end": "2021-04-09 18:15:05.117635", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-04-09 18:15:05.114339", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:05.500 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003060", "end": "2021-04-09 18:15:05.457715", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-04-09 18:15:05.454655", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:05.764 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027521", "end": "2021-04-09 18:15:05.486198", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-04-09 18:15:05.458677", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:05.815 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:05 +0000 (0:00:01.456) 0:06:12.304 ********** 2021-04-09T18:15:05.880 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.017450", "end": "2021-04-09 18:15:05.808661", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-04-09 18:15:05.791211", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:05.961 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:05 +0000 (0:00:00.151) 0:06:12.455 ********** 2021-04-09T18:15:05.986 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-04-09T18:15:06.086 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:06 +0000 (0:00:00.124) 0:06:12.580 ********** 2021-04-09T18:15:06.232 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:06 +0000 (0:00:00.145) 0:06:12.726 ********** 2021-04-09T18:15:06.736 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-04-09T18:15:06.972 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-04-09T18:15:07.387 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-04-09T18:15:07.620 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:07 +0000 (0:00:01.387) 0:06:14.114 ********** 2021-04-09T18:15:07.843 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:07 +0000 (0:00:00.222) 0:06:14.336 ********** 2021-04-09T18:15:08.886 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-04-09T18:15:08.888 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] 2021-04-09T18:15:09.103 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] 2021-04-09T18:15:09.278 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:09 +0000 (0:00:01.435) 0:06:15.772 ********** 2021-04-09T18:15:09.470 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:09 +0000 (0:00:00.191) 0:06:15.963 ********** 2021-04-09T18:15:09.555 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:15:09.558 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:09.720 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:09 +0000 (0:00:00.251) 0:06:16.214 ********** 2021-04-09T18:15:09.762 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:09.918 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:09 +0000 (0:00:00.197) 0:06:16.412 ********** 2021-04-09T18:15:09.997 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:15:10.002 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-04-09T18:15:10.030 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:10 +0000 (0:00:00.111) 0:06:16.524 ********** 2021-04-09T18:15:10.381 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-04-09T18:15:10.415 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:10 +0000 (0:00:00.385) 0:06:16.909 ********** 2021-04-09T18:15:10.640 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-04-09T18:15:10.641 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-04-09T18:15:10.670 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:10 +0000 (0:00:00.255) 0:06:17.164 ********** 2021-04-09T18:15:10.965 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-04-09T18:15:11.007 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:11 +0000 (0:00:00.337) 0:06:17.501 ********** 2021-04-09T18:15:16.781 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-04-09T18:15:16.789 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing podman are up to date", "All packages providing podman-docker are up to date", ""]} 2021-04-09T18:15:16.804 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:16 +0000 (0:00:05.796) 0:06:23.298 ********** 2021-04-09T18:15:17.003 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:15:17.005 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-04-09T18:15:17.108 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:17 +0000 (0:00:00.304) 0:06:23.602 ********** 2021-04-09T18:15:17.184 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-04-09T18:15:17.186 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing podman are up to date", "All packages providing podman-docker are up to date", ""]} 2021-04-09T18:15:17.310 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:17 +0000 (0:00:00.201) 0:06:23.804 ********** 2021-04-09T18:15:17.348 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:15:17.350 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:17.528 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:17 +0000 (0:00:00.218) 0:06:24.022 ********** 2021-04-09T18:15:17.588 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:15:17.590 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-04-09T18:15:17.769 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:17 +0000 (0:00:00.240) 0:06:24.263 ********** 2021-04-09T18:15:18.036 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-04-09T18:15:18.038 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:18.080 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:18 +0000 (0:00:00.311) 0:06:24.575 ********** 2021-04-09T18:15:18.144 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-04-09T18:15:18.152 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:cert_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:15:18.621 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:cert_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:15:18.623 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:15:18.747 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:18 +0000 (0:00:00.666) 0:06:25.241 ********** 2021-04-09T18:15:19.053 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-04-09T18:15:19.123 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:19 +0000 (0:00:00.356) 0:06:25.598 ********** 2021-04-09T18:15:20.429 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-04-09T18:15:20.431 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-04-09T18:15:21.050 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-04-09T18:15:21.435 INFO:teuthology.task.ansible.out:ok: [smithi120.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-04-09T18:15:21.533 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:21 +0000 (0:00:02.428) 0:06:28.027 ********** 2021-04-09T18:15:22.212 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-04-09T18:15:22.250 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:22 +0000 (0:00:00.716) 0:06:28.744 ********** 2021-04-09T18:15:24.159 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** ok: [smithi120.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "You are using pip version 8.1.2, however version 21.0.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 21.0.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-jKGO3D-build\nRequirement already up-to-date: toml in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: typing in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-jKGO3D-build", "Requirement already up-to-date: toml in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)", "Requirem 2021-04-09T18:15:24.161 INFO:teuthology.task.ansible.out:ent already up-to-date: typing in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-04-09T18:15:24.246 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:24 +0000 (0:00:01.995) 0:06:30.740 ********** 2021-04-09T18:15:24.473 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-04-09T18:15:24.479 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:24.608 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:24 +0000 (0:00:00.361) 0:06:31.102 ********** 2021-04-09T18:15:24.774 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-04-09T18:15:24.776 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:24.865 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:24 +0000 (0:00:00.257) 0:06:31.359 ********** 2021-04-09T18:15:25.106 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-04-09T18:15:25.108 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "You are using pip version 8.1.2, however version 21.0.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 21.0.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-A57yxz-build\nRequirement already up-to-date: toml in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: typing in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-A57yxz-build", "Requirement already up-to-date: toml in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/lib/python2.7/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: typing in /usr/lib/python2.7/site-packages (from registries- 2021-04-09T18:15:25.110 INFO:teuthology.task.ansible.out:conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-04-09T18:15:25.199 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:25 +0000 (0:00:00.333) 0:06:31.693 ********** 2021-04-09T18:15:25.492 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-04-09T18:15:25.494 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:25.536 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:25 +0000 (0:00:00.337) 0:06:32.030 ********** 2021-04-09T18:15:25.792 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-04-09T18:15:25.794 INFO:teuthology.task.ansible.out:changed: [smithi120.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.102244", "end": "2021-04-09 18:15:25.752269", "rc": 0, "start": "2021-04-09 18:15:25.650025", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:25.850 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:25 +0000 (0:00:00.314) 0:06:32.344 ********** 2021-04-09T18:15:25.924 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-04-09T18:15:25.946 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:26.080 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:26 +0000 (0:00:00.229) 0:06:32.574 ********** 2021-04-09T18:15:26.187 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-04-09T18:15:26.190 INFO:teuthology.task.ansible.out:skipping: [smithi120.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:26.789 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-04-09T18:15:26.791 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.161546", "end": "2021-04-09 18:15:26.741604", "rc": 0, "start": "2021-04-09 18:15:26.580058", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-04-09T18:15:26.849 INFO:teuthology.task.ansible.out:Friday 09 April 2021 18:15:26 +0000 (0:00:00.768) 0:06:33.343 ********** 2021-04-09T18:15:27.065 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-04-09T18:15:27.428 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-04-09T18:15:27.435 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-04-09T18:15:27.445 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2021-04-09T18:15:27.452 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2021-04-09T18:15:27.454 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi120.front.sepia.ceph.com : ok=136 changed=35 unreachable=0 failed=0 skipped=176 rescued=0 ignored=4 smithi134.front.sepia.ceph.com : ok=136 changed=35 unreachable=0 failed=0 skipped=176 rescued=0 ignored=4 Friday 09 April 2021 18:15:27 +0000 (0:00:00.603) 0:06:33.946 ********** =============================================================================== 2021-04-09T18:15:27.576 INFO:teuthology.task.ansible.out:common : Make sure smartmontools is installed -------------------------- 33.47s testnode : Install packages -------------------------------------------- 21.06s testnode : Ensure ceph packages are not present. ----------------------- 11.30s testnode : Zap all non-root disks -------------------------------------- 10.31s common : nrpe - Remove SELinux policy package --------------------------- 8.21s common : nrpe - Load SELinux policy package ----------------------------- 7.98s common : Register with subscription-manager. ---------------------------- 6.42s common : nrpe - Ensure SELinux policy is up to date --------------------- 6.04s container-host : Install container packages ----------------------------- 5.80s testnode : Ensure ceph dependency packages are not present. ------------- 5.78s testnode : Install epel packages ---------------------------------------- 5.39s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 4.73s testnode : Create logical volume(s) ------------------------------------- 4.59s testnode : Blow away lingering OSD data and FSIDs ----------------------- 4.34s testnode : Install packages via pip ------------------------------------- 4.03s testnode : Enable SELinux ----------------------------------------------- 3.76s testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph --------------------- 2.87s testnode : Create xfs filesystem on /dev/vg_nvme/lv_5 ------------------- 2.70s container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 2.41s testnode : Rebuild rpmdb ------------------------------------------------ 2.21s 2021-04-09T18:15:30.621 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2021-04-09T18:15:30.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:15:30.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:15:30.762 DEBUG:teuthology.orchestra.run.smithi120:> true 2021-04-09T18:15:31.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T18:15:31.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T18:15:31.180 DEBUG:teuthology.orchestra.run.smithi134:> true 2021-04-09T18:15:31.416 INFO:teuthology.run_tasks:Running task clock... 2021-04-09T18:15:31.468 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-04-09T18:15:31.469 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-04-09T18:15:31.501 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-04-09T18:15:31.571 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-04-09T18:15:38.617 INFO:teuthology.orchestra.run.smithi120.stdout:ntpd: time slew -0.000425s 2021-04-09T18:15:38.635 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit not found. 2021-04-09T18:15:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2021-04-09T18:15:38.679 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2021-04-09T18:15:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:15:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:15:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:15:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:15:38.681 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-04-09T18:15:38.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-04-09T18:15:38.756 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-04-09T18:15:45.806 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew -0.000759s 2021-04-09T18:15:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit not found. 2021-04-09T18:15:45.887 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2021-04-09T18:15:45.888 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2021-04-09T18:15:45.888 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:15:45.888 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:15:45.889 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:15:45.889 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-04-09T18:15:45.889 INFO:teuthology.run_tasks:Running task install... 2021-04-09T18:15:45.898 DEBUG:teuthology.task.install:project ceph 2021-04-09T18:15:45.907 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}} 2021-04-09T18:15:45.908 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'} 2021-04-09T18:15:45.908 INFO:teuthology.task.install:Using flavor: basic 2021-04-09T18:15:45.998 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2021-04-09T18:15:46.006 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-04-09T18:15:46.007 DEBUG:teuthology.orchestra.run.smithi120:> sudo lsb_release -is 2021-04-09T18:15:46.134 INFO:teuthology.orchestra.run.smithi120.stdout:RedHatEnterpriseServer 2021-04-09T18:15:46.136 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2021-04-09T18:15:46.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2021-04-09T18:15:46.138 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b', 'tag': None, 'wait_for_package': False} 2021-04-09T18:15:46.142 DEBUG:teuthology.orchestra.run.smithi120:> sudo lsb_release -is 2021-04-09T18:15:46.213 INFO:teuthology.orchestra.run.smithi120.stdout:RedHatEnterpriseServer 2021-04-09T18:15:46.215 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2021-04-09T18:15:46.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:15:46.233 INFO:teuthology.orchestra.run.smithi134.stdout:RedHatEnterpriseServer 2021-04-09T18:15:46.233 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2021-04-09T18:15:46.234 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b', 'tag': None, 'wait_for_package': False} 2021-04-09T18:15:46.234 DEBUG:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2021-04-09T18:15:46.413 INFO:teuthology.orchestra.run.smithi134.stdout:RedHatEnterpriseServer 2021-04-09T18:15:46.428 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2021-04-09T18:15:46.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:15:46.645 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/centos/7/flavors/default/ 2021-04-09T18:15:46.645 INFO:teuthology.task.install.rpm:Package version is 14.2.19-116.gd23cd2d5 2021-04-09T18:15:46.908 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/centos/7/flavors/default/ 2021-04-09T18:15:46.909 INFO:teuthology.task.install.rpm:Package version is 14.2.19-116.gd23cd2d5 2021-04-09T18:15:46.958 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/centos/7/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/centos/7/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/centos/7/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-04-09T18:15:46.959 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2021-04-09T18:15:47.043 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-04-09T18:15:47.144 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel on remote rpm x86_64 2021-04-09T18:15:47.154 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d23cd2d5f486487b0b80655c4e33344f0f97b82b/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-04-09T18:15:47.190 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/centos/7/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/centos/7/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2021-04-09-0846-nautilus/d23cd2d5f486487b0b80655c4e33344f0f97b82b/centos/7/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-04-09T18:15:47.191 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-04-09T18:15:47.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-04-09T18:15:47.254 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-04-09T18:15:47.258 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel on remote rpm x86_64 2021-04-09T18:15:47.258 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d23cd2d5f486487b0b80655c4e33344f0f97b82b/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-04-09T18:15:47.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-04-09T18:15:47.372 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-04-09T18:15:47.418 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-04-09T18:15:47.430 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2021-04-09T18:15:47.431 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2021-04-09T18:15:47.474 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2021-04-09T18:15:47.476 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2021-04-09T18:15:47.652 INFO:teuthology.orchestra.run.smithi120.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T18:15:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: : disabled-repos, subscription-manager 2021-04-09T18:15:47.675 INFO:teuthology.orchestra.run.smithi134.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T18:15:47.701 INFO:teuthology.orchestra.run.smithi134.stdout: : disabled-repos, subscription-manager 2021-04-09T18:15:47.976 INFO:teuthology.orchestra.run.smithi120.stdout:Cleaning repos: ceph ceph-noarch ceph-source epel lab-extras rhel-7-fcgi-ceph 2021-04-09T18:15:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: : rhel-7-server-extras-rpms rhel-7-server-optional-rpms 2021-04-09T18:15:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: : rhel-7-server-rpms rhel-ha-for-rhel-7-server-rpms 2021-04-09T18:15:47.999 INFO:teuthology.orchestra.run.smithi134.stdout:Cleaning repos: ceph ceph-noarch ceph-source epel lab-extras rhel-7-fcgi-ceph 2021-04-09T18:15:47.999 INFO:teuthology.orchestra.run.smithi134.stdout: : rhel-7-server-extras-rpms rhel-7-server-optional-rpms 2021-04-09T18:15:48.000 INFO:teuthology.orchestra.run.smithi134.stdout: : rhel-7-server-rpms rhel-ha-for-rhel-7-server-rpms 2021-04-09T18:15:48.160 INFO:teuthology.orchestra.run.smithi120.stdout:Cleaning up list of fastest mirrors 2021-04-09T18:15:48.178 INFO:teuthology.orchestra.run.smithi134.stdout:Cleaning up list of fastest mirrors 2021-04-09T18:15:48.179 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-ssh ceph-fuse libcephfs2 libcephfs-devel librados2 librbd1 python-ceph rbd-fuse python3-cephfs bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel 2021-04-09T18:15:48.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-ssh ceph-fuse libcephfs2 libcephfs-devel librados2 librbd1 python-ceph rbd-fuse python3-cephfs bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel 2021-04-09T18:15:48.378 INFO:teuthology.orchestra.run.smithi120.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T18:15:48.379 INFO:teuthology.orchestra.run.smithi120.stdout: : disabled-repos, subscription-manager 2021-04-09T18:15:48.385 INFO:teuthology.orchestra.run.smithi134.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T18:15:48.385 INFO:teuthology.orchestra.run.smithi134.stdout: : disabled-repos, subscription-manager 2021-04-09T18:15:48.717 INFO:teuthology.orchestra.run.smithi134.stdout:Determining fastest mirrors 2021-04-09T18:15:48.731 INFO:teuthology.orchestra.run.smithi120.stdout:Determining fastest mirrors 2021-04-09T18:15:48.810 INFO:teuthology.orchestra.run.smithi134.stdout: * epel: download-cc-rdu01.fedoraproject.org 2021-04-09T18:15:48.830 INFO:teuthology.orchestra.run.smithi120.stdout: * epel: download-cc-rdu01.fedoraproject.org 2021-04-09T18:16:21.964 INFO:teuthology.orchestra.run.smithi120.stdout:29 packages excluded due to repository priority protections 2021-04-09T18:16:22.272 INFO:teuthology.orchestra.run.smithi134.stdout:29 packages excluded due to repository priority protections 2021-04-09T18:16:48.584 INFO:teuthology.orchestra.run.smithi120.stdout:Resolving Dependencies 2021-04-09T18:16:48.585 INFO:teuthology.orchestra.run.smithi120.stdout:--> Running transaction check 2021-04-09T18:16:48.585 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package bison.x86_64 0:3.0.4-2.el7 will be installed 2021-04-09T18:16:48.592 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.594 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: ceph-osd = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.595 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: ceph-mds = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.596 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: ceph-mon = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.598 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-fuse.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.608 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-mgr.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.610 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: ceph-base = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.612 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.616 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.617 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.618 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.624 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.625 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-mgr-dashboard.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.625 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-mgr-dashboard-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:48.625 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:48.626 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.641 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.642 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:48.724 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-mgr-rook.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.725 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:48.744 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-mgr-ssh.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.744 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:48.745 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-radosgw.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.751 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: librgw2 = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.751 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: ceph-selinux = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.752 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.757 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.758 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-test.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.758 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: ceph-common = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.758 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: jq for package: 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.758 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: socat for package: 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.759 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.759 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package elfutils-libelf-devel.x86_64 0:0.176-5.el7 will be installed 2021-04-09T18:16:48.759 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.176-5.el7.x86_64 2021-04-09T18:16:48.759 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package flex.x86_64 0:2.5.37-6.el7 will be installed 2021-04-09T18:16:48.760 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package libcephfs-devel.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.760 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: librados-devel = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:libcephfs-devel-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.774 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package libcephfs2.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.774 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2021-04-09T18:16:48.775 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package librados2.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be an update 2021-04-09T18:16:48.775 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.775 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2021-04-09T18:16:48.776 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package librbd1.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be an update 2021-04-09T18:16:48.776 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package openssl-devel.x86_64 1:1.0.2k-21.el7_9 will be installed 2021-04-09T18:16:48.776 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: openssl-libs(x86-64) = 1:1.0.2k-21.el7_9 for package: 1:openssl-devel-1.0.2k-21.el7_9.x86_64 2021-04-09T18:16:48.793 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: krb5-devel(x86-64) for package: 1:openssl-devel-1.0.2k-21.el7_9.x86_64 2021-04-09T18:16:48.794 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-ceph-compat.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.795 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-cephfs = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.796 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-rgw = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.796 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-rbd = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.796 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-rados = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.796 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python3-cephfs.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.797 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python3-ceph-argparse = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python3-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.797 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python3-rados = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python3-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.797 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package rbd-fuse.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.797 INFO:teuthology.orchestra.run.smithi120.stdout:--> Running transaction check 2021-04-09T18:16:48.797 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-base.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.798 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-common.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.798 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-ceph-argparse = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.798 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.798 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.799 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.856 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:48.856 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-grafana-dashboards.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.856 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-mds.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.857 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-mon.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.864 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-osd.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.864 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package ceph-selinux.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:48.864 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package jq.x86_64 0:1.6-2.el7 will be installed 2021-04-09T18:16:48.864 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libonig.so.5()(64bit) for package: jq-1.6-2.el7.x86_64 2021-04-09T18:16:48.869 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package krb5-devel.x86_64 0:1.15.1-50.el7 will be installed 2021-04-09T18:16:48.869 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libverto-devel for package: krb5-devel-1.15.1-50.el7.x86_64 2021-04-09T18:16:48.869 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libselinux-devel for package: krb5-devel-1.15.1-50.el7.x86_64 2021-04-09T18:16:49.010 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.15.1-50.el7.x86_64 2021-04-09T18:16:49.037 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.15.1-50.el7.x86_64 2021-04-09T18:16:49.037 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2021-04-09T18:16:49.038 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package librabbitmq.x86_64 0:0.8.0-3.el7 will be installed 2021-04-09T18:16:49.038 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package librados-devel.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.050 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package libradosstriper1.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.050 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package librgw2.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.050 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2021-04-09T18:16:49.051 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2021-04-09T18:16:49.051 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2021-04-09T18:16:49.052 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package openssl-libs.x86_64 1:1.0.2k-19.el7 will be updated 2021-04-09T18:16:49.052 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: openssl-libs(x86-64) = 1:1.0.2k-19.el7 for package: 1:openssl-1.0.2k-19.el7.x86_64 2021-04-09T18:16:49.083 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package openssl-libs.x86_64 1:1.0.2k-21.el7_9 will be an update 2021-04-09T18:16:49.084 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-cephfs.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.084 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2021-04-09T18:16:49.094 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2021-04-09T18:16:49.095 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:49.102 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:49.105 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:49.105 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:49.117 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:49.118 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-rados.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.118 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-rbd.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.119 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-requests.noarch 0:2.6.0-10.el7 will be installed 2021-04-09T18:16:49.119 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-10.el7.noarch 2021-04-09T18:16:49.119 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-rgw.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.119 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2021-04-09T18:16:49.120 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2021-04-09T18:16:49.120 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2021-04-09T18:16:49.120 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2021-04-09T18:16:49.120 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2021-04-09T18:16:49.120 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-kubernetes.noarch 1:11.0.0-6.el7 will be installed 2021-04-09T18:16:49.121 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-certifi for package: 1:python2-kubernetes-11.0.0-6.el7.noarch 2021-04-09T18:16:49.121 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-google-auth for package: 1:python2-kubernetes-11.0.0-6.el7.noarch 2021-04-09T18:16:49.121 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-requests-oauthlib for package: 1:python2-kubernetes-11.0.0-6.el7.noarch 2021-04-09T18:16:49.121 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-websocket-client for package: 1:python2-kubernetes-11.0.0-6.el7.noarch 2021-04-09T18:16:49.122 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-remoto.noarch 0:1.0.0-1.el7 will be installed 2021-04-09T18:16:49.122 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python2-execnet >= 1.2.0 for package: python2-remoto-1.0.0-1.el7.noarch 2021-04-09T18:16:49.122 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python3-ceph-argparse.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.122 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python3-rados.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.122 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2021-04-09T18:16:49.123 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2021-04-09T18:16:49.155 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2021-04-09T18:16:49.155 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2021-04-09T18:16:49.164 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2021-04-09T18:16:49.164 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package zlib-devel.x86_64 0:1.2.7-19.el7_9 will be installed 2021-04-09T18:16:49.170 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: zlib = 1.2.7-19.el7_9 for package: zlib-devel-1.2.7-19.el7_9.x86_64 2021-04-09T18:16:49.170 INFO:teuthology.orchestra.run.smithi120.stdout:--> Running transaction check 2021-04-09T18:16:49.170 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package keyutils-libs-devel.x86_64 0:1.5.8-3.el7 will be installed 2021-04-09T18:16:49.171 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2021-04-09T18:16:49.174 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package libcom_err-devel.x86_64 0:1.42.9-19.el7 will be installed 2021-04-09T18:16:49.174 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2021-04-09T18:16:49.175 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package libselinux-devel.x86_64 0:2.5-15.el7 will be installed 2021-04-09T18:16:49.175 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libsepol-devel(x86-64) >= 2.5-10 for package: libselinux-devel-2.5-15.el7.x86_64 2021-04-09T18:16:49.175 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.5-15.el7.x86_64 2021-04-09T18:16:49.175 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: pkgconfig(libpcre) for package: libselinux-devel-2.5-15.el7.x86_64 2021-04-09T18:16:49.175 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package libverto-devel.x86_64 0:0.2.5-4.el7 will be installed 2021-04-09T18:16:49.176 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2021-04-09T18:16:49.176 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package oniguruma.x86_64 0:6.8.2-1.el7 will be installed 2021-04-09T18:16:49.216 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package openssl.x86_64 1:1.0.2k-19.el7 will be updated 2021-04-09T18:16:49.217 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package openssl.x86_64 1:1.0.2k-21.el7_9 will be an update 2021-04-09T18:16:49.217 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-ceph-argparse.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:49.217 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-execnet.noarch 0:1.7.1-3.el7 will be installed 2021-04-09T18:16:49.218 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-apipkg for package: python-execnet-1.7.1-3.el7.noarch 2021-04-09T18:16:49.218 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2021-04-09T18:16:49.219 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2021-04-09T18:16:49.219 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2021-04-09T18:16:49.219 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2021-04-09T18:16:49.220 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2021-04-09T18:16:49.220 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2021-04-09T18:16:49.221 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2021-04-09T18:16:49.221 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2021-04-09T18:16:49.222 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2021-04-09T18:16:49.222 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2021-04-09T18:16:49.222 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2021-04-09T18:16:49.223 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2021-04-09T18:16:49.262 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2021-04-09T18:16:49.262 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2021-04-09T18:16:49.266 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2021-04-09T18:16:49.266 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2021-04-09T18:16:49.284 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2021-04-09T18:16:49.284 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2021-04-09T18:16:49.303 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2021-04-09T18:16:49.304 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2021-04-09T18:16:49.304 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2021-04-09T18:16:49.305 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2021-04-09T18:16:49.305 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2021-04-09T18:16:49.305 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package zlib.x86_64 0:1.2.7-18.el7 will be updated 2021-04-09T18:16:49.306 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package zlib.x86_64 0:1.2.7-19.el7_9 will be an update 2021-04-09T18:16:49.306 INFO:teuthology.orchestra.run.smithi120.stdout:--> Running transaction check 2021-04-09T18:16:49.306 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package libsepol-devel.x86_64 0:2.5-10.el7 will be installed 2021-04-09T18:16:49.307 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package pcre-devel.x86_64 0:8.32-17.el7 will be installed 2021-04-09T18:16:49.335 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2021-04-09T18:16:49.336 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2021-04-09T18:16:49.336 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2021-04-09T18:16:49.337 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2021-04-09T18:16:49.337 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-apipkg.noarch 0:1.5-5.el7 will be installed 2021-04-09T18:16:49.338 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2021-04-09T18:16:49.338 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2021-04-09T18:16:49.338 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2021-04-09T18:16:49.339 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python2-rsa.noarch 0:3.4.2-2.el7 will be installed 2021-04-09T18:16:49.365 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2021-04-09T18:16:49.365 INFO:teuthology.orchestra.run.smithi120.stdout:--> Running transaction check 2021-04-09T18:16:49.366 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2021-04-09T18:16:49.366 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2021-04-09T18:16:49.374 INFO:teuthology.orchestra.run.smithi120.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2021-04-09T18:16:49.379 INFO:teuthology.orchestra.run.smithi120.stdout:--> Running transaction check 2021-04-09T18:16:49.379 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2021-04-09T18:16:49.636 INFO:teuthology.orchestra.run.smithi120.stdout:--> Finished Dependency Resolution 2021-04-09T18:16:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:16:49.720 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies Resolved 2021-04-09T18:16:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:16:49.733 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2021-04-09T18:16:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2021-04-09T18:16:49.734 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2021-04-09T18:16:49.734 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2021-04-09T18:16:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: bison x86_64 3.0.4-2.el7 rhel-7-server-rpms 674 k 2021-04-09T18:16:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 2.0 k 2021-04-09T18:16:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 572 k 2021-04-09T18:16:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 1.8 M 2021-04-09T18:16:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 3.9 M 2021-04-09T18:16:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-cloud 2021-04-09T18:16:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 83 k 2021-04-09T18:16:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local 2021-04-09T18:16:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 1.1 M 2021-04-09T18:16:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 21 k 2021-04-09T18:16:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-ssh noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 21 k 2021-04-09T18:16:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 5.9 M 2021-04-09T18:16:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 34 M 2021-04-09T18:16:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel 2021-04-09T18:16:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: x86_64 0.176-5.el7 rhel-7-server-rpms 40 k 2021-04-09T18:16:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: flex x86_64 2.5.37-6.el7 rhel-7-server-rpms 293 k 2021-04-09T18:16:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 17 k 2021-04-09T18:16:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 500 k 2021-04-09T18:16:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel x86_64 1:1.0.2k-21.el7_9 rhel-7-server-rpms 1.5 M 2021-04-09T18:16:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: python-ceph-compat x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 2.2 k 2021-04-09T18:16:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 151 k 2021-04-09T18:16:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 69 k 2021-04-09T18:16:49.745 INFO:teuthology.orchestra.run.smithi120.stdout:Updating: 2021-04-09T18:16:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 3.4 M 2021-04-09T18:16:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 1.7 M 2021-04-09T18:16:49.745 INFO:teuthology.orchestra.run.smithi120.stdout:Installing for dependencies: 2021-04-09T18:16:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 5.5 M 2021-04-09T18:16:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 19 M 2021-04-09T18:16:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards 2021-04-09T18:16:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 19 k 2021-04-09T18:16:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 1.9 M 2021-04-09T18:16:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 4.3 M 2021-04-09T18:16:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 16 M 2021-04-09T18:16:49.788 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 20 k 2021-04-09T18:16:49.788 INFO:teuthology.orchestra.run.smithi120.stdout: jq x86_64 1.6-2.el7 epel 167 k 2021-04-09T18:16:49.793 INFO:teuthology.orchestra.run.smithi120.stdout: keyutils-libs-devel 2021-04-09T18:16:49.793 INFO:teuthology.orchestra.run.smithi120.stdout: x86_64 1.5.8-3.el7 rhel-7-server-rpms 37 k 2021-04-09T18:16:49.793 INFO:teuthology.orchestra.run.smithi120.stdout: krb5-devel x86_64 1.15.1-50.el7 rhel-7-server-rpms 273 k 2021-04-09T18:16:49.793 INFO:teuthology.orchestra.run.smithi120.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2021-04-09T18:16:49.794 INFO:teuthology.orchestra.run.smithi120.stdout: libcom_err-devel x86_64 1.42.9-19.el7 rhel-7-server-rpms 32 k 2021-04-09T18:16:49.794 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2021-04-09T18:16:49.794 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.8.0-3.el7 rhel-7-server-rpms 37 k 2021-04-09T18:16:49.794 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 86 k 2021-04-09T18:16:49.794 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 364 k 2021-04-09T18:16:49.795 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2021-04-09T18:16:49.795 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 5.2 M 2021-04-09T18:16:49.795 INFO:teuthology.orchestra.run.smithi120.stdout: libselinux-devel x86_64 2.5-15.el7 rhel-7-server-rpms 187 k 2021-04-09T18:16:49.795 INFO:teuthology.orchestra.run.smithi120.stdout: libsepol-devel x86_64 2.5-10.el7 rhel-7-server-rpms 77 k 2021-04-09T18:16:49.799 INFO:teuthology.orchestra.run.smithi120.stdout: libverto-devel x86_64 0.2.5-4.el7 rhel-7-server-rpms 12 k 2021-04-09T18:16:49.800 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2021-04-09T18:16:49.800 INFO:teuthology.orchestra.run.smithi120.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 rhel-7-server-rpms 206 k 2021-04-09T18:16:49.807 INFO:teuthology.orchestra.run.smithi120.stdout: oniguruma x86_64 6.8.2-1.el7 epel 181 k 2021-04-09T18:16:49.807 INFO:teuthology.orchestra.run.smithi120.stdout: pcre-devel x86_64 8.32-17.el7 rhel-7-server-rpms 480 k 2021-04-09T18:16:49.808 INFO:teuthology.orchestra.run.smithi120.stdout: python-beaker noarch 1.5.4-10.el7 rhel-7-server-rpms 80 k 2021-04-09T18:16:49.808 INFO:teuthology.orchestra.run.smithi120.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2021-04-09T18:16:49.808 INFO:teuthology.orchestra.run.smithi120.stdout: python-ceph-argparse 2021-04-09T18:16:49.808 INFO:teuthology.orchestra.run.smithi120.stdout: x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 35 k 2021-04-09T18:16:49.809 INFO:teuthology.orchestra.run.smithi120.stdout: python-cephfs x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 113 k 2021-04-09T18:16:49.809 INFO:teuthology.orchestra.run.smithi120.stdout: python-cherrypy noarch 3.2.2-4.el7 rhel-7-server-rpms 422 k 2021-04-09T18:16:49.809 INFO:teuthology.orchestra.run.smithi120.stdout: python-execnet noarch 1.7.1-3.el7 epel 260 k 2021-04-09T18:16:49.809 INFO:teuthology.orchestra.run.smithi120.stdout: python-jwcrypto noarch 0.4.2-1.el7 rhel-7-server-rpms 57 k 2021-04-09T18:16:49.821 INFO:teuthology.orchestra.run.smithi120.stdout: python-mako noarch 0.8.1-2.el7 rhel-7-server-rpms 307 k 2021-04-09T18:16:49.822 INFO:teuthology.orchestra.run.smithi120.stdout: python-markupsafe x86_64 0.11-10.el7 rhel-7-server-rpms 25 k 2021-04-09T18:16:49.822 INFO:teuthology.orchestra.run.smithi120.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 2021-04-09T18:16:49.822 INFO:teuthology.orchestra.run.smithi120.stdout: rhel-7-server-rpms 866 k 2021-04-09T18:16:49.822 INFO:teuthology.orchestra.run.smithi120.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2021-04-09T18:16:49.822 INFO:teuthology.orchestra.run.smithi120.stdout: python-prettytable noarch 0.7.2-3.el7 rhel-7-server-rpms 37 k 2021-04-09T18:16:49.823 INFO:teuthology.orchestra.run.smithi120.stdout: python-rados x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 199 k 2021-04-09T18:16:49.823 INFO:teuthology.orchestra.run.smithi120.stdout: python-rbd x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 194 k 2021-04-09T18:16:49.823 INFO:teuthology.orchestra.run.smithi120.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2021-04-09T18:16:49.823 INFO:teuthology.orchestra.run.smithi120.stdout: python-requests noarch 2.6.0-10.el7 rhel-7-server-rpms 95 k 2021-04-09T18:16:49.824 INFO:teuthology.orchestra.run.smithi120.stdout: python-rgw x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 77 k 2021-04-09T18:16:49.824 INFO:teuthology.orchestra.run.smithi120.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2021-04-09T18:16:49.824 INFO:teuthology.orchestra.run.smithi120.stdout: python-simplegeneric 2021-04-09T18:16:49.824 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 0.8-7.el7 epel 12 k 2021-04-09T18:16:49.834 INFO:teuthology.orchestra.run.smithi120.stdout: python-singledispatch 2021-04-09T18:16:49.834 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 3.4.0.2-2.el7 epel 18 k 2021-04-09T18:16:49.834 INFO:teuthology.orchestra.run.smithi120.stdout: python-tempita noarch 0.5.1-6.el7 rhel-7-server-rpms 33 k 2021-04-09T18:16:49.834 INFO:teuthology.orchestra.run.smithi120.stdout: python-urllib3 noarch 1.10.2-7.el7 rhel-7-server-rpms 103 k 2021-04-09T18:16:49.835 INFO:teuthology.orchestra.run.smithi120.stdout: python-webob noarch 1.2.3-7.el7 rhel-7-server-optional-rpms 2021-04-09T18:16:49.835 INFO:teuthology.orchestra.run.smithi120.stdout: 202 k 2021-04-09T18:16:49.852 INFO:teuthology.orchestra.run.smithi120.stdout: python-websocket-client 2021-04-09T18:16:49.853 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 0.56.0-3.git3c25814.el7 rhel-7-server-extras-rpms 2021-04-09T18:16:49.853 INFO:teuthology.orchestra.run.smithi120.stdout: 66 k 2021-04-09T18:16:49.854 INFO:teuthology.orchestra.run.smithi120.stdout: python-webtest noarch 1.3.4-6.el7 rhel-7-server-optional-rpms 2021-04-09T18:16:49.854 INFO:teuthology.orchestra.run.smithi120.stdout: 102 k 2021-04-09T18:16:49.883 INFO:teuthology.orchestra.run.smithi120.stdout: python-werkzeug noarch 0.9.1-2.el7 rhel-7-server-extras-rpms 2021-04-09T18:16:49.884 INFO:teuthology.orchestra.run.smithi120.stdout: 562 k 2021-04-09T18:16:49.887 INFO:teuthology.orchestra.run.smithi120.stdout: python2-apipkg noarch 1.5-5.el7 epel 17 k 2021-04-09T18:16:49.888 INFO:teuthology.orchestra.run.smithi120.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2021-04-09T18:16:49.890 INFO:teuthology.orchestra.run.smithi120.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2021-04-09T18:16:49.891 INFO:teuthology.orchestra.run.smithi120.stdout: python2-google-auth 2021-04-09T18:16:49.891 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 1:1.1.1-5.el7 epel 76 k 2021-04-09T18:16:49.892 INFO:teuthology.orchestra.run.smithi120.stdout: python2-kubernetes noarch 1:11.0.0-6.el7 epel 1.1 M 2021-04-09T18:16:49.892 INFO:teuthology.orchestra.run.smithi120.stdout: python2-oauthlib noarch 2.0.1-8.el7 rhel-7-server-rpms 146 k 2021-04-09T18:16:49.892 INFO:teuthology.orchestra.run.smithi120.stdout: python2-pyasn1-modules 2021-04-09T18:16:49.893 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 0.1.9-7.el7 rhel-7-server-optional-rpms 2021-04-09T18:16:49.930 INFO:teuthology.orchestra.run.smithi120.stdout: 59 k 2021-04-09T18:16:49.930 INFO:teuthology.orchestra.run.smithi120.stdout: python2-remoto noarch 1.0.0-1.el7 epel 42 k 2021-04-09T18:16:49.931 INFO:teuthology.orchestra.run.smithi120.stdout: python2-requests-oauthlib 2021-04-09T18:16:49.931 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 0.8.0-5.el7 rhel-7-server-rpms 35 k 2021-04-09T18:16:49.932 INFO:teuthology.orchestra.run.smithi120.stdout: python2-rsa noarch 3.4.2-2.el7 epel 68 k 2021-04-09T18:16:49.932 INFO:teuthology.orchestra.run.smithi120.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2021-04-09T18:16:49.932 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse 2021-04-09T18:16:49.933 INFO:teuthology.orchestra.run.smithi120.stdout: x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 35 k 2021-04-09T18:16:49.933 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 317 k 2021-04-09T18:16:49.934 INFO:teuthology.orchestra.run.smithi120.stdout: scipy x86_64 0.12.1-6.el7 rhel-7-server-rpms 9.3 M 2021-04-09T18:16:49.934 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.3.2-2.el7 rhel-7-server-rpms 290 k 2021-04-09T18:16:49.934 INFO:teuthology.orchestra.run.smithi120.stdout: suitesparse x86_64 4.0.2-10.el7 rhel-7-server-rpms 928 k 2021-04-09T18:16:49.935 INFO:teuthology.orchestra.run.smithi120.stdout: tbb x86_64 4.1-9.20130314.el7 rhel-7-server-rpms 124 k 2021-04-09T18:16:49.969 INFO:teuthology.orchestra.run.smithi120.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2021-04-09T18:16:49.970 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel x86_64 1.2.7-19.el7_9 rhel-7-server-rpms 50 k 2021-04-09T18:16:49.970 INFO:teuthology.orchestra.run.smithi120.stdout:Updating for dependencies: 2021-04-09T18:16:49.975 INFO:teuthology.orchestra.run.smithi120.stdout: openssl x86_64 1:1.0.2k-21.el7_9 rhel-7-server-rpms 493 k 2021-04-09T18:16:49.975 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs x86_64 1:1.0.2k-21.el7_9 rhel-7-server-rpms 1.2 M 2021-04-09T18:16:49.976 INFO:teuthology.orchestra.run.smithi120.stdout: zlib x86_64 1.2.7-19.el7_9 rhel-7-server-rpms 90 k 2021-04-09T18:16:49.977 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:16:49.978 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2021-04-09T18:16:49.986 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2021-04-09T18:16:49.987 INFO:teuthology.orchestra.run.smithi120.stdout:Install 19 Packages (+70 Dependent packages) 2021-04-09T18:16:49.989 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 2 Packages (+ 3 Dependent packages) 2021-04-09T18:16:49.990 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:16:49.990 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 130 M 2021-04-09T18:16:49.991 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading packages: 2021-04-09T18:16:49.992 INFO:teuthology.orchestra.run.smithi120.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2021-04-09T18:16:50.161 INFO:teuthology.orchestra.run.smithi134.stdout:Resolving Dependencies 2021-04-09T18:16:50.162 INFO:teuthology.orchestra.run.smithi134.stdout:--> Running transaction check 2021-04-09T18:16:50.162 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package bison.x86_64 0:3.0.4-2.el7 will be installed 2021-04-09T18:16:50.162 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.163 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: ceph-osd = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.163 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: ceph-mds = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.163 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: ceph-mon = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.163 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-fuse.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.163 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-mgr.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.177 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: ceph-base = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.186 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.196 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.196 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.197 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.197 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.197 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-mgr-dashboard.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.198 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-mgr-dashboard-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:50.198 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:50.198 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.199 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.199 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:50.200 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-mgr-rook.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.200 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:50.200 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-mgr-ssh.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.201 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-14.2.19-116.gd23cd2d5.el7.noarch 2021-04-09T18:16:50.201 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-radosgw.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.201 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: librgw2 = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.201 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: ceph-selinux = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.202 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.202 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.203 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-test.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.240 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: ceph-common = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.241 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: jq for package: 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.241 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: socat for package: 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.241 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.242 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package elfutils-libelf-devel.x86_64 0:0.176-5.el7 will be installed 2021-04-09T18:16:50.242 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.176-5.el7.x86_64 2021-04-09T18:16:50.242 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package flex.x86_64 0:2.5.37-6.el7 will be installed 2021-04-09T18:16:50.243 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package libcephfs-devel.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.243 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: librados-devel = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:libcephfs-devel-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.243 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package libcephfs2.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.244 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2021-04-09T18:16:50.244 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package librados2.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be an update 2021-04-09T18:16:50.244 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.245 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2021-04-09T18:16:50.245 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package librbd1.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be an update 2021-04-09T18:16:50.245 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package openssl-devel.x86_64 1:1.0.2k-21.el7_9 will be installed 2021-04-09T18:16:50.246 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: openssl-libs(x86-64) = 1:1.0.2k-21.el7_9 for package: 1:openssl-devel-1.0.2k-21.el7_9.x86_64 2021-04-09T18:16:50.246 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: krb5-devel(x86-64) for package: 1:openssl-devel-1.0.2k-21.el7_9.x86_64 2021-04-09T18:16:50.247 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-ceph-compat.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.276 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-cephfs = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.277 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-rgw = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.288 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-rbd = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.289 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-rados = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.290 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python3-cephfs.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.290 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python3-ceph-argparse = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python3-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.291 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python3-rados = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:python3-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.303 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package rbd-fuse.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.306 INFO:teuthology.orchestra.run.smithi134.stdout:--> Running transaction check 2021-04-09T18:16:50.306 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-base.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.306 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-common.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.306 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-ceph-argparse = 2:14.2.19-116.gd23cd2d5.el7 for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.307 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.307 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.307 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.307 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 2021-04-09T18:16:50.308 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-grafana-dashboards.noarch 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.308 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-mds.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.308 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-mon.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.308 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-osd.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.309 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package ceph-selinux.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.309 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package jq.x86_64 0:1.6-2.el7 will be installed 2021-04-09T18:16:50.309 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libonig.so.5()(64bit) for package: jq-1.6-2.el7.x86_64 2021-04-09T18:16:50.309 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package krb5-devel.x86_64 0:1.15.1-50.el7 will be installed 2021-04-09T18:16:50.309 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libverto-devel for package: krb5-devel-1.15.1-50.el7.x86_64 2021-04-09T18:16:50.310 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libselinux-devel for package: krb5-devel-1.15.1-50.el7.x86_64 2021-04-09T18:16:50.310 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.15.1-50.el7.x86_64 2021-04-09T18:16:50.310 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.15.1-50.el7.x86_64 2021-04-09T18:16:50.310 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2021-04-09T18:16:50.372 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package librabbitmq.x86_64 0:0.8.0-3.el7 will be installed 2021-04-09T18:16:50.373 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package librados-devel.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.373 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package libradosstriper1.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.374 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package librgw2.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.374 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2021-04-09T18:16:50.374 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2021-04-09T18:16:50.375 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2021-04-09T18:16:50.375 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package openssl-libs.x86_64 1:1.0.2k-19.el7 will be updated 2021-04-09T18:16:50.375 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: openssl-libs(x86-64) = 1:1.0.2k-19.el7 for package: 1:openssl-1.0.2k-19.el7.x86_64 2021-04-09T18:16:50.375 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package openssl-libs.x86_64 1:1.0.2k-21.el7_9 will be an update 2021-04-09T18:16:50.376 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-cephfs.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.376 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2021-04-09T18:16:50.376 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2021-04-09T18:16:50.376 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:50.376 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:50.377 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:50.377 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:50.377 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2021-04-09T18:16:50.377 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-rados.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.378 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-rbd.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.378 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-requests.noarch 0:2.6.0-10.el7 will be installed 2021-04-09T18:16:50.378 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-10.el7.noarch 2021-04-09T18:16:50.378 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-rgw.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.378 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2021-04-09T18:16:50.418 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2021-04-09T18:16:50.419 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2021-04-09T18:16:50.421 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2021-04-09T18:16:50.422 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2021-04-09T18:16:50.423 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-kubernetes.noarch 1:11.0.0-6.el7 will be installed 2021-04-09T18:16:50.423 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-certifi for package: 1:python2-kubernetes-11.0.0-6.el7.noarch 2021-04-09T18:16:50.423 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-google-auth for package: 1:python2-kubernetes-11.0.0-6.el7.noarch 2021-04-09T18:16:50.423 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-requests-oauthlib for package: 1:python2-kubernetes-11.0.0-6.el7.noarch 2021-04-09T18:16:50.423 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-websocket-client for package: 1:python2-kubernetes-11.0.0-6.el7.noarch 2021-04-09T18:16:50.424 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-remoto.noarch 0:1.0.0-1.el7 will be installed 2021-04-09T18:16:50.424 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python2-execnet >= 1.2.0 for package: python2-remoto-1.0.0-1.el7.noarch 2021-04-09T18:16:50.424 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python3-ceph-argparse.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.424 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python3-rados.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.425 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2021-04-09T18:16:50.425 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2021-04-09T18:16:50.425 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2021-04-09T18:16:50.425 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2021-04-09T18:16:50.425 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2021-04-09T18:16:50.426 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package zlib-devel.x86_64 0:1.2.7-19.el7_9 will be installed 2021-04-09T18:16:50.426 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: zlib = 1.2.7-19.el7_9 for package: zlib-devel-1.2.7-19.el7_9.x86_64 2021-04-09T18:16:50.460 INFO:teuthology.orchestra.run.smithi134.stdout:--> Running transaction check 2021-04-09T18:16:50.460 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package keyutils-libs-devel.x86_64 0:1.5.8-3.el7 will be installed 2021-04-09T18:16:50.461 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2021-04-09T18:16:50.467 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package libcom_err-devel.x86_64 0:1.42.9-19.el7 will be installed 2021-04-09T18:16:50.467 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2021-04-09T18:16:50.467 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package libselinux-devel.x86_64 0:2.5-15.el7 will be installed 2021-04-09T18:16:50.468 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libsepol-devel(x86-64) >= 2.5-10 for package: libselinux-devel-2.5-15.el7.x86_64 2021-04-09T18:16:50.468 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.5-15.el7.x86_64 2021-04-09T18:16:50.468 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: pkgconfig(libpcre) for package: libselinux-devel-2.5-15.el7.x86_64 2021-04-09T18:16:50.468 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package libverto-devel.x86_64 0:0.2.5-4.el7 will be installed 2021-04-09T18:16:50.469 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2021-04-09T18:16:50.471 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package oniguruma.x86_64 0:6.8.2-1.el7 will be installed 2021-04-09T18:16:50.471 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package openssl.x86_64 1:1.0.2k-19.el7 will be updated 2021-04-09T18:16:50.473 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package openssl.x86_64 1:1.0.2k-21.el7_9 will be an update 2021-04-09T18:16:50.474 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-ceph-argparse.x86_64 2:14.2.19-116.gd23cd2d5.el7 will be installed 2021-04-09T18:16:50.474 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-execnet.noarch 0:1.7.1-3.el7 will be installed 2021-04-09T18:16:50.484 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-apipkg for package: python-execnet-1.7.1-3.el7.noarch 2021-04-09T18:16:50.484 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2021-04-09T18:16:50.484 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2021-04-09T18:16:50.485 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2021-04-09T18:16:50.485 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2021-04-09T18:16:50.485 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2021-04-09T18:16:50.485 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2021-04-09T18:16:50.485 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2021-04-09T18:16:50.486 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2021-04-09T18:16:50.486 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2021-04-09T18:16:50.488 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2021-04-09T18:16:50.494 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2021-04-09T18:16:50.494 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2021-04-09T18:16:50.506 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2021-04-09T18:16:50.511 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2021-04-09T18:16:50.511 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2021-04-09T18:16:50.511 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2021-04-09T18:16:50.512 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2021-04-09T18:16:50.512 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2021-04-09T18:16:50.513 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2021-04-09T18:16:50.514 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2021-04-09T18:16:50.514 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2021-04-09T18:16:50.514 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2021-04-09T18:16:50.515 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2021-04-09T18:16:50.523 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package zlib.x86_64 0:1.2.7-18.el7 will be updated 2021-04-09T18:16:50.524 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package zlib.x86_64 0:1.2.7-19.el7_9 will be an update 2021-04-09T18:16:50.524 INFO:teuthology.orchestra.run.smithi134.stdout:--> Running transaction check 2021-04-09T18:16:50.524 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package libsepol-devel.x86_64 0:2.5-10.el7 will be installed 2021-04-09T18:16:50.551 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package pcre-devel.x86_64 0:8.32-17.el7 will be installed 2021-04-09T18:16:50.552 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2021-04-09T18:16:50.555 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2021-04-09T18:16:50.558 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2021-04-09T18:16:50.559 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2021-04-09T18:16:50.559 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-apipkg.noarch 0:1.5-5.el7 will be installed 2021-04-09T18:16:50.565 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2021-04-09T18:16:50.566 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2021-04-09T18:16:50.576 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2021-04-09T18:16:50.576 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python2-rsa.noarch 0:3.4.2-2.el7 will be installed 2021-04-09T18:16:50.577 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2021-04-09T18:16:50.577 INFO:teuthology.orchestra.run.smithi134.stdout:--> Running transaction check 2021-04-09T18:16:50.610 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2021-04-09T18:16:50.610 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2021-04-09T18:16:50.627 INFO:teuthology.orchestra.run.smithi134.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2021-04-09T18:16:50.628 INFO:teuthology.orchestra.run.smithi134.stdout:--> Running transaction check 2021-04-09T18:16:50.628 INFO:teuthology.orchestra.run.smithi134.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2021-04-09T18:16:50.929 INFO:teuthology.orchestra.run.smithi134.stdout:--> Finished Dependency Resolution 2021-04-09T18:16:51.014 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:16:51.015 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies Resolved 2021-04-09T18:16:51.026 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:16:51.027 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2021-04-09T18:16:51.027 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2021-04-09T18:16:51.027 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2021-04-09T18:16:51.028 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2021-04-09T18:16:51.028 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.0.4-2.el7 rhel-7-server-rpms 674 k 2021-04-09T18:16:51.029 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 2.0 k 2021-04-09T18:16:51.029 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 572 k 2021-04-09T18:16:51.029 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 1.8 M 2021-04-09T18:16:51.030 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 3.9 M 2021-04-09T18:16:51.030 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-cloud 2021-04-09T18:16:51.030 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 83 k 2021-04-09T18:16:51.031 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local 2021-04-09T18:16:51.032 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 1.1 M 2021-04-09T18:16:51.032 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 21 k 2021-04-09T18:16:51.033 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-ssh noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 21 k 2021-04-09T18:16:51.033 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 5.9 M 2021-04-09T18:16:51.034 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 34 M 2021-04-09T18:16:51.034 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel 2021-04-09T18:16:51.034 INFO:teuthology.orchestra.run.smithi134.stdout: x86_64 0.176-5.el7 rhel-7-server-rpms 40 k 2021-04-09T18:16:51.035 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.5.37-6.el7 rhel-7-server-rpms 293 k 2021-04-09T18:16:51.035 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 17 k 2021-04-09T18:16:51.036 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 500 k 2021-04-09T18:16:51.036 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:1.0.2k-21.el7_9 rhel-7-server-rpms 1.5 M 2021-04-09T18:16:51.037 INFO:teuthology.orchestra.run.smithi134.stdout: python-ceph-compat x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 2.2 k 2021-04-09T18:16:51.037 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 151 k 2021-04-09T18:16:51.038 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 69 k 2021-04-09T18:16:51.038 INFO:teuthology.orchestra.run.smithi134.stdout:Updating: 2021-04-09T18:16:51.038 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 3.4 M 2021-04-09T18:16:51.039 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 1.7 M 2021-04-09T18:16:51.071 INFO:teuthology.orchestra.run.smithi134.stdout:Installing for dependencies: 2021-04-09T18:16:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 5.5 M 2021-04-09T18:16:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 19 M 2021-04-09T18:16:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards 2021-04-09T18:16:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 2:14.2.19-116.gd23cd2d5.el7 ceph-noarch 19 k 2021-04-09T18:16:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 1.9 M 2021-04-09T18:16:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 4.3 M 2021-04-09T18:16:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 16 M 2021-04-09T18:16:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 20 k 2021-04-09T18:16:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-2.el7 epel 167 k 2021-04-09T18:16:51.133 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel 2021-04-09T18:16:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: x86_64 1.5.8-3.el7 rhel-7-server-rpms 37 k 2021-04-09T18:16:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel x86_64 1.15.1-50.el7 rhel-7-server-rpms 273 k 2021-04-09T18:16:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2021-04-09T18:16:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel x86_64 1.42.9-19.el7 rhel-7-server-rpms 32 k 2021-04-09T18:16:51.135 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2021-04-09T18:16:51.136 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.8.0-3.el7 rhel-7-server-rpms 37 k 2021-04-09T18:16:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 86 k 2021-04-09T18:16:51.156 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 364 k 2021-04-09T18:16:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2021-04-09T18:16:51.160 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 5.2 M 2021-04-09T18:16:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel x86_64 2.5-15.el7 rhel-7-server-rpms 187 k 2021-04-09T18:16:51.161 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel x86_64 2.5-10.el7 rhel-7-server-rpms 77 k 2021-04-09T18:16:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel x86_64 0.2.5-4.el7 rhel-7-server-rpms 12 k 2021-04-09T18:16:51.176 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2021-04-09T18:16:51.177 INFO:teuthology.orchestra.run.smithi134.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 rhel-7-server-rpms 206 k 2021-04-09T18:16:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.8.2-1.el7 epel 181 k 2021-04-09T18:16:51.183 INFO:teuthology.orchestra.run.smithi134.stdout: pcre-devel x86_64 8.32-17.el7 rhel-7-server-rpms 480 k 2021-04-09T18:16:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: python-beaker noarch 1.5.4-10.el7 rhel-7-server-rpms 80 k 2021-04-09T18:16:51.212 INFO:teuthology.orchestra.run.smithi134.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2021-04-09T18:16:51.214 INFO:teuthology.orchestra.run.smithi134.stdout: python-ceph-argparse 2021-04-09T18:16:51.214 INFO:teuthology.orchestra.run.smithi134.stdout: x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 35 k 2021-04-09T18:16:51.215 INFO:teuthology.orchestra.run.smithi134.stdout: python-cephfs x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 113 k 2021-04-09T18:16:51.215 INFO:teuthology.orchestra.run.smithi134.stdout: python-cherrypy noarch 3.2.2-4.el7 rhel-7-server-rpms 422 k 2021-04-09T18:16:51.231 INFO:teuthology.orchestra.run.smithi134.stdout: python-execnet noarch 1.7.1-3.el7 epel 260 k 2021-04-09T18:16:51.232 INFO:teuthology.orchestra.run.smithi134.stdout: python-jwcrypto noarch 0.4.2-1.el7 rhel-7-server-rpms 57 k 2021-04-09T18:16:51.232 INFO:teuthology.orchestra.run.smithi134.stdout: python-mako noarch 0.8.1-2.el7 rhel-7-server-rpms 307 k 2021-04-09T18:16:51.232 INFO:teuthology.orchestra.run.smithi134.stdout: python-markupsafe x86_64 0.11-10.el7 rhel-7-server-rpms 25 k 2021-04-09T18:16:51.233 INFO:teuthology.orchestra.run.smithi134.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 2021-04-09T18:16:51.233 INFO:teuthology.orchestra.run.smithi134.stdout: rhel-7-server-rpms 866 k 2021-04-09T18:16:51.275 INFO:teuthology.orchestra.run.smithi134.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2021-04-09T18:16:51.279 INFO:teuthology.orchestra.run.smithi134.stdout: python-prettytable noarch 0.7.2-3.el7 rhel-7-server-rpms 37 k 2021-04-09T18:16:51.280 INFO:teuthology.orchestra.run.smithi134.stdout: python-rados x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 199 k 2021-04-09T18:16:51.280 INFO:teuthology.orchestra.run.smithi134.stdout: python-rbd x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 194 k 2021-04-09T18:16:51.281 INFO:teuthology.orchestra.run.smithi134.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2021-04-09T18:16:51.281 INFO:teuthology.orchestra.run.smithi134.stdout: python-requests noarch 2.6.0-10.el7 rhel-7-server-rpms 95 k 2021-04-09T18:16:51.282 INFO:teuthology.orchestra.run.smithi134.stdout: python-rgw x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 77 k 2021-04-09T18:16:51.282 INFO:teuthology.orchestra.run.smithi134.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2021-04-09T18:16:51.282 INFO:teuthology.orchestra.run.smithi134.stdout: python-simplegeneric 2021-04-09T18:16:51.283 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 0.8-7.el7 epel 12 k 2021-04-09T18:16:51.283 INFO:teuthology.orchestra.run.smithi134.stdout: python-singledispatch 2021-04-09T18:16:51.284 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 3.4.0.2-2.el7 epel 18 k 2021-04-09T18:16:51.284 INFO:teuthology.orchestra.run.smithi134.stdout: python-tempita noarch 0.5.1-6.el7 rhel-7-server-rpms 33 k 2021-04-09T18:16:51.284 INFO:teuthology.orchestra.run.smithi134.stdout: python-urllib3 noarch 1.10.2-7.el7 rhel-7-server-rpms 103 k 2021-04-09T18:16:51.285 INFO:teuthology.orchestra.run.smithi134.stdout: python-webob noarch 1.2.3-7.el7 rhel-7-server-optional-rpms 2021-04-09T18:16:51.285 INFO:teuthology.orchestra.run.smithi134.stdout: 202 k 2021-04-09T18:16:51.286 INFO:teuthology.orchestra.run.smithi134.stdout: python-websocket-client 2021-04-09T18:16:51.286 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 0.56.0-3.git3c25814.el7 rhel-7-server-extras-rpms 2021-04-09T18:16:51.286 INFO:teuthology.orchestra.run.smithi134.stdout: 66 k 2021-04-09T18:16:51.287 INFO:teuthology.orchestra.run.smithi134.stdout: python-webtest noarch 1.3.4-6.el7 rhel-7-server-optional-rpms 2021-04-09T18:16:51.323 INFO:teuthology.orchestra.run.smithi134.stdout: 102 k 2021-04-09T18:16:51.323 INFO:teuthology.orchestra.run.smithi134.stdout: python-werkzeug noarch 0.9.1-2.el7 rhel-7-server-extras-rpms 2021-04-09T18:16:51.323 INFO:teuthology.orchestra.run.smithi134.stdout: 562 k 2021-04-09T18:16:51.324 INFO:teuthology.orchestra.run.smithi134.stdout: python2-apipkg noarch 1.5-5.el7 epel 17 k 2021-04-09T18:16:51.324 INFO:teuthology.orchestra.run.smithi134.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2021-04-09T18:16:51.324 INFO:teuthology.orchestra.run.smithi134.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2021-04-09T18:16:51.350 INFO:teuthology.orchestra.run.smithi134.stdout: python2-google-auth 2021-04-09T18:16:51.350 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 1:1.1.1-5.el7 epel 76 k 2021-04-09T18:16:51.351 INFO:teuthology.orchestra.run.smithi134.stdout: python2-kubernetes noarch 1:11.0.0-6.el7 epel 1.1 M 2021-04-09T18:16:51.351 INFO:teuthology.orchestra.run.smithi134.stdout: python2-oauthlib noarch 2.0.1-8.el7 rhel-7-server-rpms 146 k 2021-04-09T18:16:51.352 INFO:teuthology.orchestra.run.smithi134.stdout: python2-pyasn1-modules 2021-04-09T18:16:51.352 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 0.1.9-7.el7 rhel-7-server-optional-rpms 2021-04-09T18:16:51.371 INFO:teuthology.orchestra.run.smithi134.stdout: 59 k 2021-04-09T18:16:51.372 INFO:teuthology.orchestra.run.smithi134.stdout: python2-remoto noarch 1.0.0-1.el7 epel 42 k 2021-04-09T18:16:51.372 INFO:teuthology.orchestra.run.smithi134.stdout: python2-requests-oauthlib 2021-04-09T18:16:51.373 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 0.8.0-5.el7 rhel-7-server-rpms 35 k 2021-04-09T18:16:51.373 INFO:teuthology.orchestra.run.smithi134.stdout: python2-rsa noarch 3.4.2-2.el7 epel 68 k 2021-04-09T18:16:51.373 INFO:teuthology.orchestra.run.smithi134.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2021-04-09T18:16:51.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse 2021-04-09T18:16:51.374 INFO:teuthology.orchestra.run.smithi134.stdout: x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 35 k 2021-04-09T18:16:51.395 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:14.2.19-116.gd23cd2d5.el7 ceph 317 k 2021-04-09T18:16:51.395 INFO:teuthology.orchestra.run.smithi134.stdout: scipy x86_64 0.12.1-6.el7 rhel-7-server-rpms 9.3 M 2021-04-09T18:16:51.396 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.3.2-2.el7 rhel-7-server-rpms 290 k 2021-04-09T18:16:51.396 INFO:teuthology.orchestra.run.smithi134.stdout: suitesparse x86_64 4.0.2-10.el7 rhel-7-server-rpms 928 k 2021-04-09T18:16:51.396 INFO:teuthology.orchestra.run.smithi134.stdout: tbb x86_64 4.1-9.20130314.el7 rhel-7-server-rpms 124 k 2021-04-09T18:16:51.397 INFO:teuthology.orchestra.run.smithi134.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2021-04-09T18:16:51.419 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.7-19.el7_9 rhel-7-server-rpms 50 k 2021-04-09T18:16:51.420 INFO:teuthology.orchestra.run.smithi134.stdout:Updating for dependencies: 2021-04-09T18:16:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:1.0.2k-21.el7_9 rhel-7-server-rpms 493 k 2021-04-09T18:16:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:1.0.2k-21.el7_9 rhel-7-server-rpms 1.2 M 2021-04-09T18:16:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: zlib x86_64 1.2.7-19.el7_9 rhel-7-server-rpms 90 k 2021-04-09T18:16:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:16:51.432 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2021-04-09T18:16:51.433 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2021-04-09T18:16:51.433 INFO:teuthology.orchestra.run.smithi134.stdout:Install 19 Packages (+70 Dependent packages) 2021-04-09T18:16:51.433 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages (+ 3 Dependent packages) 2021-04-09T18:16:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:16:51.451 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 130 M 2021-04-09T18:16:51.456 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading packages: 2021-04-09T18:16:51.464 INFO:teuthology.orchestra.run.smithi134.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2021-04-09T18:16:58.518 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2021-04-09T18:16:58.519 INFO:teuthology.orchestra.run.smithi120.stdout:Total 15 MB/s | 130 MB 00:08 2021-04-09T18:16:58.563 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2021-04-09T18:16:58.736 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2021-04-09T18:16:59.195 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded 2021-04-09T18:16:59.196 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2021-04-09T18:17:00.024 INFO:teuthology.orchestra.run.smithi120.stdout: Updating : zlib-1.2.7-19.el7_9.x86_64 1/99 2021-04-09T18:17:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: Updating : 1:openssl-libs-1.0.2k-21.el7_9.x86_64 2/99 2021-04-09T18:17:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.2-1.el7.x86_64 3/99 2021-04-09T18:17:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.8.0-3.el7.x86_64 4/99 2021-04-09T18:17:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : zlib-devel-1.2.7-19.el7_9.x86_64 5/99 2021-04-09T18:17:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python2-six-1.9.0-0.el7.noarch 6/99 2021-04-09T18:17:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 7/99 2021-04-09T18:17:02.397 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/99 2021-04-09T18:17:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-webob-1.2.3-7.el7.noarch 9/99 2021-04-09T18:17:03.065 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 10/99 2021-04-09T18:17:03.349 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-requests-2.6.0-10.el7.noarch 11/99 2021-04-09T18:17:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:python-ceph-argparse-14.2.19-116.gd23cd2d5.el7.x86_64 12/99 2021-04-09T18:17:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 13/99 2021-04-09T18:17:04.190 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 14/99 2021-04-09T18:17:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 15/99 2021-04-09T18:17:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 16/99 2021-04-09T18:17:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : oniguruma-6.8.2-1.el7.x86_64 17/99 2021-04-09T18:17:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : jq-1.6-2.el7.x86_64 18/99 2021-04-09T18:17:05.471 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2021-04-09T18:17:05.471 INFO:teuthology.orchestra.run.smithi134.stdout:Total 9.0 MB/s | 130 MB 00:14 2021-04-09T18:17:05.516 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2021-04-09T18:17:05.690 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2021-04-09T18:17:05.870 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 19/99 2021-04-09T18:17:06.180 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded 2021-04-09T18:17:06.180 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2021-04-09T18:17:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 20/99 2021-04-09T18:17:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 21/99 2021-04-09T18:17:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 22/99 2021-04-09T18:17:06.998 INFO:teuthology.orchestra.run.smithi134.stdout: Updating : zlib-1.2.7-19.el7_9.x86_64 1/99 2021-04-09T18:17:07.171 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 23/99 2021-04-09T18:17:07.380 INFO:teuthology.orchestra.run.smithi134.stdout: Updating : 1:openssl-libs-1.0.2k-21.el7_9.x86_64 2/99 2021-04-09T18:17:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 24/99 2021-04-09T18:17:07.712 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.2-1.el7.x86_64 3/99 2021-04-09T18:17:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-grafana-dashboards-14.2.19-116.gd23cd2d5.el7.noar 25/99 2021-04-09T18:17:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.8.0-3.el7.x86_64 4/99 2021-04-09T18:17:08.071 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 26/99 2021-04-09T18:17:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.7-19.el7_9.x86_64 5/99 2021-04-09T18:17:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 27/99 2021-04-09T18:17:08.558 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python2-six-1.9.0-0.el7.noarch 6/99 2021-04-09T18:17:08.656 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcom_err-devel-1.42.9-19.el7.x86_64 28/99 2021-04-09T18:17:08.932 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 7/99 2021-04-09T18:17:08.933 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 29/99 2021-04-09T18:17:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 30/99 2021-04-09T18:17:09.308 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/99 2021-04-09T18:17:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:python3-ceph-argparse-14.2.19-116.gd23cd2d5.el7.x86_64 31/99 2021-04-09T18:17:09.655 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-webob-1.2.3-7.el7.noarch 9/99 2021-04-09T18:17:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : pcre-devel-8.32-17.el7.x86_64 32/99 2021-04-09T18:17:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 10/99 2021-04-09T18:17:10.188 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 33/99 2021-04-09T18:17:10.272 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-requests-2.6.0-10.el7.noarch 11/99 2021-04-09T18:17:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 34/99 2021-04-09T18:17:10.496 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:python-ceph-argparse-14.2.19-116.gd23cd2d5.el7.x86_64 12/99 2021-04-09T18:17:10.743 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 13/99 2021-04-09T18:17:10.778 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 35/99 2021-04-09T18:17:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 36/99 2021-04-09T18:17:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 14/99 2021-04-09T18:17:11.404 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python2-rsa-3.4.2-2.el7.noarch 37/99 2021-04-09T18:17:11.473 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 15/99 2021-04-09T18:17:11.792 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 16/99 2021-04-09T18:17:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.8.2-1.el7.x86_64 17/99 2021-04-09T18:17:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-2.el7.x86_64 18/99 2021-04-09T18:17:12.543 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 38/99 2021-04-09T18:17:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 19/99 2021-04-09T18:17:12.874 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 1:python2-kubernetes-11.0.0-6.el7.noarch 39/99 2021-04-09T18:17:13.117 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 40/99 2021-04-09T18:17:13.124 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 20/99 2021-04-09T18:17:13.390 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 21/99 2021-04-09T18:17:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : keyutils-libs-devel-1.5.8-3.el7.x86_64 41/99 2021-04-09T18:17:13.651 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 42/99 2021-04-09T18:17:13.694 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 22/99 2021-04-09T18:17:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 43/99 2021-04-09T18:17:14.091 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 23/99 2021-04-09T18:17:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 24/99 2021-04-09T18:17:14.603 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 44/99 2021-04-09T18:17:14.708 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-grafana-dashboards-14.2.19-116.gd23cd2d5.el7.noar 25/99 2021-04-09T18:17:14.953 INFO:teuthology.orchestra.run.smithi120.stdout: Updating : 2:librados2-14.2.19-116.gd23cd2d5.el7.x86_64 45/99 2021-04-09T18:17:14.983 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 26/99 2021-04-09T18:17:15.313 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 27/99 2021-04-09T18:17:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:libcephfs2-14.2.19-116.gd23cd2d5.el7.x86_64 46/99 2021-04-09T18:17:15.568 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcom_err-devel-1.42.9-19.el7.x86_64 28/99 2021-04-09T18:17:15.674 INFO:teuthology.orchestra.run.smithi120.stdout: Updating : 2:librbd1-14.2.19-116.gd23cd2d5.el7.x86_64 47/99 2021-04-09T18:17:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 29/99 2021-04-09T18:17:16.214 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 30/99 2021-04-09T18:17:16.455 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:python-rados-14.2.19-116.gd23cd2d5.el7.x86_64 48/99 2021-04-09T18:17:16.561 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:python3-ceph-argparse-14.2.19-116.gd23cd2d5.el7.x86_64 31/99 2021-04-09T18:17:16.723 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:librgw2-14.2.19-116.gd23cd2d5.el7.x86_64 49/99 2021-04-09T18:17:16.892 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre-devel-8.32-17.el7.x86_64 32/99 2021-04-09T18:17:16.994 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:python-rgw-14.2.19-116.gd23cd2d5.el7.x86_64 50/99 2021-04-09T18:17:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 33/99 2021-04-09T18:17:17.246 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:python-rbd-14.2.19-116.gd23cd2d5.el7.x86_64 51/99 2021-04-09T18:17:17.452 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 34/99 2021-04-09T18:17:17.550 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:python-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 52/99 2021-04-09T18:17:17.805 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 35/99 2021-04-09T18:17:18.082 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 36/99 2021-04-09T18:17:18.407 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python2-rsa-3.4.2-2.el7.noarch 37/99 2021-04-09T18:17:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 38/99 2021-04-09T18:17:19.763 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:libradosstriper1-14.2.19-116.gd23cd2d5.el7.x86_64 53/99 2021-04-09T18:17:19.903 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 1:python2-kubernetes-11.0.0-6.el7.noarch 39/99 2021-04-09T18:17:20.198 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 40/99 2021-04-09T18:17:20.484 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : keyutils-libs-devel-1.5.8-3.el7.x86_64 41/99 2021-04-09T18:17:20.689 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 54/99 2021-04-09T18:17:20.710 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 42/99 2021-04-09T18:17:20.990 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 43/99 2021-04-09T18:17:21.554 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-base-14.2.19-116.gd23cd2d5.el7.x86_64 55/99 2021-04-09T18:17:21.635 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 44/99 2021-04-09T18:17:22.196 INFO:teuthology.orchestra.run.smithi134.stdout: Updating : 2:librados2-14.2.19-116.gd23cd2d5.el7.x86_64 45/99 2021-04-09T18:17:22.625 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:libcephfs2-14.2.19-116.gd23cd2d5.el7.x86_64 46/99 2021-04-09T18:17:22.950 INFO:teuthology.orchestra.run.smithi134.stdout: Updating : 2:librbd1-14.2.19-116.gd23cd2d5.el7.x86_64 47/99 2021-04-09T18:17:23.682 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:python-rados-14.2.19-116.gd23cd2d5.el7.x86_64 48/99 2021-04-09T18:17:23.948 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:librgw2-14.2.19-116.gd23cd2d5.el7.x86_64 49/99 2021-04-09T18:17:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:python-rgw-14.2.19-116.gd23cd2d5.el7.x86_64 50/99 2021-04-09T18:17:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:python-rbd-14.2.19-116.gd23cd2d5.el7.x86_64 51/99 2021-04-09T18:17:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:python-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 52/99 2021-04-09T18:17:26.984 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:libradosstriper1-14.2.19-116.gd23cd2d5.el7.x86_64 53/99 2021-04-09T18:17:28.035 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 54/99 2021-04-09T18:17:28.490 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-base-14.2.19-116.gd23cd2d5.el7.x86_64 55/99 2021-04-09T18:17:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-selinux-14.2.19-116.gd23cd2d5.el7.x86_64 56/99 2021-04-09T18:17:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-osd-14.2.19-116.gd23cd2d5.el7.x86_64 57/99 2021-04-09T18:17:32.553 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-mon-14.2.19-116.gd23cd2d5.el7.x86_64 58/99 2021-04-09T18:17:32.890 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-mds-14.2.19-116.gd23cd2d5.el7.x86_64 59/99 2021-04-09T18:17:33.177 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:librados-devel-14.2.19-116.gd23cd2d5.el7.x86_64 60/99 2021-04-09T18:17:33.411 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:python3-rados-14.2.19-116.gd23cd2d5.el7.x86_64 61/99 2021-04-09T18:17:33.747 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 62/99 2021-04-09T18:17:34.058 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-routes-1.13-2.el7.noarch 63/99 2021-04-09T18:17:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 64/99 2021-04-09T18:17:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-mako-0.8.1-2.el7.noarch 65/99 2021-04-09T18:17:35.448 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 66/99 2021-04-09T18:17:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 67/99 2021-04-09T18:17:36.468 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python2-apipkg-1.5-5.el7.noarch 68/99 2021-04-09T18:17:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python-execnet-1.7.1-3.el7.noarch 69/99 2021-04-09T18:17:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python2-remoto-1.0.0-1.el7.noarch 70/99 2021-04-09T18:17:37.407 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libverto-devel-0.2.5-4.el7.x86_64 71/99 2021-04-09T18:17:37.740 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libsepol-devel-2.5-10.el7.x86_64 72/99 2021-04-09T18:17:38.085 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libselinux-devel-2.5-15.el7.x86_64 73/99 2021-04-09T18:17:38.291 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-selinux-14.2.19-116.gd23cd2d5.el7.x86_64 56/99 2021-04-09T18:17:38.404 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : krb5-devel-1.15.1-50.el7.x86_64 74/99 2021-04-09T18:17:39.055 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-osd-14.2.19-116.gd23cd2d5.el7.x86_64 57/99 2021-04-09T18:17:39.497 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-mon-14.2.19-116.gd23cd2d5.el7.x86_64 58/99 2021-04-09T18:17:39.828 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-mds-14.2.19-116.gd23cd2d5.el7.x86_64 59/99 2021-04-09T18:17:40.023 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 75/99 2021-04-09T18:17:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:librados-devel-14.2.19-116.gd23cd2d5.el7.x86_64 60/99 2021-04-09T18:17:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:python3-rados-14.2.19-116.gd23cd2d5.el7.x86_64 61/99 2021-04-09T18:17:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 62/99 2021-04-09T18:17:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : scipy-0.12.1-6.el7.x86_64 76/99 2021-04-09T18:17:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-routes-1.13-2.el7.noarch 63/99 2021-04-09T18:17:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 64/99 2021-04-09T18:17:41.518 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-mgr-diskprediction-local-14.2.19-116.gd23cd2d5.el 77/99 2021-04-09T18:17:41.827 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-mako-0.8.1-2.el7.noarch 65/99 2021-04-09T18:17:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 1:openssl-devel-1.0.2k-21.el7_9.x86_64 78/99 2021-04-09T18:17:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-mgr-ssh-14.2.19-116.gd23cd2d5.el7.noarch 79/99 2021-04-09T18:17:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 66/99 2021-04-09T18:17:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 80/99 2021-04-09T18:17:42.999 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 67/99 2021-04-09T18:17:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-mgr-dashboard-14.2.19-116.gd23cd2d5.el7.noarch 81/99 2021-04-09T18:17:43.348 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python2-apipkg-1.5-5.el7.noarch 68/99 2021-04-09T18:17:43.632 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-mgr-rook-14.2.19-116.gd23cd2d5.el7.noarch 82/99 2021-04-09T18:17:43.723 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python-execnet-1.7.1-3.el7.noarch 69/99 2021-04-09T18:17:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-14.2.19-116.gd23cd2d5.el 83/99 2021-04-09T18:17:44.078 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python2-remoto-1.0.0-1.el7.noarch 70/99 2021-04-09T18:17:44.159 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:python3-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 84/99 2021-04-09T18:17:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libverto-devel-0.2.5-4.el7.x86_64 71/99 2021-04-09T18:17:44.693 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libsepol-devel-2.5-10.el7.x86_64 72/99 2021-04-09T18:17:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:libcephfs-devel-14.2.19-116.gd23cd2d5.el7.x86_64 85/99 2021-04-09T18:17:45.011 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libselinux-devel-2.5-15.el7.x86_64 73/99 2021-04-09T18:17:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : krb5-devel-1.15.1-50.el7.x86_64 74/99 2021-04-09T18:17:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 75/99 2021-04-09T18:17:47.778 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : scipy-0.12.1-6.el7.x86_64 76/99 2021-04-09T18:17:48.411 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-mgr-diskprediction-local-14.2.19-116.gd23cd2d5.el 77/99 2021-04-09T18:17:48.476 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 86/99 2021-04-09T18:17:48.730 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 87/99 2021-04-09T18:17:48.790 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 1:openssl-devel-1.0.2k-21.el7_9.x86_64 78/99 2021-04-09T18:17:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 88/99 2021-04-09T18:17:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-mgr-ssh-14.2.19-116.gd23cd2d5.el7.noarch 79/99 2021-04-09T18:17:49.290 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:rbd-fuse-14.2.19-116.gd23cd2d5.el7.x86_64 89/99 2021-04-09T18:17:49.567 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : 2:ceph-fuse-14.2.19-116.gd23cd2d5.el7.x86_64 90/99 2021-04-09T18:17:49.904 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : elfutils-libelf-devel-0.176-5.el7.x86_64 91/99 2021-04-09T18:17:49.921 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 80/99 2021-04-09T18:17:50.289 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-mgr-dashboard-14.2.19-116.gd23cd2d5.el7.noarch 81/99 2021-04-09T18:17:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: Updating : 1:openssl-1.0.2k-21.el7_9.x86_64 92/99 2021-04-09T18:17:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-mgr-rook-14.2.19-116.gd23cd2d5.el7.noarch 82/99 2021-04-09T18:17:50.787 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flex-2.5.37-6.el7.x86_64 93/99 2021-04-09T18:17:50.878 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-14.2.19-116.gd23cd2d5.el 83/99 2021-04-09T18:17:51.134 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:python3-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 84/99 2021-04-09T18:17:51.895 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:libcephfs-devel-14.2.19-116.gd23cd2d5.el7.x86_64 85/99 2021-04-09T18:17:52.518 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : bison-3.0.4-2.el7.x86_64 94/99 2021-04-09T18:17:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : 1:openssl-1.0.2k-19.el7.x86_64 95/99 2021-04-09T18:17:53.170 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : 1:openssl-libs-1.0.2k-19.el7.x86_64 96/99 2021-04-09T18:17:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 97/99 2021-04-09T18:17:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 98/99 2021-04-09T18:17:54.177 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : zlib-1.2.7-18.el7.x86_64 99/99 2021-04-09T18:17:54.178 INFO:teuthology.orchestra.run.smithi120.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription- 2021-04-09T18:17:54.178 INFO:teuthology.orchestra.run.smithi120.stdout: : manager 2021-04-09T18:17:54.912 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-fuse-14.2.19-116.gd23cd2d5.el7.x86_64 1/99 2021-04-09T18:17:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 2/99 2021-04-09T18:17:55.160 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:libradosstriper1-14.2.19-116.gd23cd2d5.el7.x86_64 3/99 2021-04-09T18:17:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : jq-1.6-2.el7.x86_64 4/99 2021-04-09T18:17:55.401 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:python-ceph-argparse-14.2.19-116.gd23cd2d5.el7.x86_64 5/99 2021-04-09T18:17:55.515 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-routes-1.13-2.el7.noarch 6/99 2021-04-09T18:17:55.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:librgw2-14.2.19-116.gd23cd2d5.el7.x86_64 7/99 2021-04-09T18:17:55.771 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 8/99 2021-04-09T18:17:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 9/99 2021-04-09T18:17:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 86/99 2021-04-09T18:17:55.984 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libsepol-devel-2.5-10.el7.x86_64 10/99 2021-04-09T18:17:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 11/99 2021-04-09T18:17:56.172 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 87/99 2021-04-09T18:17:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libverto-devel-0.2.5-4.el7.x86_64 12/99 2021-04-09T18:17:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-osd-14.2.19-116.gd23cd2d5.el7.x86_64 13/99 2021-04-09T18:17:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 88/99 2021-04-09T18:17:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 14/99 2021-04-09T18:17:56.570 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:librados2-14.2.19-116.gd23cd2d5.el7.x86_64 15/99 2021-04-09T18:17:56.687 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:openssl-1.0.2k-21.el7_9.x86_64 16/99 2021-04-09T18:17:56.735 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:rbd-fuse-14.2.19-116.gd23cd2d5.el7.x86_64 89/99 2021-04-09T18:17:56.821 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python2-apipkg-1.5-5.el7.noarch 17/99 2021-04-09T18:17:56.960 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 18/99 2021-04-09T18:17:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : 2:ceph-fuse-14.2.19-116.gd23cd2d5.el7.x86_64 90/99 2021-04-09T18:17:57.064 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 19/99 2021-04-09T18:17:57.184 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 20/99 2021-04-09T18:17:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 21/99 2021-04-09T18:17:57.424 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:openssl-libs-1.0.2k-21.el7_9.x86_64 22/99 2021-04-09T18:17:57.533 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:librados-devel-14.2.19-116.gd23cd2d5.el7.x86_64 23/99 2021-04-09T18:17:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-requests-2.6.0-10.el7.noarch 24/99 2021-04-09T18:17:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 25/99 2021-04-09T18:17:57.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 26/99 2021-04-09T18:17:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:python2-kubernetes-11.0.0-6.el7.noarch 27/99 2021-04-09T18:17:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.176-5.el7.x86_64 91/99 2021-04-09T18:17:58.136 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 28/99 2021-04-09T18:17:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-mgr-diskprediction-local-14.2.19-116.gd23cd2d5.el 29/99 2021-04-09T18:17:58.387 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 30/99 2021-04-09T18:17:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: Updating : 1:openssl-1.0.2k-21.el7_9.x86_64 92/99 2021-04-09T18:17:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python2-remoto-1.0.0-1.el7.noarch 31/99 2021-04-09T18:17:58.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 32/99 2021-04-09T18:17:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : keyutils-libs-devel-1.5.8-3.el7.x86_64 33/99 2021-04-09T18:17:58.875 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.5.37-6.el7.x86_64 93/99 2021-04-09T18:17:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:python-rbd-14.2.19-116.gd23cd2d5.el7.x86_64 34/99 2021-04-09T18:17:58.998 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 35/99 2021-04-09T18:17:59.099 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 36/99 2021-04-09T18:17:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.0.4-2.el7.x86_64 94/99 2021-04-09T18:17:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 37/99 2021-04-09T18:17:59.342 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:libcephfs2-14.2.19-116.gd23cd2d5.el7.x86_64 38/99 2021-04-09T18:17:59.457 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 39/99 2021-04-09T18:17:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : 1:openssl-1.0.2k-19.el7.x86_64 95/99 2021-04-09T18:17:59.568 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python2-rsa-3.4.2-2.el7.noarch 40/99 2021-04-09T18:17:59.679 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 41/99 2021-04-09T18:17:59.788 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : 1:openssl-libs-1.0.2k-19.el7.x86_64 96/99 2021-04-09T18:17:59.795 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 42/99 2021-04-09T18:17:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 43/99 2021-04-09T18:18:00.027 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 97/99 2021-04-09T18:18:00.054 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-devel-0.176-5.el7.x86_64 44/99 2021-04-09T18:18:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-mgr-dashboard-14.2.19-116.gd23cd2d5.el7.noarch 45/99 2021-04-09T18:18:00.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-base-14.2.19-116.gd23cd2d5.el7.x86_64 46/99 2021-04-09T18:18:00.288 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 98/99 2021-04-09T18:18:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 47/99 2021-04-09T18:18:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:libcephfs-devel-14.2.19-116.gd23cd2d5.el7.x86_64 48/99 2021-04-09T18:18:00.648 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:python-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 49/99 2021-04-09T18:18:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:python-rgw-14.2.19-116.gd23cd2d5.el7.x86_64 50/99 2021-04-09T18:18:00.781 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : zlib-1.2.7-18.el7.x86_64 99/99 2021-04-09T18:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription- 2021-04-09T18:18:00.782 INFO:teuthology.orchestra.run.smithi134.stdout: : manager 2021-04-09T18:18:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.8.0-3.el7.x86_64 51/99 2021-04-09T18:18:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libselinux-devel-2.5-15.el7.x86_64 52/99 2021-04-09T18:18:01.134 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : zlib-1.2.7-19.el7_9.x86_64 53/99 2021-04-09T18:18:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-mon-14.2.19-116.gd23cd2d5.el7.x86_64 54/99 2021-04-09T18:18:01.352 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : pcre-devel-8.32-17.el7.x86_64 55/99 2021-04-09T18:18:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 56/99 2021-04-09T18:18:01.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-fuse-14.2.19-116.gd23cd2d5.el7.x86_64 1/99 2021-04-09T18:18:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:python3-ceph-argparse-14.2.19-116.gd23cd2d5.el7.x86_64 57/99 2021-04-09T18:18:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 2/99 2021-04-09T18:18:01.724 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 58/99 2021-04-09T18:18:01.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:libradosstriper1-14.2.19-116.gd23cd2d5.el7.x86_64 3/99 2021-04-09T18:18:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 59/99 2021-04-09T18:18:01.914 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-2.el7.x86_64 4/99 2021-04-09T18:18:02.039 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:python-ceph-argparse-14.2.19-116.gd23cd2d5.el7.x86_64 5/99 2021-04-09T18:18:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-routes-1.13-2.el7.noarch 6/99 2021-04-09T18:18:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:librgw2-14.2.19-116.gd23cd2d5.el7.x86_64 7/99 2021-04-09T18:18:02.392 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 8/99 2021-04-09T18:18:02.494 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:rbd-fuse-14.2.19-116.gd23cd2d5.el7.x86_64 60/99 2021-04-09T18:18:02.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : zlib-devel-1.2.7-19.el7_9.x86_64 61/99 2021-04-09T18:18:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 62/99 2021-04-09T18:18:02.816 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : krb5-devel-1.15.1-50.el7.x86_64 63/99 2021-04-09T18:18:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 9/99 2021-04-09T18:18:02.949 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-mgr-rook-14.2.19-116.gd23cd2d5.el7.noarch 64/99 2021-04-09T18:18:02.969 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libsepol-devel-2.5-10.el7.x86_64 10/99 2021-04-09T18:18:03.108 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 65/99 2021-04-09T18:18:03.128 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 11/99 2021-04-09T18:18:03.251 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcom_err-devel-1.42.9-19.el7.x86_64 66/99 2021-04-09T18:18:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libverto-devel-0.2.5-4.el7.x86_64 12/99 2021-04-09T18:18:03.360 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-mgr-ssh-14.2.19-116.gd23cd2d5.el7.noarch 67/99 2021-04-09T18:18:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-osd-14.2.19-116.gd23cd2d5.el7.x86_64 13/99 2021-04-09T18:18:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 68/99 2021-04-09T18:18:03.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-mgr-14.2.19-116.gd23cd2d5.el7.x86_64 14/99 2021-04-09T18:18:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:librados2-14.2.19-116.gd23cd2d5.el7.x86_64 15/99 2021-04-09T18:18:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 69/99 2021-04-09T18:18:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 70/99 2021-04-09T18:18:03.764 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:openssl-1.0.2k-21.el7_9.x86_64 16/99 2021-04-09T18:18:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 71/99 2021-04-09T18:18:03.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python2-apipkg-1.5-5.el7.noarch 17/99 2021-04-09T18:18:03.996 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 72/99 2021-04-09T18:18:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 18/99 2021-04-09T18:18:04.138 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 73/99 2021-04-09T18:18:04.157 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 19/99 2021-04-09T18:18:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 74/99 2021-04-09T18:18:04.258 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 20/99 2021-04-09T18:18:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-grafana-dashboards-14.2.19-116.gd23cd2d5.el7.noar 75/99 2021-04-09T18:18:04.358 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:python-ceph-compat-14.2.19-116.gd23cd2d5.el7.x86_64 21/99 2021-04-09T18:18:04.473 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:python3-rados-14.2.19-116.gd23cd2d5.el7.x86_64 76/99 2021-04-09T18:18:04.484 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:openssl-libs-1.0.2k-21.el7_9.x86_64 22/99 2021-04-09T18:18:04.604 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 77/99 2021-04-09T18:18:04.610 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:librados-devel-14.2.19-116.gd23cd2d5.el7.x86_64 23/99 2021-04-09T18:18:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-selinux-14.2.19-116.gd23cd2d5.el7.x86_64 78/99 2021-04-09T18:18:04.761 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-requests-2.6.0-10.el7.noarch 24/99 2021-04-09T18:18:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:librbd1-14.2.19-116.gd23cd2d5.el7.x86_64 79/99 2021-04-09T18:18:04.888 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 25/99 2021-04-09T18:18:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 80/99 2021-04-09T18:18:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 26/99 2021-04-09T18:18:05.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-execnet-1.7.1-3.el7.noarch 81/99 2021-04-09T18:18:05.145 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:python2-kubernetes-11.0.0-6.el7.noarch 27/99 2021-04-09T18:18:05.235 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 82/99 2021-04-09T18:18:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 28/99 2021-04-09T18:18:05.353 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-14.2.19-116.gd23cd2d5.el 83/99 2021-04-09T18:18:05.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-mgr-diskprediction-local-14.2.19-116.gd23cd2d5.el 29/99 2021-04-09T18:18:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:python-rados-14.2.19-116.gd23cd2d5.el7.x86_64 84/99 2021-04-09T18:18:05.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 30/99 2021-04-09T18:18:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : bison-3.0.4-2.el7.x86_64 85/99 2021-04-09T18:18:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python2-remoto-1.0.0-1.el7.noarch 31/99 2021-04-09T18:18:05.732 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:openssl-devel-1.0.2k-21.el7_9.x86_64 86/99 2021-04-09T18:18:05.843 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 32/99 2021-04-09T18:18:05.846 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 87/99 2021-04-09T18:18:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 88/99 2021-04-09T18:18:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : keyutils-libs-devel-1.5.8-3.el7.x86_64 33/99 2021-04-09T18:18:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 89/99 2021-04-09T18:18:06.082 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:python-rbd-14.2.19-116.gd23cd2d5.el7.x86_64 34/99 2021-04-09T18:18:06.193 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flex-2.5.37-6.el7.x86_64 90/99 2021-04-09T18:18:06.215 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-14.2.19-116.gd23cd2d5.el7.x86_64 35/99 2021-04-09T18:18:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 36/99 2021-04-09T18:18:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 91/99 2021-04-09T18:18:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 37/99 2021-04-09T18:18:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:ceph-mds-14.2.19-116.gd23cd2d5.el7.x86_64 92/99 2021-04-09T18:18:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:libcephfs2-14.2.19-116.gd23cd2d5.el7.x86_64 38/99 2021-04-09T18:18:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : oniguruma-6.8.2-1.el7.x86_64 93/99 2021-04-09T18:18:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 39/99 2021-04-09T18:18:06.704 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 2:python3-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 94/99 2021-04-09T18:18:06.706 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 95/99 2021-04-09T18:18:06.706 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : zlib-1.2.7-18.el7.x86_64 96/99 2021-04-09T18:18:06.706 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:openssl-libs-1.0.2k-19.el7.x86_64 97/99 2021-04-09T18:18:06.707 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:openssl-1.0.2k-19.el7.x86_64 98/99 2021-04-09T18:18:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python2-rsa-3.4.2-2.el7.noarch 40/99 2021-04-09T18:18:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 41/99 2021-04-09T18:18:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 42/99 2021-04-09T18:18:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 43/99 2021-04-09T18:18:07.345 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.176-5.el7.x86_64 44/99 2021-04-09T18:18:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 99/99 2021-04-09T18:18:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2021-04-09T18:18:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: bison.x86_64 0:3.0.4-2.el7 2021-04-09T18:18:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: ceph.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-cloud.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-ssh.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel.x86_64 0:0.176-5.el7 2021-04-09T18:18:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: flex.x86_64 0:2.5.37-6.el7 2021-04-09T18:18:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel.x86_64 1:1.0.2k-21.el7_9 2021-04-09T18:18:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: python-ceph-compat.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:Dependency Installed: 2021-04-09T18:18:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: jq.x86_64 0:1.6-2.el7 2021-04-09T18:18:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: keyutils-libs-devel.x86_64 0:1.5.8-3.el7 2021-04-09T18:18:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: krb5-devel.x86_64 0:1.15.1-50.el7 2021-04-09T18:18:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2021-04-09T18:18:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: libcom_err-devel.x86_64 0:1.42.9-19.el7 2021-04-09T18:18:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: liboath.x86_64 0:2.6.2-1.el7 2021-04-09T18:18:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq.x86_64 0:0.8.0-3.el7 2021-04-09T18:18:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2021-04-09T18:18:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: libselinux-devel.x86_64 0:2.5-15.el7 2021-04-09T18:18:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: libsepol-devel.x86_64 0:2.5-10.el7 2021-04-09T18:18:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: libverto-devel.x86_64 0:0.2.5-4.el7 2021-04-09T18:18:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2021-04-09T18:18:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 2021-04-09T18:18:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: oniguruma.x86_64 0:6.8.2-1.el7 2021-04-09T18:18:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: pcre-devel.x86_64 0:8.32-17.el7 2021-04-09T18:18:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: python-beaker.noarch 0:1.5.4-10.el7 2021-04-09T18:18:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2021-04-09T18:18:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: python-ceph-argparse.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: python-cephfs.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.522 INFO:teuthology.orchestra.run.smithi120.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2021-04-09T18:18:07.523 INFO:teuthology.orchestra.run.smithi120.stdout: python-execnet.noarch 0:1.7.1-3.el7 2021-04-09T18:18:07.523 INFO:teuthology.orchestra.run.smithi120.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2021-04-09T18:18:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: python-mako.noarch 0:0.8.1-2.el7 2021-04-09T18:18:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2021-04-09T18:18:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2021-04-09T18:18:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: python-pecan.noarch 0:0.4.5-2.el7 2021-04-09T18:18:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2021-04-09T18:18:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: python-rados.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: python-rbd.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2021-04-09T18:18:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: python-requests.noarch 0:2.6.0-10.el7 2021-04-09T18:18:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: python-rgw.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: python-routes.noarch 0:1.13-2.el7 2021-04-09T18:18:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2021-04-09T18:18:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2021-04-09T18:18:07.582 INFO:teuthology.orchestra.run.smithi120.stdout: python-tempita.noarch 0:0.5.1-6.el7 2021-04-09T18:18:07.583 INFO:teuthology.orchestra.run.smithi120.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2021-04-09T18:18:07.583 INFO:teuthology.orchestra.run.smithi120.stdout: python-webob.noarch 0:1.2.3-7.el7 2021-04-09T18:18:07.589 INFO:teuthology.orchestra.run.smithi120.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2021-04-09T18:18:07.590 INFO:teuthology.orchestra.run.smithi120.stdout: python-webtest.noarch 0:1.3.4-6.el7 2021-04-09T18:18:07.590 INFO:teuthology.orchestra.run.smithi120.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2021-04-09T18:18:07.591 INFO:teuthology.orchestra.run.smithi120.stdout: python2-apipkg.noarch 0:1.5-5.el7 2021-04-09T18:18:07.605 INFO:teuthology.orchestra.run.smithi120.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2021-04-09T18:18:07.605 INFO:teuthology.orchestra.run.smithi120.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2021-04-09T18:18:07.619 INFO:teuthology.orchestra.run.smithi120.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2021-04-09T18:18:07.619 INFO:teuthology.orchestra.run.smithi120.stdout: python2-kubernetes.noarch 1:11.0.0-6.el7 2021-04-09T18:18:07.627 INFO:teuthology.orchestra.run.smithi120.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2021-04-09T18:18:07.627 INFO:teuthology.orchestra.run.smithi120.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2021-04-09T18:18:07.628 INFO:teuthology.orchestra.run.smithi120.stdout: python2-remoto.noarch 0:1.0.0-1.el7 2021-04-09T18:18:07.638 INFO:teuthology.orchestra.run.smithi120.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2021-04-09T18:18:07.638 INFO:teuthology.orchestra.run.smithi120.stdout: python2-rsa.noarch 0:3.4.2-2.el7 2021-04-09T18:18:07.644 INFO:teuthology.orchestra.run.smithi120.stdout: python2-six.noarch 0:1.9.0-0.el7 2021-04-09T18:18:07.645 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.651 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.652 INFO:teuthology.orchestra.run.smithi120.stdout: scipy.x86_64 0:0.12.1-6.el7 2021-04-09T18:18:07.652 INFO:teuthology.orchestra.run.smithi120.stdout: socat.x86_64 0:1.7.3.2-2.el7 2021-04-09T18:18:07.661 INFO:teuthology.orchestra.run.smithi120.stdout: suitesparse.x86_64 0:4.0.2-10.el7 2021-04-09T18:18:07.661 INFO:teuthology.orchestra.run.smithi120.stdout: tbb.x86_64 0:4.1-9.20130314.el7 2021-04-09T18:18:07.662 INFO:teuthology.orchestra.run.smithi120.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2021-04-09T18:18:07.662 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel.x86_64 0:1.2.7-19.el7_9 2021-04-09T18:18:07.662 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:07.680 INFO:teuthology.orchestra.run.smithi120.stdout:Updated: 2021-04-09T18:18:07.681 INFO:teuthology.orchestra.run.smithi120.stdout: librados2.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.681 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:07.682 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:07.682 INFO:teuthology.orchestra.run.smithi120.stdout:Dependency Updated: 2021-04-09T18:18:07.682 INFO:teuthology.orchestra.run.smithi120.stdout: openssl.x86_64 1:1.0.2k-21.el7_9 openssl-libs.x86_64 1:1.0.2k-21.el7_9 2021-04-09T18:18:07.682 INFO:teuthology.orchestra.run.smithi120.stdout: zlib.x86_64 0:1.2.7-19.el7_9 2021-04-09T18:18:07.682 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:07.694 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2021-04-09T18:18:07.707 DEBUG:teuthology.parallel:result is None 2021-04-09T18:18:07.944 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-mgr-dashboard-14.2.19-116.gd23cd2d5.el7.noarch 45/99 2021-04-09T18:18:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-base-14.2.19-116.gd23cd2d5.el7.x86_64 46/99 2021-04-09T18:18:08.422 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 47/99 2021-04-09T18:18:08.539 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:libcephfs-devel-14.2.19-116.gd23cd2d5.el7.x86_64 48/99 2021-04-09T18:18:08.656 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:python-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 49/99 2021-04-09T18:18:08.773 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:python-rgw-14.2.19-116.gd23cd2d5.el7.x86_64 50/99 2021-04-09T18:18:08.874 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.8.0-3.el7.x86_64 51/99 2021-04-09T18:18:09.016 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libselinux-devel-2.5-15.el7.x86_64 52/99 2021-04-09T18:18:09.144 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-1.2.7-19.el7_9.x86_64 53/99 2021-04-09T18:18:09.259 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-mon-14.2.19-116.gd23cd2d5.el7.x86_64 54/99 2021-04-09T18:18:09.385 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre-devel-8.32-17.el7.x86_64 55/99 2021-04-09T18:18:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 56/99 2021-04-09T18:18:09.635 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:python3-ceph-argparse-14.2.19-116.gd23cd2d5.el7.x86_64 57/99 2021-04-09T18:18:09.761 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 58/99 2021-04-09T18:18:09.912 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 59/99 2021-04-09T18:18:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:rbd-fuse-14.2.19-116.gd23cd2d5.el7.x86_64 60/99 2021-04-09T18:18:10.171 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.7-19.el7_9.x86_64 61/99 2021-04-09T18:18:10.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 62/99 2021-04-09T18:18:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : krb5-devel-1.15.1-50.el7.x86_64 63/99 2021-04-09T18:18:10.539 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-mgr-rook-14.2.19-116.gd23cd2d5.el7.noarch 64/99 2021-04-09T18:18:10.631 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 65/99 2021-04-09T18:18:10.757 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcom_err-devel-1.42.9-19.el7.x86_64 66/99 2021-04-09T18:18:10.858 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-mgr-ssh-14.2.19-116.gd23cd2d5.el7.noarch 67/99 2021-04-09T18:18:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-test-14.2.19-116.gd23cd2d5.el7.x86_64 68/99 2021-04-09T18:18:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 69/99 2021-04-09T18:18:11.217 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 70/99 2021-04-09T18:18:11.343 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 71/99 2021-04-09T18:18:11.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-common-14.2.19-116.gd23cd2d5.el7.x86_64 72/99 2021-04-09T18:18:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 73/99 2021-04-09T18:18:11.752 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 74/99 2021-04-09T18:18:11.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-grafana-dashboards-14.2.19-116.gd23cd2d5.el7.noar 75/99 2021-04-09T18:18:12.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:python3-rados-14.2.19-116.gd23cd2d5.el7.x86_64 76/99 2021-04-09T18:18:12.137 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 77/99 2021-04-09T18:18:12.263 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-selinux-14.2.19-116.gd23cd2d5.el7.x86_64 78/99 2021-04-09T18:18:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:librbd1-14.2.19-116.gd23cd2d5.el7.x86_64 79/99 2021-04-09T18:18:12.522 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 80/99 2021-04-09T18:18:13.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-execnet-1.7.1-3.el7.noarch 81/99 2021-04-09T18:18:13.125 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 82/99 2021-04-09T18:18:13.276 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-14.2.19-116.gd23cd2d5.el 83/99 2021-04-09T18:18:13.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:python-rados-14.2.19-116.gd23cd2d5.el7.x86_64 84/99 2021-04-09T18:18:13.532 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.0.4-2.el7.x86_64 85/99 2021-04-09T18:18:13.652 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:openssl-devel-1.0.2k-21.el7_9.x86_64 86/99 2021-04-09T18:18:13.803 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 87/99 2021-04-09T18:18:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 88/99 2021-04-09T18:18:14.087 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-radosgw-14.2.19-116.gd23cd2d5.el7.x86_64 89/99 2021-04-09T18:18:14.213 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.5.37-6.el7.x86_64 90/99 2021-04-09T18:18:14.329 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 91/99 2021-04-09T18:18:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:ceph-mds-14.2.19-116.gd23cd2d5.el7.x86_64 92/99 2021-04-09T18:18:14.539 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.8.2-1.el7.x86_64 93/99 2021-04-09T18:18:14.656 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 2:python3-cephfs-14.2.19-116.gd23cd2d5.el7.x86_64 94/99 2021-04-09T18:18:14.658 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 95/99 2021-04-09T18:18:14.659 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-1.2.7-18.el7.x86_64 96/99 2021-04-09T18:18:14.659 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:openssl-libs-1.0.2k-19.el7.x86_64 97/99 2021-04-09T18:18:14.660 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:openssl-1.0.2k-19.el7.x86_64 98/99 2021-04-09T18:18:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 99/99 2021-04-09T18:18:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2021-04-09T18:18:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: bison.x86_64 0:3.0.4-2.el7 2021-04-09T18:18:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: ceph.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-cloud.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-ssh.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel.x86_64 0:0.176-5.el7 2021-04-09T18:18:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: flex.x86_64 0:2.5.37-6.el7 2021-04-09T18:18:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel.x86_64 1:1.0.2k-21.el7_9 2021-04-09T18:18:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: python-ceph-compat.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:Dependency Installed: 2021-04-09T18:18:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards.noarch 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: jq.x86_64 0:1.6-2.el7 2021-04-09T18:18:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel.x86_64 0:1.5.8-3.el7 2021-04-09T18:18:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel.x86_64 0:1.15.1-50.el7 2021-04-09T18:18:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2021-04-09T18:18:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel.x86_64 0:1.42.9-19.el7 2021-04-09T18:18:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: liboath.x86_64 0:2.6.2-1.el7 2021-04-09T18:18:15.157 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq.x86_64 0:0.8.0-3.el7 2021-04-09T18:18:15.158 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.158 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.159 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2021-04-09T18:18:15.159 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.160 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel.x86_64 0:2.5-15.el7 2021-04-09T18:18:15.160 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel.x86_64 0:2.5-10.el7 2021-04-09T18:18:15.161 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel.x86_64 0:0.2.5-4.el7 2021-04-09T18:18:15.161 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2021-04-09T18:18:15.161 INFO:teuthology.orchestra.run.smithi134.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 2021-04-09T18:18:15.162 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma.x86_64 0:6.8.2-1.el7 2021-04-09T18:18:15.162 INFO:teuthology.orchestra.run.smithi134.stdout: pcre-devel.x86_64 0:8.32-17.el7 2021-04-09T18:18:15.190 INFO:teuthology.orchestra.run.smithi134.stdout: python-beaker.noarch 0:1.5.4-10.el7 2021-04-09T18:18:15.191 INFO:teuthology.orchestra.run.smithi134.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2021-04-09T18:18:15.191 INFO:teuthology.orchestra.run.smithi134.stdout: python-ceph-argparse.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.192 INFO:teuthology.orchestra.run.smithi134.stdout: python-cephfs.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.201 INFO:teuthology.orchestra.run.smithi134.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2021-04-09T18:18:15.201 INFO:teuthology.orchestra.run.smithi134.stdout: python-execnet.noarch 0:1.7.1-3.el7 2021-04-09T18:18:15.202 INFO:teuthology.orchestra.run.smithi134.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2021-04-09T18:18:15.202 INFO:teuthology.orchestra.run.smithi134.stdout: python-mako.noarch 0:0.8.1-2.el7 2021-04-09T18:18:15.202 INFO:teuthology.orchestra.run.smithi134.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2021-04-09T18:18:15.203 INFO:teuthology.orchestra.run.smithi134.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2021-04-09T18:18:15.203 INFO:teuthology.orchestra.run.smithi134.stdout: python-pecan.noarch 0:0.4.5-2.el7 2021-04-09T18:18:15.216 INFO:teuthology.orchestra.run.smithi134.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2021-04-09T18:18:15.217 INFO:teuthology.orchestra.run.smithi134.stdout: python-rados.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.217 INFO:teuthology.orchestra.run.smithi134.stdout: python-rbd.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.265 INFO:teuthology.orchestra.run.smithi134.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2021-04-09T18:18:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: python-requests.noarch 0:2.6.0-10.el7 2021-04-09T18:18:15.266 INFO:teuthology.orchestra.run.smithi134.stdout: python-rgw.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.267 INFO:teuthology.orchestra.run.smithi134.stdout: python-routes.noarch 0:1.13-2.el7 2021-04-09T18:18:15.268 INFO:teuthology.orchestra.run.smithi134.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2021-04-09T18:18:15.269 INFO:teuthology.orchestra.run.smithi134.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2021-04-09T18:18:15.273 INFO:teuthology.orchestra.run.smithi134.stdout: python-tempita.noarch 0:0.5.1-6.el7 2021-04-09T18:18:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2021-04-09T18:18:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: python-webob.noarch 0:1.2.3-7.el7 2021-04-09T18:18:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2021-04-09T18:18:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: python-webtest.noarch 0:1.3.4-6.el7 2021-04-09T18:18:15.276 INFO:teuthology.orchestra.run.smithi134.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2021-04-09T18:18:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: python2-apipkg.noarch 0:1.5-5.el7 2021-04-09T18:18:15.286 INFO:teuthology.orchestra.run.smithi134.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2021-04-09T18:18:15.292 INFO:teuthology.orchestra.run.smithi134.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2021-04-09T18:18:15.293 INFO:teuthology.orchestra.run.smithi134.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2021-04-09T18:18:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: python2-kubernetes.noarch 1:11.0.0-6.el7 2021-04-09T18:18:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2021-04-09T18:18:15.294 INFO:teuthology.orchestra.run.smithi134.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2021-04-09T18:18:15.295 INFO:teuthology.orchestra.run.smithi134.stdout: python2-remoto.noarch 0:1.0.0-1.el7 2021-04-09T18:18:15.304 INFO:teuthology.orchestra.run.smithi134.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2021-04-09T18:18:15.327 INFO:teuthology.orchestra.run.smithi134.stdout: python2-rsa.noarch 0:3.4.2-2.el7 2021-04-09T18:18:15.331 INFO:teuthology.orchestra.run.smithi134.stdout: python2-six.noarch 0:1.9.0-0.el7 2021-04-09T18:18:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: scipy.x86_64 0:0.12.1-6.el7 2021-04-09T18:18:15.333 INFO:teuthology.orchestra.run.smithi134.stdout: socat.x86_64 0:1.7.3.2-2.el7 2021-04-09T18:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: suitesparse.x86_64 0:4.0.2-10.el7 2021-04-09T18:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: tbb.x86_64 0:4.1-9.20130314.el7 2021-04-09T18:18:15.334 INFO:teuthology.orchestra.run.smithi134.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2021-04-09T18:18:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel.x86_64 0:1.2.7-19.el7_9 2021-04-09T18:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout:Updated: 2021-04-09T18:18:15.348 INFO:teuthology.orchestra.run.smithi134.stdout: librados2.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1.x86_64 2:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:15.349 INFO:teuthology.orchestra.run.smithi134.stdout:Dependency Updated: 2021-04-09T18:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: openssl.x86_64 1:1.0.2k-21.el7_9 openssl-libs.x86_64 1:1.0.2k-21.el7_9 2021-04-09T18:18:15.350 INFO:teuthology.orchestra.run.smithi134.stdout: zlib.x86_64 0:1.2.7-19.el7_9 2021-04-09T18:18:15.351 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:15.352 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2021-04-09T18:18:15.361 DEBUG:teuthology.parallel:result is None 2021-04-09T18:18:15.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo lsb_release -is 2021-04-09T18:18:15.472 INFO:teuthology.orchestra.run.smithi120.stdout:RedHatEnterpriseServer 2021-04-09T18:18:15.473 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2021-04-09T18:18:15.474 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:18:15.629 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-04-09T18:18:15.699 INFO:teuthology.orchestra.run.smithi120.stdout:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.700 INFO:teuthology.packaging:The installed version of ceph is 14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:15.700 INFO:teuthology.task.install:The correct ceph version 14.2.19-116.gd23cd2d5 is installed. 2021-04-09T18:18:15.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2021-04-09T18:18:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:RedHatEnterpriseServer 2021-04-09T18:18:15.799 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2021-04-09T18:18:15.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:18:15.978 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-04-09T18:18:16.046 INFO:teuthology.orchestra.run.smithi134.stdout:14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:16.046 INFO:teuthology.packaging:The installed version of ceph is 14.2.19-116.gd23cd2d5.el7 2021-04-09T18:18:16.047 INFO:teuthology.task.install:The correct ceph version 14.2.19-116.gd23cd2d5 is installed. 2021-04-09T18:18:16.048 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-04-09T18:18:16.050 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2021-04-09T18:18:16.051 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-04-09T18:18:16.112 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-04-09T18:18:16.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-04-09T18:18:16.177 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-04-09T18:18:16.178 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2021-04-09T18:18:16.178 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2021-04-09T18:18:16.241 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-04-09T18:18:16.340 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-04-09T18:18:16.341 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2021-04-09T18:18:16.401 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-04-09T18:18:16.492 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-04-09T18:18:16.493 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2021-04-09T18:18:16.493 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2021-04-09T18:18:16.547 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-04-09T18:18:16.638 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-04-09T18:18:16.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2021-04-09T18:18:16.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-04-09T18:18:16.787 INFO:teuthology.run_tasks:Running task ceph... 2021-04-09T18:18:17.062 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-04-09T18:18:17.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2021-04-09T18:18:17.090 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2021-04-09T18:18:17.152 INFO:tasks.ceph:Disabling ceph logrotate... 2021-04-09T18:18:17.152 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2021-04-09T18:18:17.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2021-04-09T18:18:17.211 INFO:tasks.ceph:Creating extra log directories... 2021-04-09T18:18:17.211 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-04-09T18:18:17.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-04-09T18:18:17.278 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-04-09T18:18:17.278 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-04-09T18:18:17.279 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-04-09T18:18:17.280 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2021-04-09T18:18:17.280 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-04-09T18:18:17.385 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-04-09T18:18:49.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2021-04-09T18:18:49.721 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-04-09T18:18:49.722 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-04-09T18:18:49.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-04-09T18:18:50.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2021-04-09T18:18:50.428 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-04-09T18:18:50.429 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'global': {'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd mds', 'ms inject socket failures': 2500}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'not responding, replacing', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-04-09T18:18:50.430 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728', 'branch': 'wip-yuri2-testing-2021-04-09-0846-nautilus', 'description': 'fs/thrash/{begin ceph-thrash/default clusters/1-mds-1-client-coloc conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_7} tasks/cfuse_workunit_suites_fsstress}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6031728', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '7.9', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2021-04-09-0846-nautilus'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'global': {'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd mds', 'ms inject socket failures': 2500}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'not responding, replacing', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2021-04-09-0846-nautilus', 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-yuri2-testing-2021-04-09-0846-nautilus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b', 'targets': {'smithi120.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXEHPdWAHllNm9JstPDUEQaAHw5bdUrzNs98AwbxrULMhv9I8aQXIK2ZWQl6uzjMvhM3wASv5KmimmOvN5Ce4DVAeg4wuQaRJ2EWZv5ZIehFIAOA6HhKv2fS5C9SkiCbkUahlJZjY+r403WLtGwVa04PbNhgGtBm3E0522oj0+qgG0Syw9B5HmtO+SF+DXoFzF+pHtNjKr/MURTPv3T1qeeLtpj2ea4mfO0gIFq5olDiHN45pQeU0bEERErrzLKEMpAwDlkJrFW86Wy/DQ0K3g+GKP07MIrw2DPQmFiCEyebA59NAEnTJ3GYVJdhElQsZ8YL2yBY+ZAurya5tab9O/', 'smithi134.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCs94NYH8h43i81cJu5/Yxf6lTc7sV9j9yQx0Zp/8zyF2BOOq07UUbNhlqSh7tuFMiQLy5krJ0qR29Yws48IR+H4Ozpb/8U8Mzu5/IMAaYocfg5cD4PvvP8i8vOVFyRr7NlS1r0h0ajVQ5m2hvSKqsvIJjIZY6QZlqoRGuKo9CJWO2CMzlzUIJVsZUwnhGvu+IaZqzfBjervmL4HpQ9Gyxhq0K7yz6Jh3Zsj+WZWplMFf2DYOMZoHmGZcreUEyxLLZPTgFtLpXEWg5mqgfGjped5Ng7NqOqbM8QHBD6zFjHzuVXm3T5VNgabxkI3z7/9NzvGLXvTe+1nvO1cVJ0qDpd'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'sha1': 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'}}, {'ceph': None}, {'mds_thrash': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology_branch': 'master', 'teuthology_sha1': '85d61eae4759f46ce21e9a37cd816a7a1a66c9d5', 'timestamp': '2021-04-09_17:56:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23935'} 2021-04-09T18:18:50.431 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-04-09T18:18:50.436 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-04-09T18:18:50.479 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2021-04-09T18:18:50.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2021-04-09T18:18:50.575 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2021-04-09T18:18:50.576 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2021-04-09T18:18:50.618 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-04-09T18:18:50.618 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-04-09T18:18:50.698 INFO:teuthology.orchestra.run.smithi120.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-0’ 2021-04-09T18:18:50.698 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:18:50.698 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 60418 Links: 1 2021-04-09T18:18:50.699 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:18:50.699 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2021-04-09T18:18:50.699 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2021-04-09 18:17:45.141851504 +0000 2021-04-09T18:18:50.699 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2021-04-09 18:14:22.686767178 +0000 2021-04-09T18:18:50.700 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2021-04-09 18:14:22.686767178 +0000 2021-04-09T18:18:50.700 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2021-04-09T18:18:50.710 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2021-04-09T18:18:50.710 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2021-04-09T18:18:50.710 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes (512 B) copied, 0.000281764 s, 1.8 MB/s 2021-04-09T18:18:50.712 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-04-09T18:18:50.794 INFO:teuthology.orchestra.run.smithi120.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-1’ 2021-04-09T18:18:50.794 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:18:50.794 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 57772 Links: 1 2021-04-09T18:18:50.795 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:18:50.795 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2021-04-09T18:18:50.795 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2021-04-09 18:17:45.141851504 +0000 2021-04-09T18:18:50.795 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2021-04-09 18:14:23.201755483 +0000 2021-04-09T18:18:50.796 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2021-04-09 18:14:23.201755483 +0000 2021-04-09T18:18:50.796 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2021-04-09T18:18:50.810 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2021-04-09T18:18:50.811 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2021-04-09T18:18:50.811 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes (512 B) copied, 0.000234534 s, 2.2 MB/s 2021-04-09T18:18:50.812 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-04-09T18:18:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2021-04-09T18:18:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:18:50.892 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 61498 Links: 1 2021-04-09T18:18:50.892 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:18:50.892 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2021-04-09T18:18:50.893 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2021-04-09 18:17:45.141851504 +0000 2021-04-09T18:18:50.893 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2021-04-09 18:14:23.746743107 +0000 2021-04-09T18:18:50.893 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2021-04-09 18:14:23.746743107 +0000 2021-04-09T18:18:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2021-04-09T18:18:50.902 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2021-04-09T18:18:50.902 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2021-04-09T18:18:50.903 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes (512 B) copied, 0.000296311 s, 1.7 MB/s 2021-04-09T18:18:50.905 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-04-09T18:18:50.984 INFO:teuthology.orchestra.run.smithi120.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-3’ 2021-04-09T18:18:50.984 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:18:50.984 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 61560 Links: 1 2021-04-09T18:18:50.984 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:18:50.985 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2021-04-09T18:18:50.985 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2021-04-09 18:17:45.141851504 +0000 2021-04-09T18:18:50.985 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2021-04-09 18:14:24.327729913 +0000 2021-04-09T18:18:50.985 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2021-04-09 18:14:24.327729913 +0000 2021-04-09T18:18:50.986 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2021-04-09T18:18:50.996 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2021-04-09T18:18:50.996 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2021-04-09T18:18:50.996 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes (512 B) copied, 0.000259283 s, 2.0 MB/s 2021-04-09T18:18:50.999 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:18:50.999 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-04-09T18:18:51.000 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2021-04-09T18:18:51.044 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-04-09T18:18:51.045 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-04-09T18:18:51.123 INFO:teuthology.orchestra.run.smithi134.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-0’ 2021-04-09T18:18:51.124 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:18:51.124 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 55166 Links: 1 2021-04-09T18:18:51.125 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:18:51.125 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2021-04-09T18:18:51.126 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2021-04-09 18:17:52.144557367 +0000 2021-04-09T18:18:51.127 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2021-04-09 18:14:22.879867916 +0000 2021-04-09T18:18:51.128 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2021-04-09 18:14:22.879867916 +0000 2021-04-09T18:18:51.128 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2021-04-09T18:18:51.136 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2021-04-09T18:18:51.137 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2021-04-09T18:18:51.137 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes (512 B) copied, 0.000443782 s, 1.2 MB/s 2021-04-09T18:18:51.140 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-04-09T18:18:51.241 INFO:teuthology.orchestra.run.smithi134.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-1’ 2021-04-09T18:18:51.242 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:18:51.242 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 55196 Links: 1 2021-04-09T18:18:51.243 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:18:51.244 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2021-04-09T18:18:51.245 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2021-04-09 18:17:52.144557367 +0000 2021-04-09T18:18:51.247 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2021-04-09 18:14:23.716847117 +0000 2021-04-09T18:18:51.248 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2021-04-09 18:14:23.716847117 +0000 2021-04-09T18:18:51.248 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2021-04-09T18:18:51.263 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2021-04-09T18:18:51.264 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2021-04-09T18:18:51.264 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes (512 B) copied, 0.000256417 s, 2.0 MB/s 2021-04-09T18:18:51.265 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-04-09T18:18:51.384 INFO:teuthology.orchestra.run.smithi134.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2021-04-09T18:18:51.384 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:18:51.385 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 57222 Links: 1 2021-04-09T18:18:51.385 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:18:51.385 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2021-04-09T18:18:51.386 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2021-04-09 18:17:52.144557367 +0000 2021-04-09T18:18:51.386 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2021-04-09 18:14:24.289832907 +0000 2021-04-09T18:18:51.388 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2021-04-09 18:14:24.289832907 +0000 2021-04-09T18:18:51.388 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2021-04-09T18:18:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2021-04-09T18:18:51.390 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2021-04-09T18:18:51.390 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes (512 B) copied, 0.000418011 s, 1.2 MB/s 2021-04-09T18:18:51.393 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-04-09T18:18:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-3’ 2021-04-09T18:18:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-04-09T18:18:51.493 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 57297 Links: 1 2021-04-09T18:18:51.494 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:18:51.495 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2021-04-09T18:18:51.529 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2021-04-09 18:17:52.144557367 +0000 2021-04-09T18:18:51.540 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2021-04-09 18:14:24.695822817 +0000 2021-04-09T18:18:51.541 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2021-04-09 18:14:24.695822817 +0000 2021-04-09T18:18:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2021-04-09T18:18:51.543 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2021-04-09T18:18:51.554 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2021-04-09T18:18:51.554 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes (512 B) copied, 0.000260331 s, 2.0 MB/s 2021-04-09T18:18:51.559 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:18:51.560 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-04-09T18:18:51.565 INFO:tasks.ceph:Generating config... 2021-04-09T18:18:51.599 INFO:tasks.ceph:[client] client mount timeout = 600 2021-04-09T18:18:51.600 INFO:tasks.ceph:[client] debug client = 20 2021-04-09T18:18:51.601 INFO:tasks.ceph:[client] debug ms = 1 2021-04-09T18:18:51.601 INFO:tasks.ceph:[global] ms inject delay max = 1 2021-04-09T18:18:51.602 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2021-04-09T18:18:51.602 INFO:tasks.ceph:[global] ms inject delay type = osd mds 2021-04-09T18:18:51.603 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2021-04-09T18:18:51.603 INFO:tasks.ceph:[mds] debug mds = 20 2021-04-09T18:18:51.604 INFO:tasks.ceph:[mds] debug ms = 1 2021-04-09T18:18:51.604 INFO:tasks.ceph:[mds] mds bal frag = True 2021-04-09T18:18:51.605 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-04-09T18:18:51.605 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-04-09T18:18:51.606 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-04-09T18:18:51.606 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-04-09T18:18:51.607 INFO:tasks.ceph:[mds] mds debug frag = True 2021-04-09T18:18:51.626 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-04-09T18:18:51.627 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-04-09T18:18:51.628 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-04-09T18:18:51.628 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-04-09T18:18:51.629 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-04-09T18:18:51.632 INFO:tasks.ceph:[mgr] debug ms = 1 2021-04-09T18:18:51.635 INFO:tasks.ceph:[mon] debug mon = 20 2021-04-09T18:18:51.636 INFO:tasks.ceph:[mon] debug ms = 1 2021-04-09T18:18:51.636 INFO:tasks.ceph:[mon] debug paxos = 20 2021-04-09T18:18:51.637 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-04-09T18:18:51.637 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-04-09T18:18:51.671 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-04-09T18:18:51.672 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-04-09T18:18:51.673 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-04-09T18:18:51.683 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-04-09T18:18:51.684 INFO:tasks.ceph:[osd] debug ms = 1 2021-04-09T18:18:51.684 INFO:tasks.ceph:[osd] debug osd = 20 2021-04-09T18:18:51.694 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-04-09T18:18:51.694 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-04-09T18:18:51.695 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-04-09T18:18:51.696 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-04-09T18:18:51.696 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-04-09T18:18:51.697 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-04-09T18:18:51.697 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-04-09T18:18:51.698 INFO:tasks.ceph:Setting up mon.a... 2021-04-09T18:18:51.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-04-09T18:18:51.821 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.keyring 2021-04-09T18:18:51.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-04-09T18:18:51.911 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-04-09T18:18:51.965 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.120'), ('mon.b', '172.21.15.134'), ('mon.c', '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]')] 2021-04-09T18:18:51.966 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.120 --add b 172.21.15.134 --addv c '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:18:52.049 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:18:52.050 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: generated fsid dcbe2161-e5ca-44be-8661-d46578834d60 2021-04-09T18:18:52.050 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 0 2021-04-09T18:18:52.051 INFO:teuthology.orchestra.run.smithi120.stdout:fsid dcbe2161-e5ca-44be-8661-d46578834d60 2021-04-09T18:18:52.051 INFO:teuthology.orchestra.run.smithi120.stdout:last_changed 2021-04-09 18:18:52.052525 2021-04-09T18:18:52.052 INFO:teuthology.orchestra.run.smithi120.stdout:created 2021-04-09 18:18:52.052525 2021-04-09T18:18:52.052 INFO:teuthology.orchestra.run.smithi120.stdout:min_mon_release 0 (unknown) 2021-04-09T18:18:52.052 INFO:teuthology.orchestra.run.smithi120.stdout:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2021-04-09T18:18:52.053 INFO:teuthology.orchestra.run.smithi120.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2021-04-09T18:18:52.053 INFO:teuthology.orchestra.run.smithi120.stdout:2: [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] mon.c 2021-04-09T18:18:52.054 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-04-09T18:18:52.057 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dcbe2161-e5ca-44be-8661-d46578834d60... 2021-04-09T18:18:52.059 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:18:52.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-04-09T18:18:52.146 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2021-04-09T18:18:52.146 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2021-04-09T18:18:52.147 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:18:52.147 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2021-04-09T18:18:52.148 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.148 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2021-04-09T18:18:52.149 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.149 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2021-04-09T18:18:52.149 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.155 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2021-04-09T18:18:52.156 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2021-04-09T18:18:52.156 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.157 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2021-04-09T18:18:52.157 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2021-04-09T18:18:52.158 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.158 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:18:52.158 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2021-04-09T18:18:52.159 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.159 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2021-04-09T18:18:52.160 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.161 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2021-04-09T18:18:52.161 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2021-04-09T18:18:52.162 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:18:52.162 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:18:52.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2021-04-09T18:18:52.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:18:52.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2021-04-09T18:18:52.164 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:18:52.164 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:18:52.165 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:18:52.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.166 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2021-04-09T18:18:52.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.167 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2021-04-09T18:18:52.167 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.168 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2021-04-09T18:18:52.168 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2021-04-09T18:18:52.169 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2021-04-09T18:18:52.169 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.169 INFO:teuthology.orchestra.run.smithi120.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:18:52.170 INFO:teuthology.orchestra.run.smithi120.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:18:52.170 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.120,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2021-04-09T18:18:52.171 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject delay max = 1 2021-04-09T18:18:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject delay probability = 0.005 2021-04-09T18:18:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject delay type = osd mds 2021-04-09T18:18:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject socket failures = 2500 2021-04-09T18:18:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = dcbe2161-e5ca-44be-8661-d46578834d60 2021-04-09T18:18:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.207 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2021-04-09T18:18:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2021-04-09T18:18:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2021-04-09T18:18:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2021-04-09T18:18:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2021-04-09T18:18:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2021-04-09T18:18:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2021-04-09T18:18:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2021-04-09T18:18:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2021-04-09T18:18:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2021-04-09T18:18:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2021-04-09T18:18:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:18:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2021-04-09T18:18:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2021-04-09T18:18:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:18:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2021-04-09T18:18:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2021-04-09T18:18:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2021-04-09T18:18:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2021-04-09T18:18:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore compression mode = aggressive 2021-04-09T18:18:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2021-04-09T18:18:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 20 2021-04-09T18:18:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 20 2021-04-09T18:18:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2021-04-09T18:18:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2021-04-09T18:18:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 10 2021-04-09T18:18:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:18:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2021-04-09T18:18:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:18:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:18:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2021-04-09T18:18:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2021-04-09T18:18:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.245 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2021-04-09T18:18:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2021-04-09T18:18:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2021-04-09T18:18:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2021-04-09T18:18:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2021-04-09T18:18:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:18:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:18:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.278 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2021-04-09T18:18:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2021-04-09T18:18:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2021-04-09T18:18:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2021-04-09T18:18:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2021-04-09T18:18:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2021-04-09T18:18:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2021-04-09T18:18:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:18:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2021-04-09T18:18:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2021-04-09T18:18:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:18:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: mon op complaint time = 120 2021-04-09T18:18:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:18:52.285 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2021-04-09T18:18:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2021-04-09T18:18:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2021-04-09T18:18:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2021-04-09T18:18:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:18:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:18:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: client mount timeout = 600 2021-04-09T18:18:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: debug client = 20 2021-04-09T18:18:52.306 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2021-04-09T18:18:52.306 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2021-04-09T18:18:52.308 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2021-04-09T18:18:52.308 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2021-04-09T18:18:52.310 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2021-04-09T18:18:52.311 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2021-04-09T18:18:52.311 INFO:teuthology.orchestra.run.smithi120.stdout:[mds] 2021-04-09T18:18:52.312 INFO:teuthology.orchestra.run.smithi120.stdout: debug mds = 20 2021-04-09T18:18:52.312 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2021-04-09T18:18:52.313 INFO:teuthology.orchestra.run.smithi120.stdout: mds bal frag = True 2021-04-09T18:18:52.313 INFO:teuthology.orchestra.run.smithi120.stdout: mds bal fragment size max = 10000 2021-04-09T18:18:52.318 INFO:teuthology.orchestra.run.smithi120.stdout: mds bal merge size = 5 2021-04-09T18:18:52.318 INFO:teuthology.orchestra.run.smithi120.stdout: mds bal split bits = 3 2021-04-09T18:18:52.319 INFO:teuthology.orchestra.run.smithi120.stdout: mds bal split size = 100 2021-04-09T18:18:52.322 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug frag = True 2021-04-09T18:18:52.322 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug scatterstat = True 2021-04-09T18:18:52.326 INFO:teuthology.orchestra.run.smithi120.stdout: mds op complaint time = 180 2021-04-09T18:18:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: mds verify scatter = True 2021-04-09T18:18:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2021-04-09T18:18:52.373 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2021-04-09T18:18:52.374 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2021-04-09T18:18:52.374 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-04-09T18:18:52.375 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2021-04-09T18:18:52.375 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.376 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2021-04-09T18:18:52.376 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.376 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2021-04-09T18:18:52.377 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.377 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2021-04-09T18:18:52.389 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2021-04-09T18:18:52.389 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.391 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2021-04-09T18:18:52.392 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2021-04-09T18:18:52.392 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.393 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2021-04-09T18:18:52.393 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2021-04-09T18:18:52.393 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.394 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2021-04-09T18:18:52.394 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.395 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2021-04-09T18:18:52.395 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2021-04-09T18:18:52.396 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2021-04-09T18:18:52.396 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2021-04-09T18:18:52.396 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2021-04-09T18:18:52.397 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2021-04-09T18:18:52.397 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2021-04-09T18:18:52.397 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-04-09T18:18:52.398 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2021-04-09T18:18:52.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.421 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-04-09T18:18:52.427 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.428 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2021-04-09T18:18:52.428 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2021-04-09T18:18:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2021-04-09T18:18:52.430 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2021-04-09T18:18:52.430 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2021-04-09T18:18:52.435 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.435 INFO:teuthology.orchestra.run.smithi134.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-04-09T18:18:52.435 INFO:teuthology.orchestra.run.smithi134.stdout: mon_client_directed_command_retry = 4 2021-04-09T18:18:52.436 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.120,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2021-04-09T18:18:52.436 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay max = 1 2021-04-09T18:18:52.437 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay probability = 0.005 2021-04-09T18:18:52.437 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject delay type = osd mds 2021-04-09T18:18:52.437 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 2500 2021-04-09T18:18:52.452 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = dcbe2161-e5ca-44be-8661-d46578834d60 2021-04-09T18:18:52.453 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.456 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2021-04-09T18:18:52.458 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2021-04-09T18:18:52.458 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.459 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2021-04-09T18:18:52.459 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2021-04-09T18:18:52.459 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.460 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2021-04-09T18:18:52.465 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2021-04-09T18:18:52.475 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.476 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2021-04-09T18:18:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2021-04-09T18:18:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2021-04-09T18:18:52.485 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2021-04-09T18:18:52.486 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2021-04-09T18:18:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2021-04-09T18:18:52.488 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2021-04-09T18:18:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.489 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2021-04-09T18:18:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.490 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2021-04-09T18:18:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2021-04-09T18:18:52.495 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2021-04-09T18:18:52.499 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2021-04-09T18:18:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2021-04-09T18:18:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression mode = aggressive 2021-04-09T18:18:52.500 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2021-04-09T18:18:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2021-04-09T18:18:52.501 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2021-04-09T18:18:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2021-04-09T18:18:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2021-04-09T18:18:52.502 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2021-04-09T18:18:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2021-04-09T18:18:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2021-04-09T18:18:52.503 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2021-04-09T18:18:52.504 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2021-04-09T18:18:52.554 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2021-04-09T18:18:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2021-04-09T18:18:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.555 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2021-04-09T18:18:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2021-04-09T18:18:52.556 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2021-04-09T18:18:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2021-04-09T18:18:52.559 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2021-04-09T18:18:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:18:52.560 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:18:52.561 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.583 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2021-04-09T18:18:52.591 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2021-04-09T18:18:52.592 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2021-04-09T18:18:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2021-04-09T18:18:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2021-04-09T18:18:52.593 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2021-04-09T18:18:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2021-04-09T18:18:52.594 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2021-04-09T18:18:52.596 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2021-04-09T18:18:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2021-04-09T18:18:52.597 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2021-04-09T18:18:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2021-04-09T18:18:52.598 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-04-09T18:18:52.598 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2021-04-09T18:18:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2021-04-09T18:18:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2021-04-09T18:18:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2021-04-09T18:18:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-04-09T18:18:52.617 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-04-09T18:18:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2021-04-09T18:18:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2021-04-09T18:18:52.618 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2021-04-09T18:18:52.619 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2021-04-09T18:18:52.619 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2021-04-09T18:18:52.620 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2021-04-09T18:18:52.620 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2021-04-09T18:18:52.620 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2021-04-09T18:18:52.621 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2021-04-09T18:18:52.621 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2021-04-09T18:18:52.631 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2021-04-09T18:18:52.631 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal frag = True 2021-04-09T18:18:52.631 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal fragment size max = 10000 2021-04-09T18:18:52.632 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal merge size = 5 2021-04-09T18:18:52.638 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal split bits = 3 2021-04-09T18:18:52.639 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal split size = 100 2021-04-09T18:18:52.639 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2021-04-09T18:18:52.640 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2021-04-09T18:18:52.640 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2021-04-09T18:18:52.645 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2021-04-09T18:18:52.645 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2021-04-09T18:18:52.645 INFO:tasks.ceph:Creating admin key on mon.a... 2021-04-09T18:18:52.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-04-09T18:18:52.752 INFO:tasks.ceph:Copying monmap to all nodes... 2021-04-09T18:18:52.808 DEBUG:teuthology.orchestra.remote:smithi120:/etc/ceph/ceph.keyring is 206B 2021-04-09T18:18:52.915 DEBUG:teuthology.orchestra.remote:smithi120:/home/ubuntu/cephtest/ceph.monmap is 373B 2021-04-09T18:18:52.969 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:18:52.969 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2021-04-09T18:18:52.970 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2021-04-09T18:18:52.971 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-04-09T18:18:53.037 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2021-04-09T18:18:53.038 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:18:53.117 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:18:53.118 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-04-09T18:18:53.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2021-04-09T18:18:53.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-04-09T18:18:53.200 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-04-09T18:18:53.201 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:18:53.290 INFO:tasks.ceph:Setting up mon nodes... 2021-04-09T18:18:53.290 INFO:tasks.ceph:Setting up mgr nodes... 2021-04-09T18:18:53.291 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-04-09T18:18:53.389 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-04-09T18:18:53.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-04-09T18:18:53.507 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-04-09T18:18:53.510 INFO:tasks.ceph:Setting up mds nodes... 2021-04-09T18:18:53.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-04-09T18:18:53.609 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-04-09T18:18:53.612 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-04-09T18:18:53.665 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-04-09T18:18:53.765 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-04-09T18:18:53.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-04-09T18:18:53.826 INFO:tasks.ceph_client:Setting up client nodes... 2021-04-09T18:18:53.826 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-04-09T18:18:53.909 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-04-09T18:18:53.925 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-04-09T18:18:53.926 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-04-09T18:18:53.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-04-09T18:18:53.981 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:18:53.982 INFO:tasks.ceph:role: osd.0 2021-04-09T18:18:53.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:18:53.984 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-04-09T18:18:54.522 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2021-04-09T18:18:54.523 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:18:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:18:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=0, sparse=0 2021-04-09T18:18:54.524 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:18:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:18:54.525 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:18:54.525 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:18:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:18:54.526 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:18:54.528 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2021-04-09T18:18:54.529 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-04-09T18:18:54.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-04-09T18:18:54.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-04-09T18:18:54.782 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:18:54.782 INFO:tasks.ceph:role: osd.1 2021-04-09T18:18:54.783 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:18:54.784 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-04-09T18:18:55.294 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2021-04-09T18:18:55.295 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:18:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:18:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=0, sparse=0 2021-04-09T18:18:55.296 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:18:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:18:55.297 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:18:55.297 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:18:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:18:55.298 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:18:55.299 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2021-04-09T18:18:55.300 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-04-09T18:18:55.389 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-04-09T18:18:55.448 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-04-09T18:18:55.501 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:18:55.502 INFO:tasks.ceph:role: osd.2 2021-04-09T18:18:55.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:18:55.502 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-04-09T18:18:56.045 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2021-04-09T18:18:56.045 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:18:56.045 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:18:56.046 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=0, sparse=0 2021-04-09T18:18:56.046 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:18:56.047 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:18:56.055 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:18:56.056 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:18:56.056 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:18:56.060 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:18:56.061 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2021-04-09T18:18:56.061 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-04-09T18:18:56.177 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-04-09T18:18:56.233 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-04-09T18:18:56.286 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-04-09T18:18:56.286 INFO:tasks.ceph:role: osd.3 2021-04-09T18:18:56.286 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:18:56.287 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-04-09T18:18:56.837 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2021-04-09T18:18:56.837 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:18:56.837 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:18:56.838 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=0, sparse=0 2021-04-09T18:18:56.838 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:18:56.838 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:18:56.838 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:18:56.839 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:18:56.839 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:18:56.839 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:18:56.840 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2021-04-09T18:18:56.841 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-04-09T18:18:56.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-04-09T18:18:57.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:18:57.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:18:57.105 7fd67f656a80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-04-09T18:18:57.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:18:57.106 7fd67f656a80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-04-09T18:18:57.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:18:57.106 7fd67f656a80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-04-09T18:18:57.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:18:57.106 7fd67f656a80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-04-09T18:18:57.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:18:57.106 7fd67f656a80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-04-09T18:18:57.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:18:57.106 7fd67f656a80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-04-09T18:18:59.904 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-04-09T18:18:59.971 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:19:00.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:00.064 7f3e63b40a80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-04-09T18:19:00.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:00.065 7f3e63b40a80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-04-09T18:19:00.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:00.065 7f3e63b40a80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-04-09T18:19:00.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:00.065 7f3e63b40a80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-04-09T18:19:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:00.065 7f3e63b40a80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-04-09T18:19:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:00.065 7f3e63b40a80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-04-09T18:19:02.860 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-04-09T18:19:02.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:19:03.015 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:03.015 7fbbbef7ca80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-04-09T18:19:03.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:03.015 7fbbbef7ca80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-04-09T18:19:03.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:03.015 7fbbbef7ca80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-04-09T18:19:03.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:03.015 7fbbbef7ca80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-04-09T18:19:03.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:03.015 7fbbbef7ca80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-04-09T18:19:03.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:03.016 7fbbbef7ca80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-04-09T18:19:05.809 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-04-09T18:19:05.863 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:19:05.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:05.966 7fae7c31ca80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-04-09T18:19:05.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:05.966 7fae7c31ca80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-04-09T18:19:05.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:05.966 7fae7c31ca80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-04-09T18:19:05.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:05.966 7fae7c31ca80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-04-09T18:19:05.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:05.966 7fae7c31ca80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-04-09T18:19:05.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:05.967 7fae7c31ca80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-04-09T18:19:08.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-04-09T18:19:08.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-04-09T18:19:08.898 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:19:08.898 INFO:tasks.ceph:role: osd.4 2021-04-09T18:19:08.899 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:19:08.899 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-04-09T18:19:09.433 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2021-04-09T18:19:09.433 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:19:09.434 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:19:09.434 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=0, sparse=0 2021-04-09T18:19:09.434 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:19:09.435 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:19:09.435 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:19:09.435 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:19:09.436 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:19:09.436 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:19:09.438 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2021-04-09T18:19:09.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-04-09T18:19:09.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-04-09T18:19:09.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-04-09T18:19:09.680 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:19:09.681 INFO:tasks.ceph:role: osd.5 2021-04-09T18:19:09.681 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:19:09.682 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-04-09T18:19:10.180 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2021-04-09T18:19:10.180 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:19:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:19:10.181 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=0, sparse=0 2021-04-09T18:19:10.182 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:19:10.182 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:19:10.182 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:19:10.183 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:19:10.183 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:19:10.184 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:19:10.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2021-04-09T18:19:10.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-04-09T18:19:10.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-04-09T18:19:10.333 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-04-09T18:19:10.387 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:19:10.388 INFO:tasks.ceph:role: osd.6 2021-04-09T18:19:10.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:19:10.389 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-04-09T18:19:10.925 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2021-04-09T18:19:10.925 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:19:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:19:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=0, sparse=0 2021-04-09T18:19:10.926 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:19:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:19:10.927 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:19:10.927 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:19:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:19:10.928 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:19:10.929 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2021-04-09T18:19:10.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-04-09T18:19:11.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-04-09T18:19:11.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-04-09T18:19:11.160 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-04-09T18:19:11.160 INFO:tasks.ceph:role: osd.7 2021-04-09T18:19:11.161 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:19:11.161 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-04-09T18:19:11.713 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2021-04-09T18:19:11.714 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-04-09T18:19:11.714 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2021-04-09T18:19:11.715 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=0, sparse=0 2021-04-09T18:19:11.715 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-04-09T18:19:11.716 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2021-04-09T18:19:11.716 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-04-09T18:19:11.716 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-04-09T18:19:11.717 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-04-09T18:19:11.719 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-04-09T18:19:11.721 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2021-04-09T18:19:11.727 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-04-09T18:19:11.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-04-09T18:19:11.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:19:12.020 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:12.023 7f1b7e7f1a80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-04-09T18:19:12.022 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:12.023 7f1b7e7f1a80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-04-09T18:19:12.022 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:12.023 7f1b7e7f1a80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-04-09T18:19:12.022 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:12.023 7f1b7e7f1a80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-04-09T18:19:12.022 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:12.023 7f1b7e7f1a80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-04-09T18:19:12.023 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:12.024 7f1b7e7f1a80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-04-09T18:19:14.816 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-04-09T18:19:14.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:19:14.976 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:14.977 7f3c26f74a80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-04-09T18:19:14.977 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:14.977 7f3c26f74a80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-04-09T18:19:14.977 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:14.977 7f3c26f74a80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-04-09T18:19:14.977 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:14.977 7f3c26f74a80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-04-09T18:19:14.978 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:14.977 7f3c26f74a80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-04-09T18:19:14.978 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:14.978 7f3c26f74a80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-04-09T18:19:17.766 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-04-09T18:19:17.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:19:17.910 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:17.911 7ff144f8fa80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-04-09T18:19:17.910 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:17.911 7ff144f8fa80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-04-09T18:19:17.911 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:17.911 7ff144f8fa80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-04-09T18:19:17.911 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:17.911 7ff144f8fa80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-04-09T18:19:17.912 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:17.911 7ff144f8fa80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-04-09T18:19:17.912 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:17.912 7ff144f8fa80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-04-09T18:19:20.434 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:19:20.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:19:20.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-04-09T18:19:20.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:19:20.856 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:20.857 7fabc7921a80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-04-09T18:19:20.856 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:20.858 7fabc7921a80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-04-09T18:19:20.857 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:20.858 7fabc7921a80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-04-09T18:19:20.857 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:20.858 7fabc7921a80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-04-09T18:19:20.858 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:20.858 7fabc7921a80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-04-09T18:19:20.858 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:20.858 7fabc7921a80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-04-09T18:19:23.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-04-09T18:19:23.712 INFO:tasks.ceph:Reading keys from all nodes... 2021-04-09T18:19:23.712 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:23.761 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.dv3OEZdkVw 2021-04-09T18:19:23.761 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.dv3OEZdkVw 2021-04-09T18:19:23.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.dv3OEZdkVw 2021-04-09T18:19:23.919 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.dv3OEZdkVw is 56B 2021-04-09T18:19:23.971 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.dv3OEZdkVw 2021-04-09T18:19:24.039 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:24.096 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.1cUkdePLsb 2021-04-09T18:19:24.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.1cUkdePLsb 2021-04-09T18:19:24.188 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.1cUkdePLsb 2021-04-09T18:19:24.286 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.1cUkdePLsb is 56B 2021-04-09T18:19:24.338 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.1cUkdePLsb 2021-04-09T18:19:24.380 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:24.459 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.F283aQuyZh 2021-04-09T18:19:24.460 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.F283aQuyZh 2021-04-09T18:19:24.551 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.F283aQuyZh 2021-04-09T18:19:24.652 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.F283aQuyZh is 56B 2021-04-09T18:19:24.700 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.F283aQuyZh 2021-04-09T18:19:24.741 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:24.820 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.fN4s5Rw1eW 2021-04-09T18:19:24.820 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.fN4s5Rw1eW 2021-04-09T18:19:24.920 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.fN4s5Rw1eW 2021-04-09T18:19:25.048 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.fN4s5Rw1eW is 56B 2021-04-09T18:19:25.098 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.fN4s5Rw1eW 2021-04-09T18:19:25.139 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:25.219 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.0bg1s6rwVH 2021-04-09T18:19:25.220 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.0bg1s6rwVH 2021-04-09T18:19:25.312 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.0bg1s6rwVH 2021-04-09T18:19:25.413 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.0bg1s6rwVH is 56B 2021-04-09T18:19:25.474 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.0bg1s6rwVH 2021-04-09T18:19:25.517 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:25.598 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.lqCFl3Iyp5 2021-04-09T18:19:25.599 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.lqCFl3Iyp5 2021-04-09T18:19:25.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.lqCFl3Iyp5 2021-04-09T18:19:25.788 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.lqCFl3Iyp5 is 56B 2021-04-09T18:19:25.837 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.lqCFl3Iyp5 2021-04-09T18:19:25.878 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:25.928 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.mTDvkPvU2o 2021-04-09T18:19:25.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.mTDvkPvU2o 2021-04-09T18:19:25.992 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.mTDvkPvU2o 2021-04-09T18:19:26.115 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.mTDvkPvU2o is 56B 2021-04-09T18:19:26.174 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.mTDvkPvU2o 2021-04-09T18:19:26.216 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:26.296 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.Xup9Xm4NMl 2021-04-09T18:19:26.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.Xup9Xm4NMl 2021-04-09T18:19:26.393 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.Xup9Xm4NMl 2021-04-09T18:19:26.506 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.Xup9Xm4NMl is 56B 2021-04-09T18:19:26.560 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.Xup9Xm4NMl 2021-04-09T18:19:26.603 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:26.681 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.C58j4WcQbS 2021-04-09T18:19:26.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.C58j4WcQbS 2021-04-09T18:19:26.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.C58j4WcQbS 2021-04-09T18:19:26.880 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.C58j4WcQbS is 56B 2021-04-09T18:19:26.933 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.C58j4WcQbS 2021-04-09T18:19:26.985 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:27.074 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.xsEfL4En1P 2021-04-09T18:19:27.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.xsEfL4En1P 2021-04-09T18:19:27.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.xsEfL4En1P 2021-04-09T18:19:27.284 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.xsEfL4En1P is 56B 2021-04-09T18:19:27.338 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.xsEfL4En1P 2021-04-09T18:19:27.395 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:27.476 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.iIUmJBqZ3H 2021-04-09T18:19:27.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.iIUmJBqZ3H 2021-04-09T18:19:27.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.iIUmJBqZ3H 2021-04-09T18:19:27.668 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.iIUmJBqZ3H is 56B 2021-04-09T18:19:27.718 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.iIUmJBqZ3H 2021-04-09T18:19:27.759 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:27.838 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.PxVeFjiEiq 2021-04-09T18:19:27.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.PxVeFjiEiq 2021-04-09T18:19:27.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.PxVeFjiEiq 2021-04-09T18:19:28.034 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.PxVeFjiEiq is 56B 2021-04-09T18:19:28.085 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.PxVeFjiEiq 2021-04-09T18:19:28.176 DEBUG:teuthology.orchestra.remote:smithi120:/etc/ceph/ceph.client.0.keyring is 59B 2021-04-09T18:19:28.247 INFO:tasks.ceph:Adding keys to all mons... 2021-04-09T18:19:28.248 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2021-04-09T18:19:28.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2021-04-09T18:19:28.302 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2021-04-09T18:19:28.302 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCNmnBgGmVeFxAATQn1kUQxcYLDEc5ABhSt0A== 2021-04-09T18:19:28.302 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2021-04-09T18:19:28.302 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCNmnBg71J/JBAAbGl5XZBk19ZF0wCZY3aStw== 2021-04-09T18:19:28.303 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2021-04-09T18:19:28.303 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCRmnBghPhlBhAAXpLPQctpH8M46H/zNjTpag== 2021-04-09T18:19:28.303 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2021-04-09T18:19:28.304 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCUmnBgP9jzAxAAIP+S1n/xHRwCTanEl4oEfQ== 2021-04-09T18:19:28.304 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2021-04-09T18:19:28.304 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCXmnBgxagDARAAv2qy1/kw4RLIAqUjMRs3aA== 2021-04-09T18:19:28.304 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2021-04-09T18:19:28.304 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCZmnBgRNSwORAAQy4nUSn6YVD2t7PXabtqaA== 2021-04-09T18:19:28.305 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2021-04-09T18:19:28.305 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCNmnBg3FBlHhAAlokbKVJQfur9+77n82pFOw== 2021-04-09T18:19:28.305 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2021-04-09T18:19:28.305 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCNmnBg7+20LRAAqBU/MvfE/664ZY6XPh+2qQ== 2021-04-09T18:19:28.306 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2021-04-09T18:19:28.307 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCgmnBgW3pyARAArKDJTm8wRCtvwmXF0Y/Xaw== 2021-04-09T18:19:28.307 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2021-04-09T18:19:28.308 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCimnBgtsROOhAAkS7B5JHbMmmJ/dM2ZeQIqA== 2021-04-09T18:19:28.308 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2021-04-09T18:19:28.309 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQClmnBg+UpgNhAA3iTbaGfr/4vFLWB9zd+DXQ== 2021-04-09T18:19:28.309 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2021-04-09T18:19:28.309 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQComnBgLQArMxAA5PFqAWajDjR7Wg0VKFGebw== 2021-04-09T18:19:28.309 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2021-04-09T18:19:28.310 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCNmnBgLWRnNhAAxBIdw7WE4mrvD1w5NqmfYg== 2021-04-09T18:19:28.312 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2021-04-09T18:19:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCNmnBgGmVeFxAATQn1kUQxcYLDEc5ABhSt0A== 2021-04-09T18:19:28.312 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2021-04-09T18:19:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCNmnBg71J/JBAAbGl5XZBk19ZF0wCZY3aStw== 2021-04-09T18:19:28.313 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2021-04-09T18:19:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCRmnBghPhlBhAAXpLPQctpH8M46H/zNjTpag== 2021-04-09T18:19:28.313 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2021-04-09T18:19:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCUmnBgP9jzAxAAIP+S1n/xHRwCTanEl4oEfQ== 2021-04-09T18:19:28.314 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2021-04-09T18:19:28.314 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCXmnBgxagDARAAv2qy1/kw4RLIAqUjMRs3aA== 2021-04-09T18:19:28.314 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2021-04-09T18:19:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCZmnBgRNSwORAAQy4nUSn6YVD2t7PXabtqaA== 2021-04-09T18:19:28.315 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2021-04-09T18:19:28.315 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCNmnBg3FBlHhAAlokbKVJQfur9+77n82pFOw== 2021-04-09T18:19:28.315 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2021-04-09T18:19:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCNmnBg7+20LRAAqBU/MvfE/664ZY6XPh+2qQ== 2021-04-09T18:19:28.316 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2021-04-09T18:19:28.316 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCgmnBgW3pyARAArKDJTm8wRCtvwmXF0Y/Xaw== 2021-04-09T18:19:28.325 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2021-04-09T18:19:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCimnBgtsROOhAAkS7B5JHbMmmJ/dM2ZeQIqA== 2021-04-09T18:19:28.326 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2021-04-09T18:19:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQClmnBg+UpgNhAA3iTbaGfr/4vFLWB9zd+DXQ== 2021-04-09T18:19:28.326 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2021-04-09T18:19:28.327 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQComnBgLQArMxAA5PFqAWajDjR7Wg0VKFGebw== 2021-04-09T18:19:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2021-04-09T18:19:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCNmnBgLWRnNhAAxBIdw7WE4mrvD1w5NqmfYg== 2021-04-09T18:19:28.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-04-09T18:19:28.354 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-04-09T18:19:28.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-04-09T18:19:28.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-04-09T18:19:28.551 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:28.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:28.653 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:28.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:28.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:28.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:28.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:28.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:28.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-04-09T18:19:28.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-04-09T18:19:29.055 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-04-09T18:19:29.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-04-09T18:19:29.160 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:29.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:29.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:29.283 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:29.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:29.391 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:29.505 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:29.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-04-09T18:19:29.605 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-04-09T18:19:29.609 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-04-09T18:19:29.708 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-04-09T18:19:29.709 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-04-09T18:19:29.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-04-09T18:19:29.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-04-09T18:19:29.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-04-09T18:19:29.985 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-04-09T18:19:30.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-04-09T18:19:30.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-04-09T18:19:30.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-04-09T18:19:30.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-04-09T18:19:30.352 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:19:30.356 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-04-09T18:19:30.398 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-04-09T18:19:30.399 INFO:tasks.ceph.mon.a:Restarting daemon 2021-04-09T18:19:30.400 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-04-09T18:19:30.440 INFO:tasks.ceph.mon.a:Started 2021-04-09T18:19:30.440 INFO:tasks.ceph.mon.b:Restarting daemon 2021-04-09T18:19:30.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-04-09T18:19:30.445 INFO:tasks.ceph.mon.b:Started 2021-04-09T18:19:30.446 INFO:tasks.ceph.mon.c:Restarting daemon 2021-04-09T18:19:30.446 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-04-09T18:19:30.449 INFO:tasks.ceph.mon.c:Started 2021-04-09T18:19:30.449 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-04-09T18:19:30.450 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-04-09T18:19:30.450 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-04-09T18:19:30.454 INFO:tasks.ceph.mgr.y:Started 2021-04-09T18:19:30.454 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-04-09T18:19:30.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-04-09T18:19:30.458 INFO:tasks.ceph.mgr.x:Started 2021-04-09T18:19:30.461 INFO:tasks.ceph:Setting crush tunables to default 2021-04-09T18:19:30.462 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd crush tunables default 2021-04-09T18:19:31.021 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.606 7f72a688a700 1 Processor -- start 2021-04-09T18:19:31.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.606 7f72a688a700 1 -- start start 2021-04-09T18:19:31.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.606 7f72a688a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 0x7f72a00e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.606 7f72a688a700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 0x7f72a00d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.606 7f72a688a700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a00d6be0 con 0x7f72a00d5bc0 2021-04-09T18:19:31.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.606 7f72a688a700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a00d80f0 con 0x7f72a00d7560 2021-04-09T18:19:31.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.606 7f72a688a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00e7f00 con 0x7f72a00d7160 2021-04-09T18:19:31.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.607 7f7297fff700 1 -- >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 msgr2=0x7f72a00d55a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.120:3300/0 2021-04-09T18:19:31.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.607 7f72a4ea7700 1 -- >> v1:172.21.15.120:6789/0 conn(0x7f72a00d5bc0 legacy=0x7f72a00d5fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.120:6789/0 2021-04-09T18:19:31.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.607 7f7297fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 0x7f72a00d55a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:19:31.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.607 7f729ffff700 1 -- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 msgr2=0x7f72a00e78e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.134:3301/0 2021-04-09T18:19:31.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.607 7f729ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 0x7f72a00e78e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:19:31.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f7297fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 0x7f72a00d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f72a4ea7700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f72a00d5bc0 0x7f72a00d5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:46902/0 (socket says 172.21.15.120:46902) 2021-04-09T18:19:31.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f7297fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 0x7f72a00d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51986/0 (socket says 172.21.15.120:51986) 2021-04-09T18:19:31.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f72a4ea7700 1 -- 172.21.15.120:0/2274931418 learned_addr learned my addr 172.21.15.120:0/2274931418 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:31.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f729ffff700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 0x7f72a00e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f7297fff700 1 -- 172.21.15.120:0/2274931418 >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 msgr2=0x7f72a00d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-04-09T18:19:31.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f7297fff700 1 -- 172.21.15.120:0/2274931418 >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 msgr2=0x7f72a00d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:19:31.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f7297fff700 1 --2- 172.21.15.120:0/2274931418 >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 0x7f72a00d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:19:31.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f7297fff700 1 --2- 172.21.15.120:0/2274931418 >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 0x7f72a00d55a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-04-09T18:19:31.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f729ffff700 1 -- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 msgr2=0x7f72a00e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:19:31.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f729ffff700 1 -- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 msgr2=0x7f72a00e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:19:31.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f729ffff700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 0x7f72a00e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:19:31.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.808 7f729ffff700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 0x7f72a00e78e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-04-09T18:19:31.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.993 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793480965 0 0) 0x7f7298000f90 con 0x7f72a00d5bc0 2021-04-09T18:19:31.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.993 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f728c002fe0 con 0x7f72a00d5bc0 2021-04-09T18:19:31.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2419108464 0 0) 0x7f7298003980 con 0x7f72a00d5bc0 2021-04-09T18:19:31.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 msgr2=0x7f72a00e78e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-04-09T18:19:31.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a00d7160 0x7f72a00e78e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 msgr2=0x7f72a00d55a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-04-09T18:19:31.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 --2- 172.21.15.120:0/2274931418 >> v2:172.21.15.120:3300/0 conn(0x7f72a00d7560 0x7f72a00d55a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a01a2ac0 con 0x7f72a00d5bc0 2021-04-09T18:19:31.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f7298003dc0 con 0x7f72a00d5bc0 2021-04-09T18:19:31.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 >> v1:172.21.15.120:6789/0 conn(0x7f72a00d5bc0 legacy=0x7f72a00d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:31.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f728c047a90 0x7f728c049ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f728c04a740 0x7f728c04cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728c04d500 0x7f728c04fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0502d0 con 0x7f728c04d500 2021-04-09T18:19:31.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0504f0 con 0x7f728c04a740 2021-04-09T18:19:31.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c050710 con 0x7f728c047a90 2021-04-09T18:19:31.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f72a4ea7700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728c04d500 0x7f728c04fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f7297fff700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f728c04a740 0x7f728c04cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f729ffff700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f728c047a90 0x7f728c049ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f72a4ea7700 1 -- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f728c047a90 msgr2=0x7f728c049ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:31.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f72a4ea7700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f728c047a90 0x7f728c049ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f72a4ea7700 1 -- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f728c04a740 msgr2=0x7f728c04cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:31.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f72a4ea7700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f728c04a740 0x7f728c04cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f72a4ea7700 1 -- 172.21.15.120:0/2274931418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c0509b0 con 0x7f728c04d500 2021-04-09T18:19:31.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.994 7f72a4ea7700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728c04d500 0x7f728c04fa20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7298009cd0 tx=0x7f729800b300).ready entity=mon.0 client_cookie=6e5ae313687a5794 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:31.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.995 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7298003b90 con 0x7f728c04d500 2021-04-09T18:19:31.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.995 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7298006e20 con 0x7f728c04d500 2021-04-09T18:19:31.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.995 7f729f7fe700 1 -- 172.21.15.120:0/2274931418 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f729800b8e0 con 0x7f728c04d500 2021-04-09T18:19:31.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.995 7f72a688a700 1 -- 172.21.15.120:0/2274931418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728c04d500 msgr2=0x7f728c04fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:31.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.995 7f72a688a700 1 --2- 172.21.15.120:0/2274931418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f728c04d500 0x7f728c04fa20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f7298009cd0 tx=0x7f729800b300).stop 2021-04-09T18:19:31.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.995 7f72a4ea7700 1 -- 172.21.15.120:0/2274931418 reap_dead start 2021-04-09T18:19:31.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.996 7f72a688a700 1 -- 172.21.15.120:0/2274931418 shutdown_connections 2021-04-09T18:19:31.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.996 7f72a688a700 1 -- 172.21.15.120:0/2274931418 >> 172.21.15.120:0/2274931418 conn(0x7f72a00d1590 msgr2=0x7f72a00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:31.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.996 7f72a688a700 1 -- 172.21.15.120:0/2274931418 shutdown_connections 2021-04-09T18:19:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:30.996 7f72a688a700 1 -- 172.21.15.120:0/2274931418 wait complete. 2021-04-09T18:19:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.015 7f72a688a700 1 Processor -- start 2021-04-09T18:19:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.015 7f72a688a700 1 -- start start 2021-04-09T18:19:31.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.015 7f72a688a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 0x7f72a00b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.015 7f72a688a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72a00b4ad0 0x7f72a0091d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.015 7f72a688a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a0092320 0x7f72a0098590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.015 7f72a688a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0092860 con 0x7f72a0092d60 2021-04-09T18:19:31.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.015 7f72a688a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a019a250 con 0x7f72a00b4ad0 2021-04-09T18:19:31.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.015 7f72a688a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0093160 con 0x7f72a0092320 2021-04-09T18:19:31.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 0x7f72a00b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 0x7f72a00b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52018/0 (socket says 172.21.15.120:52018) 2021-04-09T18:19:31.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 -- 172.21.15.120:0/3346387624 learned_addr learned my addr 172.21.15.120:0/3346387624 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:31.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f72a4ea7700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a0092320 0x7f72a0098590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f7297fff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72a00b4ad0 0x7f72a0091d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 -- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a0092320 msgr2=0x7f72a0098590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:31.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a0092320 0x7f72a0098590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 -- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72a00b4ad0 msgr2=0x7f72a0091d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:31.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72a00b4ad0 0x7f72a0091d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 -- 172.21.15.120:0/3346387624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0093380 con 0x7f72a0092d60 2021-04-09T18:19:31.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 0x7f72a00b44b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f729000d740 tx=0x7f7290004ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:31.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72900009b0 con 0x7f72a0092d60 2021-04-09T18:19:31.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7290008070 con 0x7f72a0092d60 2021-04-09T18:19:31.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f72a688a700 1 -- 172.21.15.120:0/3346387624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a0093380 con 0x7f72a0092d60 2021-04-09T18:19:31.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72900084c0 con 0x7f72a0092d60 2021-04-09T18:19:31.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f72a688a700 1 -- 172.21.15.120:0/3346387624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a0093380 con 0x7f72a0092d60 2021-04-09T18:19:31.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 -- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 msgr2=0x7f72a00b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-04-09T18:19:31.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 -- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 msgr2=0x7f72a00b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:19:31.127 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 0x7f72a00b44b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f729000d740 tx=0x7f7290004ad0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:19:31.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729ffff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 0x7f72a00b44b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f729000d740 tx=0x7f7290004ad0).stop 2021-04-09T18:19:31.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7290008250 con 0x7f72a0092d60 2021-04-09T18:19:31.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 msgr2=0x7f72a00b44b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-04-09T18:19:31.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a0092d60 0x7f72a00b44b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7284003af0 0x7f7284005f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7284006640 0x7f7284008b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72840093e0 0x7f728400b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:31.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.016 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728400c150 con 0x7f7284003af0 2021-04-09T18:19:31.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728400c370 con 0x7f7284006640 2021-04-09T18:19:31.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728400c590 con 0x7f72840093e0 2021-04-09T18:19:31.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f729ffff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7284003af0 0x7f7284005f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f7297fff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7284006640 0x7f7284008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f72a4ea7700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72840093e0 0x7f728400b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:31.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f729ffff700 1 -- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72840093e0 msgr2=0x7f728400b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:31.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f729ffff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72840093e0 0x7f728400b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f729ffff700 1 -- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7284006640 msgr2=0x7f7284008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:31.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f729ffff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7284006640 0x7f7284008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.192 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f729ffff700 1 -- 172.21.15.120:0/3346387624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) v3 -- 0x7f728400c8b0 con 0x7f7284003af0 2021-04-09T18:19:31.192 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.017 7f729ffff700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7284003af0 0x7f7284005f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7290004e70 tx=0x7f7290010530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:31.194 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.018 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7290010920 con 0x7f7284003af0 2021-04-09T18:19:31.194 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.018 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7290010920 con 0x7f7284003af0 2021-04-09T18:19:31.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.018 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7290006540 con 0x7f7284003af0 2021-04-09T18:19:31.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.018 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 4 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f729000f0d0 con 0x7f7284003af0 2021-04-09T18:19:31.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.052 7f72a688a700 1 -- 172.21.15.120:0/3346387624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a0182a10 con 0x7f7284003af0 2021-04-09T18:19:31.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.055 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66016 (secure 0 0 0) 0x7f7290010920 con 0x7f7284003af0 2021-04-09T18:19:31.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.148 7f72a688a700 1 -- 172.21.15.120:0/3346387624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"profile": "default", "prefix": "osd crush tunables"} v 0) v1 -- 0x7f72a00d6be0 con 0x7f7284003af0 2021-04-09T18:19:31.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.151 7f729d7fa700 1 -- 172.21.15.120:0/3346387624 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"profile": "default", "prefix": "osd crush tunables"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7290006540 con 0x7f7284003af0 2021-04-09T18:19:31.247 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2021-04-09T18:19:31.248 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.156 7f72a688a700 1 -- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7284003af0 msgr2=0x7f7284005f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:31.250 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.156 7f72a688a700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7284003af0 0x7f7284005f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7290004e70 tx=0x7f7290010530).stop 2021-04-09T18:19:31.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.156 7f72a688a700 1 -- 172.21.15.120:0/3346387624 shutdown_connections 2021-04-09T18:19:31.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.156 7f72a688a700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72840093e0 0x7f728400b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.156 7f72a688a700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7284006640 0x7f7284008b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.156 7f72a688a700 1 --2- 172.21.15.120:0/3346387624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7284003af0 0x7f7284005f00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:31.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.156 7f72a688a700 1 -- 172.21.15.120:0/3346387624 >> 172.21.15.120:0/3346387624 conn(0x7f72a018dce0 msgr2=0x7f72a0099450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:31.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.156 7f72a688a700 1 -- 172.21.15.120:0/3346387624 shutdown_connections 2021-04-09T18:19:31.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:31.156 7f72a688a700 1 -- 172.21.15.120:0/3346387624 wait complete. 2021-04-09T18:19:31.267 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-04-09T18:19:31.268 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:31.333 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.lvkSgib5ua 2021-04-09T18:19:31.344 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.lvkSgib5ua 2021-04-09T18:19:31.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.lvkSgib5ua 2021-04-09T18:19:31.528 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.lvkSgib5ua is 37B 2021-04-09T18:19:31.575 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.lvkSgib5ua 2021-04-09T18:19:31.618 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:31.697 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.eGjJh4gEkc 2021-04-09T18:19:31.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.eGjJh4gEkc 2021-04-09T18:19:31.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.eGjJh4gEkc 2021-04-09T18:19:31.892 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.eGjJh4gEkc is 37B 2021-04-09T18:19:31.947 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.eGjJh4gEkc 2021-04-09T18:19:32.000 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:32.072 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.knCRA20T7A 2021-04-09T18:19:32.072 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.knCRA20T7A 2021-04-09T18:19:32.165 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.knCRA20T7A 2021-04-09T18:19:32.300 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.knCRA20T7A is 37B 2021-04-09T18:19:32.372 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.knCRA20T7A 2021-04-09T18:19:32.416 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:19:32.495 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.a0vJa6B0R7 2021-04-09T18:19:32.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.a0vJa6B0R7 2021-04-09T18:19:32.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.a0vJa6B0R7 2021-04-09T18:19:32.702 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.a0vJa6B0R7 is 37B 2021-04-09T18:19:32.752 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.a0vJa6B0R7 2021-04-09T18:19:32.795 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:32.840 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.toFZngADT0 2021-04-09T18:19:32.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.toFZngADT0 2021-04-09T18:19:32.935 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.toFZngADT0 2021-04-09T18:19:33.038 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.toFZngADT0 is 37B 2021-04-09T18:19:33.146 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.toFZngADT0 2021-04-09T18:19:33.201 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:33.280 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.kGYMEaYzbO 2021-04-09T18:19:33.281 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.kGYMEaYzbO 2021-04-09T18:19:33.374 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.kGYMEaYzbO 2021-04-09T18:19:33.498 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.kGYMEaYzbO is 37B 2021-04-09T18:19:33.561 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.kGYMEaYzbO 2021-04-09T18:19:33.609 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:33.688 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.XdEsRL3hL1 2021-04-09T18:19:33.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.XdEsRL3hL1 2021-04-09T18:19:33.782 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.XdEsRL3hL1 2021-04-09T18:19:33.887 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.XdEsRL3hL1 is 37B 2021-04-09T18:19:33.948 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.XdEsRL3hL1 2021-04-09T18:19:34.003 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:19:34.075 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.faeR9hnIYL 2021-04-09T18:19:34.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.faeR9hnIYL 2021-04-09T18:19:34.167 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.faeR9hnIYL 2021-04-09T18:19:34.273 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.faeR9hnIYL is 37B 2021-04-09T18:19:34.326 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.faeR9hnIYL 2021-04-09T18:19:34.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 99df735f-537d-4d75-a10d-c026975a00a1 0 2021-04-09T18:19:34.581 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.552 7ff1a637c700 1 Processor -- start 2021-04-09T18:19:34.589 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.552 7ff1a637c700 1 -- start start 2021-04-09T18:19:34.590 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff1a637c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a00d7160 0x7ff1a00e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:34.590 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff1a637c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff1a00e70a0 0x7ff1a00d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:34.590 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff1a637c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a00d6be0 con 0x7ff1a00d7560 2021-04-09T18:19:34.590 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff1a637c700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a00d80f0 con 0x7ff1a00e70a0 2021-04-09T18:19:34.591 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff1a637c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00e7f00 con 0x7ff1a00d7160 2021-04-09T18:19:34.591 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff19ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a00d7160 0x7ff1a00e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:34.591 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff1a4999700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff1a00e70a0 0x7ff1a00d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:34.596 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff19ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a00d7160 0x7ff1a00e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:43992/0 (socket says 172.21.15.134:43992) 2021-04-09T18:19:34.596 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff19ffff700 1 -- 172.21.15.134:0/3148779130 learned_addr learned my addr 172.21.15.134:0/3148779130 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:34.596 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.553 7ff197fff700 1 --1- 172.21.15.134:0/3148779130 >> v1:172.21.15.134:6789/0 conn(0x7ff1a00d7560 0x7ff1a00d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42498/0 (socket says 172.21.15.134:42498) 2021-04-09T18:19:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff1a4999700 1 -- 172.21.15.134:0/3148779130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a00d7160 msgr2=0x7ff1a00e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff1a4999700 1 --2- 172.21.15.134:0/3148779130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a00d7160 0x7ff1a00e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff1a4999700 1 -- 172.21.15.134:0/3148779130 >> v1:172.21.15.134:6789/0 conn(0x7ff1a00d7560 legacy=0x7ff1a00d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff19f7fe700 1 -- 172.21.15.134:0/3148779130 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073907769 0 0) 0x7ff188000ce0 con 0x7ff1a00d7560 2021-04-09T18:19:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff1a4999700 1 -- 172.21.15.134:0/3148779130 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a01a2ac0 con 0x7ff1a00e70a0 2021-04-09T18:19:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff19ffff700 1 --2- 172.21.15.134:0/3148779130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a00d7160 0x7ff1a00e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff1a4999700 1 --2- 172.21.15.134:0/3148779130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00e70a0 0x7ff1a00d5d90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff198006e30 tx=0x7ff198009e60).ready entity=mon.1 client_cookie=7d9257de2f49a20 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff19f7fe700 1 -- 172.21.15.134:0/3148779130 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff198006a50 con 0x7ff1a00e70a0 2021-04-09T18:19:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff19f7fe700 1 -- 172.21.15.134:0/3148779130 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19800b300 con 0x7ff1a00e70a0 2021-04-09T18:19:34.599 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff19f7fe700 1 -- 172.21.15.134:0/3148779130 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff19800b750 con 0x7ff1a00e70a0 2021-04-09T18:19:34.599 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff1a637c700 1 -- 172.21.15.134:0/3148779130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00e70a0 msgr2=0x7ff1a00d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:34.599 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.554 7ff1a637c700 1 --2- 172.21.15.134:0/3148779130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00e70a0 0x7ff1a00d5d90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff198006e30 tx=0x7ff198009e60).stop 2021-04-09T18:19:34.599 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.555 7ff1a637c700 1 -- 172.21.15.134:0/3148779130 shutdown_connections 2021-04-09T18:19:34.599 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.555 7ff1a637c700 1 --2- 172.21.15.134:0/3148779130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00e70a0 0x7ff1a00d5d90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.555 7ff1a637c700 1 --2- 172.21.15.134:0/3148779130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a00d7160 0x7ff1a00e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.555 7ff1a637c700 1 -- 172.21.15.134:0/3148779130 >> 172.21.15.134:0/3148779130 conn(0x7ff1a00d1590 msgr2=0x7ff1a00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.555 7ff1a637c700 1 -- 172.21.15.134:0/3148779130 shutdown_connections 2021-04-09T18:19:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.555 7ff1a637c700 1 -- 172.21.15.134:0/3148779130 wait complete. 2021-04-09T18:19:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.573 7ff1a637c700 1 Processor -- start 2021-04-09T18:19:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff1a637c700 1 -- start start 2021-04-09T18:19:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff1a637c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a018c8c0 0x7ff1a0183f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff1a637c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a018ccc0 0x7ff1a00b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:34.601 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff1a637c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a0184540 0x7ff1a00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:34.602 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff1a637c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a018c3c0 con 0x7ff1a0184540 2021-04-09T18:19:34.611 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff1a637c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00a34b0 con 0x7ff1a018ccc0 2021-04-09T18:19:34.612 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff1a637c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00a36d0 con 0x7ff1a018c8c0 2021-04-09T18:19:34.612 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff19ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a018c8c0 0x7ff1a0183f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:34.612 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff19ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a018c8c0 0x7ff1a0183f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:43998/0 (socket says 172.21.15.134:43998) 2021-04-09T18:19:34.613 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff197fff700 1 -- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a018ccc0 msgr2=0x7ff1a00b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-04-09T18:19:34.613 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff19ffff700 1 -- 172.21.15.134:0/1525930123 learned_addr learned my addr 172.21.15.134:0/1525930123 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:34.614 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff197fff700 1 -- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a018ccc0 msgr2=0x7ff1a00b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:19:34.614 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff197fff700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a018ccc0 0x7ff1a00b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2021-04-09T18:19:34.627 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff197fff700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a018ccc0 0x7ff1a00b4fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:19:34.627 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff19ffff700 1 -- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a018ccc0 msgr2=0x7ff1a00b4fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-04-09T18:19:34.628 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff19ffff700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a018ccc0 0x7ff1a00b4fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:19:34.628 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff19ffff700 1 -- 172.21.15.134:0/1525930123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a0184540 msgr2=0x7ff1a00b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:34.629 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff1a4999700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a0184540 0x7ff1a00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:34.629 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff19ffff700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a0184540 0x7ff1a00b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.629 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff19ffff700 1 -- 172.21.15.134:0/1525930123 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00b5c70 con 0x7ff1a018c8c0 2021-04-09T18:19:34.630 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.574 7ff19ffff700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a018c8c0 0x7ff1a0183f20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff190006ee0 tx=0x7ff19000b8e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:34.630 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.575 7ff19d7fa700 1 -- 172.21.15.134:0/1525930123 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff19000bcd0 con 0x7ff1a018c8c0 2021-04-09T18:19:34.631 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.575 7ff19d7fa700 1 -- 172.21.15.134:0/1525930123 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1900052e0 con 0x7ff1a018c8c0 2021-04-09T18:19:34.631 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.575 7ff19d7fa700 1 -- 172.21.15.134:0/1525930123 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff190005730 con 0x7ff1a018c8c0 2021-04-09T18:19:34.635 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.575 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a00b5c70 con 0x7ff1a018c8c0 2021-04-09T18:19:34.635 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.575 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a00b5c70 con 0x7ff1a018c8c0 2021-04-09T18:19:34.636 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.575 7ff19d7fa700 1 -- 172.21.15.134:0/1525930123 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff1900054c0 con 0x7ff1a018c8c0 2021-04-09T18:19:34.637 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.575 7ff19d7fa700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff1840188d0 0x7ff18401add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:34.637 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.575 7ff19d7fa700 1 -- 172.21.15.134:0/1525930123 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff1900318a0 con 0x7ff1a018c8c0 2021-04-09T18:19:34.638 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.575 7ff197fff700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff1840188d0 0x7ff18401add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:34.638 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.576 7ff197fff700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff1840188d0 0x7ff18401add0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:34.647 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.599 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a0182a30 con 0x7ff1a018c8c0 2021-04-09T18:19:34.649 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.602 7ff19d7fa700 1 -- 172.21.15.134:0/1525930123 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff19001f730 con 0x7ff1a018c8c0 2021-04-09T18:19:34.788 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.789 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "99df735f-537d-4d75-a10d-c026975a00a1", "id": 0} v 0) v1 -- 0x7ff1a0182a30 con 0x7ff1a018c8c0 2021-04-09T18:19:34.796 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.795 7ff19d7fa700 1 -- 172.21.15.134:0/1525930123 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99df735f-537d-4d75-a10d-c026975a00a1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff19000bcd0 con 0x7ff1a018c8c0 2021-04-09T18:19:34.797 INFO:teuthology.orchestra.run.smithi134.stdout:0 2021-04-09T18:19:34.799 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff1840188d0 msgr2=0x7ff18401add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:34.804 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff1840188d0 0x7ff18401add0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.805 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a018c8c0 msgr2=0x7ff1a0183f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:34.805 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a018c8c0 0x7ff1a0183f20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff190006ee0 tx=0x7ff19000b8e0).stop 2021-04-09T18:19:34.806 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 shutdown_connections 2021-04-09T18:19:34.806 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a0184540 0x7ff1a00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.806 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a018ccc0 0x7ff1a00b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:19:34.807 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff1840188d0 0x7ff18401add0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.809 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 --2- 172.21.15.134:0/1525930123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1a018c8c0 0x7ff1a0183f20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.809 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 >> 172.21.15.134:0/1525930123 conn(0x7ff1a018dce0 msgr2=0x7ff1a0197a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:34.810 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 shutdown_connections 2021-04-09T18:19:34.810 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.799 7ff1a637c700 1 -- 172.21.15.134:0/1525930123 wait complete. 2021-04-09T18:19:34.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c48018d0-ff09-4a42-834e-5bbb908978d8 1 2021-04-09T18:19:34.982 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.958 7f8e61e62700 1 Processor -- start 2021-04-09T18:19:34.982 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.958 7f8e61e62700 1 -- start start 2021-04-09T18:19:34.983 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.958 7f8e61e62700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8e5c0d7160 0x7f8e5c0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:34.983 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.958 7f8e61e62700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c0d55a0 0x7f8e5c0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:34.989 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.958 7f8e61e62700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8e5c0d5fc0 0x7f8e5c0d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:34.989 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.958 7f8e61e62700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c0e80a0 con 0x7f8e5c0d7160 2021-04-09T18:19:34.990 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.958 7f8e61e62700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c0d80f0 con 0x7f8e5c0d5fc0 2021-04-09T18:19:34.990 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.958 7f8e61e62700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c0d6be0 con 0x7f8e5c0d55a0 2021-04-09T18:19:34.991 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8e5c0d5fc0 0x7f8e5c0d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:34.991 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5affd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c0d55a0 0x7f8e5c0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:34.992 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8e5c0d5fc0 0x7f8e5c0d63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41578/0 (socket says 172.21.15.134:41578) 2021-04-09T18:19:34.992 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5affd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c0d55a0 0x7f8e5c0d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:44014/0 (socket says 172.21.15.134:44014) 2021-04-09T18:19:34.992 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5bfff700 1 -- 172.21.15.134:0/1831610546 learned_addr learned my addr 172.21.15.134:0/1831610546 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:34.993 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5b7fe700 1 --2- 172.21.15.134:0/1831610546 >> v2:172.21.15.120:3300/0 conn(0x7f8e5c0d7160 0x7f8e5c0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:34.993 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5bfff700 1 -- 172.21.15.134:0/1831610546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c0d55a0 msgr2=0x7f8e5c0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:34.993 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5bfff700 1 --2- 172.21.15.134:0/1831610546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c0d55a0 0x7f8e5c0d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5bfff700 1 -- 172.21.15.134:0/1831610546 >> v2:172.21.15.120:3300/0 conn(0x7f8e5c0d7160 msgr2=0x7f8e5c0d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:34.994 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5bfff700 1 --2- 172.21.15.134:0/1831610546 >> v2:172.21.15.120:3300/0 conn(0x7f8e5c0d7160 0x7f8e5c0d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:34.996 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5bfff700 1 -- 172.21.15.134:0/1831610546 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c1a2ac0 con 0x7f8e5c0d5fc0 2021-04-09T18:19:34.996 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5affd700 1 --2- 172.21.15.134:0/1831610546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c0d55a0 0x7f8e5c0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:35.035 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5b7fe700 1 --2- 172.21.15.134:0/1831610546 >> v2:172.21.15.120:3300/0 conn(0x7f8e5c0d7160 0x7f8e5c0d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:35.035 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5bfff700 1 --2- 172.21.15.134:0/1831610546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c0d5fc0 0x7f8e5c0d63c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8e54006b80 tx=0x7f8e54009b90).ready entity=mon.1 client_cookie=e55dafb33e012026 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:35.036 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5a7fc700 1 -- 172.21.15.134:0/1831610546 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e540022e0 con 0x7f8e5c0d5fc0 2021-04-09T18:19:35.036 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5a7fc700 1 -- 172.21.15.134:0/1831610546 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e54002620 con 0x7f8e5c0d5fc0 2021-04-09T18:19:35.036 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e5a7fc700 1 -- 172.21.15.134:0/1831610546 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e54002b00 con 0x7f8e5c0d5fc0 2021-04-09T18:19:35.041 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e61e62700 1 -- 172.21.15.134:0/1831610546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c0d5fc0 msgr2=0x7f8e5c0d63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.042 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.959 7f8e61e62700 1 --2- 172.21.15.134:0/1831610546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c0d5fc0 0x7f8e5c0d63c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8e54006b80 tx=0x7f8e54009b90).stop 2021-04-09T18:19:35.042 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.960 7f8e61e62700 1 -- 172.21.15.134:0/1831610546 shutdown_connections 2021-04-09T18:19:35.043 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.960 7f8e61e62700 1 --2- 172.21.15.134:0/1831610546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c0d5fc0 0x7f8e5c0d63c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.043 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.960 7f8e61e62700 1 --2- 172.21.15.134:0/1831610546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c0d55a0 0x7f8e5c0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.044 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.960 7f8e61e62700 1 --2- 172.21.15.134:0/1831610546 >> v2:172.21.15.120:3300/0 conn(0x7f8e5c0d7160 0x7f8e5c0d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.044 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.960 7f8e61e62700 1 -- 172.21.15.134:0/1831610546 >> 172.21.15.134:0/1831610546 conn(0x7f8e5c0d1590 msgr2=0x7f8e5c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:35.045 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.960 7f8e61e62700 1 -- 172.21.15.134:0/1831610546 shutdown_connections 2021-04-09T18:19:35.045 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.960 7f8e61e62700 1 -- 172.21.15.134:0/1831610546 wait complete. 2021-04-09T18:19:35.045 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.979 7f8e61e62700 1 Processor -- start 2021-04-09T18:19:35.046 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.979 7f8e61e62700 1 -- start start 2021-04-09T18:19:35.058 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e61e62700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e5c19f420 0x7f8e5c183bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.059 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e61e62700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c184210 0x7f8e5c094900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.059 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e61e62700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c094f20 0x7f8e5c095320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.060 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e61e62700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c095940 con 0x7f8e5c19f420 2021-04-09T18:19:35.060 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e61e62700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c0af1b0 con 0x7f8e5c184210 2021-04-09T18:19:35.061 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e61e62700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c18cf20 con 0x7f8e5c094f20 2021-04-09T18:19:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5bfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c094f20 0x7f8e5c095320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c184210 0x7f8e5c094900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5bfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c094f20 0x7f8e5c095320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:44020/0 (socket says 172.21.15.134:44020) 2021-04-09T18:19:35.068 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5bfff700 1 -- 172.21.15.134:0/933064869 learned_addr learned my addr 172.21.15.134:0/933064869 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:35.068 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5affd700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c184210 0x7f8e5c094900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41584/0 (socket says 172.21.15.134:41584) 2021-04-09T18:19:35.068 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5b7fe700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e5c19f420 0x7f8e5c183bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.097 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5bfff700 1 -- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c184210 msgr2=0x7f8e5c094900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.098 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5bfff700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c184210 0x7f8e5c094900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.099 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5bfff700 1 -- 172.21.15.134:0/933064869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e5c19f420 msgr2=0x7f8e5c183bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.099 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5bfff700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e5c19f420 0x7f8e5c183bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.099 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5bfff700 1 -- 172.21.15.134:0/933064869 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c19f820 con 0x7f8e5c094f20 2021-04-09T18:19:35.100 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5affd700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c184210 0x7f8e5c094900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:35.100 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e5bfff700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c094f20 0x7f8e5c095320 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8e54006f10 tx=0x7f8e5400b960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:35.101 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e53fff700 1 -- 172.21.15.134:0/933064869 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e54000b90 con 0x7f8e5c094f20 2021-04-09T18:19:35.101 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e53fff700 1 -- 172.21.15.134:0/933064869 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5400bd50 con 0x7f8e5c094f20 2021-04-09T18:19:35.101 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e61e62700 1 -- 172.21.15.134:0/933064869 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c19f820 con 0x7f8e5c094f20 2021-04-09T18:19:35.102 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e53fff700 1 -- 172.21.15.134:0/933064869 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e54002270 con 0x7f8e5c094f20 2021-04-09T18:19:35.102 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.980 7f8e61e62700 1 -- 172.21.15.134:0/933064869 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c19f820 con 0x7f8e5c094f20 2021-04-09T18:19:35.102 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.981 7f8e53fff700 1 -- 172.21.15.134:0/933064869 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8e54002020 con 0x7f8e5c094f20 2021-04-09T18:19:35.103 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.981 7f8e53fff700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e40018930 0x7f8e4001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.103 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.981 7f8e53fff700 1 -- 172.21.15.134:0/933064869 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 857+0+0 (secure 0 0 0) 0x7f8e540318f0 con 0x7f8e5c094f20 2021-04-09T18:19:35.104 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.981 7f8e5b7fe700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e40018930 0x7f8e4001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.104 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:34.981 7f8e5b7fe700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e40018930 0x7f8e4001ae10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:35.105 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.004 7f8e61e62700 1 -- 172.21.15.134:0/933064869 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c095940 con 0x7f8e5c094f20 2021-04-09T18:19:35.106 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.007 7f8e53fff700 1 -- 172.21.15.134:0/933064869 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8e54009310 con 0x7f8e5c094f20 2021-04-09T18:19:35.191 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.193 7f8e61e62700 1 -- 172.21.15.134:0/933064869 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c48018d0-ff09-4a42-834e-5bbb908978d8", "id": 1} v 0) v1 -- 0x7f8e5c095940 con 0x7f8e5c094f20 2021-04-09T18:19:35.199 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.201 7f8e53fff700 1 -- 172.21.15.134:0/933064869 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c48018d0-ff09-4a42-834e-5bbb908978d8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e5400bd50 con 0x7f8e5c094f20 2021-04-09T18:19:35.206 INFO:teuthology.orchestra.run.smithi134.stdout:1 2021-04-09T18:19:35.210 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 -- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e40018930 msgr2=0x7f8e4001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.210 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e40018930 0x7f8e4001ae10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.211 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 -- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c094f20 msgr2=0x7f8e5c095320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.211 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c094f20 0x7f8e5c095320 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8e54006f10 tx=0x7f8e5400b960).stop 2021-04-09T18:19:35.211 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 -- 172.21.15.134:0/933064869 shutdown_connections 2021-04-09T18:19:35.212 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e40018930 0x7f8e4001ae10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.212 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e5c094f20 0x7f8e5c095320 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.213 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e5c184210 0x7f8e5c094900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.214 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 --2- 172.21.15.134:0/933064869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e5c19f420 0x7f8e5c183bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.214 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 -- 172.21.15.134:0/933064869 >> 172.21.15.134:0/933064869 conn(0x7f8e5c18dcc0 msgr2=0x7f8e5c197a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:35.214 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 -- 172.21.15.134:0/933064869 shutdown_connections 2021-04-09T18:19:35.215 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.210 7f8e61e62700 1 -- 172.21.15.134:0/933064869 wait complete. 2021-04-09T18:19:35.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 3612c205-5cef-4483-b2f7-af04854d9004 2 2021-04-09T18:19:35.384 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.361 7f0440a9b700 1 Processor -- start 2021-04-09T18:19:35.385 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.361 7f0440a9b700 1 -- start start 2021-04-09T18:19:35.385 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f0440a9b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f043c0d7560 0x7f043c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.386 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f0440a9b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c0d63b0 0x7f043c1ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.386 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f0440a9b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0d7960 con 0x7f043c0d7160 2021-04-09T18:19:35.387 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f0440a9b700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c0d80f0 con 0x7f043c0d7560 2021-04-09T18:19:35.387 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f0440a9b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0d6be0 con 0x7f043c0d63b0 2021-04-09T18:19:35.387 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043b05f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c0d63b0 0x7f043c1ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.388 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043a85e700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f043c0d7160 0x7f043c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42530/0 (socket says 172.21.15.134:42530) 2021-04-09T18:19:35.388 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043a85e700 1 -- 172.21.15.134:0/4283912772 learned_addr learned my addr 172.21.15.134:0/4283912772 (peer_addr_for_me v1:172.21.15.134:0/0) 2021-04-09T18:19:35.389 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043a05d700 1 --2- 172.21.15.134:0/4283912772 >> v2:172.21.15.120:3300/0 conn(0x7f043c0d7560 0x7f043c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.390 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043985c700 1 -- 172.21.15.134:0/4283912772 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295100741 0 0) 0x7f0424001060 con 0x7f043c0d7160 2021-04-09T18:19:35.390 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043985c700 1 -- 172.21.15.134:0/4283912772 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f041c002fe0 con 0x7f043c0d7160 2021-04-09T18:19:35.391 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043b05f700 1 -- 172.21.15.134:0/4283912772 >> v2:172.21.15.120:3300/0 conn(0x7f043c0d7560 msgr2=0x7f043c0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:35.391 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043b05f700 1 --2- 172.21.15.134:0/4283912772 >> v2:172.21.15.120:3300/0 conn(0x7f043c0d7560 0x7f043c0d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.391 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043b05f700 1 -- 172.21.15.134:0/4283912772 >> v1:172.21.15.134:6789/0 conn(0x7f043c0d7160 legacy=0x7f043c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.392 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.362 7f043b05f700 1 -- 172.21.15.134:0/4283912772 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c1a2ac0 con 0x7f043c0d63b0 2021-04-09T18:19:35.392 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.363 7f043b05f700 1 --2- 172.21.15.134:0/4283912772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c0d63b0 0x7f043c1ab1e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f0434006ab0 tx=0x7f0434009b40).ready entity=mon.2 client_cookie=8201e8808e89478b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:35.393 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.363 7f043985c700 1 -- 172.21.15.134:0/4283912772 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f04340022e0 con 0x7f043c0d63b0 2021-04-09T18:19:35.393 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.363 7f043985c700 1 -- 172.21.15.134:0/4283912772 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434002660 con 0x7f043c0d63b0 2021-04-09T18:19:35.394 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.363 7f043985c700 1 -- 172.21.15.134:0/4283912772 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0434002b40 con 0x7f043c0d63b0 2021-04-09T18:19:35.394 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.363 7f0440a9b700 1 -- 172.21.15.134:0/4283912772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c0d63b0 msgr2=0x7f043c1ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.407 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.363 7f0440a9b700 1 --2- 172.21.15.134:0/4283912772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c0d63b0 0x7f043c1ab1e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f0434006ab0 tx=0x7f0434009b40).stop 2021-04-09T18:19:35.408 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.364 7f0440a9b700 1 -- 172.21.15.134:0/4283912772 shutdown_connections 2021-04-09T18:19:35.408 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.364 7f0440a9b700 1 --2- 172.21.15.134:0/4283912772 >> v2:172.21.15.120:3300/0 conn(0x7f043c0d7560 0x7f043c0d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.409 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.364 7f0440a9b700 1 --2- 172.21.15.134:0/4283912772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c0d63b0 0x7f043c1ab1e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.409 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.364 7f0440a9b700 1 -- 172.21.15.134:0/4283912772 >> 172.21.15.134:0/4283912772 conn(0x7f043c0d1590 msgr2=0x7f043c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:35.410 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.364 7f0440a9b700 1 -- 172.21.15.134:0/4283912772 shutdown_connections 2021-04-09T18:19:35.422 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.364 7f0440a9b700 1 -- 172.21.15.134:0/4283912772 wait complete. 2021-04-09T18:19:35.422 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.382 7f0440a9b700 1 Processor -- start 2021-04-09T18:19:35.456 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f0440a9b700 1 -- start start 2021-04-09T18:19:35.457 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f0440a9b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f043c18c8c0 0x7f043c183f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.457 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f0440a9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 0x7f043c0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.457 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f0440a9b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c184540 0x7f043c0b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.458 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f0440a9b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c18c3c0 con 0x7f043c18c8c0 2021-04-09T18:19:35.458 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f0440a9b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0a34b0 con 0x7f043c18ccc0 2021-04-09T18:19:35.459 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f0440a9b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0a36d0 con 0x7f043c184540 2021-04-09T18:19:35.459 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043b05f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c184540 0x7f043c0b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.459 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043b05f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c184540 0x7f043c0b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:44032/0 (socket says 172.21.15.134:44032) 2021-04-09T18:19:35.460 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043a05d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 0x7f043c0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.460 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043b05f700 1 -- 172.21.15.134:0/114333455 learned_addr learned my addr 172.21.15.134:0/114333455 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:35.461 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043a85e700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f043c18c8c0 0x7f043c183f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.461 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043a05d700 1 -- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c184540 msgr2=0x7f043c0b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.461 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c184540 0x7f043c0b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.462 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043a05d700 1 -- 172.21.15.134:0/114333455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f043c18c8c0 msgr2=0x7f043c183f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.462 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f043c18c8c0 0x7f043c183f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.463 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043a05d700 1 -- 172.21.15.134:0/114333455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0b5c70 con 0x7f043c18ccc0 2021-04-09T18:19:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.383 7f043b05f700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f043c184540 0x7f043c0b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.384 7f043a05d700 1 -- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 msgr2=0x7f043c0b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send send error: (32) Broken pipe 2021-04-09T18:19:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.384 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 0x7f043c0b4fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0x7f042c009540 tx=0x7f042c00b8e0).write client ident write failed r=-32 ((32) Broken pipe) 2021-04-09T18:19:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.384 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 0x7f043c0b4fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:19:35.590 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 0x7f043c0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.590 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 0 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 0x7f043c0b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2021-04-09T18:19:35.591 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 0x7f043c0b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.591 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 -- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 msgr2=0x7f043c0b4fc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-04-09T18:19:35.592 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f043c18ccc0 0x7f043c0b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.592 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0414002eb0 0x7f0414005390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.592 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0414005c30 0x7f0414008150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.593 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04140089f0 0x7f041400af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.593 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 -- 172.21.15.134:0/114333455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041400b760 con 0x7f0414002eb0 2021-04-09T18:19:35.594 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 -- 172.21.15.134:0/114333455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041400b980 con 0x7f04140089f0 2021-04-09T18:19:35.594 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 -- 172.21.15.134:0/114333455 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041400bba0 con 0x7f0414005c30 2021-04-09T18:19:35.594 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0414005c30 0x7f0414008150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.597 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043b05f700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04140089f0 0x7f041400af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.597 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a85e700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0414002eb0 0x7f0414005390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.599 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 1 -- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04140089f0 msgr2=0x7f041400af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.599 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04140089f0 0x7f041400af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 1 -- 172.21.15.134:0/114333455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0414002eb0 msgr2=0x7f0414005390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0414002eb0 0x7f0414005390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 1 -- 172.21.15.134:0/114333455 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041400be40 con 0x7f0414005c30 2021-04-09T18:19:35.601 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043b05f700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04140089f0 0x7f041400af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:35.601 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f043a05d700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0414005c30 0x7f0414008150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f042c006e80 tx=0x7f042c002930).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:35.602 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 -- 172.21.15.134:0/114333455 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f042c00d300 con 0x7f0414005c30 2021-04-09T18:19:35.602 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 -- 172.21.15.134:0/114333455 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c00d580 con 0x7f0414005c30 2021-04-09T18:19:35.609 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f0440a9b700 1 -- 172.21.15.134:0/114333455 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c0b5c70 con 0x7f0414005c30 2021-04-09T18:19:35.610 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 -- 172.21.15.134:0/114333455 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f042c00da60 con 0x7f0414005c30 2021-04-09T18:19:35.610 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f0440a9b700 1 -- 172.21.15.134:0/114333455 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c0b5c70 con 0x7f0414005c30 2021-04-09T18:19:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 -- 172.21.15.134:0/114333455 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f042c0052e0 con 0x7f0414005c30 2021-04-09T18:19:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0414020f90 0x7f04140233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.611 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.585 7f04337fe700 1 -- 172.21.15.134:0/114333455 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 960+0+0 (secure 0 0 0) 0x7f042c032b80 con 0x7f0414005c30 2021-04-09T18:19:35.612 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.586 7f043a85e700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0414020f90 0x7f04140233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.612 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.586 7f043a85e700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0414020f90 0x7f04140233a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:35.613 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.608 7f0440a9b700 1 -- 172.21.15.134:0/114333455 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c182a30 con 0x7f0414005c30 2021-04-09T18:19:35.614 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.612 7f04337fe700 1 -- 172.21.15.134:0/114333455 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f042c002a70 con 0x7f0414005c30 2021-04-09T18:19:35.799 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.800 7f0440a9b700 1 -- 172.21.15.134:0/114333455 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3612c205-5cef-4483-b2f7-af04854d9004", "id": 2} v 0) v1 -- 0x7f043c182a30 con 0x7f0414005c30 2021-04-09T18:19:35.802 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.804 7f04337fe700 1 -- 172.21.15.134:0/114333455 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3612c205-5cef-4483-b2f7-af04854d9004", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f042c0052e0 con 0x7f0414005c30 2021-04-09T18:19:35.806 INFO:teuthology.orchestra.run.smithi134.stdout:2 2021-04-09T18:19:35.809 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 -- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0414020f90 msgr2=0x7f04140233a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.810 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0414020f90 0x7f04140233a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.810 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 -- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0414005c30 msgr2=0x7f0414008150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.811 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0414005c30 0x7f0414008150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f042c006e80 tx=0x7f042c002930).stop 2021-04-09T18:19:35.811 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 -- 172.21.15.134:0/114333455 shutdown_connections 2021-04-09T18:19:35.812 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04140089f0 0x7f041400af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.812 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0414020f90 0x7f04140233a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.812 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0414005c30 0x7f0414008150 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.813 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 --2- 172.21.15.134:0/114333455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0414002eb0 0x7f0414005390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.813 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 -- 172.21.15.134:0/114333455 >> 172.21.15.134:0/114333455 conn(0x7f043c18dce0 msgr2=0x7f043c197a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:35.814 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 -- 172.21.15.134:0/114333455 shutdown_connections 2021-04-09T18:19:35.815 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.810 7f0440a9b700 1 -- 172.21.15.134:0/114333455 wait complete. 2021-04-09T18:19:35.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 45c829c9-94c2-4106-abd4-1823a81a19d8 3 2021-04-09T18:19:35.982 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.961 7f0bbbae4700 1 Processor -- start 2021-04-09T18:19:35.983 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.961 7f0bbbae4700 1 -- start start 2021-04-09T18:19:35.983 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bbbae4700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0bb407e700 0x7f0bb4100210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.983 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bbbae4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb4100830 0x7f0bb40ff080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:35.985 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bbbae4700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb40ffc90 con 0x7f0bb40ff6a0 2021-04-09T18:19:35.986 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bbbae4700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb40d79a0 con 0x7f0bb407e700 2021-04-09T18:19:35.987 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bbbae4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40d80e0 con 0x7f0bb4100830 2021-04-09T18:19:35.987 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bb90ff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb4100830 0x7f0bb40ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.988 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bb9900700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0bb407e700 0x7f0bb4100210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:35.988 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bb9900700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0bb407e700 0x7f0bb4100210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41612/0 (socket says 172.21.15.134:41612) 2021-04-09T18:19:35.988 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bb90ff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb4100830 0x7f0bb40ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:44050/0 (socket says 172.21.15.134:44050) 2021-04-09T18:19:35.989 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.962 7f0bb9900700 1 -- 172.21.15.134:0/3972251261 learned_addr learned my addr 172.21.15.134:0/3972251261 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:35.989 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bb90ff700 1 -- 172.21.15.134:0/3972251261 >> v2:172.21.15.134:3300/0 conn(0x7f0bb407e700 msgr2=0x7f0bb4100210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:35.989 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bb90ff700 1 --2- 172.21.15.134:0/3972251261 >> v2:172.21.15.134:3300/0 conn(0x7f0bb407e700 0x7f0bb4100210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.990 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bb90ff700 1 -- 172.21.15.134:0/3972251261 >> v1:172.21.15.120:6789/0 conn(0x7f0bb40ff6a0 legacy=0x7f0bb41aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.990 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bb90ff700 1 -- 172.21.15.134:0/3972251261 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb40d2040 con 0x7f0bb4100830 2021-04-09T18:19:35.990 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bb9900700 1 --2- 172.21.15.134:0/3972251261 >> v2:172.21.15.134:3300/0 conn(0x7f0bb407e700 0x7f0bb4100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:35.991 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bb90ff700 1 --2- 172.21.15.134:0/3972251261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb4100830 0x7f0bb40ff080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0ba8006650 tx=0x7f0ba8009a80).ready entity=mon.2 client_cookie=ef23f8600882b32f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:35.991 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bb88fe700 1 -- 172.21.15.134:0/3972251261 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ba800c0c0 con 0x7f0bb4100830 2021-04-09T18:19:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bb88fe700 1 -- 172.21.15.134:0/3972251261 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba800c3c0 con 0x7f0bb4100830 2021-04-09T18:19:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bb88fe700 1 -- 172.21.15.134:0/3972251261 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ba800c810 con 0x7f0bb4100830 2021-04-09T18:19:35.992 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bbbae4700 1 -- 172.21.15.134:0/3972251261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb4100830 msgr2=0x7f0bb40ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:35.993 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.963 7f0bbbae4700 1 --2- 172.21.15.134:0/3972251261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb4100830 0x7f0bb40ff080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0ba8006650 tx=0x7f0ba8009a80).stop 2021-04-09T18:19:35.993 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.964 7f0bbbae4700 1 -- 172.21.15.134:0/3972251261 shutdown_connections 2021-04-09T18:19:35.994 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.964 7f0bbbae4700 1 --2- 172.21.15.134:0/3972251261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb4100830 0x7f0bb40ff080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:35.994 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.964 7f0bbbae4700 1 --2- 172.21.15.134:0/3972251261 >> v2:172.21.15.134:3300/0 conn(0x7f0bb407e700 0x7f0bb4100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.004 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.964 7f0bbbae4700 1 -- 172.21.15.134:0/3972251261 >> 172.21.15.134:0/3972251261 conn(0x7f0bb40f0050 msgr2=0x7f0bb40d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:36.004 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.964 7f0bbbae4700 1 -- 172.21.15.134:0/3972251261 shutdown_connections 2021-04-09T18:19:36.004 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.964 7f0bbbae4700 1 -- 172.21.15.134:0/3972251261 wait complete. 2021-04-09T18:19:36.005 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bbbae4700 1 Processor -- start 2021-04-09T18:19:36.005 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bbbae4700 1 -- start start 2021-04-09T18:19:36.006 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bbbae4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0bb409ac20 0x7f0bb409b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.006 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bbbae4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb409b020 0x7f0bb408d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.024 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bbbae4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bb408d910 0x7f0bb40af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.030 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bbbae4700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb409b5e0 con 0x7f0bb409ac20 2021-04-09T18:19:36.064 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bbbae4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb408c990 con 0x7f0bb408d910 2021-04-09T18:19:36.065 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bbbae4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb409bf10 con 0x7f0bb409b020 2021-04-09T18:19:36.065 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bb90ff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb409b020 0x7f0bb408d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.065 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bba101700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bb408d910 0x7f0bb40af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.066 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bba101700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bb408d910 0x7f0bb40af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41618/0 (socket says 172.21.15.134:41618) 2021-04-09T18:19:36.066 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bba101700 1 -- 172.21.15.134:0/3518581095 learned_addr learned my addr 172.21.15.134:0/3518581095 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:36.070 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bb90ff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb409b020 0x7f0bb408d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:44052/0 (socket says 172.21.15.134:44052) 2021-04-09T18:19:36.071 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.983 7f0bb9900700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0bb409ac20 0x7f0bb409b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.071 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bba101700 1 -- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb409b020 msgr2=0x7f0bb408d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.072 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bba101700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb409b020 0x7f0bb408d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.072 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bba101700 1 -- 172.21.15.134:0/3518581095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0bb409ac20 msgr2=0x7f0bb409b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.072 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bba101700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0bb409ac20 0x7f0bb409b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.073 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bba101700 1 -- 172.21.15.134:0/3518581095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb40afd20 con 0x7f0bb408d910 2021-04-09T18:19:36.073 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bb90ff700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb409b020 0x7f0bb408d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:36.073 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bba101700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bb408d910 0x7f0bb40af700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0bac006ed0 tx=0x7f0bac00b960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:36.074 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bb27fc700 1 -- 172.21.15.134:0/3518581095 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0bac00bd50 con 0x7f0bb408d910 2021-04-09T18:19:36.074 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bb27fc700 1 -- 172.21.15.134:0/3518581095 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac0020d0 con 0x7f0bb408d910 2021-04-09T18:19:36.074 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb40afd20 con 0x7f0bb408d910 2021-04-09T18:19:36.095 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bb27fc700 1 -- 172.21.15.134:0/3518581095 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0bac0025f0 con 0x7f0bb408d910 2021-04-09T18:19:36.095 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.984 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb40afd20 con 0x7f0bb408d910 2021-04-09T18:19:36.096 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.985 7f0bb27fc700 1 -- 172.21.15.134:0/3518581095 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0bac0022b0 con 0x7f0bb408d910 2021-04-09T18:19:36.096 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.985 7f0bb27fc700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 0x7f0b9401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.096 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.985 7f0bb27fc700 1 -- 172.21.15.134:0/3518581095 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1063+0+0 (secure 0 0 0) 0x7f0bac031880 con 0x7f0bb408d910 2021-04-09T18:19:36.097 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.985 7f0bb9900700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 0x7f0b9401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.097 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.985 7f0bb9900700 1 -- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 msgr2=0x7f0b9401ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-04-09T18:19:36.097 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.985 7f0bb9900700 1 -- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 msgr2=0x7f0b9401ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:19:36.097 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.985 7f0bb9900700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 0x7f0b9401ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:19:36.098 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:35.985 7f0bb9900700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 0x7f0b9401ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:19:36.098 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.007 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb4179b60 con 0x7f0bb408d910 2021-04-09T18:19:36.098 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.011 7f0bb27fc700 1 -- 172.21.15.134:0/3518581095 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0bac0022e0 con 0x7f0bb408d910 2021-04-09T18:19:36.184 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.186 7f0bb9900700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 0x7f0b9401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.185 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.186 7f0bb9900700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 0x7f0b9401ae10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:36.205 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.197 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "45c829c9-94c2-4106-abd4-1823a81a19d8", "id": 3} v 0) v1 -- 0x7f0bb40ffc90 con 0x7f0bb408d910 2021-04-09T18:19:36.205 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.201 7f0bb27fc700 1 -- 172.21.15.134:0/3518581095 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45c829c9-94c2-4106-abd4-1823a81a19d8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0bac0020d0 con 0x7f0bb408d910 2021-04-09T18:19:36.206 INFO:teuthology.orchestra.run.smithi134.stdout:3 2021-04-09T18:19:36.221 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 msgr2=0x7f0b9401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.222 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 0x7f0b9401ae10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.223 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bb408d910 msgr2=0x7f0bb40af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.223 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bb408d910 0x7f0bb40af700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0bac006ed0 tx=0x7f0bac00b960).stop 2021-04-09T18:19:36.223 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 shutdown_connections 2021-04-09T18:19:36.228 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bb408d910 0x7f0bb40af700 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.228 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0b94018930 0x7f0b9401ae10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.228 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bb409b020 0x7f0bb408d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.229 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 --2- 172.21.15.134:0/3518581095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0bb409ac20 0x7f0bb409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.229 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 >> 172.21.15.134:0/3518581095 conn(0x7f0bb419c010 msgr2=0x7f0bb417faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:36.230 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 shutdown_connections 2021-04-09T18:19:36.230 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.207 7f0bbbae4700 1 -- 172.21.15.134:0/3518581095 wait complete. 2021-04-09T18:19:36.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c57cf86c-b87c-4772-8dec-62047661f3d5 4 2021-04-09T18:19:36.420 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.400 7f8e6f991700 1 Processor -- start 2021-04-09T18:19:36.420 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.400 7f8e6f991700 1 -- start start 2021-04-09T18:19:36.420 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6f991700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6807e700 0x7f8e68100210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.421 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6f991700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8e680ff480 0x7f8e681ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.421 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6f991700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e680ffc90 con 0x7f8e680ff080 2021-04-09T18:19:36.421 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6f991700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e680d80e0 con 0x7f8e680ff480 2021-04-09T18:19:36.421 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6f991700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680d2040 con 0x7f8e6807e700 2021-04-09T18:19:36.422 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6dfae700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8e680ff480 0x7f8e681ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.422 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6d7ad700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6807e700 0x7f8e68100210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.422 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6cfac700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8e680ff080 0x7f8e681a8150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42570/0 (socket says 172.21.15.134:42570) 2021-04-09T18:19:36.422 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6cfac700 1 -- 172.21.15.134:0/1040215906 learned_addr learned my addr 172.21.15.134:0/1040215906 (peer_addr_for_me v1:172.21.15.134:0/0) 2021-04-09T18:19:36.422 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6dfae700 1 -- 172.21.15.134:0/1040215906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6807e700 msgr2=0x7f8e68100210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:36.423 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6dfae700 1 --2- 172.21.15.134:0/1040215906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6807e700 0x7f8e68100210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6dfae700 1 -- 172.21.15.134:0/1040215906 >> v1:172.21.15.134:6789/0 conn(0x7f8e680ff080 legacy=0x7f8e681a8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.428 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6dfae700 1 -- 172.21.15.134:0/1040215906 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6807eb00 con 0x7f8e680ff480 2021-04-09T18:19:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e5ffff700 1 -- 172.21.15.134:0/1040215906 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102989782 0 0) 0x7f8e580009b0 con 0x7f8e680ff080 2021-04-09T18:19:36.429 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6d7ad700 1 --2- 172.21.15.134:0/1040215906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6807e700 0x7f8e68100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:36.430 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.401 7f8e6dfae700 1 --2- 172.21.15.134:0/1040215906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e680ff480 0x7f8e681ab960 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f8e60006ab0 tx=0x7f8e60009b40).ready entity=mon.1 client_cookie=a6ad368ad0fd5bb1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:36.430 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.402 7f8e5ffff700 1 -- 172.21.15.134:0/1040215906 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e600022e0 con 0x7f8e680ff480 2021-04-09T18:19:36.431 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.402 7f8e5ffff700 1 -- 172.21.15.134:0/1040215906 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e60002660 con 0x7f8e680ff480 2021-04-09T18:19:36.431 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.402 7f8e5ffff700 1 -- 172.21.15.134:0/1040215906 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e60002b40 con 0x7f8e680ff480 2021-04-09T18:19:36.431 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.402 7f8e6f991700 1 -- 172.21.15.134:0/1040215906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e680ff480 msgr2=0x7f8e681ab960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.432 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.402 7f8e6f991700 1 --2- 172.21.15.134:0/1040215906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e680ff480 0x7f8e681ab960 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f8e60006ab0 tx=0x7f8e60009b40).stop 2021-04-09T18:19:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.402 7f8e6f991700 1 -- 172.21.15.134:0/1040215906 shutdown_connections 2021-04-09T18:19:36.433 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.402 7f8e6f991700 1 --2- 172.21.15.134:0/1040215906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e680ff480 0x7f8e681ab960 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.402 7f8e6f991700 1 --2- 172.21.15.134:0/1040215906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6807e700 0x7f8e68100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.434 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.402 7f8e6f991700 1 -- 172.21.15.134:0/1040215906 >> 172.21.15.134:0/1040215906 conn(0x7f8e680f0050 msgr2=0x7f8e680d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.403 7f8e6f991700 1 -- 172.21.15.134:0/1040215906 shutdown_connections 2021-04-09T18:19:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.403 7f8e6f991700 1 -- 172.21.15.134:0/1040215906 wait complete. 2021-04-09T18:19:36.435 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.421 7f8e6f991700 1 Processor -- start 2021-04-09T18:19:36.436 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.421 7f8e6f991700 1 -- start start 2021-04-09T18:19:36.467 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6f991700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6819d950 0x7f8e6819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.468 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6f991700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6819cfa0 0x7f8e6818d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.468 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6f991700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e6818d8d0 0x7f8e6817a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.469 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6f991700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680a9030 con 0x7f8e6819cfa0 2021-04-09T18:19:36.469 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6f991700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680a9220 con 0x7f8e6818d8d0 2021-04-09T18:19:36.469 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6f991700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68190e10 con 0x7f8e6819d950 2021-04-09T18:19:36.470 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6d7ad700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6819d950 0x7f8e6819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.470 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6d7ad700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6819d950 0x7f8e6819c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:44066/0 (socket says 172.21.15.134:44066) 2021-04-09T18:19:36.471 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6d7ad700 1 -- 172.21.15.134:0/3159911740 learned_addr learned my addr 172.21.15.134:0/3159911740 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:36.471 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6dfae700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e6818d8d0 0x7f8e6817a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.472 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6cfac700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6819cfa0 0x7f8e6818d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.472 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6d7ad700 1 -- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e6818d8d0 msgr2=0x7f8e6817a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.473 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6d7ad700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e6818d8d0 0x7f8e6817a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.473 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6d7ad700 1 -- 172.21.15.134:0/3159911740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6819cfa0 msgr2=0x7f8e6818d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.473 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6d7ad700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6819cfa0 0x7f8e6818d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.474 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6d7ad700 1 -- 172.21.15.134:0/3159911740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6819dd50 con 0x7f8e6819d950 2021-04-09T18:19:36.474 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6dfae700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e6818d8d0 0x7f8e6817a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:36.475 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.422 7f8e6d7ad700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6819d950 0x7f8e6819c980 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8e6400b970 tx=0x7f8e6400bd10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:36.505 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.423 7f8e5dffb700 1 -- 172.21.15.134:0/3159911740 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e64000d30 con 0x7f8e6819d950 2021-04-09T18:19:36.505 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.423 7f8e5dffb700 1 -- 172.21.15.134:0/3159911740 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64006240 con 0x7f8e6819d950 2021-04-09T18:19:36.505 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.423 7f8e5dffb700 1 -- 172.21.15.134:0/3159911740 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e64005660 con 0x7f8e6819d950 2021-04-09T18:19:36.505 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.423 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6819dd50 con 0x7f8e6819d950 2021-04-09T18:19:36.506 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.423 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6819dd50 con 0x7f8e6819d950 2021-04-09T18:19:36.506 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.423 7f8e5dffb700 1 -- 172.21.15.134:0/3159911740 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8e64005660 con 0x7f8e6819d950 2021-04-09T18:19:36.507 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.423 7f8e5dffb700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e48018930 0x7f8e4801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.507 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.423 7f8e5dffb700 1 -- 172.21.15.134:0/3159911740 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1166+0+0 (secure 0 0 0) 0x7f8e64031c90 con 0x7f8e6819d950 2021-04-09T18:19:36.508 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.423 7f8e6cfac700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e48018930 0x7f8e4801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.508 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.424 7f8e6cfac700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e48018930 0x7f8e4801adc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:36.508 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.447 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e68087b90 con 0x7f8e6819d950 2021-04-09T18:19:36.508 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.450 7f8e5dffb700 1 -- 172.21.15.134:0/3159911740 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8e640064a0 con 0x7f8e6819d950 2021-04-09T18:19:36.634 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.635 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c57cf86c-b87c-4772-8dec-62047661f3d5", "id": 4} v 0) v1 -- 0x7f8e680ffc90 con 0x7f8e6819d950 2021-04-09T18:19:36.644 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.639 7f8e5dffb700 1 -- 172.21.15.134:0/3159911740 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c57cf86c-b87c-4772-8dec-62047661f3d5", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e64005660 con 0x7f8e6819d950 2021-04-09T18:19:36.645 INFO:teuthology.orchestra.run.smithi134.stdout:4 2021-04-09T18:19:36.647 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.644 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e48018930 msgr2=0x7f8e4801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.648 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.644 7f8e6f991700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e48018930 0x7f8e4801adc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.656 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.644 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6819d950 msgr2=0x7f8e6819c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.656 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.644 7f8e6f991700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6819d950 0x7f8e6819c980 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8e6400b970 tx=0x7f8e6400bd10).stop 2021-04-09T18:19:36.657 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.645 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 shutdown_connections 2021-04-09T18:19:36.657 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.645 7f8e6f991700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e6818d8d0 0x7f8e6817a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.677 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.645 7f8e6f991700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6819cfa0 0x7f8e6818d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.678 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.645 7f8e6f991700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e48018930 0x7f8e4801adc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.678 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.645 7f8e6f991700 1 --2- 172.21.15.134:0/3159911740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e6819d950 0x7f8e6819c980 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.683 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.645 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 >> 172.21.15.134:0/3159911740 conn(0x7f8e68192150 msgr2=0x7f8e68183f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:36.684 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.645 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 shutdown_connections 2021-04-09T18:19:36.684 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.645 7f8e6f991700 1 -- 172.21.15.134:0/3159911740 wait complete. 2021-04-09T18:19:36.694 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 486e506e-c976-44c7-b7cd-99c4b45b65e3 5 2021-04-09T18:19:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.840 7f799a7e9700 1 Processor -- start 2021-04-09T18:19:36.872 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.840 7f799a7e9700 1 -- start start 2021-04-09T18:19:36.878 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.841 7f799a7e9700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79940d7160 0x7f79940d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.879 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.841 7f799a7e9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79940d6190 0x7f79940d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.879 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.841 7f799a7e9700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79940d6be0 con 0x7f79940d55a0 2021-04-09T18:19:36.879 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.841 7f799a7e9700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79940d80f0 con 0x7f79940d7160 2021-04-09T18:19:36.880 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.841 7f799a7e9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79941a2ac0 con 0x7f79940d6190 2021-04-09T18:19:36.885 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.841 7f7993fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79940d7160 0x7f79940d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.885 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.841 7f7998e06700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79940d6190 0x7f79940d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.886 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.841 7f7993fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79940d7160 0x7f79940d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41640/0 (socket says 172.21.15.134:41640) 2021-04-09T18:19:36.887 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.841 7f7993fff700 1 -- 172.21.15.134:0/3727895583 learned_addr learned my addr 172.21.15.134:0/3727895583 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:36.887 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f7993fff700 1 -- 172.21.15.134:0/3727895583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79940d6190 msgr2=0x7f79940d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:36.888 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f7993fff700 1 --2- 172.21.15.134:0/3727895583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79940d6190 0x7f79940d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.888 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f7993fff700 1 -- 172.21.15.134:0/3727895583 >> v1:172.21.15.120:6789/0 conn(0x7f79940d55a0 legacy=0x7f79940d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.888 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f79937fe700 1 -- 172.21.15.134:0/3727895583 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499114475 0 0) 0x7f797c000ff0 con 0x7f79940d55a0 2021-04-09T18:19:36.889 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f7993fff700 1 -- 172.21.15.134:0/3727895583 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79941a2cb0 con 0x7f79940d7160 2021-04-09T18:19:36.889 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f7998e06700 1 --2- 172.21.15.134:0/3727895583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79940d6190 0x7f79940d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:36.890 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f7993fff700 1 --2- 172.21.15.134:0/3727895583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79940d7160 0x7f79940d7560 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7984006700 tx=0x7f7984009b80).ready entity=mon.1 client_cookie=5848dd2b4e3e923b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:36.890 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f79937fe700 1 -- 172.21.15.134:0/3727895583 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f798400c0c0 con 0x7f79940d7160 2021-04-09T18:19:36.890 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f79937fe700 1 -- 172.21.15.134:0/3727895583 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400c440 con 0x7f79940d7160 2021-04-09T18:19:36.891 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f79937fe700 1 -- 172.21.15.134:0/3727895583 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f798400c920 con 0x7f79940d7160 2021-04-09T18:19:36.917 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f799a7e9700 1 -- 172.21.15.134:0/3727895583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79940d7160 msgr2=0x7f79940d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.917 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.842 7f799a7e9700 1 --2- 172.21.15.134:0/3727895583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79940d7160 0x7f79940d7560 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7984006700 tx=0x7f7984009b80).stop 2021-04-09T18:19:36.918 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.843 7f799a7e9700 1 -- 172.21.15.134:0/3727895583 shutdown_connections 2021-04-09T18:19:36.919 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.843 7f799a7e9700 1 --2- 172.21.15.134:0/3727895583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79940d6190 0x7f79940d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.919 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.843 7f799a7e9700 1 --2- 172.21.15.134:0/3727895583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79940d7160 0x7f79940d7560 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.920 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.843 7f799a7e9700 1 -- 172.21.15.134:0/3727895583 >> 172.21.15.134:0/3727895583 conn(0x7f79940d1590 msgr2=0x7f79940d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:36.920 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.843 7f799a7e9700 1 -- 172.21.15.134:0/3727895583 shutdown_connections 2021-04-09T18:19:36.921 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.843 7f799a7e9700 1 -- 172.21.15.134:0/3727895583 wait complete. 2021-04-09T18:19:36.921 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f799a7e9700 1 Processor -- start 2021-04-09T18:19:36.921 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f799a7e9700 1 -- start start 2021-04-09T18:19:36.922 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f799a7e9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7994193ef0 0x7f79941990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.922 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f799a7e9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7994197f10 0x7f7994198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.923 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f799a7e9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79940b3e10 0x7f79940b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.942 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f799a7e9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7994198b50 con 0x7f7994197f10 2021-04-09T18:19:36.942 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f799a7e9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79941996f0 con 0x7f79940b3e10 2021-04-09T18:19:36.943 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f799a7e9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79941939e0 con 0x7f7994193ef0 2021-04-09T18:19:36.943 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f7993fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7994193ef0 0x7f79941990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.943 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f7993fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7994193ef0 0x7f79941990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:44080/0 (socket says 172.21.15.134:44080) 2021-04-09T18:19:36.944 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f7993fff700 1 -- 172.21.15.134:0/1697580864 learned_addr learned my addr 172.21.15.134:0/1697580864 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:36.944 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f7998e06700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79940b3e10 0x7f79940b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.945 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f798bfff700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7994197f10 0x7f7994198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.945 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f7993fff700 1 -- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79940b3e10 msgr2=0x7f79940b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.945 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f7993fff700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79940b3e10 0x7f79940b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.946 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f7993fff700 1 -- 172.21.15.134:0/1697580864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7994197f10 msgr2=0x7f7994198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:36.946 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f7993fff700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7994197f10 0x7f7994198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:36.947 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f7993fff700 1 -- 172.21.15.134:0/1697580864 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79940b4830 con 0x7f7994193ef0 2021-04-09T18:19:36.979 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.862 7f798bfff700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7994197f10 0x7f7994198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:19:36.979 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.863 7f7993fff700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7994193ef0 0x7f79941990d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f798400b580 tx=0x7f798400b920).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:36.980 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.863 7f79917fa700 1 -- 172.21.15.134:0/1697580864 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f798400bd10 con 0x7f7994193ef0 2021-04-09T18:19:36.980 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.863 7f79917fa700 1 -- 172.21.15.134:0/1697580864 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7984000c90 con 0x7f7994193ef0 2021-04-09T18:19:36.980 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.863 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79940b4830 con 0x7f7994193ef0 2021-04-09T18:19:36.980 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.863 7f79917fa700 1 -- 172.21.15.134:0/1697580864 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7984002220 con 0x7f7994193ef0 2021-04-09T18:19:36.980 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.863 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79940b4830 con 0x7f7994193ef0 2021-04-09T18:19:36.981 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.863 7f79917fa700 1 -- 172.21.15.134:0/1697580864 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7984009f90 con 0x7f7994193ef0 2021-04-09T18:19:36.981 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.863 7f79917fa700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7978018930 0x7f797801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:36.981 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.864 7f79917fa700 1 -- 172.21.15.134:0/1697580864 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1269+0+0 (secure 0 0 0) 0x7f7984031920 con 0x7f7994193ef0 2021-04-09T18:19:36.981 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.864 7f798bfff700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7978018930 0x7f797801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:36.991 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.864 7f798bfff700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7978018930 0x7f797801ae10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:36.996 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.887 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7994182a40 con 0x7f7994193ef0 2021-04-09T18:19:36.997 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:36.890 7f79917fa700 1 -- 172.21.15.134:0/1697580864 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f79840091e0 con 0x7f7994193ef0 2021-04-09T18:19:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.077 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "486e506e-c976-44c7-b7cd-99c4b45b65e3", "id": 5} v 0) v1 -- 0x7f7994182a40 con 0x7f7994193ef0 2021-04-09T18:19:37.081 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.083 7f79917fa700 1 -- 172.21.15.134:0/1697580864 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "486e506e-c976-44c7-b7cd-99c4b45b65e3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7984000c90 con 0x7f7994193ef0 2021-04-09T18:19:37.083 INFO:teuthology.orchestra.run.smithi134.stdout:5 2021-04-09T18:19:37.088 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7978018930 msgr2=0x7f797801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.088 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7978018930 0x7f797801ae10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.089 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7994193ef0 msgr2=0x7f79941990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.089 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7994193ef0 0x7f79941990d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f798400b580 tx=0x7f798400b920).stop 2021-04-09T18:19:37.090 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 shutdown_connections 2021-04-09T18:19:37.091 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79940b3e10 0x7f79940b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.092 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7994197f10 0x7f7994198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.092 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7978018930 0x7f797801ae10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.092 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 --2- 172.21.15.134:0/1697580864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7994193ef0 0x7f79941990d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.093 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 >> 172.21.15.134:0/1697580864 conn(0x7f799418dcd0 msgr2=0x7f7994187e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:37.093 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 shutdown_connections 2021-04-09T18:19:37.093 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.087 7f799a7e9700 1 -- 172.21.15.134:0/1697580864 wait complete. 2021-04-09T18:19:37.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 43649114-88d7-4924-a650-24cdb8307d8a 6 2021-04-09T18:19:37.256 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.237 7f0d10777700 1 Processor -- start 2021-04-09T18:19:37.256 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.237 7f0d10777700 1 -- start start 2021-04-09T18:19:37.257 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.237 7f0d10777700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080d7160 0x7f0d080e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.257 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.237 7f0d10777700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0d080d7560 0x7f0d080d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.257 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.237 7f0d10777700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d080d6be0 con 0x7f0d080d5bc0 2021-04-09T18:19:37.257 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.237 7f0d10777700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d080d80f0 con 0x7f0d080d7560 2021-04-09T18:19:37.258 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.237 7f0d10777700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080e7f00 con 0x7f0d080d7160 2021-04-09T18:19:37.258 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0e593700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080d7160 0x7f0d080e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.258 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0dd92700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0d080d7560 0x7f0d080d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.258 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0ed94700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0d080d5bc0 0x7f0d080d5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42596/0 (socket says 172.21.15.134:42596) 2021-04-09T18:19:37.259 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0e593700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080d7160 0x7f0d080e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:44088/0 (socket says 172.21.15.134:44088) 2021-04-09T18:19:37.259 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0dd92700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0d080d7560 0x7f0d080d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41658/0 (socket says 172.21.15.134:41658) 2021-04-09T18:19:37.268 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0ed94700 1 -- 172.21.15.134:0/2814858217 learned_addr learned my addr 172.21.15.134:0/2814858217 (peer_addr_for_me v1:172.21.15.134:0/0) 2021-04-09T18:19:37.268 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0e593700 1 -- 172.21.15.134:0/2814858217 >> v2:172.21.15.134:3300/0 conn(0x7f0d080d7560 msgr2=0x7f0d080d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:37.268 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0e593700 1 --2- 172.21.15.134:0/2814858217 >> v2:172.21.15.134:3300/0 conn(0x7f0d080d7560 0x7f0d080d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.269 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0e593700 1 -- 172.21.15.134:0/2814858217 >> v1:172.21.15.134:6789/0 conn(0x7f0d080d5bc0 legacy=0x7f0d080d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.269 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0e593700 1 -- 172.21.15.134:0/2814858217 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d081a2ac0 con 0x7f0d080d7160 2021-04-09T18:19:37.269 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0d591700 1 -- 172.21.15.134:0/2814858217 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203859563 0 0) 0x7f0d000009b0 con 0x7f0d080d5bc0 2021-04-09T18:19:37.269 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0dd92700 1 --2- 172.21.15.134:0/2814858217 >> v2:172.21.15.134:3300/0 conn(0x7f0d080d7560 0x7f0d080d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:37.270 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0e593700 1 --2- 172.21.15.134:0/2814858217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080d7160 0x7f0d080e78e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0d040069d0 tx=0x7f0d04009e40).ready entity=mon.2 client_cookie=f5a6bc36d4865b03 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:37.274 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0d591700 1 -- 172.21.15.134:0/2814858217 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d0400b510 con 0x7f0d080d7160 2021-04-09T18:19:37.279 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0d591700 1 -- 172.21.15.134:0/2814858217 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0400b890 con 0x7f0d080d7160 2021-04-09T18:19:37.279 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d0d591700 1 -- 172.21.15.134:0/2814858217 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d0400bd70 con 0x7f0d080d7160 2021-04-09T18:19:37.280 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d10777700 1 -- 172.21.15.134:0/2814858217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080d7160 msgr2=0x7f0d080e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.280 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.238 7f0d10777700 1 --2- 172.21.15.134:0/2814858217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080d7160 0x7f0d080e78e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0d040069d0 tx=0x7f0d04009e40).stop 2021-04-09T18:19:37.281 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.239 7f0d10777700 1 -- 172.21.15.134:0/2814858217 shutdown_connections 2021-04-09T18:19:37.281 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.239 7f0d10777700 1 --2- 172.21.15.134:0/2814858217 >> v2:172.21.15.134:3300/0 conn(0x7f0d080d7560 0x7f0d080d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.281 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.239 7f0d10777700 1 --2- 172.21.15.134:0/2814858217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080d7160 0x7f0d080e78e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.282 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.239 7f0d10777700 1 -- 172.21.15.134:0/2814858217 >> 172.21.15.134:0/2814858217 conn(0x7f0d080d1590 msgr2=0x7f0d080d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:37.282 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.239 7f0d10777700 1 -- 172.21.15.134:0/2814858217 shutdown_connections 2021-04-09T18:19:37.282 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.239 7f0d10777700 1 -- 172.21.15.134:0/2814858217 wait complete. 2021-04-09T18:19:37.283 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d10777700 1 Processor -- start 2021-04-09T18:19:37.283 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d10777700 1 -- start start 2021-04-09T18:19:37.314 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d10777700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d080a7cf0 0x7f0d08095f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.314 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d10777700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d0819e1f0 0x7f0d080940b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.315 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d10777700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080946d0 0x7f0d08094ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.315 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d10777700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080959e0 con 0x7f0d0819e1f0 2021-04-09T18:19:37.316 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d10777700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08096580 con 0x7f0d080a7cf0 2021-04-09T18:19:37.316 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d10777700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080950f0 con 0x7f0d080946d0 2021-04-09T18:19:37.316 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d0e593700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d080a7cf0 0x7f0d08095f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.359 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d0ed94700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080946d0 0x7f0d08094ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.359 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d0e593700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d080a7cf0 0x7f0d08095f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41660/0 (socket says 172.21.15.134:41660) 2021-04-09T18:19:37.360 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.258 7f0d0e593700 1 -- 172.21.15.134:0/979230694 learned_addr learned my addr 172.21.15.134:0/979230694 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:37.361 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d0dd92700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d0819e1f0 0x7f0d080940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.361 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d0ed94700 1 -- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d080a7cf0 msgr2=0x7f0d08095f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.361 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d0ed94700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d080a7cf0 0x7f0d08095f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.361 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d0ed94700 1 -- 172.21.15.134:0/979230694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d0819e1f0 msgr2=0x7f0d080940b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.365 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d0ed94700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d0819e1f0 0x7f0d080940b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.365 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d0ed94700 1 -- 172.21.15.134:0/979230694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08095310 con 0x7f0d080946d0 2021-04-09T18:19:37.365 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d0e593700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d080a7cf0 0x7f0d08095f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:37.368 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d0dd92700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d0819e1f0 0x7f0d080940b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:19:37.368 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d0ed94700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080946d0 0x7f0d08094ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d0000a4c0 tx=0x7f0d0000a860).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:37.369 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0cfeffd700 1 -- 172.21.15.134:0/979230694 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d00000bf0 con 0x7f0d080946d0 2021-04-09T18:19:37.369 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0cfeffd700 1 -- 172.21.15.134:0/979230694 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0000ac50 con 0x7f0d080946d0 2021-04-09T18:19:37.369 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d10777700 1 -- 172.21.15.134:0/979230694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d08095310 con 0x7f0d080946d0 2021-04-09T18:19:37.369 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0cfeffd700 1 -- 172.21.15.134:0/979230694 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d00004620 con 0x7f0d080946d0 2021-04-09T18:19:37.370 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.259 7f0d10777700 1 -- 172.21.15.134:0/979230694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d08095310 con 0x7f0d080946d0 2021-04-09T18:19:37.370 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.260 7f0cfeffd700 1 -- 172.21.15.134:0/979230694 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0d000043a0 con 0x7f0d080946d0 2021-04-09T18:19:37.370 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.260 7f0cfeffd700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0cf0018930 0x7f0cf001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.370 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.260 7f0cfeffd700 1 -- 172.21.15.134:0/979230694 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1372+0+0 (secure 0 0 0) 0x7f0d00031900 con 0x7f0d080946d0 2021-04-09T18:19:37.370 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.260 7f0d0e593700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0cf0018930 0x7f0cf001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.371 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.260 7f0d0e593700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0cf0018930 0x7f0cf001ae10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:37.371 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.283 7f0d10777700 1 -- 172.21.15.134:0/979230694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d081833d0 con 0x7f0d080946d0 2021-04-09T18:19:37.380 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.287 7f0cfeffd700 1 -- 172.21.15.134:0/979230694 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0d00004f00 con 0x7f0d080946d0 2021-04-09T18:19:37.472 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.474 7f0d10777700 1 -- 172.21.15.134:0/979230694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "43649114-88d7-4924-a650-24cdb8307d8a", "id": 6} v 0) v1 -- 0x7f0d081833d0 con 0x7f0d080946d0 2021-04-09T18:19:37.478 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.480 7f0cfeffd700 1 -- 172.21.15.134:0/979230694 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43649114-88d7-4924-a650-24cdb8307d8a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d000043a0 con 0x7f0d080946d0 2021-04-09T18:19:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:6 2021-04-09T18:19:37.482 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 -- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0cf0018930 msgr2=0x7f0cf001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.482 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0cf0018930 0x7f0cf001ae10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.483 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 -- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080946d0 msgr2=0x7f0d08094ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.483 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080946d0 0x7f0d08094ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d0000a4c0 tx=0x7f0d0000a860).stop 2021-04-09T18:19:37.483 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 -- 172.21.15.134:0/979230694 shutdown_connections 2021-04-09T18:19:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0cf0018930 0x7f0cf001ae10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d080946d0 0x7f0d08094ad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d0819e1f0 0x7f0d080940b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 --2- 172.21.15.134:0/979230694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d080a7cf0 0x7f0d08095f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.484 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 -- 172.21.15.134:0/979230694 >> 172.21.15.134:0/979230694 conn(0x7f0d0819bc90 msgr2=0x7f0d081949f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:37.486 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 -- 172.21.15.134:0/979230694 shutdown_connections 2021-04-09T18:19:37.486 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.483 7f0d10777700 1 -- 172.21.15.134:0/979230694 wait complete. 2021-04-09T18:19:37.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 39042b46-2011-4e62-81af-2a30eb565457 7 2021-04-09T18:19:37.671 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.643 7f71b9a96700 1 Processor -- start 2021-04-09T18:19:37.671 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.643 7f71b9a96700 1 -- start start 2021-04-09T18:19:37.672 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.643 7f71b9a96700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f71b40d7160 0x7f71b40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.672 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.643 7f71b9a96700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40d55a0 0x7f71b40d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.673 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.643 7f71b9a96700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b40d6be0 con 0x7f71b40d5fc0 2021-04-09T18:19:37.673 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.643 7f71b9a96700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b40d80f0 con 0x7f71b40d7160 2021-04-09T18:19:37.673 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.643 7f71b9a96700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b41a2ac0 con 0x7f71b40d55a0 2021-04-09T18:19:37.674 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b37fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f71b40d7160 0x7f71b40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.674 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b2ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40d55a0 0x7f71b40d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.675 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b3fff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f71b40d5fc0 0x7f71b40d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:42610/0 (socket says 172.21.15.134:42610) 2021-04-09T18:19:37.676 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b3fff700 1 -- 172.21.15.134:0/700380236 learned_addr learned my addr 172.21.15.134:0/700380236 (peer_addr_for_me v1:172.21.15.134:0/0) 2021-04-09T18:19:37.676 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b37fe700 1 -- 172.21.15.134:0/700380236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40d55a0 msgr2=0x7f71b40d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:37.676 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b37fe700 1 --2- 172.21.15.134:0/700380236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40d55a0 0x7f71b40d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.677 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b37fe700 1 -- 172.21.15.134:0/700380236 >> v1:172.21.15.134:6789/0 conn(0x7f71b40d5fc0 legacy=0x7f71b40d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.677 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b37fe700 1 -- 172.21.15.134:0/700380236 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b41a2cb0 con 0x7f71b40d7160 2021-04-09T18:19:37.678 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b27fc700 1 -- 172.21.15.134:0/700380236 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522079253 0 0) 0x7f71ac0009b0 con 0x7f71b40d5fc0 2021-04-09T18:19:37.685 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b2ffd700 1 --2- 172.21.15.134:0/700380236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40d55a0 0x7f71b40d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:37.685 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b37fe700 1 --2- 172.21.15.134:0/700380236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b40d7160 0x7f71b40d7560 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f71a40069d0 tx=0x7f71a4009e40).ready entity=mon.1 client_cookie=7f7b337464f3482f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:37.686 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b27fc700 1 -- 172.21.15.134:0/700380236 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71a400b510 con 0x7f71b40d7160 2021-04-09T18:19:37.701 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b27fc700 1 -- 172.21.15.134:0/700380236 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400b890 con 0x7f71b40d7160 2021-04-09T18:19:37.701 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b27fc700 1 -- 172.21.15.134:0/700380236 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71a400bd70 con 0x7f71b40d7160 2021-04-09T18:19:37.702 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b9a96700 1 -- 172.21.15.134:0/700380236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b40d7160 msgr2=0x7f71b40d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.702 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.644 7f71b9a96700 1 --2- 172.21.15.134:0/700380236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b40d7160 0x7f71b40d7560 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f71a40069d0 tx=0x7f71a4009e40).stop 2021-04-09T18:19:37.709 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.645 7f71b9a96700 1 -- 172.21.15.134:0/700380236 shutdown_connections 2021-04-09T18:19:37.709 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.645 7f71b9a96700 1 --2- 172.21.15.134:0/700380236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b40d55a0 0x7f71b40d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.710 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.645 7f71b9a96700 1 --2- 172.21.15.134:0/700380236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b40d7160 0x7f71b40d7560 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.710 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.645 7f71b9a96700 1 -- 172.21.15.134:0/700380236 >> 172.21.15.134:0/700380236 conn(0x7f71b40d1590 msgr2=0x7f71b40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:37.710 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.645 7f71b9a96700 1 -- 172.21.15.134:0/700380236 shutdown_connections 2021-04-09T18:19:37.722 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.645 7f71b9a96700 1 -- 172.21.15.134:0/700380236 wait complete. 2021-04-09T18:19:37.723 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.664 7f71b9a96700 1 Processor -- start 2021-04-09T18:19:37.723 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.664 7f71b9a96700 1 -- start start 2021-04-09T18:19:37.723 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.664 7f71b9a96700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b4188750 0x7f71b419c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.724 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.664 7f71b9a96700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b4188170 0x7f71b4182b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.724 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.664 7f71b9a96700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71b417b1f0 0x7f71b417b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.664 7f71b9a96700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4183490 con 0x7f71b417b1f0 2021-04-09T18:19:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.664 7f71b9a96700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b41a1d70 con 0x7f71b4188170 2021-04-09T18:19:37.725 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.664 7f71b9a96700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4182590 con 0x7f71b4188750 2021-04-09T18:19:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b4188170 0x7f71b4182b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.726 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b37fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b4188750 0x7f71b419c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.727 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b4188170 0x7f71b4182b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41676/0 (socket says 172.21.15.134:41676) 2021-04-09T18:19:37.727 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b37fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b4188750 0x7f71b419c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:44110/0 (socket says 172.21.15.134:44110) 2021-04-09T18:19:37.747 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b2ffd700 1 -- 172.21.15.134:0/3741845195 learned_addr learned my addr 172.21.15.134:0/3741845195 (peer_addr_for_me v2:172.21.15.134:0/0) 2021-04-09T18:19:37.747 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b3fff700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71b417b1f0 0x7f71b417b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.748 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b2ffd700 1 -- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b4188750 msgr2=0x7f71b419c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.748 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b2ffd700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b4188750 0x7f71b419c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.748 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b2ffd700 1 -- 172.21.15.134:0/3741845195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71b417b1f0 msgr2=0x7f71b417b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.749 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b2ffd700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71b417b1f0 0x7f71b417b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.761 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b2ffd700 1 -- 172.21.15.134:0/3741845195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b4183130 con 0x7f71b4188170 2021-04-09T18:19:37.762 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b37fe700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b4188750 0x7f71b419c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:37.762 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b3fff700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71b417b1f0 0x7f71b417b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:19:37.763 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b2ffd700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b4188170 0x7f71b4182b10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f71a8006f40 tx=0x7f71a800b990).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:37.763 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f719bfff700 1 -- 172.21.15.134:0/3741845195 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71a8006bd0 con 0x7f71b4188170 2021-04-09T18:19:37.763 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f719bfff700 1 -- 172.21.15.134:0/3741845195 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a800bd80 con 0x7f71b4188170 2021-04-09T18:19:37.764 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f719bfff700 1 -- 172.21.15.134:0/3741845195 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71a8002220 con 0x7f71b4188170 2021-04-09T18:19:37.764 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b4183130 con 0x7f71b4188170 2021-04-09T18:19:37.780 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.665 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b4183130 con 0x7f71b4188170 2021-04-09T18:19:37.780 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.666 7f719bfff700 1 -- 172.21.15.134:0/3741845195 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f71a800a000 con 0x7f71b4188170 2021-04-09T18:19:37.780 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.666 7f719bfff700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7194018930 0x7f719401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:37.781 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.666 7f719bfff700 1 -- 172.21.15.134:0/3741845195 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1475+0+0 (secure 0 0 0) 0x7f71a80319b0 con 0x7f71b4188170 2021-04-09T18:19:37.781 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.666 7f71b37fe700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7194018930 0x7f719401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:37.781 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.666 7f71b37fe700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7194018930 0x7f719401adc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:37.787 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.690 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b417a2e0 con 0x7f71b4188170 2021-04-09T18:19:37.788 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.693 7f719bfff700 1 -- 172.21.15.134:0/3741845195 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f71a8000c90 con 0x7f71b4188170 2021-04-09T18:19:37.885 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.887 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39042b46-2011-4e62-81af-2a30eb565457", "id": 7} v 0) v1 -- 0x7f71b417a2e0 con 0x7f71b4188170 2021-04-09T18:19:37.890 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.893 7f719bfff700 1 -- 172.21.15.134:0/3741845195 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39042b46-2011-4e62-81af-2a30eb565457", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f71a800bd80 con 0x7f71b4188170 2021-04-09T18:19:37.893 INFO:teuthology.orchestra.run.smithi134.stdout:7 2021-04-09T18:19:37.896 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7194018930 msgr2=0x7f719401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.897 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7194018930 0x7f719401adc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.897 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b4188170 msgr2=0x7f71b4182b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:37.897 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b4188170 0x7f71b4182b10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f71a8006f40 tx=0x7f71a800b990).stop 2021-04-09T18:19:37.898 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 shutdown_connections 2021-04-09T18:19:37.898 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71b417b1f0 0x7f71b417b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.899 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b4188170 0x7f71b4182b10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.899 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7194018930 0x7f719401adc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.903 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 --2- 172.21.15.134:0/3741845195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b4188750 0x7f71b419c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:37.904 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 >> 172.21.15.134:0/3741845195 conn(0x7f71b419c990 msgr2=0x7f71b419fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 shutdown_connections 2021-04-09T18:19:37.905 INFO:teuthology.orchestra.run.smithi134.stderr:2021-04-09 18:19:37.896 7f71b9a96700 1 -- 172.21.15.134:0/3741845195 wait complete. 2021-04-09T18:19:37.907 INFO:tasks.ceph.osd.0:Restarting daemon 2021-04-09T18:19:37.908 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-04-09T18:19:37.920 INFO:tasks.ceph.osd.0:Started 2021-04-09T18:19:37.931 INFO:tasks.ceph.osd.1:Restarting daemon 2021-04-09T18:19:37.933 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-04-09T18:19:37.955 INFO:tasks.ceph.osd.1:Started 2021-04-09T18:19:37.956 INFO:tasks.ceph.osd.2:Restarting daemon 2021-04-09T18:19:37.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-04-09T18:19:37.987 INFO:tasks.ceph.osd.2:Started 2021-04-09T18:19:37.999 INFO:tasks.ceph.osd.3:Restarting daemon 2021-04-09T18:19:38.000 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-04-09T18:19:38.016 INFO:tasks.ceph.osd.3:Started 2021-04-09T18:19:38.017 INFO:tasks.ceph.osd.4:Restarting daemon 2021-04-09T18:19:38.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-04-09T18:19:38.036 INFO:tasks.ceph.osd.4:Started 2021-04-09T18:19:38.036 INFO:tasks.ceph.osd.5:Restarting daemon 2021-04-09T18:19:38.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-04-09T18:19:38.053 INFO:tasks.ceph.osd.5:Started 2021-04-09T18:19:38.054 INFO:tasks.ceph.osd.6:Restarting daemon 2021-04-09T18:19:38.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-04-09T18:19:38.092 INFO:tasks.ceph.osd.6:Started 2021-04-09T18:19:38.093 INFO:tasks.ceph.osd.7:Restarting daemon 2021-04-09T18:19:38.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-04-09T18:19:38.112 INFO:tasks.ceph.osd.7:Started 2021-04-09T18:19:38.113 INFO:tasks.ceph:Waiting for OSDs to come up 2021-04-09T18:19:38.554 INFO:tasks.ceph.osd.0.smithi120.stderr:2021-04-09 18:19:38.555 7f2067102a80 -1 Falling back to public interface 2021-04-09T18:19:38.597 INFO:tasks.ceph.osd.1.smithi120.stderr:2021-04-09 18:19:38.598 7fb0c2de0a80 -1 Falling back to public interface 2021-04-09T18:19:38.624 INFO:tasks.ceph.osd.2.smithi120.stderr:2021-04-09 18:19:38.626 7fdbfc14ba80 -1 Falling back to public interface 2021-04-09T18:19:38.645 INFO:tasks.ceph.osd.3.smithi120.stderr:2021-04-09 18:19:38.646 7fb2afa0ba80 -1 Falling back to public interface 2021-04-09T18:19:38.665 INFO:tasks.ceph.osd.4.smithi134.stderr:2021-04-09 18:19:38.666 7febbbaada80 -1 Falling back to public interface 2021-04-09T18:19:38.698 INFO:tasks.ceph.osd.5.smithi134.stderr:2021-04-09 18:19:38.699 7fec53d38a80 -1 Falling back to public interface 2021-04-09T18:19:38.745 INFO:tasks.ceph.osd.6.smithi134.stderr:2021-04-09 18:19:38.746 7f4834e98a80 -1 Falling back to public interface 2021-04-09T18:19:38.751 INFO:tasks.ceph.osd.7.smithi134.stderr:2021-04-09 18:19:38.752 7f249a857a80 -1 Falling back to public interface 2021-04-09T18:19:38.924 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-04-09T18:19:39.099 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.072 7f6dbfd8f700 1 Processor -- start 2021-04-09T18:19:39.104 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.073 7f6dbfd8f700 1 -- start start 2021-04-09T18:19:39.104 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.073 7f6dbfd8f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db80dc680 0x7f6db80d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:39.105 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.073 7f6dbfd8f700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db80d61b0 con 0x7f6db80d6730 2021-04-09T18:19:39.105 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.073 7f6dbfd8f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db80dca80 con 0x7f6db80eac10 2021-04-09T18:19:39.113 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.073 7f6dbfd8f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80ea9e0 con 0x7f6db80dc680 2021-04-09T18:19:39.113 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.073 7f6dbe3ac700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6db80d6730 0x7f6db80d5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:46972/0 (socket says 172.21.15.120:46972) 2021-04-09T18:19:39.113 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.073 7f6dbe3ac700 1 -- 172.21.15.120:0/4240994343 learned_addr learned my addr 172.21.15.120:0/4240994343 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:39.114 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.073 7f6dbd3aa700 1 --2- 172.21.15.120:0/4240994343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db80dc680 0x7f6db80d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:39.115 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbcba9700 1 -- 172.21.15.120:0/4240994343 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610767867 0 0) 0x7f6db0000d30 con 0x7f6db80d6730 2021-04-09T18:19:39.141 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbcba9700 1 -- 172.21.15.120:0/4240994343 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da4002fe0 con 0x7f6db80d6730 2021-04-09T18:19:39.141 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbcba9700 1 -- 172.21.15.120:0/4240994343 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198890572 0 0) 0x7f6db4000c60 con 0x7f6db80eac10 2021-04-09T18:19:39.141 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbcba9700 1 -- 172.21.15.120:0/4240994343 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da40042c0 con 0x7f6db80eac10 2021-04-09T18:19:39.142 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbd3aa700 1 -- 172.21.15.120:0/4240994343 >> v1:172.21.15.134:6789/0 conn(0x7f6db80eac10 legacy=0x7f6db8088030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:39.142 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbd3aa700 1 -- 172.21.15.120:0/4240994343 >> v1:172.21.15.120:6789/0 conn(0x7f6db80d6730 legacy=0x7f6db80d5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:39.143 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbd3aa700 1 -- 172.21.15.120:0/4240994343 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80f38b0 con 0x7f6db80dc680 2021-04-09T18:19:39.143 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbd3aa700 1 --2- 172.21.15.120:0/4240994343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db80dc680 0x7f6db80d1b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6da8006650 tx=0x7f6da8009a80).ready entity=mon.2 client_cookie=fbc57591524144f3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:39.149 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbcba9700 1 -- 172.21.15.120:0/4240994343 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6da80009b0 con 0x7f6db80dc680 2021-04-09T18:19:39.150 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbcba9700 1 -- 172.21.15.120:0/4240994343 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800c0c0 con 0x7f6db80dc680 2021-04-09T18:19:39.150 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.074 7f6dbcba9700 1 -- 172.21.15.120:0/4240994343 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6da800c510 con 0x7f6db80dc680 2021-04-09T18:19:39.151 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.075 7f6dbfd8f700 1 -- 172.21.15.120:0/4240994343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db80dc680 msgr2=0x7f6db80d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:39.151 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.075 7f6dbfd8f700 1 --2- 172.21.15.120:0/4240994343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db80dc680 0x7f6db80d1b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6da8006650 tx=0x7f6da8009a80).stop 2021-04-09T18:19:39.151 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.075 7f6dbfd8f700 1 -- 172.21.15.120:0/4240994343 shutdown_connections 2021-04-09T18:19:39.152 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.075 7f6dbfd8f700 1 --2- 172.21.15.120:0/4240994343 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db80dc680 0x7f6db80d1b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.152 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.075 7f6dbfd8f700 1 -- 172.21.15.120:0/4240994343 >> 172.21.15.120:0/4240994343 conn(0x7f6db80e9390 msgr2=0x7f6db8100540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:39.153 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.075 7f6dbfd8f700 1 -- 172.21.15.120:0/4240994343 shutdown_connections 2021-04-09T18:19:39.153 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.075 7f6dbfd8f700 1 -- 172.21.15.120:0/4240994343 wait complete. 2021-04-09T18:19:39.153 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.094 7f6dbfd8f700 1 Processor -- start 2021-04-09T18:19:39.154 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.094 7f6dbfd8f700 1 -- start start 2021-04-09T18:19:39.154 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbfd8f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6db819dd20 0x7f6db8187610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:39.155 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbfd8f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db8187d40 0x7f6db8096580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:39.168 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbfd8f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db8188140 0x7f6db8094eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:39.169 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbfd8f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8096080 con 0x7f6db8188140 2021-04-09T18:19:39.169 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbfd8f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8096ba0 con 0x7f6db819dd20 2021-04-09T18:19:39.200 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbfd8f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8096dc0 con 0x7f6db8187d40 2021-04-09T18:19:39.200 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbdbab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6db819dd20 0x7f6db8187610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:39.201 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbdbab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6db819dd20 0x7f6db8187610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:40898/0 (socket says 172.21.15.120:40898) 2021-04-09T18:19:39.205 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbdbab700 1 -- 172.21.15.120:0/3170699106 learned_addr learned my addr 172.21.15.120:0/3170699106 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:39.210 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db8187d40 0x7f6db8096580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:39.211 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbe3ac700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db8188140 0x7f6db8094eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:39.213 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbd3aa700 1 -- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6db819dd20 msgr2=0x7f6db8187610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:39.214 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6db819dd20 0x7f6db8187610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.215 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbd3aa700 1 -- 172.21.15.120:0/3170699106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db8188140 msgr2=0x7f6db8094eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:39.215 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db8188140 0x7f6db8094eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.242 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbd3aa700 1 -- 172.21.15.120:0/3170699106 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80954d0 con 0x7f6db8187d40 2021-04-09T18:19:39.243 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbdbab700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6db819dd20 0x7f6db8187610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:39.243 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.095 7f6dbe3ac700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db8188140 0x7f6db8094eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:39.244 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.096 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db8187d40 0x7f6db8096580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6da800b530 tx=0x7f6da800b8d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:39.244 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.096 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6da8006740 con 0x7f6db8187d40 2021-04-09T18:19:39.245 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.096 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8002030 con 0x7f6db8187d40 2021-04-09T18:19:39.245 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.096 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6da8002510 con 0x7f6db8187d40 2021-04-09T18:19:39.246 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.096 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db80954d0 con 0x7f6db8187d40 2021-04-09T18:19:39.248 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db80954d0 con 0x7f6db8187d40 2021-04-09T18:19:39.248 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dbd3aa700 1 -- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db8187d40 msgr2=0x7f6db8096580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2021-04-09T18:19:39.249 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dbd3aa700 1 -- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db8187d40 msgr2=0x7f6db8096580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:19:39.249 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db8187d40 0x7f6db8096580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6da800b530 tx=0x7f6da800b8d0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:19:39.256 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db8187d40 0x7f6db8096580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6da800b530 tx=0x7f6da800b8d0).stop 2021-04-09T18:19:39.256 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db8187d40 msgr2=0x7f6db8096580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-04-09T18:19:39.257 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dae7fc700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6db8187d40 0x7f6db8096580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.258 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dae7fc700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da0005b60 0x7f6da0007f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:39.258 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dae7fc700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6da00085e0 0x7f6da000aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:39.264 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dae7fc700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6da000b380 0x7f6da000d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:39.264 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da000e0f0 con 0x7f6da0005b60 2021-04-09T18:19:39.265 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da000e310 con 0x7f6da000b380 2021-04-09T18:19:39.266 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da000e530 con 0x7f6da00085e0 2021-04-09T18:19:39.268 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6da00085e0 0x7f6da000aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:39.269 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dbe3ac700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6da000b380 0x7f6da000d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:39.269 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.097 7f6dbdbab700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da0005b60 0x7f6da0007f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:39.269 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.098 7f6dbd3aa700 1 -- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6da000b380 msgr2=0x7f6da000d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:39.270 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.098 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6da000b380 0x7f6da000d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.278 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.098 7f6dbd3aa700 1 -- 172.21.15.120:0/3170699106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da0005b60 msgr2=0x7f6da0007f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:39.279 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.098 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da0005b60 0x7f6da0007f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.279 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.098 7f6dbd3aa700 1 -- 172.21.15.120:0/3170699106 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) v3 -- 0x7f6da000e850 con 0x7f6da00085e0 2021-04-09T18:19:39.280 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.098 7f6dbd3aa700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6da00085e0 0x7f6da000aae0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6da8009470 tx=0x7f6da80028f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:39.280 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.098 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6da80072f0 con 0x7f6da00085e0 2021-04-09T18:19:39.280 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.098 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8007570 con 0x7f6da00085e0 2021-04-09T18:19:39.281 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.099 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6da8006fe0 con 0x7f6da00085e0 2021-04-09T18:19:39.281 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.099 7f6dae7fc700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6da0023250 0x7f6da0025660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:39.281 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.099 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 <== mon.2 v2:172.21.15.134:3301/0 4 ==== osd_map(10..10 src has 1..10) v4 ==== 1578+0+0 (secure 0 0 0) 0x7f6da8032b80 con 0x7f6da00085e0 2021-04-09T18:19:39.303 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.099 7f6dbdbab700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6da0023250 0x7f6da0025660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:39.304 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.099 7f6dbdbab700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6da0023250 0x7f6da0025660 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:39.347 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.118 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db8095dd0 con 0x7f6da00085e0 2021-04-09T18:19:39.348 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.124 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 <== mon.2 v2:172.21.15.134:3301/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6da8002a30 con 0x7f6da00085e0 2021-04-09T18:19:39.348 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.328 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6db8095dd0 con 0x7f6da00085e0 2021-04-09T18:19:39.348 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.329 7f6dae7fc700 1 -- 172.21.15.120:0/3170699106 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+5464 (secure 0 0 0) 0x7f6da8006fe0 con 0x7f6da00085e0 2021-04-09T18:19:39.350 INFO:teuthology.misc.health.smithi120.stdout: 2021-04-09T18:19:39.350 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":10,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:37.889496","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:19:39.397 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6da0023250 msgr2=0x7f6da0025660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:39.397 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6da0023250 0x7f6da0025660 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.398 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6da00085e0 msgr2=0x7f6da000aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:39.398 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6da00085e0 0x7f6da000aae0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6da8009470 tx=0x7f6da80028f0).stop 2021-04-09T18:19:39.398 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 shutdown_connections 2021-04-09T18:19:39.399 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6da000b380 0x7f6da000d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.399 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6da0023250 0x7f6da0025660 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.400 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6da00085e0 0x7f6da000aae0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.400 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 --2- 172.21.15.120:0/3170699106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da0005b60 0x7f6da0007f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:39.405 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.331 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 >> 172.21.15.120:0/3170699106 conn(0x7f6db809a280 msgr2=0x7f6db8088730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:39.407 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.332 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 shutdown_connections 2021-04-09T18:19:39.407 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:39.332 7f6dbfd8f700 1 -- 172.21.15.120:0/3170699106 wait complete. 2021-04-09T18:19:39.408 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-04-09T18:19:39.842 INFO:tasks.ceph.osd.0.smithi120.stderr:2021-04-09 18:19:39.844 7f2067102a80 -1 osd.0 0 log_to_monitors {default=true} 2021-04-09T18:19:39.890 INFO:tasks.ceph.osd.1.smithi120.stderr:2021-04-09 18:19:39.888 7fb0c2de0a80 -1 osd.1 0 log_to_monitors {default=true} 2021-04-09T18:19:39.914 INFO:tasks.ceph.osd.2.smithi120.stderr:2021-04-09 18:19:39.916 7fdbfc14ba80 -1 osd.2 0 log_to_monitors {default=true} 2021-04-09T18:19:39.937 INFO:tasks.ceph.osd.3.smithi120.stderr:2021-04-09 18:19:39.939 7fb2afa0ba80 -1 osd.3 0 log_to_monitors {default=true} 2021-04-09T18:19:39.949 INFO:tasks.ceph.osd.4.smithi134.stderr:2021-04-09 18:19:39.951 7febbbaada80 -1 osd.4 0 log_to_monitors {default=true} 2021-04-09T18:19:39.989 INFO:tasks.ceph.osd.5.smithi134.stderr:2021-04-09 18:19:39.990 7fec53d38a80 -1 osd.5 0 log_to_monitors {default=true} 2021-04-09T18:19:40.043 INFO:tasks.ceph.osd.6.smithi134.stderr:2021-04-09 18:19:40.043 7f4834e98a80 -1 osd.6 0 log_to_monitors {default=true} 2021-04-09T18:19:40.050 INFO:tasks.ceph.osd.7.smithi134.stderr:2021-04-09 18:19:40.051 7f249a857a80 -1 osd.7 0 log_to_monitors {default=true} 2021-04-09T18:19:41.760 INFO:tasks.ceph.osd.2.smithi120.stderr:2021-04-09 18:19:41.761 7fdbe27c4700 -1 osd.2 0 waiting for initial osdmap 2021-04-09T18:19:41.761 INFO:tasks.ceph.osd.0.smithi120.stderr:2021-04-09 18:19:41.761 7f204d77b700 -1 osd.0 0 waiting for initial osdmap 2021-04-09T18:19:41.761 INFO:tasks.ceph.osd.3.smithi120.stderr:2021-04-09 18:19:41.762 7fb296084700 -1 osd.3 0 waiting for initial osdmap 2021-04-09T18:19:41.762 INFO:tasks.ceph.osd.1.smithi120.stderr:2021-04-09 18:19:41.762 7fb0a9459700 -1 osd.1 0 waiting for initial osdmap 2021-04-09T18:19:41.766 INFO:tasks.ceph.osd.5.smithi134.stderr:2021-04-09 18:19:41.768 7fec3a3b1700 -1 osd.5 0 waiting for initial osdmap 2021-04-09T18:19:41.767 INFO:tasks.ceph.osd.6.smithi134.stderr:2021-04-09 18:19:41.768 7f481b511700 -1 osd.6 0 waiting for initial osdmap 2021-04-09T18:19:41.767 INFO:tasks.ceph.osd.4.smithi134.stderr:2021-04-09 18:19:41.768 7feba2126700 -1 osd.4 0 waiting for initial osdmap 2021-04-09T18:19:41.768 INFO:tasks.ceph.osd.7.smithi134.stderr:2021-04-09 18:19:41.769 7f2480ed0700 -1 osd.7 0 waiting for initial osdmap 2021-04-09T18:19:46.221 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-04-09T18:19:46.390 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.363 7f33e7bac700 1 Processor -- start 2021-04-09T18:19:46.390 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.363 7f33e7bac700 1 -- start start 2021-04-09T18:19:46.391 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e7bac700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f33e00dc6b0 0x7f33e00d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.392 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e7bac700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00d6760 0x7f33e00d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.392 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e7bac700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e00d61e0 con 0x7f33e00eac40 2021-04-09T18:19:46.393 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e7bac700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e0100d60 con 0x7f33e00dc6b0 2021-04-09T18:19:46.394 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e7bac700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00eaa10 con 0x7f33e00d6760 2021-04-09T18:19:46.395 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e59c8700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f33e00eac40 0x7f33e0088030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47190/0 (socket says 172.21.15.120:47190) 2021-04-09T18:19:46.395 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e59c8700 1 -- 172.21.15.120:0/2990440109 learned_addr learned my addr 172.21.15.120:0/2990440109 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:46.396 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e51c7700 1 --2- 172.21.15.120:0/2990440109 >> v2:172.21.15.134:3300/0 conn(0x7f33e00dc6b0 0x7f33e00d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.397 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e61c9700 1 --2- 172.21.15.120:0/2990440109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00d6760 0x7f33e00d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.398 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e49c6700 1 -- 172.21.15.120:0/2990440109 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256541345 0 0) 0x7f33dc001060 con 0x7f33e00eac40 2021-04-09T18:19:46.398 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e49c6700 1 -- 172.21.15.120:0/2990440109 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33cc002fe0 con 0x7f33e00eac40 2021-04-09T18:19:46.401 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e61c9700 1 -- 172.21.15.120:0/2990440109 >> v2:172.21.15.134:3300/0 conn(0x7f33e00dc6b0 msgr2=0x7f33e00d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:46.401 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e61c9700 1 --2- 172.21.15.120:0/2990440109 >> v2:172.21.15.134:3300/0 conn(0x7f33e00dc6b0 0x7f33e00d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.403 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e49c6700 1 -- 172.21.15.120:0/2990440109 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3247236030 0 0) 0x7f33dc001460 con 0x7f33e00eac40 2021-04-09T18:19:46.404 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e61c9700 1 -- 172.21.15.120:0/2990440109 >> v1:172.21.15.120:6789/0 conn(0x7f33e00eac40 legacy=0x7f33e0088030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.406 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e61c9700 1 -- 172.21.15.120:0/2990440109 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00dcab0 con 0x7f33e00d6760 2021-04-09T18:19:46.406 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.364 7f33e51c7700 1 --2- 172.21.15.120:0/2990440109 >> v2:172.21.15.134:3300/0 conn(0x7f33e00dc6b0 0x7f33e00d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:46.407 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.365 7f33e61c9700 1 --2- 172.21.15.120:0/2990440109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00d6760 0x7f33e00d6b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f33d8006ad0 tx=0x7f33d8009ad0).ready entity=mon.2 client_cookie=3ef84d29c3439008 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:46.407 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.365 7f33e49c6700 1 -- 172.21.15.120:0/2990440109 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33d80022e0 con 0x7f33e00d6760 2021-04-09T18:19:46.408 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.365 7f33e49c6700 1 -- 172.21.15.120:0/2990440109 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d8006410 con 0x7f33e00d6760 2021-04-09T18:19:46.408 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.365 7f33e49c6700 1 -- 172.21.15.120:0/2990440109 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33d8002620 con 0x7f33e00d6760 2021-04-09T18:19:46.409 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.365 7f33e7bac700 1 -- 172.21.15.120:0/2990440109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00d6760 msgr2=0x7f33e00d6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.410 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.365 7f33e7bac700 1 --2- 172.21.15.120:0/2990440109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00d6760 0x7f33e00d6b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f33d8006ad0 tx=0x7f33d8009ad0).stop 2021-04-09T18:19:46.410 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.366 7f33e7bac700 1 -- 172.21.15.120:0/2990440109 shutdown_connections 2021-04-09T18:19:46.411 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.366 7f33e7bac700 1 --2- 172.21.15.120:0/2990440109 >> v2:172.21.15.134:3300/0 conn(0x7f33e00dc6b0 0x7f33e00d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.412 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.366 7f33e7bac700 1 --2- 172.21.15.120:0/2990440109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00d6760 0x7f33e00d6b60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.413 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.366 7f33e7bac700 1 -- 172.21.15.120:0/2990440109 >> 172.21.15.120:0/2990440109 conn(0x7f33e00e93c0 msgr2=0x7f33e0100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:46.413 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.366 7f33e7bac700 1 -- 172.21.15.120:0/2990440109 shutdown_connections 2021-04-09T18:19:46.414 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.366 7f33e7bac700 1 -- 172.21.15.120:0/2990440109 wait complete. 2021-04-09T18:19:46.414 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.384 7f33e7bac700 1 Processor -- start 2021-04-09T18:19:46.415 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.384 7f33e7bac700 1 -- start start 2021-04-09T18:19:46.416 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e7bac700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e018f2a0 0x7f33e00947f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.416 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e7bac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33e00c2fa0 0x7f33e00c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.417 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e7bac700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00c39c0 0x7f33e00c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.417 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e7bac700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00bf830 con 0x7f33e018f2a0 2021-04-09T18:19:46.417 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e7bac700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0094e10 con 0x7f33e00c2fa0 2021-04-09T18:19:46.418 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e7bac700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0093ec0 con 0x7f33e00c39c0 2021-04-09T18:19:46.419 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e59c8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e018f2a0 0x7f33e00947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.419 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e59c8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e018f2a0 0x7f33e00947f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52284/0 (socket says 172.21.15.120:52284) 2021-04-09T18:19:46.421 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e59c8700 1 -- 172.21.15.120:0/1094877503 learned_addr learned my addr 172.21.15.120:0/1094877503 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:46.421 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e51c7700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33e00c2fa0 0x7f33e00c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.432 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e61c9700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00c39c0 0x7f33e00c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.433 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e59c8700 1 -- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00c39c0 msgr2=0x7f33e00c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.433 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e59c8700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00c39c0 0x7f33e00c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.434 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e59c8700 1 -- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33e00c2fa0 msgr2=0x7f33e00c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.435 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e59c8700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33e00c2fa0 0x7f33e00c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.435 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e59c8700 1 -- 172.21.15.120:0/1094877503 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00c43e0 con 0x7f33e018f2a0 2021-04-09T18:19:46.435 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.385 7f33e59c8700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e018f2a0 0x7f33e00947f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f33dc00a870 tx=0x7f33dc00ac10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:46.436 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.386 7f33d67fc700 1 -- 172.21.15.120:0/1094877503 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33dc001270 con 0x7f33e018f2a0 2021-04-09T18:19:46.436 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.386 7f33d67fc700 1 -- 172.21.15.120:0/1094877503 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc007280 con 0x7f33e018f2a0 2021-04-09T18:19:46.437 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.386 7f33d67fc700 1 -- 172.21.15.120:0/1094877503 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33dc004720 con 0x7f33e018f2a0 2021-04-09T18:19:46.453 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.386 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e00c43e0 con 0x7f33e018f2a0 2021-04-09T18:19:46.453 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.386 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e00c43e0 con 0x7f33e018f2a0 2021-04-09T18:19:46.453 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.386 7f33d67fc700 1 -- 172.21.15.120:0/1094877503 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f33dc007460 con 0x7f33e018f2a0 2021-04-09T18:19:46.453 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.386 7f33d67fc700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f33c8018930 0x7f33c801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.457 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.386 7f33d67fc700 1 -- 172.21.15.120:0/1094877503 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4404+0+0 (secure 0 0 0) 0x7f33dc032900 con 0x7f33e018f2a0 2021-04-09T18:19:46.458 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.387 7f33e51c7700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f33c8018930 0x7f33c801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.458 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.387 7f33e51c7700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f33c8018930 0x7f33c801ae10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:46.459 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.409 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e00fee20 con 0x7f33e018f2a0 2021-04-09T18:19:46.468 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.413 7f33d67fc700 1 -- 172.21.15.120:0/1094877503 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f33dc007070 con 0x7f33e018f2a0 2021-04-09T18:19:46.586 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.587 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33e00ccba0 con 0x7f33e018f2a0 2021-04-09T18:19:46.587 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.588 7f33d67fc700 1 -- 172.21.15.120:0/1094877503 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+9868 (secure 0 0 0) 0x7f33dc007280 con 0x7f33e018f2a0 2021-04-09T18:19:46.588 INFO:teuthology.misc.health.smithi120.stdout: 2021-04-09T18:19:46.588 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":13,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:42.766712","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:19:46.590 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f33c8018930 msgr2=0x7f33c801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.591 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f33c8018930 0x7f33c801ae10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.591 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e018f2a0 msgr2=0x7f33e00947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.592 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e018f2a0 0x7f33e00947f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f33dc00a870 tx=0x7f33dc00ac10).stop 2021-04-09T18:19:46.604 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 shutdown_connections 2021-04-09T18:19:46.605 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f33c8018930 0x7f33c801ae10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.605 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33e00c39c0 0x7f33e00c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.605 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33e00c2fa0 0x7f33e00c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.606 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 --2- 172.21.15.120:0/1094877503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e018f2a0 0x7f33e00947f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.606 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 >> 172.21.15.120:0/1094877503 conn(0x7f33e00ab290 msgr2=0x7f33e00bfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:46.606 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 shutdown_connections 2021-04-09T18:19:46.607 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:19:46.590 7f33e7bac700 1 -- 172.21.15.120:0/1094877503 wait complete. 2021-04-09T18:19:46.613 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-04-09T18:19:46.621 INFO:tasks.ceph:Creating RBD pool 2021-04-09T18:19:46.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd pool create rbd 8 2021-04-09T18:19:46.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe746b03700 1 Processor -- start 2021-04-09T18:19:46.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe746b03700 1 -- start start 2021-04-09T18:19:46.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe746b03700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7400d65a0 0x7fe7401ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe746b03700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7400d7980 con 0x7fe7400d7180 2021-04-09T18:19:46.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe746b03700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7400d69a0 con 0x7fe7400d7580 2021-04-09T18:19:46.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe746b03700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7400d6c00 con 0x7fe7400d65a0 2021-04-09T18:19:46.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe74491f700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe7400d7180 0x7fe7400d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47210/0 (socket says 172.21.15.120:47210) 2021-04-09T18:19:46.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe74491f700 1 -- 172.21.15.120:0/4169386225 learned_addr learned my addr 172.21.15.120:0/4169386225 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:46.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe745120700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7400d65a0 0x7fe7401ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.765 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163585208 0 0) 0x7fe728000ce0 con 0x7fe7400d7180 2021-04-09T18:19:46.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe72c002fe0 con 0x7fe7400d7180 2021-04-09T18:19:46.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3583372747 0 0) 0x7fe7280010e0 con 0x7fe7400d7180 2021-04-09T18:19:46.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7400d65a0 msgr2=0x7fe7401ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:46.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7400d65a0 0x7fe7401ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 >> v1:172.21.15.134:6789/0 conn(0x7fe7400d7580 legacy=0x7fe7400d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7400d1210 con 0x7fe7400d7180 2021-04-09T18:19:46.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7fe728001600 con 0x7fe7400d7180 2021-04-09T18:19:46.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 >> v1:172.21.15.120:6789/0 conn(0x7fe7400d7180 legacy=0x7fe7400d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe72c003a70 0x7fe72c005ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c006740 0x7fe72c008c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe72c009500 0x7fe72c00ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c00c2d0 con 0x7fe72c009500 2021-04-09T18:19:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c00c4f0 con 0x7fe72c006740 2021-04-09T18:19:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c050720 con 0x7fe72c003a70 2021-04-09T18:19:46.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe745120700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe72c009500 0x7fe72c00ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe74491f700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe72c003a70 0x7fe72c005ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe73ffff700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c006740 0x7fe72c008c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe745120700 1 -- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe72c003a70 msgr2=0x7fe72c005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:46.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe745120700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe72c003a70 0x7fe72c005ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe745120700 1 -- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c006740 msgr2=0x7fe72c008c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:46.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe745120700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c006740 0x7fe72c008c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe745120700 1 -- 172.21.15.120:0/4169386225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c050980 con 0x7fe72c009500 2021-04-09T18:19:46.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.766 7fe745120700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe72c009500 0x7fe72c00ba20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe738006af0 tx=0x7fe738009a50).ready entity=mon.0 client_cookie=2c4f5814e902e5d2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:46.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7380066c0 con 0x7fe72c009500 2021-04-09T18:19:46.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7380022e0 con 0x7fe72c009500 2021-04-09T18:19:46.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe73f7fe700 1 -- 172.21.15.120:0/4169386225 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe738002730 con 0x7fe72c009500 2021-04-09T18:19:46.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe746b03700 1 -- 172.21.15.120:0/4169386225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe72c009500 msgr2=0x7fe72c00ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe746b03700 1 --2- 172.21.15.120:0/4169386225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe72c009500 0x7fe72c00ba20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe738006af0 tx=0x7fe738009a50).stop 2021-04-09T18:19:46.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe745120700 1 -- 172.21.15.120:0/4169386225 reap_dead start 2021-04-09T18:19:46.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe746b03700 1 -- 172.21.15.120:0/4169386225 shutdown_connections 2021-04-09T18:19:46.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe746b03700 1 -- 172.21.15.120:0/4169386225 >> 172.21.15.120:0/4169386225 conn(0x7fe7400d15b0 msgr2=0x7fe7400d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:46.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe746b03700 1 -- 172.21.15.120:0/4169386225 shutdown_connections 2021-04-09T18:19:46.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.767 7fe746b03700 1 -- 172.21.15.120:0/4169386225 wait complete. 2021-04-09T18:19:46.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.786 7fe746b03700 1 Processor -- start 2021-04-09T18:19:46.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.786 7fe746b03700 1 -- start start 2021-04-09T18:19:46.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe746b03700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740193290 0x7fe7400b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe746b03700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7400b4c20 0x7fe740191830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe746b03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe740191e50 0x7fe740192250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe746b03700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74017bef0 con 0x7fe740193290 2021-04-09T18:19:46.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe746b03700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe740192d10 con 0x7fe740191e50 2021-04-09T18:19:46.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe746b03700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7401965f0 con 0x7fe7400b4c20 2021-04-09T18:19:46.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe74491f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740193290 0x7fe7400b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe74491f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740193290 0x7fe7400b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52310/0 (socket says 172.21.15.120:52310) 2021-04-09T18:19:46.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe74491f700 1 -- 172.21.15.120:0/1781110995 learned_addr learned my addr 172.21.15.120:0/1781110995 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:46.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe745120700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe740191e50 0x7fe740192250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe73ffff700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7400b4c20 0x7fe740191830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe74491f700 1 -- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7400b4c20 msgr2=0x7fe740191830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe74491f700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7400b4c20 0x7fe740191830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe74491f700 1 -- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe740191e50 msgr2=0x7fe740192250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:46.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe74491f700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe740191e50 0x7fe740192250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:46.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe74491f700 1 -- 172.21.15.120:0/1781110995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe740193690 con 0x7fe740193290 2021-04-09T18:19:46.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.787 7fe74491f700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740193290 0x7fe7400b4600 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe728001790 tx=0x7fe72800a880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:46.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.788 7fe73d7fa700 1 -- 172.21.15.120:0/1781110995 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7280070d0 con 0x7fe740193290 2021-04-09T18:19:46.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.788 7fe73d7fa700 1 -- 172.21.15.120:0/1781110995 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72800ac70 con 0x7fe740193290 2021-04-09T18:19:46.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.788 7fe73d7fa700 1 -- 172.21.15.120:0/1781110995 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe728004620 con 0x7fe740193290 2021-04-09T18:19:46.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.788 7fe746b03700 1 -- 172.21.15.120:0/1781110995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe740193690 con 0x7fe740193290 2021-04-09T18:19:46.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.788 7fe746b03700 1 -- 172.21.15.120:0/1781110995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe740193690 con 0x7fe740193290 2021-04-09T18:19:46.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.788 7fe73d7fa700 1 -- 172.21.15.120:0/1781110995 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe7280043a0 con 0x7fe740193290 2021-04-09T18:19:46.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.788 7fe73d7fa700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe724018930 0x7fe72401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:46.839 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.788 7fe73d7fa700 1 -- 172.21.15.120:0/1781110995 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4404+0+0 (secure 0 0 0) 0x7fe7280325b0 con 0x7fe740193290 2021-04-09T18:19:46.839 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.788 7fe73ffff700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe724018930 0x7fe72401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:46.839 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.789 7fe73ffff700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe724018930 0x7fe72401ae10 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:46.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.810 7fe746b03700 1 -- 172.21.15.120:0/1781110995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7400e25c0 con 0x7fe740193290 2021-04-09T18:19:46.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.814 7fe73d7fa700 1 -- 172.21.15.120:0/1781110995 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe728000940 con 0x7fe740193290 2021-04-09T18:19:46.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:46.989 7fe746b03700 1 -- 172.21.15.120:0/1781110995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"} v 0) v1 -- 0x7fe7400e25c0 con 0x7fe740193290 2021-04-09T18:19:47.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.645 7fe73d7fa700 1 -- 172.21.15.120:0/1781110995 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fe7280043a0 con 0x7fe740193290 2021-04-09T18:19:47.653 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'rbd' created 2021-04-09T18:19:47.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.656 7fe746b03700 1 -- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe724018930 msgr2=0x7fe72401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:47.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.656 7fe746b03700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe724018930 0x7fe72401ae10 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.656 7fe746b03700 1 -- 172.21.15.120:0/1781110995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740193290 msgr2=0x7fe7400b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:47.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.656 7fe746b03700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740193290 0x7fe7400b4600 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe728001790 tx=0x7fe72800a880).stop 2021-04-09T18:19:47.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.657 7fe746b03700 1 -- 172.21.15.120:0/1781110995 shutdown_connections 2021-04-09T18:19:47.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.657 7fe746b03700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe740191e50 0x7fe740192250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.657 7fe746b03700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe724018930 0x7fe72401ae10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.657 7fe746b03700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7400b4c20 0x7fe740191830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.661 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.657 7fe746b03700 1 --2- 172.21.15.120:0/1781110995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740193290 0x7fe7400b4600 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.661 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.657 7fe746b03700 1 -- 172.21.15.120:0/1781110995 >> 172.21.15.120:0/1781110995 conn(0x7fe740182320 msgr2=0x7fe740197100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:47.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.657 7fe746b03700 1 -- 172.21.15.120:0/1781110995 shutdown_connections 2021-04-09T18:19:47.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.657 7fe746b03700 1 -- 172.21.15.120:0/1781110995 wait complete. 2021-04-09T18:19:47.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-04-09T18:19:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.816 7f7530c9f700 1 Processor -- start 2021-04-09T18:19:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.817 7f7530c9f700 1 -- start start 2021-04-09T18:19:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.817 7f7530c9f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c0d71a0 0x7f752c0e7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.817 7f7530c9f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f752c0e70e0 0x7f752c0d5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.817 7f7530c9f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0d6c20 con 0x7f752c0d75a0 2021-04-09T18:19:47.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.817 7f7530c9f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0d8130 con 0x7f752c0e70e0 2021-04-09T18:19:47.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.817 7f7530c9f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0e7f40 con 0x7f752c0d71a0 2021-04-09T18:19:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752a85e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c0d71a0 0x7f752c0e7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752b05f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f752c0e70e0 0x7f752c0d5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752a05d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f752c0d75a0 0x7f752c0d55e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42068/0 (socket says 172.21.15.120:42068) 2021-04-09T18:19:47.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752b05f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f752c0e70e0 0x7f752c0d5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:41174/0 (socket says 172.21.15.120:41174) 2021-04-09T18:19:47.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752a05d700 1 -- 172.21.15.120:0/964343350 learned_addr learned my addr 172.21.15.120:0/964343350 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:47.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752a85e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c0d71a0 0x7f752c0e7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:39000/0 (socket says 172.21.15.120:39000) 2021-04-09T18:19:47.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752b05f700 1 -- 172.21.15.120:0/964343350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c0d71a0 msgr2=0x7f752c0e7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:47.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752b05f700 1 --2- 172.21.15.120:0/964343350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c0d71a0 0x7f752c0e7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752b05f700 1 -- 172.21.15.120:0/964343350 >> v1:172.21.15.134:6789/0 conn(0x7f752c0d75a0 legacy=0x7f752c0d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:47.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752b05f700 1 -- 172.21.15.120:0/964343350 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c1a2b00 con 0x7f752c0e70e0 2021-04-09T18:19:47.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752a85e700 1 --2- 172.21.15.120:0/964343350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c0d71a0 0x7f752c0e7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:47.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752985c700 1 -- 172.21.15.120:0/964343350 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077053103 0 0) 0x7f75200010b0 con 0x7f752c0d75a0 2021-04-09T18:19:47.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752b05f700 1 --2- 172.21.15.120:0/964343350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f752c0e70e0 0x7f752c0d5dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7524006ad0 tx=0x7f7524009ad0).ready entity=mon.1 client_cookie=d8103724c0eb4dd0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:47.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752985c700 1 -- 172.21.15.120:0/964343350 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f75240022e0 con 0x7f752c0e70e0 2021-04-09T18:19:47.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752985c700 1 -- 172.21.15.120:0/964343350 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524006410 con 0x7f752c0e70e0 2021-04-09T18:19:47.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f752985c700 1 -- 172.21.15.120:0/964343350 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7524000c10 con 0x7f752c0e70e0 2021-04-09T18:19:47.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f7530c9f700 1 -- 172.21.15.120:0/964343350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f752c0e70e0 msgr2=0x7f752c0d5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:47.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.818 7f7530c9f700 1 --2- 172.21.15.120:0/964343350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f752c0e70e0 0x7f752c0d5dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7524006ad0 tx=0x7f7524009ad0).stop 2021-04-09T18:19:47.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.819 7f7530c9f700 1 -- 172.21.15.120:0/964343350 shutdown_connections 2021-04-09T18:19:47.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.819 7f7530c9f700 1 --2- 172.21.15.120:0/964343350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f752c0e70e0 0x7f752c0d5dd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.819 7f7530c9f700 1 --2- 172.21.15.120:0/964343350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c0d71a0 0x7f752c0e7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.819 7f7530c9f700 1 -- 172.21.15.120:0/964343350 >> 172.21.15.120:0/964343350 conn(0x7f752c0d15d0 msgr2=0x7f752c0d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:47.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.819 7f7530c9f700 1 -- 172.21.15.120:0/964343350 shutdown_connections 2021-04-09T18:19:47.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.819 7f7530c9f700 1 -- 172.21.15.120:0/964343350 wait complete. 2021-04-09T18:19:47.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f7530c9f700 1 Processor -- start 2021-04-09T18:19:47.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f7530c9f700 1 -- start start 2021-04-09T18:19:47.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f7530c9f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c19bf30 0x7f752c1a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:47.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f7530c9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f752c180530 0x7f752c17a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:47.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f7530c9f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c180930 0x7f752c17aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:47.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f7530c9f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c180030 con 0x7f752c19bf30 2021-04-09T18:19:47.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f7530c9f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c1a1490 con 0x7f752c180530 2021-04-09T18:19:47.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f7530c9f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c17fca0 con 0x7f752c180930 2021-04-09T18:19:47.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f752a85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c19bf30 0x7f752c1a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:47.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f752a85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c19bf30 0x7f752c1a0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52342/0 (socket says 172.21.15.120:52342) 2021-04-09T18:19:47.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f752a85e700 1 -- 172.21.15.120:0/369747403 learned_addr learned my addr 172.21.15.120:0/369747403 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:47.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f752a05d700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f752c180530 0x7f752c17a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:47.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.838 7f752b05f700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c180930 0x7f752c17aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:47.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f752a85e700 1 -- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c180930 msgr2=0x7f752c17aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:47.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f752a85e700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c180930 0x7f752c17aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f752a85e700 1 -- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f752c180530 msgr2=0x7f752c17a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:47.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f752a85e700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f752c180530 0x7f752c17a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:47.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f752a85e700 1 -- 172.21.15.120:0/369747403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c1a09b0 con 0x7f752c19bf30 2021-04-09T18:19:47.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f752b05f700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c180930 0x7f752c17aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:47.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f752a85e700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c19bf30 0x7f752c1a0e70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f751c00b970 tx=0x7f751c00bd10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:47.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f751b7fe700 1 -- 172.21.15.120:0/369747403 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f751c000d30 con 0x7f752c19bf30 2021-04-09T18:19:47.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f751b7fe700 1 -- 172.21.15.120:0/369747403 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c006240 con 0x7f752c19bf30 2021-04-09T18:19:47.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f751b7fe700 1 -- 172.21.15.120:0/369747403 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f751c005660 con 0x7f752c19bf30 2021-04-09T18:19:47.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f7530c9f700 1 -- 172.21.15.120:0/369747403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c1a09b0 con 0x7f752c19bf30 2021-04-09T18:19:47.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.839 7f7530c9f700 1 -- 172.21.15.120:0/369747403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c1a09b0 con 0x7f752c19bf30 2021-04-09T18:19:47.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.840 7f751b7fe700 1 -- 172.21.15.120:0/369747403 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f751c005660 con 0x7f752c19bf30 2021-04-09T18:19:47.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.840 7f751b7fe700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75100188c0 0x7f751001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:47.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.840 7f751b7fe700 1 -- 172.21.15.120:0/369747403 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4746+0+0 (secure 0 0 0) 0x7f751c032840 con 0x7f752c19bf30 2021-04-09T18:19:47.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.840 7f752a05d700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75100188c0 0x7f751001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:47.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.840 7f752a05d700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75100188c0 0x7f751001adc0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:47.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.863 7f7530c9f700 1 -- 172.21.15.120:0/369747403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c1a1490 con 0x7f752c19bf30 2021-04-09T18:19:47.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:47.866 7f751b7fe700 1 -- 172.21.15.120:0/369747403 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f751c0064a0 con 0x7f752c19bf30 2021-04-09T18:19:48.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.032 7f7530c9f700 1 -- 172.21.15.120:0/369747403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool application enable", "app": "rbd", "pool": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f752c1a1490 con 0x7f752c19bf30 2021-04-09T18:19:48.653 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.652 7f751b7fe700 1 -- 172.21.15.120:0/369747403 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "app": "rbd", "pool": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f751c005660 con 0x7f752c19bf30 2021-04-09T18:19:48.695 INFO:teuthology.orchestra.run.smithi120.stderr:enabled application 'rbd' on pool 'rbd' 2021-04-09T18:19:48.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 -- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75100188c0 msgr2=0x7f751001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:48.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75100188c0 0x7f751001adc0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 -- 172.21.15.120:0/369747403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c19bf30 msgr2=0x7f752c1a0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:48.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c19bf30 0x7f752c1a0e70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f751c00b970 tx=0x7f751c00bd10).stop 2021-04-09T18:19:48.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 -- 172.21.15.120:0/369747403 shutdown_connections 2021-04-09T18:19:48.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75100188c0 0x7f751001adc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f752c180930 0x7f752c17aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f752c180530 0x7f752c17a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 --2- 172.21.15.120:0/369747403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c19bf30 0x7f752c1a0e70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 -- 172.21.15.120:0/369747403 >> 172.21.15.120:0/369747403 conn(0x7f752c184610 msgr2=0x7f752c194a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:48.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 -- 172.21.15.120:0/369747403 shutdown_connections 2021-04-09T18:19:48.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.699 7f7530c9f700 1 -- 172.21.15.120:0/369747403 wait complete. 2021-04-09T18:19:48.708 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-04-09T18:19:48.708 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:19:48.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.849 7f299fd57700 1 Processor -- start 2021-04-09T18:19:48.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.849 7f299fd57700 1 -- start start 2021-04-09T18:19:48.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299fd57700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f29980d7160 0x7f29980d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:48.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299fd57700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980d6190 0x7f29980d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:48.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299fd57700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29980d6be0 con 0x7f29980d55a0 2021-04-09T18:19:48.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299fd57700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29980d80f0 con 0x7f29980d7160 2021-04-09T18:19:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299fd57700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29981a2ac0 con 0x7f29980d6190 2021-04-09T18:19:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299db73700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f29980d7160 0x7f29980d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299e374700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980d6190 0x7f29980d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299d372700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f29980d55a0 0x7f29980d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42084/0 (socket says 172.21.15.120:42084) 2021-04-09T18:19:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299e374700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980d6190 0x7f29980d6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:39018/0 (socket says 172.21.15.120:39018) 2021-04-09T18:19:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299db73700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f29980d7160 0x7f29980d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:41188/0 (socket says 172.21.15.120:41188) 2021-04-09T18:19:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299d372700 1 -- 172.21.15.120:0/2798888694 learned_addr learned my addr 172.21.15.120:0/2798888694 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.850 7f299cb71700 1 -- 172.21.15.120:0/2798888694 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134872931 0 0) 0x7f29940009b0 con 0x7f29980d55a0 2021-04-09T18:19:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299cb71700 1 -- 172.21.15.120:0/2798888694 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2984002fe0 con 0x7f29980d55a0 2021-04-09T18:19:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299e374700 1 -- 172.21.15.120:0/2798888694 >> v2:172.21.15.134:3300/0 conn(0x7f29980d7160 msgr2=0x7f29980d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299e374700 1 --2- 172.21.15.120:0/2798888694 >> v2:172.21.15.134:3300/0 conn(0x7f29980d7160 0x7f29980d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299e374700 1 -- 172.21.15.120:0/2798888694 >> v1:172.21.15.134:6789/0 conn(0x7f29980d55a0 legacy=0x7f29980d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299e374700 1 -- 172.21.15.120:0/2798888694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29981a2cb0 con 0x7f29980d6190 2021-04-09T18:19:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299db73700 1 --2- 172.21.15.120:0/2798888694 >> v2:172.21.15.134:3300/0 conn(0x7f29980d7160 0x7f29980d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299e374700 1 --2- 172.21.15.120:0/2798888694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980d6190 0x7f29980d6590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2990006ad0 tx=0x7f2990009ad0).ready entity=mon.2 client_cookie=4f0b2e6191faf34 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:48.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299cb71700 1 -- 172.21.15.120:0/2798888694 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29900022e0 con 0x7f29980d6190 2021-04-09T18:19:48.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299cb71700 1 -- 172.21.15.120:0/2798888694 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2990006410 con 0x7f29980d6190 2021-04-09T18:19:48.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299cb71700 1 -- 172.21.15.120:0/2798888694 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2990002620 con 0x7f29980d6190 2021-04-09T18:19:48.914 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299fd57700 1 -- 172.21.15.120:0/2798888694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980d6190 msgr2=0x7f29980d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.851 7f299fd57700 1 --2- 172.21.15.120:0/2798888694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980d6190 0x7f29980d6590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2990006ad0 tx=0x7f2990009ad0).stop 2021-04-09T18:19:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.852 7f299fd57700 1 -- 172.21.15.120:0/2798888694 shutdown_connections 2021-04-09T18:19:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.852 7f299fd57700 1 --2- 172.21.15.120:0/2798888694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980d6190 0x7f29980d6590 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.852 7f299fd57700 1 --2- 172.21.15.120:0/2798888694 >> v2:172.21.15.134:3300/0 conn(0x7f29980d7160 0x7f29980d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.852 7f299fd57700 1 -- 172.21.15.120:0/2798888694 >> 172.21.15.120:0/2798888694 conn(0x7f29980d1590 msgr2=0x7f29980d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.852 7f299fd57700 1 -- 172.21.15.120:0/2798888694 shutdown_connections 2021-04-09T18:19:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.852 7f299fd57700 1 -- 172.21.15.120:0/2798888694 wait complete. 2021-04-09T18:19:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299fd57700 1 Processor -- start 2021-04-09T18:19:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299fd57700 1 -- start start 2021-04-09T18:19:48.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299fd57700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2998187670 0x7f29980a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:48.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299fd57700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980a5050 0x7f29980b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:48.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299fd57700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980b5710 0x7f29981838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:48.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299fd57700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980b5b10 con 0x7f29980a5050 2021-04-09T18:19:48.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299fd57700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980b5d30 con 0x7f2998187670 2021-04-09T18:19:48.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299fd57700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980b5f50 con 0x7f29980b5710 2021-04-09T18:19:48.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299d372700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980a5050 0x7f29980b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:48.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299d372700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980a5050 0x7f29980b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52358/0 (socket says 172.21.15.120:52358) 2021-04-09T18:19:48.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299d372700 1 -- 172.21.15.120:0/2375647814 learned_addr learned my addr 172.21.15.120:0/2375647814 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:48.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299e374700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980b5710 0x7f29981838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:48.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.871 7f299db73700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2998187670 0x7f29980a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:48.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f299d372700 1 -- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980b5710 msgr2=0x7f29981838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:48.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f299d372700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980b5710 0x7f29981838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f299d372700 1 -- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2998187670 msgr2=0x7f29980a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:48.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f299d372700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2998187670 0x7f29980a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:48.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f299d372700 1 -- 172.21.15.120:0/2375647814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998183ef0 con 0x7f29980a5050 2021-04-09T18:19:48.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f299d372700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980a5050 0x7f29980b50f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2994001c60 tx=0x7f299400a8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:48.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f298a7fc700 1 -- 172.21.15.120:0/2375647814 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f299400acc0 con 0x7f29980a5050 2021-04-09T18:19:48.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f298a7fc700 1 -- 172.21.15.120:0/2375647814 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2994004140 con 0x7f29980a5050 2021-04-09T18:19:48.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f299fd57700 1 -- 172.21.15.120:0/2375647814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2998183ef0 con 0x7f29980a5050 2021-04-09T18:19:48.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f298a7fc700 1 -- 172.21.15.120:0/2375647814 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2994000e20 con 0x7f29980a5050 2021-04-09T18:19:48.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f299fd57700 1 -- 172.21.15.120:0/2375647814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2998183ef0 con 0x7f29980a5050 2021-04-09T18:19:48.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.872 7f298a7fc700 1 -- 172.21.15.120:0/2375647814 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2994004320 con 0x7f29980a5050 2021-04-09T18:19:48.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.873 7f298a7fc700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2980018930 0x7f298001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:48.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.873 7f298a7fc700 1 -- 172.21.15.120:0/2375647814 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4757+0+0 (secure 0 0 0) 0x7f2994032710 con 0x7f29980a5050 2021-04-09T18:19:48.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.873 7f299db73700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2980018930 0x7f298001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:48.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.873 7f299db73700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2980018930 0x7f298001ae10 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:48.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.896 7f299fd57700 1 -- 172.21.15.120:0/2375647814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29981829e0 con 0x7f29980a5050 2021-04-09T18:19:48.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:48.899 7f298a7fc700 1 -- 172.21.15.120:0/2375647814 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2994000990 con 0x7f29980a5050 2021-04-09T18:19:49.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.075 7f299fd57700 1 -- 172.21.15.120:0/2375647814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29981829e0 con 0x7f29980a5050 2021-04-09T18:19:49.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.076 7f298a7fc700 1 -- 172.21.15.120:0/2375647814 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11251 (secure 0 0 0) 0x7f2994004140 con 0x7f29980a5050 2021-04-09T18:19:49.076 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:19:49.076 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:48.645769","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:19:49.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 -- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2980018930 msgr2=0x7f298001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2980018930 0x7f298001ae10 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 -- 172.21.15.120:0/2375647814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980a5050 msgr2=0x7f29980b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980a5050 0x7f29980b50f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2994001c60 tx=0x7f299400a8d0).stop 2021-04-09T18:19:49.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 -- 172.21.15.120:0/2375647814 shutdown_connections 2021-04-09T18:19:49.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2980018930 0x7f298001ae10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29980b5710 0x7f29981838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980a5050 0x7f29980b50f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 --2- 172.21.15.120:0/2375647814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2998187670 0x7f29980a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 -- 172.21.15.120:0/2375647814 >> 172.21.15.120:0/2375647814 conn(0x7f299818dc90 msgr2=0x7f299808fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:49.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 -- 172.21.15.120:0/2375647814 shutdown_connections 2021-04-09T18:19:49.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.078 7f299fd57700 1 -- 172.21.15.120:0/2375647814 wait complete. 2021-04-09T18:19:49.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:19:47.013532', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-04-09T18:19:49.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:19:49.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.238 7f7ce5acd700 1 Processor -- start 2021-04-09T18:19:49.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.238 7f7ce5acd700 1 -- start start 2021-04-09T18:19:49.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7ce5acd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7ce00d65a0 0x7f7ce01ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7ce5acd700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce00d7980 con 0x7f7ce00d7180 2021-04-09T18:19:49.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7ce5acd700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce00d69a0 con 0x7f7ce00d7580 2021-04-09T18:19:49.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7ce5acd700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce00d6c00 con 0x7f7ce00d65a0 2021-04-09T18:19:49.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7cdffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7ce00d65a0 0x7f7ce01ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7cdf7fe700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7ce00d7180 0x7f7ce00d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47278/0 (socket says 172.21.15.120:47278) 2021-04-09T18:19:49.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7cdf7fe700 1 -- 172.21.15.120:0/833403603 learned_addr learned my addr 172.21.15.120:0/833403603 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:49.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7cdffff700 1 -- 172.21.15.120:0/833403603 >> v1:172.21.15.134:6789/0 conn(0x7f7ce00d7580 legacy=0x7f7ce00d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7cdffff700 1 -- 172.21.15.120:0/833403603 >> v1:172.21.15.120:6789/0 conn(0x7f7ce00d7180 legacy=0x7f7ce00d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.273 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.239 7f7cde7fc700 1 -- 172.21.15.120:0/833403603 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427712972 0 0) 0x7f7cd4000c60 con 0x7f7ce00d7580 2021-04-09T18:19:49.273 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7cdffff700 1 -- 172.21.15.120:0/833403603 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce01a2ae0 con 0x7f7ce00d65a0 2021-04-09T18:19:49.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7cdffff700 1 --2- 172.21.15.120:0/833403603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce00d65a0 0x7f7ce01ac210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7cd8006ab0 tx=0x7f7cd8009ac0).ready entity=mon.0 client_cookie=96b750205f003109 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:49.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7cde7fc700 1 -- 172.21.15.120:0/833403603 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7cd80066d0 con 0x7f7ce00d65a0 2021-04-09T18:19:49.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7cde7fc700 1 -- 172.21.15.120:0/833403603 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd80022e0 con 0x7f7ce00d65a0 2021-04-09T18:19:49.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7cde7fc700 1 -- 172.21.15.120:0/833403603 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7cd8000c10 con 0x7f7ce00d65a0 2021-04-09T18:19:49.308 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7ce5acd700 1 -- 172.21.15.120:0/833403603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce00d65a0 msgr2=0x7f7ce01ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.308 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7ce5acd700 1 --2- 172.21.15.120:0/833403603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce00d65a0 0x7f7ce01ac210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7cd8006ab0 tx=0x7f7cd8009ac0).stop 2021-04-09T18:19:49.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7ce5acd700 1 -- 172.21.15.120:0/833403603 shutdown_connections 2021-04-09T18:19:49.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7ce5acd700 1 --2- 172.21.15.120:0/833403603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce00d65a0 0x7f7ce01ac210 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7ce5acd700 1 -- 172.21.15.120:0/833403603 >> 172.21.15.120:0/833403603 conn(0x7f7ce00d15b0 msgr2=0x7f7ce00d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.240 7f7ce5acd700 1 -- 172.21.15.120:0/833403603 shutdown_connections 2021-04-09T18:19:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.241 7f7ce5acd700 1 -- 172.21.15.120:0/833403603 wait complete. 2021-04-09T18:19:49.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.259 7f7ce5acd700 1 Processor -- start 2021-04-09T18:19:49.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7ce5acd700 1 -- start start 2021-04-09T18:19:49.322 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7ce5acd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce0179cb0 0x7f7ce018ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7ce5acd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce017a500 0x7f7ce009b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7ce5acd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce017a900 0x7f7ce009bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.327 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7ce5acd700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00aaa50 con 0x7f7ce0179cb0 2021-04-09T18:19:49.328 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7ce5acd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce009c2e0 con 0x7f7ce017a500 2021-04-09T18:19:49.328 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7ce5acd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce009c500 con 0x7f7ce017a900 2021-04-09T18:19:49.328 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7cdf7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce0179cb0 0x7f7ce018ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.328 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7cdf7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce0179cb0 0x7f7ce018ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52372/0 (socket says 172.21.15.120:52372) 2021-04-09T18:19:49.329 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7cdf7fe700 1 -- 172.21.15.120:0/3595057947 learned_addr learned my addr 172.21.15.120:0/3595057947 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:49.329 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7cdeffd700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce017a500 0x7f7ce009b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.329 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.260 7f7cdffff700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce017a900 0x7f7ce009bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.329 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cdf7fe700 1 -- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce017a900 msgr2=0x7f7ce009bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.329 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cdf7fe700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce017a900 0x7f7ce009bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cdf7fe700 1 -- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce017a500 msgr2=0x7f7ce009b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cdf7fe700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce017a500 0x7f7ce009b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cdf7fe700 1 -- 172.21.15.120:0/3595057947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce009c720 con 0x7f7ce0179cb0 2021-04-09T18:19:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cdf7fe700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce0179cb0 0x7f7ce018ae80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7cd0009980 tx=0x7f7cd000bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cc7fff700 1 -- 172.21.15.120:0/3595057947 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7cd0006030 con 0x7f7ce0179cb0 2021-04-09T18:19:49.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cc7fff700 1 -- 172.21.15.120:0/3595057947 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd0006370 con 0x7f7ce0179cb0 2021-04-09T18:19:49.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce009c720 con 0x7f7ce0179cb0 2021-04-09T18:19:49.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cc7fff700 1 -- 172.21.15.120:0/3595057947 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7cd0004910 con 0x7f7ce0179cb0 2021-04-09T18:19:49.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce009c720 con 0x7f7ce0179cb0 2021-04-09T18:19:49.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cc7fff700 1 -- 172.21.15.120:0/3595057947 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7cd0004720 con 0x7f7ce0179cb0 2021-04-09T18:19:49.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.261 7f7cc7fff700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7cc0018930 0x7f7cc001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.262 7f7cc7fff700 1 -- 172.21.15.120:0/3595057947 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4757+0+0 (secure 0 0 0) 0x7f7cd0032a80 con 0x7f7ce0179cb0 2021-04-09T18:19:49.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.262 7f7cdeffd700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7cc0018930 0x7f7cc001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.262 7f7cdeffd700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7cc0018930 0x7f7cc001ae10 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:49.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.285 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce00aaa50 con 0x7f7ce0179cb0 2021-04-09T18:19:49.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.288 7f7cc7fff700 1 -- 172.21.15.120:0/3595057947 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7cd0000d30 con 0x7f7ce0179cb0 2021-04-09T18:19:49.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.456 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f7ce00aaa50 con 0x7f7ce0179cb0 2021-04-09T18:19:49.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.457 7f7cc7fff700 1 -- 172.21.15.120:0/3595057947 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7cd0006350 con 0x7f7ce0179cb0 2021-04-09T18:19:49.456 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:19:49.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7cc0018930 msgr2=0x7f7cc001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7cc0018930 0x7f7cc001ae10 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce0179cb0 msgr2=0x7f7ce018ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce0179cb0 0x7f7ce018ae80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7cd0009980 tx=0x7f7cd000bcd0).stop 2021-04-09T18:19:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 shutdown_connections 2021-04-09T18:19:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7cc0018930 0x7f7cc001ae10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.460 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ce017a900 0x7f7ce009bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce017a500 0x7f7ce009b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 --2- 172.21.15.120:0/3595057947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ce0179cb0 0x7f7ce018ae80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 >> 172.21.15.120:0/3595057947 conn(0x7f7ce017ebe0 msgr2=0x7f7ce00a11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:49.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 shutdown_connections 2021-04-09T18:19:49.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.459 7f7ce5acd700 1 -- 172.21.15.120:0/3595057947 wait complete. 2021-04-09T18:19:49.469 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-04-09T18:19:49.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.610 7f6b94fc6700 1 Processor -- start 2021-04-09T18:19:49.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.610 7f6b94fc6700 1 -- start start 2021-04-09T18:19:49.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b94fc6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900d7160 0x7f6b900e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b94fc6700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b900d7560 0x7f6b900d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b94fc6700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b900d6be0 con 0x7f6b900d5bc0 2021-04-09T18:19:49.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b94fc6700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b900d80f0 con 0x7f6b900d7560 2021-04-09T18:19:49.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b94fc6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900e7f00 con 0x7f6b900d7160 2021-04-09T18:19:49.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b8e59c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b900d7560 0x7f6b900d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b8e59c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b900d7560 0x7f6b900d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52384/0 (socket says 172.21.15.120:52384) 2021-04-09T18:19:49.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b8e59c700 1 -- 172.21.15.120:0/84825629 learned_addr learned my addr 172.21.15.120:0/84825629 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:49.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b8ed9d700 1 --2- 172.21.15.120:0/84825629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900d7160 0x7f6b900e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b8e59c700 1 -- 172.21.15.120:0/84825629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900d7160 msgr2=0x7f6b900e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:49.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b8e59c700 1 --2- 172.21.15.120:0/84825629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900d7160 0x7f6b900e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b8e59c700 1 -- 172.21.15.120:0/84825629 >> v1:172.21.15.134:6789/0 conn(0x7f6b900d5bc0 legacy=0x7f6b900d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b8dd9b700 1 -- 172.21.15.120:0/84825629 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200650721 0 0) 0x7f6b88000d30 con 0x7f6b900d5bc0 2021-04-09T18:19:49.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.611 7f6b8e59c700 1 -- 172.21.15.120:0/84825629 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b901a2ac0 con 0x7f6b900d7560 2021-04-09T18:19:49.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.612 7f6b8e59c700 1 --2- 172.21.15.120:0/84825629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b900d7560 0x7f6b900d55a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6b84006700 tx=0x7f6b84009b80).ready entity=mon.0 client_cookie=9da5ab88d8ad1dda server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:49.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.612 7f6b8dd9b700 1 -- 172.21.15.120:0/84825629 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b8400c0c0 con 0x7f6b900d7560 2021-04-09T18:19:49.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.612 7f6b8dd9b700 1 -- 172.21.15.120:0/84825629 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8400c440 con 0x7f6b900d7560 2021-04-09T18:19:49.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.612 7f6b8dd9b700 1 -- 172.21.15.120:0/84825629 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b8400c920 con 0x7f6b900d7560 2021-04-09T18:19:49.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.612 7f6b94fc6700 1 -- 172.21.15.120:0/84825629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b900d7560 msgr2=0x7f6b900d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.612 7f6b94fc6700 1 --2- 172.21.15.120:0/84825629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b900d7560 0x7f6b900d55a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6b84006700 tx=0x7f6b84009b80).stop 2021-04-09T18:19:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.613 7f6b94fc6700 1 -- 172.21.15.120:0/84825629 shutdown_connections 2021-04-09T18:19:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.613 7f6b94fc6700 1 --2- 172.21.15.120:0/84825629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b900d7560 0x7f6b900d55a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.613 7f6b94fc6700 1 --2- 172.21.15.120:0/84825629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900d7160 0x7f6b900e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.613 7f6b94fc6700 1 -- 172.21.15.120:0/84825629 >> 172.21.15.120:0/84825629 conn(0x7f6b900d1590 msgr2=0x7f6b900d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.613 7f6b94fc6700 1 -- 172.21.15.120:0/84825629 shutdown_connections 2021-04-09T18:19:49.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.613 7f6b94fc6700 1 -- 172.21.15.120:0/84825629 wait complete. 2021-04-09T18:19:49.669 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.631 7f6b94fc6700 1 Processor -- start 2021-04-09T18:19:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.631 7f6b94fc6700 1 -- start start 2021-04-09T18:19:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b94fc6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b90095db0 0x7f6b9017ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b94fc6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900961b0 0x7f6b9017a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b94fc6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b9017aa00 0x7f6b9017ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b94fc6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9008c760 con 0x7f6b9017aa00 2021-04-09T18:19:49.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b94fc6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9017f1f0 con 0x7f6b90095db0 2021-04-09T18:19:49.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b94fc6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9008a9b0 con 0x7f6b900961b0 2021-04-09T18:19:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8f59e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b9017aa00 0x7f6b9017ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8f59e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b9017aa00 0x7f6b9017ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52390/0 (socket says 172.21.15.120:52390) 2021-04-09T18:19:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8f59e700 1 -- 172.21.15.120:0/773616819 learned_addr learned my addr 172.21.15.120:0/773616819 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:49.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8ed9d700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b90095db0 0x7f6b9017ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8e59c700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900961b0 0x7f6b9017a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8f59e700 1 -- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900961b0 msgr2=0x7f6b9017a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8f59e700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900961b0 0x7f6b9017a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8f59e700 1 -- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b90095db0 msgr2=0x7f6b9017ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8f59e700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b90095db0 0x7f6b9017ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8f59e700 1 -- 172.21.15.120:0/773616819 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9008abd0 con 0x7f6b9017aa00 2021-04-09T18:19:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8ed9d700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b90095db0 0x7f6b9017ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:49.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b8f59e700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b9017aa00 0x7f6b9017ae00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6b8800b8c0 tx=0x7f6b8800bc60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:49.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.632 7f6b7f7fe700 1 -- 172.21.15.120:0/773616819 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b88005870 con 0x7f6b9017aa00 2021-04-09T18:19:49.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.633 7f6b7f7fe700 1 -- 172.21.15.120:0/773616819 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b88005b70 con 0x7f6b9017aa00 2021-04-09T18:19:49.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.633 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9008abd0 con 0x7f6b9017aa00 2021-04-09T18:19:49.691 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.633 7f6b7f7fe700 1 -- 172.21.15.120:0/773616819 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b88006030 con 0x7f6b9017aa00 2021-04-09T18:19:49.691 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.633 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9008abd0 con 0x7f6b9017aa00 2021-04-09T18:19:49.692 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.633 7f6b7f7fe700 1 -- 172.21.15.120:0/773616819 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6b88006030 con 0x7f6b9017aa00 2021-04-09T18:19:49.692 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.633 7f6b7f7fe700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6b74018930 0x7f6b7401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:49.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.633 7f6b7f7fe700 1 -- 172.21.15.120:0/773616819 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4757+0+0 (secure 0 0 0) 0x7f6b88032ae0 con 0x7f6b9017aa00 2021-04-09T18:19:49.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.633 7f6b8ed9d700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6b74018930 0x7f6b7401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:49.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.634 7f6b8ed9d700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6b74018930 0x7f6b7401ae10 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:49.695 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.657 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b900e48e0 con 0x7f6b9017aa00 2021-04-09T18:19:49.695 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.662 7f6b7f7fe700 1 -- 172.21.15.120:0/773616819 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6b8800bda0 con 0x7f6b9017aa00 2021-04-09T18:19:49.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.826 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6b900e48e0 con 0x7f6b9017aa00 2021-04-09T18:19:49.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.826 7f6b7f7fe700 1 -- 172.21.15.120:0/773616819 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+64 (secure 0 0 0) 0x7f6b8800bda0 con 0x7f6b9017aa00 2021-04-09T18:19:49.826 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:19:49.826 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2021-04-09T18:19:49.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:19:49.827 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2021-04-09T18:19:49.827 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": "rbd" 2021-04-09T18:19:49.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:19:49.828 INFO:teuthology.orchestra.run.smithi120.stdout:] 2021-04-09T18:19:49.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6b74018930 msgr2=0x7f6b7401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6b74018930 0x7f6b7401ae10 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b9017aa00 msgr2=0x7f6b9017ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:49.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b9017aa00 0x7f6b9017ae00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6b8800b8c0 tx=0x7f6b8800bc60).stop 2021-04-09T18:19:49.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 shutdown_connections 2021-04-09T18:19:49.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b9017aa00 0x7f6b9017ae00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6b74018930 0x7f6b7401ae10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b900961b0 0x7f6b9017a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 --2- 172.21.15.120:0/773616819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b90095db0 0x7f6b9017ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:49.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 >> 172.21.15.120:0/773616819 conn(0x7f6b901993c0 msgr2=0x7f6b90199820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:49.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 shutdown_connections 2021-04-09T18:19:49.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:49.829 7f6b94fc6700 1 -- 172.21.15.120:0/773616819 wait complete. 2021-04-09T18:19:49.860 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-04-09T18:19:49.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-04-09T18:19:50.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc19a50700 1 Processor -- start 2021-04-09T18:19:50.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc19a50700 1 -- start start 2021-04-09T18:19:50.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc19a50700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efc140d7180 0x7efc140d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc19a50700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140d55c0 0x7efc140d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc19a50700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc140d6c00 con 0x7efc140d5fe0 2021-04-09T18:19:50.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc19a50700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc140d8110 con 0x7efc140d7180 2021-04-09T18:19:50.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc19a50700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc141a2ae0 con 0x7efc140d55c0 2021-04-09T18:19:50.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc137fe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efc140d7180 0x7efc140d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc137fe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efc140d7180 0x7efc140d7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52394/0 (socket says 172.21.15.120:52394) 2021-04-09T18:19:50.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc137fe700 1 -- 172.21.15.120:0/881876254 learned_addr learned my addr 172.21.15.120:0/881876254 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:50.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.012 7efc12ffd700 1 --2- 172.21.15.120:0/881876254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140d55c0 0x7efc140d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc137fe700 1 -- 172.21.15.120:0/881876254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140d55c0 msgr2=0x7efc140d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:50.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc137fe700 1 --2- 172.21.15.120:0/881876254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140d55c0 0x7efc140d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc137fe700 1 -- 172.21.15.120:0/881876254 >> v1:172.21.15.134:6789/0 conn(0x7efc140d5fe0 legacy=0x7efc140d63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc137fe700 1 -- 172.21.15.120:0/881876254 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc141ac210 con 0x7efc140d7180 2021-04-09T18:19:50.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc137fe700 1 --2- 172.21.15.120:0/881876254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140d7180 0x7efc140d7580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efc04006a80 tx=0x7efc04009f00).ready entity=mon.0 client_cookie=f8dbcfa06acdfdf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:50.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc127fc700 1 -- 172.21.15.120:0/881876254 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc0400b5c0 con 0x7efc140d7180 2021-04-09T18:19:50.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc127fc700 1 -- 172.21.15.120:0/881876254 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0400b8c0 con 0x7efc140d7180 2021-04-09T18:19:50.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc127fc700 1 -- 172.21.15.120:0/881876254 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc0400bda0 con 0x7efc140d7180 2021-04-09T18:19:50.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc19a50700 1 -- 172.21.15.120:0/881876254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140d7180 msgr2=0x7efc140d7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.013 7efc19a50700 1 --2- 172.21.15.120:0/881876254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140d7180 0x7efc140d7580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efc04006a80 tx=0x7efc04009f00).stop 2021-04-09T18:19:50.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.014 7efc19a50700 1 -- 172.21.15.120:0/881876254 shutdown_connections 2021-04-09T18:19:50.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.014 7efc19a50700 1 --2- 172.21.15.120:0/881876254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140d55c0 0x7efc140d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.014 7efc19a50700 1 --2- 172.21.15.120:0/881876254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140d7180 0x7efc140d7580 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.014 7efc19a50700 1 -- 172.21.15.120:0/881876254 >> 172.21.15.120:0/881876254 conn(0x7efc140d15b0 msgr2=0x7efc140d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:50.077 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.014 7efc19a50700 1 -- 172.21.15.120:0/881876254 shutdown_connections 2021-04-09T18:19:50.077 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.014 7efc19a50700 1 -- 172.21.15.120:0/881876254 wait complete. 2021-04-09T18:19:50.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc19a50700 1 Processor -- start 2021-04-09T18:19:50.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc19a50700 1 -- start start 2021-04-09T18:19:50.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc19a50700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc14182800 0x7efc14099590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc19a50700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140b3d30 0x7efc140b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc19a50700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140b4750 0x7efc1409cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc19a50700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc140b4b50 con 0x7efc140b3d30 2021-04-09T18:19:50.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc19a50700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14099bb0 con 0x7efc14182800 2021-04-09T18:19:50.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc19a50700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc14182e70 con 0x7efc140b4750 2021-04-09T18:19:50.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc12ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140b3d30 0x7efc140b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc12ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140b3d30 0x7efc140b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52400/0 (socket says 172.21.15.120:52400) 2021-04-09T18:19:50.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc12ffd700 1 -- 172.21.15.120:0/562194790 learned_addr learned my addr 172.21.15.120:0/562194790 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:50.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc13fff700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140b4750 0x7efc1409cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.033 7efc137fe700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc14182800 0x7efc14099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc12ffd700 1 -- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140b4750 msgr2=0x7efc1409cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc12ffd700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140b4750 0x7efc1409cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc12ffd700 1 -- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc14182800 msgr2=0x7efc14099590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.099 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc12ffd700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc14182800 0x7efc14099590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.099 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc12ffd700 1 -- 172.21.15.120:0/562194790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1409d410 con 0x7efc140b3d30 2021-04-09T18:19:50.100 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc12ffd700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140b3d30 0x7efc140b4130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7efbfc006f60 tx=0x7efbfc00b970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:50.100 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc0bfff700 1 -- 172.21.15.120:0/562194790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efbfc00bd60 con 0x7efc140b3d30 2021-04-09T18:19:50.101 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc0bfff700 1 -- 172.21.15.120:0/562194790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc000c90 con 0x7efc140b3d30 2021-04-09T18:19:50.101 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc19a50700 1 -- 172.21.15.120:0/562194790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1409d410 con 0x7efc140b3d30 2021-04-09T18:19:50.101 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc0bfff700 1 -- 172.21.15.120:0/562194790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efbfc002220 con 0x7efc140b3d30 2021-04-09T18:19:50.102 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.034 7efc19a50700 1 -- 172.21.15.120:0/562194790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1409d410 con 0x7efc140b3d30 2021-04-09T18:19:50.102 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.035 7efc0bfff700 1 -- 172.21.15.120:0/562194790 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efbfc0052e0 con 0x7efc140b3d30 2021-04-09T18:19:50.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.035 7efc0bfff700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbec018930 0x7efbec01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.035 7efc0bfff700 1 -- 172.21.15.120:0/562194790 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4757+0+0 (secure 0 0 0) 0x7efbfc0326c0 con 0x7efc140b3d30 2021-04-09T18:19:50.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.035 7efc137fe700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbec018930 0x7efbec01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.035 7efc137fe700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbec018930 0x7efbec01ae10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:50.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.058 7efc19a50700 1 -- 172.21.15.120:0/562194790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc14099060 con 0x7efc140b3d30 2021-04-09T18:19:50.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.062 7efc0bfff700 1 -- 172.21.15.120:0/562194790 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efbfc000c90 con 0x7efc140b3d30 2021-04-09T18:19:50.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.231 7efc19a50700 1 -- 172.21.15.120:0/562194790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7efc14099060 con 0x7efc140b3d30 2021-04-09T18:19:50.554 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:19:50.558 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:19:50.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.658 7efc0bfff700 1 -- 172.21.15.120:0/562194790 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v17) v1 ==== 133+0+0 (secure 0 0 0) 0x7efbfc0052e0 con 0x7efc140b3d30 2021-04-09T18:19:50.693 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2021-04-09T18:19:50.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 -- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbec018930 msgr2=0x7efbec01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbec018930 0x7efbec01ae10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 -- 172.21.15.120:0/562194790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140b3d30 msgr2=0x7efc140b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140b3d30 0x7efc140b4130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7efbfc006f60 tx=0x7efbfc00b970).stop 2021-04-09T18:19:50.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 -- 172.21.15.120:0/562194790 shutdown_connections 2021-04-09T18:19:50.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbec018930 0x7efbec01ae10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc140b4750 0x7efc1409cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc140b3d30 0x7efc140b4130 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 --2- 172.21.15.120:0/562194790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc14182800 0x7efc14099590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.697 7efc19a50700 1 -- 172.21.15.120:0/562194790 >> 172.21.15.120:0/562194790 conn(0x7efc141822c0 msgr2=0x7efc1409df50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:50.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.698 7efc19a50700 1 -- 172.21.15.120:0/562194790 shutdown_connections 2021-04-09T18:19:50.703 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.698 7efc19a50700 1 -- 172.21.15.120:0/562194790 wait complete. 2021-04-09T18:19:50.706 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2021-04-09T18:19:50.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2021-04-09T18:19:50.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.896 7f9d976be700 1 Processor -- start 2021-04-09T18:19:50.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.896 7f9d976be700 1 -- start start 2021-04-09T18:19:50.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.896 7f9d976be700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900d75a0 0x7f9d900d5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.896 7f9d976be700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d900d79a0 con 0x7f9d900d63f0 2021-04-09T18:19:50.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.896 7f9d976be700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d900d6c20 con 0x7f9d900d71a0 2021-04-09T18:19:50.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.896 7f9d976be700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d901a2b00 con 0x7f9d900d75a0 2021-04-09T18:19:50.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.896 7f9d95cdb700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9d900d63f0 0x7f9d901ab220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47324/0 (socket says 172.21.15.120:47324) 2021-04-09T18:19:50.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.896 7f9d95cdb700 1 -- 172.21.15.120:0/679373534 learned_addr learned my addr 172.21.15.120:0/679373534 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:50.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.896 7f9d94cd9700 1 --2- 172.21.15.120:0/679373534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900d75a0 0x7f9d900d5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d87fff700 1 -- 172.21.15.120:0/679373534 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215562687 0 0) 0x7f9d880009b0 con 0x7f9d900d63f0 2021-04-09T18:19:50.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d87fff700 1 -- 172.21.15.120:0/679373534 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d7c002fe0 con 0x7f9d900d63f0 2021-04-09T18:19:50.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d87fff700 1 -- 172.21.15.120:0/679373534 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687402782 0 0) 0x7f9d8c000fe0 con 0x7f9d900d71a0 2021-04-09T18:19:50.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d87fff700 1 -- 172.21.15.120:0/679373534 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d7c0042c0 con 0x7f9d900d71a0 2021-04-09T18:19:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d94cd9700 1 -- 172.21.15.120:0/679373534 >> v1:172.21.15.134:6789/0 conn(0x7f9d900d71a0 legacy=0x7f9d900d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d94cd9700 1 -- 172.21.15.120:0/679373534 >> v1:172.21.15.120:6789/0 conn(0x7f9d900d63f0 legacy=0x7f9d901ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d94cd9700 1 -- 172.21.15.120:0/679373534 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900d67f0 con 0x7f9d900d75a0 2021-04-09T18:19:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d94cd9700 1 --2- 172.21.15.120:0/679373534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900d75a0 0x7f9d900d5dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9d80006650 tx=0x7f9d80009a00).ready entity=mon.2 client_cookie=549ba07a181c2ea6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:50.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d87fff700 1 -- 172.21.15.120:0/679373534 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d80009df0 con 0x7f9d900d75a0 2021-04-09T18:19:50.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d87fff700 1 -- 172.21.15.120:0/679373534 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d800009b0 con 0x7f9d900d75a0 2021-04-09T18:19:50.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d87fff700 1 -- 172.21.15.120:0/679373534 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d8000c2b0 con 0x7f9d900d75a0 2021-04-09T18:19:50.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d976be700 1 -- 172.21.15.120:0/679373534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900d75a0 msgr2=0x7f9d900d5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.897 7f9d976be700 1 --2- 172.21.15.120:0/679373534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900d75a0 0x7f9d900d5dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9d80006650 tx=0x7f9d80009a00).stop 2021-04-09T18:19:50.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.898 7f9d976be700 1 -- 172.21.15.120:0/679373534 shutdown_connections 2021-04-09T18:19:50.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.898 7f9d976be700 1 --2- 172.21.15.120:0/679373534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900d75a0 0x7f9d900d5dd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.898 7f9d976be700 1 -- 172.21.15.120:0/679373534 >> 172.21.15.120:0/679373534 conn(0x7f9d900d15d0 msgr2=0x7f9d900d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:50.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.898 7f9d976be700 1 -- 172.21.15.120:0/679373534 shutdown_connections 2021-04-09T18:19:50.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.898 7f9d976be700 1 -- 172.21.15.120:0/679373534 wait complete. 2021-04-09T18:19:50.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.917 7f9d976be700 1 Processor -- start 2021-04-09T18:19:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.917 7f9d976be700 1 -- start start 2021-04-09T18:19:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d976be700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900909c0 0x7f9d9017aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d976be700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d9017b020 0x7f9d900ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d976be700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d90090dc0 0x7f9d900ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d976be700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90090440 con 0x7f9d90090dc0 2021-04-09T18:19:50.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d976be700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900ade70 con 0x7f9d9017b020 2021-04-09T18:19:50.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d976be700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900ae050 con 0x7f9d900909c0 2021-04-09T18:19:50.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d95cdb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d90090dc0 0x7f9d900ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d95cdb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d90090dc0 0x7f9d900ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52420/0 (socket says 172.21.15.120:52420) 2021-04-09T18:19:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d95cdb700 1 -- 172.21.15.120:0/1010120160 learned_addr learned my addr 172.21.15.120:0/1010120160 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d954da700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900909c0 0x7f9d9017aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d94cd9700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d9017b020 0x7f9d900ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d95cdb700 1 -- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900909c0 msgr2=0x7f9d9017aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d95cdb700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900909c0 0x7f9d9017aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d95cdb700 1 -- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d9017b020 msgr2=0x7f9d900ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:50.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d95cdb700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d9017b020 0x7f9d900ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:50.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d95cdb700 1 -- 172.21.15.120:0/1010120160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d901a0760 con 0x7f9d90090dc0 2021-04-09T18:19:50.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d94cd9700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d9017b020 0x7f9d900ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:19:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d95cdb700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d90090dc0 0x7f9d900ad850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9d8800b530 tx=0x7f9d8800b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d85ffb700 1 -- 172.21.15.120:0/1010120160 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d8800bcc0 con 0x7f9d90090dc0 2021-04-09T18:19:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d85ffb700 1 -- 172.21.15.120:0/1010120160 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d88006020 con 0x7f9d90090dc0 2021-04-09T18:19:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d976be700 1 -- 172.21.15.120:0/1010120160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d901a0760 con 0x7f9d90090dc0 2021-04-09T18:19:50.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.918 7f9d85ffb700 1 -- 172.21.15.120:0/1010120160 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d880043a0 con 0x7f9d90090dc0 2021-04-09T18:19:50.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.919 7f9d976be700 1 -- 172.21.15.120:0/1010120160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d901a0760 con 0x7f9d90090dc0 2021-04-09T18:19:50.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.919 7f9d85ffb700 1 -- 172.21.15.120:0/1010120160 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9d88006200 con 0x7f9d90090dc0 2021-04-09T18:19:50.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.919 7f9d85ffb700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d70018930 0x7f9d7001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:50.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.919 7f9d85ffb700 1 -- 172.21.15.120:0/1010120160 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f9d88032810 con 0x7f9d90090dc0 2021-04-09T18:19:50.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.919 7f9d954da700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d70018930 0x7f9d7001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:50.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.920 7f9d954da700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d70018930 0x7f9d7001ae10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:50.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.942 7f9d976be700 1 -- 172.21.15.120:0/1010120160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d900e44d0 con 0x7f9d90090dc0 2021-04-09T18:19:50.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:50.946 7f9d85ffb700 1 -- 172.21.15.120:0/1010120160 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9d88006b90 con 0x7f9d90090dc0 2021-04-09T18:19:51.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.122 7f9d976be700 1 -- 172.21.15.120:0/1010120160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"profile": ["m=2", "k=2", "crush-failure-domain=osd"], "prefix": "osd erasure-code-profile set", "name": "cephfs_data"} v 0) v1 -- 0x7f9d900e44d0 con 0x7f9d90090dc0 2021-04-09T18:19:51.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.664 7f9d85ffb700 1 -- 172.21.15.120:0/1010120160 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"profile": ["m=2", "k=2", "crush-failure-domain=osd"], "prefix": "osd erasure-code-profile set", "name": "cephfs_data"}]=0 v18) v1 ==== 154+0+0 (secure 0 0 0) 0x7f9d88006020 con 0x7f9d90090dc0 2021-04-09T18:19:51.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 -- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d70018930 msgr2=0x7f9d7001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:51.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d70018930 0x7f9d7001ae10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 -- 172.21.15.120:0/1010120160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d90090dc0 msgr2=0x7f9d900ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:51.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d90090dc0 0x7f9d900ad850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9d8800b530 tx=0x7f9d8800b8d0).stop 2021-04-09T18:19:51.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 -- 172.21.15.120:0/1010120160 shutdown_connections 2021-04-09T18:19:51.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d90090dc0 0x7f9d900ad850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d9017b020 0x7f9d900ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d70018930 0x7f9d7001ae10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 --2- 172.21.15.120:0/1010120160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d900909c0 0x7f9d9017aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 -- 172.21.15.120:0/1010120160 >> 172.21.15.120:0/1010120160 conn(0x7f9d90184230 msgr2=0x7f9d90091a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:51.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 -- 172.21.15.120:0/1010120160 shutdown_connections 2021-04-09T18:19:51.691 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.689 7f9d976be700 1 -- 172.21.15.120:0/1010120160 wait complete. 2021-04-09T18:19:51.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2021-04-09T18:19:51.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.848 7f795c548700 1 Processor -- start 2021-04-09T18:19:51.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.848 7f795c548700 1 -- start start 2021-04-09T18:19:51.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795c548700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f79540d71a0 0x7f79540d75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:51.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795c548700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79540d55e0 0x7f79540d59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:51.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795c548700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79540d6000 0x7f79540d6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:51.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795c548700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540e80e0 con 0x7f79540d71a0 2021-04-09T18:19:51.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795c548700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540d8130 con 0x7f79540d6000 2021-04-09T18:19:51.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795c548700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540d6c20 con 0x7f79540d55e0 2021-04-09T18:19:51.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795a364700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f79540d71a0 0x7f79540d75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:51.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795a364700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f79540d71a0 0x7f79540d75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52424/0 (socket says 172.21.15.120:52424) 2021-04-09T18:19:51.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795a364700 1 -- 172.21.15.120:0/4245030595 learned_addr learned my addr 172.21.15.120:0/4245030595 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:51.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795ab65700 1 --2- 172.21.15.120:0/4245030595 >> v2:172.21.15.134:3300/0 conn(0x7f79540d6000 0x7f79540d6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:51.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f7959b63700 1 --2- 172.21.15.120:0/4245030595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79540d55e0 0x7f79540d59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:51.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795a364700 1 -- 172.21.15.120:0/4245030595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79540d55e0 msgr2=0x7f79540d59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:51.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795a364700 1 --2- 172.21.15.120:0/4245030595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79540d55e0 0x7f79540d59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795a364700 1 -- 172.21.15.120:0/4245030595 >> v2:172.21.15.134:3300/0 conn(0x7f79540d6000 msgr2=0x7f79540d6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:51.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795a364700 1 --2- 172.21.15.120:0/4245030595 >> v2:172.21.15.134:3300/0 conn(0x7f79540d6000 0x7f79540d6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795a364700 1 -- 172.21.15.120:0/4245030595 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79541a2b00 con 0x7f79540d71a0 2021-04-09T18:19:51.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f7959b63700 1 --2- 172.21.15.120:0/4245030595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79540d55e0 0x7f79540d59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:19:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f795a364700 1 --2- 172.21.15.120:0/4245030595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79540d71a0 0x7f79540d75a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7950006a80 tx=0x7f7950009f00).ready entity=mon.0 client_cookie=a8acd15c311952cd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f7959362700 1 -- 172.21.15.120:0/4245030595 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f795000b5c0 con 0x7f79540d71a0 2021-04-09T18:19:51.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f7959362700 1 -- 172.21.15.120:0/4245030595 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795000b8c0 con 0x7f79540d71a0 2021-04-09T18:19:51.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.849 7f7959362700 1 -- 172.21.15.120:0/4245030595 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f795000bda0 con 0x7f79540d71a0 2021-04-09T18:19:51.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.850 7f795c548700 1 -- 172.21.15.120:0/4245030595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79540d71a0 msgr2=0x7f79540d75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:51.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.850 7f795c548700 1 --2- 172.21.15.120:0/4245030595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79540d71a0 0x7f79540d75a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7950006a80 tx=0x7f7950009f00).stop 2021-04-09T18:19:51.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.850 7f795c548700 1 -- 172.21.15.120:0/4245030595 shutdown_connections 2021-04-09T18:19:51.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.850 7f795c548700 1 --2- 172.21.15.120:0/4245030595 >> v2:172.21.15.134:3300/0 conn(0x7f79540d6000 0x7f79540d6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.850 7f795c548700 1 --2- 172.21.15.120:0/4245030595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79540d55e0 0x7f79540d59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.850 7f795c548700 1 --2- 172.21.15.120:0/4245030595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79540d71a0 0x7f79540d75a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.850 7f795c548700 1 -- 172.21.15.120:0/4245030595 >> 172.21.15.120:0/4245030595 conn(0x7f79540d15d0 msgr2=0x7f79540d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:51.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.850 7f795c548700 1 -- 172.21.15.120:0/4245030595 shutdown_connections 2021-04-09T18:19:51.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.850 7f795c548700 1 -- 172.21.15.120:0/4245030595 wait complete. 2021-04-09T18:19:51.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.869 7f795c548700 1 Processor -- start 2021-04-09T18:19:51.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.869 7f795c548700 1 -- start start 2021-04-09T18:19:51.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.869 7f795c548700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79541a1a00 0x7f795408b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:51.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f795c548700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7954183950 0x7f7954183d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:51.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f795c548700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7954184370 0x7f795418b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:51.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f795c548700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79541a1e00 con 0x7f7954183950 2021-04-09T18:19:51.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f795c548700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795408aae0 con 0x7f7954184370 2021-04-09T18:19:51.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f795c548700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7954184770 con 0x7f79541a1a00 2021-04-09T18:19:51.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f7959b63700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7954183950 0x7f7954183d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:51.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f7959b63700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7954183950 0x7f7954183d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52432/0 (socket says 172.21.15.120:52432) 2021-04-09T18:19:51.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f7959b63700 1 -- 172.21.15.120:0/2996780673 learned_addr learned my addr 172.21.15.120:0/2996780673 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:51.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f795a364700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79541a1a00 0x7f795408b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:51.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f795ab65700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7954184370 0x7f795418b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:51.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f7959b63700 1 -- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79541a1a00 msgr2=0x7f795408b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:51.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f7959b63700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79541a1a00 0x7f795408b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f7959b63700 1 -- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7954184370 msgr2=0x7f795418b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:51.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f7959b63700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7954184370 0x7f795418b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:51.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f7959b63700 1 -- 172.21.15.120:0/2996780673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795408b680 con 0x7f7954183950 2021-04-09T18:19:51.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f7959b63700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7954183950 0x7f7954183d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7944006f20 tx=0x7f794400b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:51.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f794affd700 1 -- 172.21.15.120:0/2996780673 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f794400bd80 con 0x7f7954183950 2021-04-09T18:19:51.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f794affd700 1 -- 172.21.15.120:0/2996780673 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7944000c90 con 0x7f7954183950 2021-04-09T18:19:51.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f795c548700 1 -- 172.21.15.120:0/2996780673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795408b680 con 0x7f7954183950 2021-04-09T18:19:51.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f794affd700 1 -- 172.21.15.120:0/2996780673 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f79440022b0 con 0x7f7954183950 2021-04-09T18:19:51.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.870 7f795c548700 1 -- 172.21.15.120:0/2996780673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795408b680 con 0x7f7954183950 2021-04-09T18:19:51.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.871 7f794affd700 1 -- 172.21.15.120:0/2996780673 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f794400a000 con 0x7f7954183950 2021-04-09T18:19:51.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.871 7f794affd700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f793c018930 0x7f793c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:51.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.871 7f794affd700 1 -- 172.21.15.120:0/2996780673 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5367+0+0 (secure 0 0 0) 0x7f7944032960 con 0x7f7954183950 2021-04-09T18:19:51.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.871 7f795a364700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f793c018930 0x7f793c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:51.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.871 7f795a364700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f793c018930 0x7f793c01ae10 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:51.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.895 7f795c548700 1 -- 172.21.15.120:0/2996780673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7954182a40 con 0x7f7954183950 2021-04-09T18:19:51.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:51.898 7f794affd700 1 -- 172.21.15.120:0/2996780673 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7944006bb0 con 0x7f7954183950 2021-04-09T18:19:52.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:52.065 7f795c548700 1 -- 172.21.15.120:0/2996780673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"pool_type": "erasure", "prefix": "osd pool create", "pg_num": 8, "erasure_code_profile": "cephfs_data", "pool": "cephfs_data"} v 0) v1 -- 0x7f7954182a40 con 0x7f7954183950 2021-04-09T18:19:53.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.668 7f794affd700 1 -- 172.21.15.120:0/2996780673 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"pool_type": "erasure", "prefix": "osd pool create", "pg_num": 8, "erasure_code_profile": "cephfs_data", "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v20) v1 ==== 188+0+0 (secure 0 0 0) 0x7f794400a000 con 0x7f7954183950 2021-04-09T18:19:53.680 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2021-04-09T18:19:53.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 -- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f793c018930 msgr2=0x7f793c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:53.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f793c018930 0x7f793c01ae10 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 -- 172.21.15.120:0/2996780673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7954183950 msgr2=0x7f7954183d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:53.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7954183950 0x7f7954183d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7944006f20 tx=0x7f794400b990).stop 2021-04-09T18:19:53.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 -- 172.21.15.120:0/2996780673 shutdown_connections 2021-04-09T18:19:53.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7954184370 0x7f795418b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7954183950 0x7f7954183d50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f793c018930 0x7f793c01ae10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 --2- 172.21.15.120:0/2996780673 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79541a1a00 0x7f795408b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 -- 172.21.15.120:0/2996780673 >> 172.21.15.120:0/2996780673 conn(0x7f7954188a50 msgr2=0x7f7954186b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:53.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 -- 172.21.15.120:0/2996780673 shutdown_connections 2021-04-09T18:19:53.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.684 7f795c548700 1 -- 172.21.15.120:0/2996780673 wait complete. 2021-04-09T18:19:53.694 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2021-04-09T18:19:53.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4bec4ec700 1 Processor -- start 2021-04-09T18:19:53.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4bec4ec700 1 -- start start 2021-04-09T18:19:53.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4bec4ec700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be40d8870 0x7f4be40ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:53.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4bec4ec700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4be40d75e0 0x7f4be40d8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:53.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4bec4ec700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4be41a7d90 0x7f4be41aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:53.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4bec4ec700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be41000c0 con 0x7f4be40d75e0 2021-04-09T18:19:53.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4bec4ec700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be40d80f0 con 0x7f4be41a7d90 2021-04-09T18:19:53.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4bec4ec700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be419f900 con 0x7f4be40d8870 2021-04-09T18:19:53.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4be9b07700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4be40d75e0 0x7f4be40d8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:53.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4be9b07700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4be40d75e0 0x7f4be40d8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52448/0 (socket says 172.21.15.120:52448) 2021-04-09T18:19:53.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4be9b07700 1 -- 172.21.15.120:0/3672220328 learned_addr learned my addr 172.21.15.120:0/3672220328 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:53.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4bea308700 1 --2- 172.21.15.120:0/3672220328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be40d8870 0x7f4be40ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:53.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.840 7f4beab09700 1 --2- 172.21.15.120:0/3672220328 >> v2:172.21.15.134:3300/0 conn(0x7f4be41a7d90 0x7f4be41aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:53.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4beab09700 1 -- 172.21.15.120:0/3672220328 >> v2:172.21.15.134:3300/0 conn(0x7f4be41a7d90 msgr2=0x7f4be41aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-04-09T18:19:53.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4beab09700 1 -- 172.21.15.120:0/3672220328 >> v2:172.21.15.134:3300/0 conn(0x7f4be41a7d90 msgr2=0x7f4be41aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:19:53.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4beab09700 1 --2- 172.21.15.120:0/3672220328 >> v2:172.21.15.134:3300/0 conn(0x7f4be41a7d90 0x7f4be41aa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:19:53.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4beab09700 1 --2- 172.21.15.120:0/3672220328 >> v2:172.21.15.134:3300/0 conn(0x7f4be41a7d90 0x7f4be41aa1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:19:53.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4be9b07700 1 -- 172.21.15.120:0/3672220328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be40d8870 msgr2=0x7f4be40ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:53.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4be9b07700 1 --2- 172.21.15.120:0/3672220328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be40d8870 0x7f4be40ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4be9b07700 1 -- 172.21.15.120:0/3672220328 >> v2:172.21.15.134:3300/0 conn(0x7f4be41a7d90 msgr2=0x7f4be41aa1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-04-09T18:19:53.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4be9b07700 1 --2- 172.21.15.120:0/3672220328 >> v2:172.21.15.134:3300/0 conn(0x7f4be41a7d90 0x7f4be41aa1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4be9b07700 1 -- 172.21.15.120:0/3672220328 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be40ff1c0 con 0x7f4be40d75e0 2021-04-09T18:19:53.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4be9b07700 1 --2- 172.21.15.120:0/3672220328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40d75e0 0x7f4be40d8dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4be0006700 tx=0x7f4be0009b00).ready entity=mon.0 client_cookie=ef9efd1a1f7d3f71 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:53.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4be9306700 1 -- 172.21.15.120:0/3672220328 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4be000c0c0 con 0x7f4be40d75e0 2021-04-09T18:19:53.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4be9306700 1 -- 172.21.15.120:0/3672220328 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be000c400 con 0x7f4be40d75e0 2021-04-09T18:19:53.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4be9306700 1 -- 172.21.15.120:0/3672220328 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4be000c8e0 con 0x7f4be40d75e0 2021-04-09T18:19:53.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4bec4ec700 1 -- 172.21.15.120:0/3672220328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40d75e0 msgr2=0x7f4be40d8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:53.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.841 7f4bec4ec700 1 --2- 172.21.15.120:0/3672220328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40d75e0 0x7f4be40d8dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4be0006700 tx=0x7f4be0009b00).stop 2021-04-09T18:19:53.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.842 7f4bec4ec700 1 -- 172.21.15.120:0/3672220328 shutdown_connections 2021-04-09T18:19:53.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.842 7f4bec4ec700 1 --2- 172.21.15.120:0/3672220328 >> v2:172.21.15.134:3300/0 conn(0x7f4be41a7d90 0x7f4be41aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.842 7f4bec4ec700 1 --2- 172.21.15.120:0/3672220328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40d75e0 0x7f4be40d8dc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.842 7f4bec4ec700 1 --2- 172.21.15.120:0/3672220328 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be40d8870 0x7f4be40ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.842 7f4bec4ec700 1 -- 172.21.15.120:0/3672220328 >> 172.21.15.120:0/3672220328 conn(0x7f4be40d1580 msgr2=0x7f4be40d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:53.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.842 7f4bec4ec700 1 -- 172.21.15.120:0/3672220328 shutdown_connections 2021-04-09T18:19:53.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.842 7f4bec4ec700 1 -- 172.21.15.120:0/3672220328 wait complete. 2021-04-09T18:19:53.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4bec4ec700 1 Processor -- start 2021-04-09T18:19:53.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4bec4ec700 1 -- start start 2021-04-09T18:19:53.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4bec4ec700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be4191760 0x7f4be419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:53.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4bec4ec700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40b71b0 0x7f4be40b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:53.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4bec4ec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be40b7bd0 0x7f4be40a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:53.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4bec4ec700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be419bec0 con 0x7f4be40b71b0 2021-04-09T18:19:53.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4bec4ec700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be419ca30 con 0x7f4be40b7bd0 2021-04-09T18:19:53.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4bec4ec700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40a3a20 con 0x7f4be4191760 2021-04-09T18:19:53.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4be9b07700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40b71b0 0x7f4be40b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:53.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4be9b07700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40b71b0 0x7f4be40b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52452/0 (socket says 172.21.15.120:52452) 2021-04-09T18:19:53.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4be9b07700 1 -- 172.21.15.120:0/90895973 learned_addr learned my addr 172.21.15.120:0/90895973 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:53.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4bea308700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be4191760 0x7f4be419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:53.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4beab09700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be40b7bd0 0x7f4be40a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:53.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4be9b07700 1 -- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be4191760 msgr2=0x7f4be419c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:53.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4be9b07700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be4191760 0x7f4be419c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4be9b07700 1 -- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be40b7bd0 msgr2=0x7f4be40a3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:53.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4be9b07700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be40b7bd0 0x7f4be40a3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:53.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.861 7f4be9b07700 1 -- 172.21.15.120:0/90895973 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be40a3c40 con 0x7f4be40b71b0 2021-04-09T18:19:53.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.862 7f4be9b07700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40b71b0 0x7f4be40b75b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4be0006f20 tx=0x7f4be000b9e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:53.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.862 7f4bd6ffd700 1 -- 172.21.15.120:0/90895973 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4be000bdd0 con 0x7f4be40b71b0 2021-04-09T18:19:53.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.862 7f4bd6ffd700 1 -- 172.21.15.120:0/90895973 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be0006440 con 0x7f4be40b71b0 2021-04-09T18:19:53.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.862 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be40a3c40 con 0x7f4be40b71b0 2021-04-09T18:19:53.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.862 7f4bd6ffd700 1 -- 172.21.15.120:0/90895973 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4be00052e0 con 0x7f4be40b71b0 2021-04-09T18:19:53.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.862 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be40a3c40 con 0x7f4be40b71b0 2021-04-09T18:19:53.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.862 7f4bd6ffd700 1 -- 172.21.15.120:0/90895973 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4be00052e0 con 0x7f4be40b71b0 2021-04-09T18:19:53.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.862 7f4bd6ffd700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4bcc018930 0x7f4bcc01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:53.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.862 7f4bd6ffd700 1 -- 172.21.15.120:0/90895973 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5819+0+0 (secure 0 0 0) 0x7f4be0032c70 con 0x7f4be40b71b0 2021-04-09T18:19:53.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.863 7f4bea308700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4bcc018930 0x7f4bcc01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:53.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.863 7f4bea308700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4bcc018930 0x7f4bcc01adc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:53.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.887 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be41831b0 con 0x7f4be40b71b0 2021-04-09T18:19:53.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:53.890 7f4bd6ffd700 1 -- 172.21.15.120:0/90895973 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4be0006440 con 0x7f4be40b71b0 2021-04-09T18:19:54.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.057 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "allow_ec_overwrites", "prefix": "osd pool set", "pool": "cephfs_data", "val": "true"} v 0) v1 -- 0x7f4be41831b0 con 0x7f4be40b71b0 2021-04-09T18:19:54.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.668 7f4bd6ffd700 1 -- 172.21.15.120:0/90895973 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "allow_ec_overwrites", "prefix": "osd pool set", "pool": "cephfs_data", "val": "true"}]=0 set pool 3 allow_ec_overwrites to true v21) v1 ==== 166+0+0 (secure 0 0 0) 0x7f4be00052e0 con 0x7f4be40b71b0 2021-04-09T18:19:54.672 INFO:teuthology.orchestra.run.smithi120.stderr:set pool 3 allow_ec_overwrites to true 2021-04-09T18:19:54.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4bcc018930 msgr2=0x7f4bcc01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:54.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4bcc018930 0x7f4bcc01adc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:54.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40b71b0 msgr2=0x7f4be40b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:54.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40b71b0 0x7f4be40b75b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4be0006f20 tx=0x7f4be000b9e0).stop 2021-04-09T18:19:54.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 shutdown_connections 2021-04-09T18:19:54.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be40b7bd0 0x7f4be40a3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:54.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4be40b71b0 0x7f4be40b75b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:54.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4bcc018930 0x7f4bcc01adc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:54.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 --2- 172.21.15.120:0/90895973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4be4191760 0x7f4be419c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:54.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 >> 172.21.15.120:0/90895973 conn(0x7f4be418e440 msgr2=0x7f4be4191dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:54.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 shutdown_connections 2021-04-09T18:19:54.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.675 7f4bec4ec700 1 -- 172.21.15.120:0/90895973 wait complete. 2021-04-09T18:19:54.685 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-04-09T18:19:54.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.827 7f8c00130700 1 Processor -- start 2021-04-09T18:19:54.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.828 7f8c00130700 1 -- start start 2021-04-09T18:19:54.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.828 7f8c00130700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8bf80d75e0 0x7f8bf80ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:54.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.828 7f8c00130700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80ff1c0 con 0x7f8bf80ffd60 2021-04-09T18:19:54.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.828 7f8c00130700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf81ad5c0 con 0x7f8bf80d8870 2021-04-09T18:19:54.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.828 7f8c00130700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80d9580 con 0x7f8bf80d75e0 2021-04-09T18:19:54.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.828 7f8bfd74b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8bf80d75e0 0x7f8bf80ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:54.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.828 7f8bfd74b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8bf80d75e0 0x7f8bf80ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52464/0 (socket says 172.21.15.120:52464) 2021-04-09T18:19:54.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.828 7f8bfd74b700 1 -- 172.21.15.120:0/2066382285 learned_addr learned my addr 172.21.15.120:0/2066382285 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:54.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.828 7f8bfe74d700 1 --1- 172.21.15.120:0/2066382285 >> v1:172.21.15.120:6789/0 conn(0x7f8bf80ffd60 0x7f8bf81aadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47374/0 (socket says 172.21.15.120:47374) 2021-04-09T18:19:54.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8bfd74b700 1 -- 172.21.15.120:0/2066382285 >> v1:172.21.15.134:6789/0 conn(0x7f8bf80d8870 legacy=0x7f8bf80d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:54.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8bfd74b700 1 -- 172.21.15.120:0/2066382285 >> v1:172.21.15.120:6789/0 conn(0x7f8bf80ffd60 legacy=0x7f8bf81aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:54.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8bfd74b700 1 -- 172.21.15.120:0/2066382285 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80d80f0 con 0x7f8bf80d75e0 2021-04-09T18:19:54.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8bfcf4a700 1 -- 172.21.15.120:0/2066382285 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849498334 0 0) 0x7f8bf0000d30 con 0x7f8bf80ffd60 2021-04-09T18:19:54.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8bfd74b700 1 --2- 172.21.15.120:0/2066382285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80d75e0 0x7f8bf80ff740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8be8006700 tx=0x7f8be8009b00).ready entity=mon.0 client_cookie=2daa7b69706f5b23 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:54.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8bfcf4a700 1 -- 172.21.15.120:0/2066382285 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8be800c0c0 con 0x7f8bf80d75e0 2021-04-09T18:19:54.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8bfcf4a700 1 -- 172.21.15.120:0/2066382285 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800c400 con 0x7f8bf80d75e0 2021-04-09T18:19:54.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8bfcf4a700 1 -- 172.21.15.120:0/2066382285 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8be800c8e0 con 0x7f8bf80d75e0 2021-04-09T18:19:54.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8c00130700 1 -- 172.21.15.120:0/2066382285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80d75e0 msgr2=0x7f8bf80ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:54.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.829 7f8c00130700 1 --2- 172.21.15.120:0/2066382285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80d75e0 0x7f8bf80ff740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8be8006700 tx=0x7f8be8009b00).stop 2021-04-09T18:19:54.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.830 7f8c00130700 1 -- 172.21.15.120:0/2066382285 shutdown_connections 2021-04-09T18:19:54.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.830 7f8c00130700 1 --2- 172.21.15.120:0/2066382285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80d75e0 0x7f8bf80ff740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:54.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.830 7f8c00130700 1 -- 172.21.15.120:0/2066382285 >> 172.21.15.120:0/2066382285 conn(0x7f8bf80d1580 msgr2=0x7f8bf80d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:54.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.830 7f8c00130700 1 -- 172.21.15.120:0/2066382285 shutdown_connections 2021-04-09T18:19:54.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.830 7f8c00130700 1 -- 172.21.15.120:0/2066382285 wait complete. 2021-04-09T18:19:54.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8c00130700 1 Processor -- start 2021-04-09T18:19:54.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8c00130700 1 -- start start 2021-04-09T18:19:54.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8c00130700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8196180 0x7f8bf808c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:54.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8c00130700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80b1d20 0x7f8bf80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:54.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8c00130700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8bf80b2740 0x7f8bf817dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:54.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8c00130700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf808c210 con 0x7f8bf80b1d20 2021-04-09T18:19:54.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8c00130700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf819eea0 con 0x7f8bf8196180 2021-04-09T18:19:54.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8c00130700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf808cdb0 con 0x7f8bf80b2740 2021-04-09T18:19:54.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfd74b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80b1d20 0x7f8bf80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:54.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfd74b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80b1d20 0x7f8bf80b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52466/0 (socket says 172.21.15.120:52466) 2021-04-09T18:19:54.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfd74b700 1 -- 172.21.15.120:0/4179640383 learned_addr learned my addr 172.21.15.120:0/4179640383 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:54.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfe74d700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8bf80b2740 0x7f8bf817dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:54.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfdf4c700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8196180 0x7f8bf808c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:54.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfd74b700 1 -- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8bf80b2740 msgr2=0x7f8bf817dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:54.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfd74b700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8bf80b2740 0x7f8bf817dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:54.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfd74b700 1 -- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8196180 msgr2=0x7f8bf808c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:54.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfd74b700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8196180 0x7f8bf808c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:54.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfd74b700 1 -- 172.21.15.120:0/4179640383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf819b3e0 con 0x7f8bf80b1d20 2021-04-09T18:19:54.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfe74d700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8bf80b2740 0x7f8bf817dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:19:54.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.849 7f8bfdf4c700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8196180 0x7f8bf808c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:19:54.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.850 7f8bfd74b700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80b1d20 0x7f8bf80b2120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8be8006f20 tx=0x7f8be800b9e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:54.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.850 7f8bee7fc700 1 -- 172.21.15.120:0/4179640383 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8be800bdd0 con 0x7f8bf80b1d20 2021-04-09T18:19:54.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.850 7f8bee7fc700 1 -- 172.21.15.120:0/4179640383 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be8006440 con 0x7f8bf80b1d20 2021-04-09T18:19:54.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.850 7f8c00130700 1 -- 172.21.15.120:0/4179640383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf819b3e0 con 0x7f8bf80b1d20 2021-04-09T18:19:54.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.850 7f8bee7fc700 1 -- 172.21.15.120:0/4179640383 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8be80052e0 con 0x7f8bf80b1d20 2021-04-09T18:19:54.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.850 7f8c00130700 1 -- 172.21.15.120:0/4179640383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf819b3e0 con 0x7f8bf80b1d20 2021-04-09T18:19:54.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.850 7f8bee7fc700 1 -- 172.21.15.120:0/4179640383 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8be8006030 con 0x7f8bf80b1d20 2021-04-09T18:19:54.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.850 7f8bee7fc700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8be0018930 0x7f8be001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:54.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.850 7f8bee7fc700 1 -- 172.21.15.120:0/4179640383 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5819+0+0 (secure 0 0 0) 0x7f8be8032b30 con 0x7f8bf80b1d20 2021-04-09T18:19:54.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.851 7f8bfdf4c700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8be0018930 0x7f8be001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:54.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.851 7f8bfdf4c700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8be0018930 0x7f8be001ae10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:54.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.874 7f8c00130700 1 -- 172.21.15.120:0/4179640383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf80ff1c0 con 0x7f8bf80b1d20 2021-04-09T18:19:54.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:54.878 7f8bee7fc700 1 -- 172.21.15.120:0/4179640383 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8be8032d40 con 0x7f8bf80b1d20 2021-04-09T18:19:55.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.047 7f8c00130700 1 -- 172.21.15.120:0/4179640383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f8bf80ff1c0 con 0x7f8bf80b1d20 2021-04-09T18:19:55.046 INFO:tasks.ceph.mon.a.smithi120.stderr:2021-04-09 18:19:55.047 7fcc03f5f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-04-09T18:19:55.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.050 7f8bee7fc700 1 -- 172.21.15.120:0/4179640383 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": true, "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f8be801f740 con 0x7f8bf80b1d20 2021-04-09T18:19:55.052 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 2 and data pool 3 2021-04-09T18:19:55.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 -- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8be0018930 msgr2=0x7f8be001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8be0018930 0x7f8be001ae10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 -- 172.21.15.120:0/4179640383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80b1d20 msgr2=0x7f8bf80b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80b1d20 0x7f8bf80b2120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8be8006f20 tx=0x7f8be800b9e0).stop 2021-04-09T18:19:55.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 -- 172.21.15.120:0/4179640383 shutdown_connections 2021-04-09T18:19:55.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8be0018930 0x7f8be001ae10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8bf80b2740 0x7f8bf817dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf80b1d20 0x7f8bf80b2120 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 --2- 172.21.15.120:0/4179640383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8196180 0x7f8bf808c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 -- 172.21.15.120:0/4179640383 >> 172.21.15.120:0/4179640383 conn(0x7f8bf8094c50 msgr2=0x7f8bf819c410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:55.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 -- 172.21.15.120:0/4179640383 shutdown_connections 2021-04-09T18:19:55.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.056 7f8c00130700 1 -- 172.21.15.120:0/4179640383 wait complete. 2021-04-09T18:19:55.066 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:19:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.210 7f2009bf2700 1 Processor -- start 2021-04-09T18:19:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.210 7f2009bf2700 1 -- start start 2021-04-09T18:19:55.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.211 7f2009bf2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20040d7160 0x7f20040d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.211 7f2009bf2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040d55a0 0x7f20040d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.211 7f2009bf2700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20040d6be0 con 0x7f20040d5fc0 2021-04-09T18:19:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.211 7f2009bf2700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20040d80f0 con 0x7f20040d7160 2021-04-09T18:19:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.211 7f2009bf2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20041a2ac0 con 0x7f20040d55a0 2021-04-09T18:19:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.211 7f20037fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20040d7160 0x7f20040d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.211 7f2002ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040d55a0 0x7f20040d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.211 7f20037fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20040d7160 0x7f20040d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:41310/0 (socket says 172.21.15.120:41310) 2021-04-09T18:19:55.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.211 7f20037fe700 1 -- 172.21.15.120:0/1260337882 learned_addr learned my addr 172.21.15.120:0/1260337882 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:55.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f2002ffd700 1 -- 172.21.15.120:0/1260337882 >> v2:172.21.15.134:3300/0 conn(0x7f20040d7160 msgr2=0x7f20040d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:55.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f2002ffd700 1 --2- 172.21.15.120:0/1260337882 >> v2:172.21.15.134:3300/0 conn(0x7f20040d7160 0x7f20040d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f2002ffd700 1 -- 172.21.15.120:0/1260337882 >> v1:172.21.15.134:6789/0 conn(0x7f20040d5fc0 legacy=0x7f20040d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f2002ffd700 1 -- 172.21.15.120:0/1260337882 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20041a2cb0 con 0x7f20040d55a0 2021-04-09T18:19:55.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f20027fc700 1 -- 172.21.15.120:0/1260337882 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041459693 0 0) 0x7f1ffc0009b0 con 0x7f20040d5fc0 2021-04-09T18:19:55.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f20037fe700 1 --2- 172.21.15.120:0/1260337882 >> v2:172.21.15.134:3300/0 conn(0x7f20040d7160 0x7f20040d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:55.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f2002ffd700 1 --2- 172.21.15.120:0/1260337882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040d55a0 0x7f20040d59a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1ff8006650 tx=0x7f1ff8009a80).ready entity=mon.2 client_cookie=7a7910a2da83fdfd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:55.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f20027fc700 1 -- 172.21.15.120:0/1260337882 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ff80009b0 con 0x7f20040d55a0 2021-04-09T18:19:55.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f20027fc700 1 -- 172.21.15.120:0/1260337882 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff800c0c0 con 0x7f20040d55a0 2021-04-09T18:19:55.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f20027fc700 1 -- 172.21.15.120:0/1260337882 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ff800c510 con 0x7f20040d55a0 2021-04-09T18:19:55.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f2009bf2700 1 -- 172.21.15.120:0/1260337882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040d55a0 msgr2=0x7f20040d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.212 7f2009bf2700 1 --2- 172.21.15.120:0/1260337882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040d55a0 0x7f20040d59a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1ff8006650 tx=0x7f1ff8009a80).stop 2021-04-09T18:19:55.283 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.213 7f2009bf2700 1 -- 172.21.15.120:0/1260337882 shutdown_connections 2021-04-09T18:19:55.283 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.213 7f2009bf2700 1 --2- 172.21.15.120:0/1260337882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040d55a0 0x7f20040d59a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.213 7f2009bf2700 1 --2- 172.21.15.120:0/1260337882 >> v2:172.21.15.134:3300/0 conn(0x7f20040d7160 0x7f20040d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.213 7f2009bf2700 1 -- 172.21.15.120:0/1260337882 >> 172.21.15.120:0/1260337882 conn(0x7f20040d1590 msgr2=0x7f20040d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:55.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.213 7f2009bf2700 1 -- 172.21.15.120:0/1260337882 shutdown_connections 2021-04-09T18:19:55.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.213 7f2009bf2700 1 -- 172.21.15.120:0/1260337882 wait complete. 2021-04-09T18:19:55.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2009bf2700 1 Processor -- start 2021-04-09T18:19:55.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2009bf2700 1 -- start start 2021-04-09T18:19:55.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2009bf2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2004187670 0x7f20040a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2009bf2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040a5050 0x7f20040b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.294 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2009bf2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20040b5710 0x7f20041838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.294 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2009bf2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040b5b10 con 0x7f2004187670 2021-04-09T18:19:55.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2009bf2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040b5d30 con 0x7f20040b5710 2021-04-09T18:19:55.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2009bf2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20040b5f50 con 0x7f20040a5050 2021-04-09T18:19:55.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f20037fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2004187670 0x7f20040a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f20037fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2004187670 0x7f20040a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52480/0 (socket says 172.21.15.120:52480) 2021-04-09T18:19:55.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f20037fe700 1 -- 172.21.15.120:0/1819267717 learned_addr learned my addr 172.21.15.120:0/1819267717 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:55.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2002ffd700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040a5050 0x7f20040b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.232 7f2003fff700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20040b5710 0x7f20041838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f20037fe700 1 -- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040a5050 msgr2=0x7f20040b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f20037fe700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040a5050 0x7f20040b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f20037fe700 1 -- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20040b5710 msgr2=0x7f20041838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f20037fe700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20040b5710 0x7f20041838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f20037fe700 1 -- 172.21.15.120:0/1819267717 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004183ef0 con 0x7f2004187670 2021-04-09T18:19:55.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f20037fe700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2004187670 0x7f20040a4a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1ff400b970 tx=0x7f1ff400bd10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:55.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f1febfff700 1 -- 172.21.15.120:0/1819267717 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ff4000d30 con 0x7f2004187670 2021-04-09T18:19:55.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f1febfff700 1 -- 172.21.15.120:0/1819267717 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4006240 con 0x7f2004187670 2021-04-09T18:19:55.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2004183ef0 con 0x7f2004187670 2021-04-09T18:19:55.304 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f1febfff700 1 -- 172.21.15.120:0/1819267717 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ff4005660 con 0x7f2004187670 2021-04-09T18:19:55.305 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.233 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2004183ef0 con 0x7f2004187670 2021-04-09T18:19:55.305 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.234 7f1febfff700 1 -- 172.21.15.120:0/1819267717 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1ff4005660 con 0x7f2004187670 2021-04-09T18:19:55.305 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.234 7f1febfff700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1fe4018930 0x7f1fe401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.305 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.234 7f1febfff700 1 -- 172.21.15.120:0/1819267717 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1ff4032ed0 con 0x7f2004187670 2021-04-09T18:19:55.306 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.234 7f2002ffd700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1fe4018930 0x7f1fe401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.306 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.234 7f2002ffd700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1fe4018930 0x7f1fe401ae10 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:55.307 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.257 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20041829e0 con 0x7f2004187670 2021-04-09T18:19:55.307 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.260 7f1febfff700 1 -- 172.21.15.120:0/1819267717 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1ff40064a0 con 0x7f2004187670 2021-04-09T18:19:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.435 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20041829e0 con 0x7f2004187670 2021-04-09T18:19:55.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.436 7f1febfff700 1 -- 172.21.15.120:0/1819267717 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7f1ff401fab0 con 0x7f2004187670 2021-04-09T18:19:55.435 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:19:55.436 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:19:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1fe4018930 msgr2=0x7f1fe401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1fe4018930 0x7f1fe401ae10 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2004187670 msgr2=0x7f20040a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2004187670 0x7f20040a4a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1ff400b970 tx=0x7f1ff400bd10).stop 2021-04-09T18:19:55.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 shutdown_connections 2021-04-09T18:19:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20040b5710 0x7f20041838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1fe4018930 0x7f1fe401ae10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20040a5050 0x7f20040b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 --2- 172.21.15.120:0/1819267717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2004187670 0x7f20040a4a30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 >> 172.21.15.120:0/1819267717 conn(0x7f200418dc90 msgr2=0x7f200408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:55.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 shutdown_connections 2021-04-09T18:19:55.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.438 7f2009bf2700 1 -- 172.21.15.120:0/1819267717 wait complete. 2021-04-09T18:19:55.447 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:19:55.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.585 7fb2cf56f700 1 Processor -- start 2021-04-09T18:19:55.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.585 7fb2cf56f700 1 -- start start 2021-04-09T18:19:55.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cf56f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb2c80eac40 0x7fb2c80dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cf56f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb2c80d6760 0x7fb2c80d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cf56f700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c80d61e0 con 0x7fb2c80d1b40 2021-04-09T18:19:55.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cf56f700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c8100d60 con 0x7fb2c80d6760 2021-04-09T18:19:55.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cf56f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c80eaa10 con 0x7fb2c80eac40 2021-04-09T18:19:55.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cdb8c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb2c80d6760 0x7fb2c80d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cdb8c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb2c80d6760 0x7fb2c80d6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52488/0 (socket says 172.21.15.120:52488) 2021-04-09T18:19:55.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2ccb8a700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb2c80d1b40 0x7fb2c8088000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47404/0 (socket says 172.21.15.120:47404) 2021-04-09T18:19:55.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cdb8c700 1 -- 172.21.15.120:0/3282190172 learned_addr learned my addr 172.21.15.120:0/3282190172 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:55.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cd38b700 1 --2- 172.21.15.120:0/3282190172 >> v2:172.21.15.134:3300/0 conn(0x7fb2c80eac40 0x7fb2c80dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cdb8c700 1 -- 172.21.15.120:0/3282190172 >> v2:172.21.15.134:3300/0 conn(0x7fb2c80eac40 msgr2=0x7fb2c80dc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:55.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cdb8c700 1 --2- 172.21.15.120:0/3282190172 >> v2:172.21.15.134:3300/0 conn(0x7fb2c80eac40 0x7fb2c80dc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cdb8c700 1 -- 172.21.15.120:0/3282190172 >> v1:172.21.15.120:6789/0 conn(0x7fb2c80d1b40 legacy=0x7fb2c8088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2bffff700 1 -- 172.21.15.120:0/3282190172 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107800874 0 0) 0x7fb2b80009b0 con 0x7fb2c80d1b40 2021-04-09T18:19:55.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cdb8c700 1 -- 172.21.15.120:0/3282190172 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c80f38e0 con 0x7fb2c80d6760 2021-04-09T18:19:55.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cd38b700 1 --2- 172.21.15.120:0/3282190172 >> v2:172.21.15.134:3300/0 conn(0x7fb2c80eac40 0x7fb2c80dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:19:55.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.586 7fb2cdb8c700 1 --2- 172.21.15.120:0/3282190172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c80d6760 0x7fb2c80d6b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb2c0006b80 tx=0x7fb2c0009b90).ready entity=mon.0 client_cookie=2ab7a668d33e42d2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:55.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.587 7fb2bffff700 1 -- 172.21.15.120:0/3282190172 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2c00022e0 con 0x7fb2c80d6760 2021-04-09T18:19:55.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.587 7fb2bffff700 1 -- 172.21.15.120:0/3282190172 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c0002620 con 0x7fb2c80d6760 2021-04-09T18:19:55.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.587 7fb2bffff700 1 -- 172.21.15.120:0/3282190172 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2c00022e0 con 0x7fb2c80d6760 2021-04-09T18:19:55.610 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.587 7fb2cf56f700 1 -- 172.21.15.120:0/3282190172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c80d6760 msgr2=0x7fb2c80d6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.610 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.587 7fb2cf56f700 1 --2- 172.21.15.120:0/3282190172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c80d6760 0x7fb2c80d6b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb2c0006b80 tx=0x7fb2c0009b90).stop 2021-04-09T18:19:55.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.587 7fb2cf56f700 1 -- 172.21.15.120:0/3282190172 shutdown_connections 2021-04-09T18:19:55.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.587 7fb2cf56f700 1 --2- 172.21.15.120:0/3282190172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c80d6760 0x7fb2c80d6b60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.587 7fb2cf56f700 1 --2- 172.21.15.120:0/3282190172 >> v2:172.21.15.134:3300/0 conn(0x7fb2c80eac40 0x7fb2c80dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.587 7fb2cf56f700 1 -- 172.21.15.120:0/3282190172 >> 172.21.15.120:0/3282190172 conn(0x7fb2c80e93c0 msgr2=0x7fb2c8100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:55.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.588 7fb2cf56f700 1 -- 172.21.15.120:0/3282190172 shutdown_connections 2021-04-09T18:19:55.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.588 7fb2cf56f700 1 -- 172.21.15.120:0/3282190172 wait complete. 2021-04-09T18:19:55.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.606 7fb2cf56f700 1 Processor -- start 2021-04-09T18:19:55.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.606 7fb2cf56f700 1 -- start start 2021-04-09T18:19:55.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2cf56f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2c818bfc0 0x7fb2c808c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2cf56f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c8092a40 0x7fb2c8092e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2cf56f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2c8089410 0x7fb2c8089810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2cf56f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c808bb30 con 0x7fb2c8092a40 2021-04-09T18:19:55.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2cf56f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c8092750 con 0x7fb2c8089410 2021-04-09T18:19:55.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2cf56f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c808c6d0 con 0x7fb2c818bfc0 2021-04-09T18:19:55.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2ccb8a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c8092a40 0x7fb2c8092e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2ccb8a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c8092a40 0x7fb2c8092e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52498/0 (socket says 172.21.15.120:52498) 2021-04-09T18:19:55.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2ccb8a700 1 -- 172.21.15.120:0/4001574443 learned_addr learned my addr 172.21.15.120:0/4001574443 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:55.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2cd38b700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2c818bfc0 0x7fb2c808c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2cdb8c700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2c8089410 0x7fb2c8089810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2ccb8a700 1 -- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2c818bfc0 msgr2=0x7fb2c808c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2ccb8a700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2c818bfc0 0x7fb2c808c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2ccb8a700 1 -- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2c8089410 msgr2=0x7fb2c8089810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2ccb8a700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2c8089410 0x7fb2c8089810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2ccb8a700 1 -- 172.21.15.120:0/4001574443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c818c3c0 con 0x7fb2c8092a40 2021-04-09T18:19:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2ccb8a700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c8092a40 0x7fb2c8092e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb2b800a4c0 tx=0x7fb2b800a860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2bdffb700 1 -- 172.21.15.120:0/4001574443 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2b800ac50 con 0x7fb2c8092a40 2021-04-09T18:19:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.607 7fb2bdffb700 1 -- 172.21.15.120:0/4001574443 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b8004140 con 0x7fb2c8092a40 2021-04-09T18:19:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.608 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c818c3c0 con 0x7fb2c8092a40 2021-04-09T18:19:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.608 7fb2bdffb700 1 -- 172.21.15.120:0/4001574443 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb2b8004620 con 0x7fb2c8092a40 2021-04-09T18:19:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.608 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c818c3c0 con 0x7fb2c8092a40 2021-04-09T18:19:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.609 7fb2bdffb700 1 -- 172.21.15.120:0/4001574443 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb2b8004140 con 0x7fb2c8092a40 2021-04-09T18:19:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.609 7fb2bdffb700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb2a80188c0 0x7fb2a801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.609 7fb2bdffb700 1 -- 172.21.15.120:0/4001574443 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb2b80328b0 con 0x7fb2c8092a40 2021-04-09T18:19:55.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.609 7fb2cd38b700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb2a80188c0 0x7fb2a801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:55.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.609 7fb2cd38b700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb2a80188c0 0x7fb2a801adc0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:55.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.632 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c8092700 con 0x7fb2c8092a40 2021-04-09T18:19:55.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.635 7fb2bdffb700 1 -- 172.21.15.120:0/4001574443 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb2b80009b0 con 0x7fb2c8092a40 2021-04-09T18:19:55.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.812 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2c8092700 con 0x7fb2c8092a40 2021-04-09T18:19:55.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.813 7fb2bdffb700 1 -- 172.21.15.120:0/4001574443 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7fb2b8004140 con 0x7fb2c8092a40 2021-04-09T18:19:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:19:55.814 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:19:55.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb2a80188c0 msgr2=0x7fb2a801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb2a80188c0 0x7fb2a801adc0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c8092a40 msgr2=0x7fb2c8092e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:55.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c8092a40 0x7fb2c8092e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb2b800a4c0 tx=0x7fb2b800a860).stop 2021-04-09T18:19:55.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 shutdown_connections 2021-04-09T18:19:55.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2c8089410 0x7fb2c8089810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2c8092a40 0x7fb2c8092e40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb2a80188c0 0x7fb2a801adc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 --2- 172.21.15.120:0/4001574443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2c818bfc0 0x7fb2c808c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 >> 172.21.15.120:0/4001574443 conn(0x7fb2c81ad050 msgr2=0x7fb2c81a96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 shutdown_connections 2021-04-09T18:19:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.815 7fb2cf56f700 1 -- 172.21.15.120:0/4001574443 wait complete. 2021-04-09T18:19:55.836 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-04-09T18:19:56.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.989 7f9805092700 1 Processor -- start 2021-04-09T18:19:56.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.989 7f9805092700 1 -- start start 2021-04-09T18:19:56.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f9805092700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98000d7180 0x7f98000e7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f9805092700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f98000d7580 0x7f98000d55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.015 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f9805092700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98000d6c00 con 0x7f98000d5be0 2021-04-09T18:19:56.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f9805092700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98000d8110 con 0x7f98000d7580 2021-04-09T18:19:56.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f9805092700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98000e7f20 con 0x7f98000d7180 2021-04-09T18:19:56.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f97fe59c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f98000d7580 0x7f98000d55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f97fe59c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f98000d7580 0x7f98000d55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52506/0 (socket says 172.21.15.120:52506) 2021-04-09T18:19:56.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f97fe59c700 1 -- 172.21.15.120:0/3302964796 learned_addr learned my addr 172.21.15.120:0/3302964796 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:56.018 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f97ff59e700 1 --1- 172.21.15.120:0/3302964796 >> v1:172.21.15.120:6789/0 conn(0x7f98000d5be0 0x7f98000d5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47416/0 (socket says 172.21.15.120:47416) 2021-04-09T18:19:56.018 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f97fed9d700 1 --2- 172.21.15.120:0/3302964796 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98000d7180 0x7f98000e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.018 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f97fe59c700 1 -- 172.21.15.120:0/3302964796 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98000d7180 msgr2=0x7f98000e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:56.019 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f97fe59c700 1 --2- 172.21.15.120:0/3302964796 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98000d7180 0x7f98000e7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.019 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.990 7f97fe59c700 1 -- 172.21.15.120:0/3302964796 >> v1:172.21.15.120:6789/0 conn(0x7f98000d5be0 legacy=0x7f98000d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.020 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.991 7f97fe59c700 1 -- 172.21.15.120:0/3302964796 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98001a2ae0 con 0x7f98000d7580 2021-04-09T18:19:56.020 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.991 7f97fdd9b700 1 -- 172.21.15.120:0/3302964796 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565546576 0 0) 0x7f97f80009b0 con 0x7f98000d5be0 2021-04-09T18:19:56.021 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.991 7f97fe59c700 1 --2- 172.21.15.120:0/3302964796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98000d7580 0x7f98000d55c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f97f0006700 tx=0x7f97f0009b00).ready entity=mon.0 client_cookie=259791d76d75f17 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:56.021 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.991 7f97fdd9b700 1 -- 172.21.15.120:0/3302964796 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97f000c0c0 con 0x7f98000d7580 2021-04-09T18:19:56.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.991 7f97fdd9b700 1 -- 172.21.15.120:0/3302964796 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f000c400 con 0x7f98000d7580 2021-04-09T18:19:56.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.991 7f97fdd9b700 1 -- 172.21.15.120:0/3302964796 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97f000c8e0 con 0x7f98000d7580 2021-04-09T18:19:56.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.991 7f9805092700 1 -- 172.21.15.120:0/3302964796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98000d7580 msgr2=0x7f98000d55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.991 7f9805092700 1 --2- 172.21.15.120:0/3302964796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98000d7580 0x7f98000d55c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f97f0006700 tx=0x7f97f0009b00).stop 2021-04-09T18:19:56.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.992 7f9805092700 1 -- 172.21.15.120:0/3302964796 shutdown_connections 2021-04-09T18:19:56.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.992 7f9805092700 1 --2- 172.21.15.120:0/3302964796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98000d7580 0x7f98000d55c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.992 7f9805092700 1 --2- 172.21.15.120:0/3302964796 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98000d7180 0x7f98000e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.992 7f9805092700 1 -- 172.21.15.120:0/3302964796 >> 172.21.15.120:0/3302964796 conn(0x7f98000d15b0 msgr2=0x7f98000d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:56.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.992 7f9805092700 1 -- 172.21.15.120:0/3302964796 shutdown_connections 2021-04-09T18:19:56.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:55.992 7f9805092700 1 -- 172.21.15.120:0/3302964796 wait complete. 2021-04-09T18:19:56.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.010 7f9805092700 1 Processor -- start 2021-04-09T18:19:56.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.010 7f9805092700 1 -- start start 2021-04-09T18:19:56.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f9805092700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f980009b120 0x7f98000e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f9805092700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98000e40c0 0x7f98000b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f9805092700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980009b520 0x7f98000b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f9805092700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980009dce0 con 0x7f980009b520 2021-04-09T18:19:56.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f9805092700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980009aba0 con 0x7f98000e40c0 2021-04-09T18:19:56.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f9805092700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98000b5c50 con 0x7f980009b120 2021-04-09T18:19:56.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97ff59e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980009b520 0x7f98000b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97ff59e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980009b520 0x7f98000b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52508/0 (socket says 172.21.15.120:52508) 2021-04-09T18:19:56.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97ff59e700 1 -- 172.21.15.120:0/1173282769 learned_addr learned my addr 172.21.15.120:0/1173282769 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:56.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97fe59c700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98000e40c0 0x7f98000b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97fed9d700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f980009b120 0x7f98000e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97ff59e700 1 -- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f980009b120 msgr2=0x7f98000e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97ff59e700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f980009b120 0x7f98000e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97ff59e700 1 -- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98000e40c0 msgr2=0x7f98000b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97ff59e700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98000e40c0 0x7f98000b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97ff59e700 1 -- 172.21.15.120:0/1173282769 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000b5e30 con 0x7f980009b520 2021-04-09T18:19:56.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.011 7f97ff59e700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980009b520 0x7f98000b5630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f97f800a590 tx=0x7f97f800a930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:56.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.012 7f97f77fe700 1 -- 172.21.15.120:0/1173282769 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97f800ad20 con 0x7f980009b520 2021-04-09T18:19:56.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.012 7f97f77fe700 1 -- 172.21.15.120:0/1173282769 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f80070d0 con 0x7f980009b520 2021-04-09T18:19:56.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.012 7f97f77fe700 1 -- 172.21.15.120:0/1173282769 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97f8004590 con 0x7f980009b520 2021-04-09T18:19:56.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.012 7f9805092700 1 -- 172.21.15.120:0/1173282769 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98000b5e30 con 0x7f980009b520 2021-04-09T18:19:56.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.012 7f9805092700 1 -- 172.21.15.120:0/1173282769 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98000b5e30 con 0x7f980009b520 2021-04-09T18:19:56.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.012 7f97f77fe700 1 -- 172.21.15.120:0/1173282769 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f97f8008000 con 0x7f980009b520 2021-04-09T18:19:56.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.012 7f97f77fe700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97e40188d0 0x7f97e401add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.013 7f97f77fe700 1 -- 172.21.15.120:0/1173282769 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f97f8032b70 con 0x7f980009b520 2021-04-09T18:19:56.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.013 7f97fed9d700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97e40188d0 0x7f97e401add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.013 7f97fed9d700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97e40188d0 0x7f97e401add0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:56.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.036 7f9805092700 1 -- 172.21.15.120:0/1173282769 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98000e25b0 con 0x7f980009b520 2021-04-09T18:19:56.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.039 7f97f77fe700 1 -- 172.21.15.120:0/1173282769 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f97f8000940 con 0x7f980009b520 2021-04-09T18:19:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.222 7f9805092700 1 -- 172.21.15.120:0/1173282769 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f98000e25b0 con 0x7f980009b520 2021-04-09T18:19:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.704 7f97f77fe700 1 -- 172.21.15.120:0/1173282769 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f97f80070b0 con 0x7f980009b520 2021-04-09T18:19:56.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 -- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97e40188d0 msgr2=0x7f97e401add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97e40188d0 0x7f97e401add0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 -- 172.21.15.120:0/1173282769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980009b520 msgr2=0x7f98000b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980009b520 0x7f98000b5630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f97f800a590 tx=0x7f97f800a930).stop 2021-04-09T18:19:56.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 -- 172.21.15.120:0/1173282769 shutdown_connections 2021-04-09T18:19:56.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980009b520 0x7f98000b5630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98000e40c0 0x7f98000b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97e40188d0 0x7f97e401add0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 --2- 172.21.15.120:0/1173282769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f980009b120 0x7f98000e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 -- 172.21.15.120:0/1173282769 >> 172.21.15.120:0/1173282769 conn(0x7f98001822c0 msgr2=0x7f980009df50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:56.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 -- 172.21.15.120:0/1173282769 shutdown_connections 2021-04-09T18:19:56.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.739 7f9805092700 1 -- 172.21.15.120:0/1173282769 wait complete. 2021-04-09T18:19:56.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2021-04-09T18:19:56.916 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.892 7f3b468de700 1 Processor -- start 2021-04-09T18:19:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.892 7f3b468de700 1 -- start start 2021-04-09T18:19:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b468de700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3b400d65a0 0x7f3b401ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b468de700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b400d7980 con 0x7f3b400d7180 2021-04-09T18:19:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b468de700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b400d69a0 con 0x7f3b400d7580 2021-04-09T18:19:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b468de700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b400d6c00 con 0x7f3b400d65a0 2021-04-09T18:19:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b44efb700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3b400d65a0 0x7f3b401ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b44efb700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3b400d65a0 0x7f3b401ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52520/0 (socket says 172.21.15.120:52520) 2021-04-09T18:19:56.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b3ffff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3b400d7180 0x7f3b400d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47428/0 (socket says 172.21.15.120:47428) 2021-04-09T18:19:56.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b44efb700 1 -- 172.21.15.120:0/771590496 learned_addr learned my addr 172.21.15.120:0/771590496 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:56.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b44efb700 1 -- 172.21.15.120:0/771590496 >> v1:172.21.15.134:6789/0 conn(0x7f3b400d7580 legacy=0x7f3b400d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b44efb700 1 -- 172.21.15.120:0/771590496 >> v1:172.21.15.120:6789/0 conn(0x7f3b400d7180 legacy=0x7f3b400d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b44efb700 1 -- 172.21.15.120:0/771590496 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b401a2ae0 con 0x7f3b400d65a0 2021-04-09T18:19:56.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b3f7fe700 1 -- 172.21.15.120:0/771590496 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557779905 0 0) 0x7f3b30000ce0 con 0x7f3b400d7180 2021-04-09T18:19:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.893 7f3b44efb700 1 --2- 172.21.15.120:0/771590496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b400d65a0 0x7f3b401ac210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3b38006f00 tx=0x7f3b38009e90).ready entity=mon.0 client_cookie=483a99a45d90a617 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b3f7fe700 1 -- 172.21.15.120:0/771590496 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3b3800b300 con 0x7f3b400d65a0 2021-04-09T18:19:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b3f7fe700 1 -- 172.21.15.120:0/771590496 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3800b640 con 0x7f3b400d65a0 2021-04-09T18:19:56.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b3f7fe700 1 -- 172.21.15.120:0/771590496 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3b3800bb20 con 0x7f3b400d65a0 2021-04-09T18:19:56.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b468de700 1 -- 172.21.15.120:0/771590496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b400d65a0 msgr2=0x7f3b401ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b468de700 1 --2- 172.21.15.120:0/771590496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b400d65a0 0x7f3b401ac210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3b38006f00 tx=0x7f3b38009e90).stop 2021-04-09T18:19:56.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b468de700 1 -- 172.21.15.120:0/771590496 shutdown_connections 2021-04-09T18:19:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b468de700 1 --2- 172.21.15.120:0/771590496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b400d65a0 0x7f3b401ac210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b468de700 1 -- 172.21.15.120:0/771590496 >> 172.21.15.120:0/771590496 conn(0x7f3b400d15b0 msgr2=0x7f3b400d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b468de700 1 -- 172.21.15.120:0/771590496 shutdown_connections 2021-04-09T18:19:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.894 7f3b468de700 1 -- 172.21.15.120:0/771590496 wait complete. 2021-04-09T18:19:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.913 7f3b468de700 1 Processor -- start 2021-04-09T18:19:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.913 7f3b468de700 1 -- start start 2021-04-09T18:19:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b468de700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4017be20 0x7f3b4009b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b468de700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4017c7d0 0x7f3b400dfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b468de700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4017cbd0 0x7f3b400e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b468de700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4009f080 con 0x7f3b4017be20 2021-04-09T18:19:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b468de700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4009f460 con 0x7f3b4017c7d0 2021-04-09T18:19:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b468de700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b400e09f0 con 0x7f3b4017cbd0 2021-04-09T18:19:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4017be20 0x7f3b4009b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4017be20 0x7f3b4009b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52522/0 (socket says 172.21.15.120:52522) 2021-04-09T18:19:56.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3ffff700 1 -- 172.21.15.120:0/45197988 learned_addr learned my addr 172.21.15.120:0/45197988 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:56.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b44efb700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4017cbd0 0x7f3b400e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b37fff700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4017c7d0 0x7f3b400dfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3ffff700 1 -- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4017cbd0 msgr2=0x7f3b400e03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3ffff700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4017cbd0 0x7f3b400e03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3ffff700 1 -- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4017c7d0 msgr2=0x7f3b400dfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:56.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3ffff700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4017c7d0 0x7f3b400dfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3ffff700 1 -- 172.21.15.120:0/45197988 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b400e0c10 con 0x7f3b4017be20 2021-04-09T18:19:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3ffff700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4017be20 0x7f3b4009b020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3b3000b530 tx=0x7f3b3000b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3d7fa700 1 -- 172.21.15.120:0/45197988 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3b30006020 con 0x7f3b4017be20 2021-04-09T18:19:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3d7fa700 1 -- 172.21.15.120:0/45197988 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b300063a0 con 0x7f3b4017be20 2021-04-09T18:19:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b3d7fa700 1 -- 172.21.15.120:0/45197988 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3b30004590 con 0x7f3b4017be20 2021-04-09T18:19:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b468de700 1 -- 172.21.15.120:0/45197988 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b400e0c10 con 0x7f3b4017be20 2021-04-09T18:19:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.914 7f3b468de700 1 -- 172.21.15.120:0/45197988 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b400e0c10 con 0x7f3b4017be20 2021-04-09T18:19:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.915 7f3b3d7fa700 1 -- 172.21.15.120:0/45197988 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3b3000a030 con 0x7f3b4017be20 2021-04-09T18:19:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.915 7f3b3d7fa700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b240188d0 0x7f3b2401add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.915 7f3b3d7fa700 1 -- 172.21.15.120:0/45197988 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f3b30032b00 con 0x7f3b4017be20 2021-04-09T18:19:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.915 7f3b37fff700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b240188d0 0x7f3b2401add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.916 7f3b37fff700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b240188d0 0x7f3b2401add0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.938 7f3b468de700 1 -- 172.21.15.120:0/45197988 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4017c2a0 con 0x7f3b4017be20 2021-04-09T18:19:56.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:56.942 7f3b3d7fa700 1 -- 172.21.15.120:0/45197988 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3b30006b90 con 0x7f3b4017be20 2021-04-09T18:19:57.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.123 7f3b468de700 1 -- 172.21.15.120:0/45197988 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "session_timeout", "prefix": "fs set", "fs_name": "cephfs", "val": "300"} v 0) v1 -- 0x7f3b4017c2a0 con 0x7f3b4017be20 2021-04-09T18:19:57.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.709 7f3b3d7fa700 1 -- 172.21.15.120:0/45197988 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "session_timeout", "prefix": "fs set", "fs_name": "cephfs", "val": "300"}]=0 v4) v1 ==== 115+0+0 (secure 0 0 0) 0x7f3b3000a030 con 0x7f3b4017be20 2021-04-09T18:19:57.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 -- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b240188d0 msgr2=0x7f3b2401add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:57.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b240188d0 0x7f3b2401add0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:57.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 -- 172.21.15.120:0/45197988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4017be20 msgr2=0x7f3b4009b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:57.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4017be20 0x7f3b4009b020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3b3000b530 tx=0x7f3b3000b8d0).stop 2021-04-09T18:19:57.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 -- 172.21.15.120:0/45197988 shutdown_connections 2021-04-09T18:19:57.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b240188d0 0x7f3b2401add0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:57.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4017cbd0 0x7f3b400e03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:57.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4017c7d0 0x7f3b400dfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:57.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 --2- 172.21.15.120:0/45197988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4017be20 0x7f3b4009b020 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:57.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 -- 172.21.15.120:0/45197988 >> 172.21.15.120:0/45197988 conn(0x7f3b4017ebe0 msgr2=0x7f3b400e3920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:57.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 -- 172.21.15.120:0/45197988 shutdown_connections 2021-04-09T18:19:57.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.740 7f3b468de700 1 -- 172.21.15.120:0/45197988 wait complete. 2021-04-09T18:19:57.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:19:57.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.945 7efebff40700 1 Processor -- start 2021-04-09T18:19:57.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.945 7efebff40700 1 -- start start 2021-04-09T18:19:57.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.945 7efebff40700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb80eac40 0x7efeb80dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:57.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.945 7efebff40700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efeb80d1b40 0x7efeb8088000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:57.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.945 7efebff40700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80d61e0 con 0x7efeb8088620 2021-04-09T18:19:57.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.945 7efebff40700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80eaa10 con 0x7efeb80d1b40 2021-04-09T18:19:57.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.945 7efebff40700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80f38e0 con 0x7efeb80eac40 2021-04-09T18:19:57.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebd55b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efeb80d1b40 0x7efeb8088000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:57.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebd55b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efeb80d1b40 0x7efeb8088000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52534/0 (socket says 172.21.15.120:52534) 2021-04-09T18:19:57.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebd55b700 1 -- 172.21.15.120:0/411193978 learned_addr learned my addr 172.21.15.120:0/411193978 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:57.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebdd5c700 1 --2- 172.21.15.120:0/411193978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb80eac40 0x7efeb80dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:57.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebd55b700 1 -- 172.21.15.120:0/411193978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb80eac40 msgr2=0x7efeb80dc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:57.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebd55b700 1 --2- 172.21.15.120:0/411193978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb80eac40 0x7efeb80dc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:57.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebd55b700 1 -- 172.21.15.120:0/411193978 >> v1:172.21.15.134:6789/0 conn(0x7efeb8088620 legacy=0x7efeb80d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:57.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebd55b700 1 -- 172.21.15.120:0/411193978 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80d6f50 con 0x7efeb80d1b40 2021-04-09T18:19:57.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebd55b700 1 --2- 172.21.15.120:0/411193978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb80d1b40 0x7efeb8088000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7efeac006700 tx=0x7efeac009b00).ready entity=mon.0 client_cookie=b012ceb385385c2f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:57.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebcd5a700 1 -- 172.21.15.120:0/411193978 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efeac00c0c0 con 0x7efeb80d1b40 2021-04-09T18:19:57.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebcd5a700 1 -- 172.21.15.120:0/411193978 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac00c400 con 0x7efeb80d1b40 2021-04-09T18:19:57.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebcd5a700 1 -- 172.21.15.120:0/411193978 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efeac00c8e0 con 0x7efeb80d1b40 2021-04-09T18:19:57.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebff40700 1 -- 172.21.15.120:0/411193978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb80d1b40 msgr2=0x7efeb8088000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:57.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.946 7efebff40700 1 --2- 172.21.15.120:0/411193978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb80d1b40 0x7efeb8088000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7efeac006700 tx=0x7efeac009b00).stop 2021-04-09T18:19:57.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.947 7efebff40700 1 -- 172.21.15.120:0/411193978 shutdown_connections 2021-04-09T18:19:57.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.947 7efebff40700 1 --2- 172.21.15.120:0/411193978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb80d1b40 0x7efeb8088000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:57.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.947 7efebff40700 1 --2- 172.21.15.120:0/411193978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb80eac40 0x7efeb80dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:57.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.947 7efebff40700 1 -- 172.21.15.120:0/411193978 >> 172.21.15.120:0/411193978 conn(0x7efeb80e93c0 msgr2=0x7efeb8100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:57.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.947 7efebff40700 1 -- 172.21.15.120:0/411193978 shutdown_connections 2021-04-09T18:19:57.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.947 7efebff40700 1 -- 172.21.15.120:0/411193978 wait complete. 2021-04-09T18:19:57.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.966 7efebff40700 1 Processor -- start 2021-04-09T18:19:57.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.966 7efebff40700 1 -- start start 2021-04-09T18:19:57.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebff40700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb818bfc0 0x7efeb808c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:57.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebff40700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb808c6d0 0x7efeb8092a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:57.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebff40700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb8093060 0x7efeb8089410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebff40700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80a4770 con 0x7efeb808c6d0 2021-04-09T18:19:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebff40700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb818c3c0 con 0x7efeb818bfc0 2021-04-09T18:19:58.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebff40700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb8092540 con 0x7efeb8093060 2021-04-09T18:19:58.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebd55b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb808c6d0 0x7efeb8092a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebd55b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb808c6d0 0x7efeb8092a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52538/0 (socket says 172.21.15.120:52538) 2021-04-09T18:19:58.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebd55b700 1 -- 172.21.15.120:0/3120982642 learned_addr learned my addr 172.21.15.120:0/3120982642 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:58.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebdd5c700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb818bfc0 0x7efeb808c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebe55d700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb8093060 0x7efeb8089410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebd55b700 1 -- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb8093060 msgr2=0x7efeb8089410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebd55b700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb8093060 0x7efeb8089410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebd55b700 1 -- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb818bfc0 msgr2=0x7efeb808c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebd55b700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb818bfc0 0x7efeb808c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebd55b700 1 -- 172.21.15.120:0/3120982642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb8089a30 con 0x7efeb808c6d0 2021-04-09T18:19:58.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebd55b700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb808c6d0 0x7efeb8092a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7efeac006f20 tx=0x7efeac00b910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:58.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efeb67fc700 1 -- 172.21.15.120:0/3120982642 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efeac0090d0 con 0x7efeb808c6d0 2021-04-09T18:19:58.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efeb67fc700 1 -- 172.21.15.120:0/3120982642 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac00bd00 con 0x7efeb808c6d0 2021-04-09T18:19:58.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efebff40700 1 -- 172.21.15.120:0/3120982642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb8089a30 con 0x7efeb808c6d0 2021-04-09T18:19:58.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.967 7efeb67fc700 1 -- 172.21.15.120:0/3120982642 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efeac005560 con 0x7efeb808c6d0 2021-04-09T18:19:58.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.968 7efebff40700 1 -- 172.21.15.120:0/3120982642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb8089a30 con 0x7efeb808c6d0 2021-04-09T18:19:58.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.968 7efeb67fc700 1 -- 172.21.15.120:0/3120982642 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efeac00a000 con 0x7efeb808c6d0 2021-04-09T18:19:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.968 7efeb67fc700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efe98018930 0x7efe9801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.968 7efeb67fc700 1 -- 172.21.15.120:0/3120982642 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7efeac032b50 con 0x7efeb808c6d0 2021-04-09T18:19:58.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.968 7efebdd5c700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efe98018930 0x7efe9801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.969 7efebdd5c700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efe98018930 0x7efe9801ae10 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:58.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.992 7efebff40700 1 -- 172.21.15.120:0/3120982642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb8088500 con 0x7efeb808c6d0 2021-04-09T18:19:58.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:57.995 7efeb67fc700 1 -- 172.21.15.120:0/3120982642 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efeac0090d0 con 0x7efeb808c6d0 2021-04-09T18:19:58.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.171 7efebff40700 1 -- 172.21.15.120:0/3120982642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efeb80ccba0 con 0x7efeb808c6d0 2021-04-09T18:19:58.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.171 7efeb67fc700 1 -- 172.21.15.120:0/3120982642 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+1416 (secure 0 0 0) 0x7efeac00bd00 con 0x7efeb808c6d0 2021-04-09T18:19:58.171 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 4 2021-04-09T18:19:58.172 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:19:58.172 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":4,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":4,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:19:57.705229","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:19:58.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.173 7efebff40700 1 -- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efe98018930 msgr2=0x7efe9801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.173 7efebff40700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efe98018930 0x7efe9801ae10 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.173 7efebff40700 1 -- 172.21.15.120:0/3120982642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb808c6d0 msgr2=0x7efeb8092a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.173 7efebff40700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb808c6d0 0x7efeb8092a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7efeac006f20 tx=0x7efeac00b910).stop 2021-04-09T18:19:58.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.174 7efebff40700 1 -- 172.21.15.120:0/3120982642 shutdown_connections 2021-04-09T18:19:58.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.174 7efebff40700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efe98018930 0x7efe9801ae10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.174 7efebff40700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efeb8093060 0x7efeb8089410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.174 7efebff40700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efeb808c6d0 0x7efeb8092a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.174 7efebff40700 1 --2- 172.21.15.120:0/3120982642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeb818bfc0 0x7efeb808c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.174 7efebff40700 1 -- 172.21.15.120:0/3120982642 >> 172.21.15.120:0/3120982642 conn(0x7efeb81ad050 msgr2=0x7efeb81a96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:58.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.174 7efebff40700 1 -- 172.21.15.120:0/3120982642 shutdown_connections 2021-04-09T18:19:58.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.174 7efebff40700 1 -- 172.21.15.120:0/3120982642 wait complete. 2021-04-09T18:19:58.183 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:19:58.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.327 7f4d43ec0700 1 Processor -- start 2021-04-09T18:19:58.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.327 7f4d43ec0700 1 -- start start 2021-04-09T18:19:58.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.327 7f4d43ec0700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d3c0d7160 0x7f4d3c0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.327 7f4d43ec0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4d3c0d55a0 0x7f4d3c0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.327 7f4d43ec0700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c0d6be0 con 0x7f4d3c0d5fc0 2021-04-09T18:19:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.327 7f4d43ec0700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c0d80f0 con 0x7f4d3c0d55a0 2021-04-09T18:19:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.327 7f4d43ec0700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c1a2ac0 con 0x7f4d3c0d7160 2021-04-09T18:19:58.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d414db700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4d3c0d55a0 0x7f4d3c0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d414db700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4d3c0d55a0 0x7f4d3c0d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52548/0 (socket says 172.21.15.120:52548) 2021-04-09T18:19:58.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d414db700 1 -- 172.21.15.120:0/3399043267 learned_addr learned my addr 172.21.15.120:0/3399043267 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:58.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d41cdc700 1 --2- 172.21.15.120:0/3399043267 >> v2:172.21.15.134:3300/0 conn(0x7f4d3c0d7160 0x7f4d3c0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d414db700 1 -- 172.21.15.120:0/3399043267 >> v2:172.21.15.134:3300/0 conn(0x7f4d3c0d7160 msgr2=0x7f4d3c0d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:58.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d414db700 1 --2- 172.21.15.120:0/3399043267 >> v2:172.21.15.134:3300/0 conn(0x7f4d3c0d7160 0x7f4d3c0d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d414db700 1 -- 172.21.15.120:0/3399043267 >> v1:172.21.15.134:6789/0 conn(0x7f4d3c0d5fc0 legacy=0x7f4d3c0d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:58.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d414db700 1 -- 172.21.15.120:0/3399043267 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c1ac1f0 con 0x7f4d3c0d55a0 2021-04-09T18:19:58.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d41cdc700 1 --2- 172.21.15.120:0/3399043267 >> v2:172.21.15.134:3300/0 conn(0x7f4d3c0d7160 0x7f4d3c0d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:19:58.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d414db700 1 --2- 172.21.15.120:0/3399043267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0d55a0 0x7f4d3c0d59a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4d30006700 tx=0x7f4d30009b80).ready entity=mon.0 client_cookie=ad9785beb742b60 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:58.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d40cda700 1 -- 172.21.15.120:0/3399043267 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d3000c0c0 con 0x7f4d3c0d55a0 2021-04-09T18:19:58.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d40cda700 1 -- 172.21.15.120:0/3399043267 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3000c440 con 0x7f4d3c0d55a0 2021-04-09T18:19:58.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d40cda700 1 -- 172.21.15.120:0/3399043267 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d3000c920 con 0x7f4d3c0d55a0 2021-04-09T18:19:58.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d43ec0700 1 -- 172.21.15.120:0/3399043267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0d55a0 msgr2=0x7f4d3c0d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.328 7f4d43ec0700 1 --2- 172.21.15.120:0/3399043267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0d55a0 0x7f4d3c0d59a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4d30006700 tx=0x7f4d30009b80).stop 2021-04-09T18:19:58.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.329 7f4d43ec0700 1 -- 172.21.15.120:0/3399043267 shutdown_connections 2021-04-09T18:19:58.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.329 7f4d43ec0700 1 --2- 172.21.15.120:0/3399043267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0d55a0 0x7f4d3c0d59a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.329 7f4d43ec0700 1 --2- 172.21.15.120:0/3399043267 >> v2:172.21.15.134:3300/0 conn(0x7f4d3c0d7160 0x7f4d3c0d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.329 7f4d43ec0700 1 -- 172.21.15.120:0/3399043267 >> 172.21.15.120:0/3399043267 conn(0x7f4d3c0d1590 msgr2=0x7f4d3c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:58.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.329 7f4d43ec0700 1 -- 172.21.15.120:0/3399043267 shutdown_connections 2021-04-09T18:19:58.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.329 7f4d43ec0700 1 -- 172.21.15.120:0/3399043267 wait complete. 2021-04-09T18:19:58.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d43ec0700 1 Processor -- start 2021-04-09T18:19:58.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d43ec0700 1 -- start start 2021-04-09T18:19:58.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d43ec0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c18d590 0x7f4d3c094800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d43ec0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0937d0 0x7f4d3c093bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d43ec0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d3c180fd0 0x7f4d3c1813d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d43ec0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c094280 con 0x7f4d3c0937d0 2021-04-09T18:19:58.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d43ec0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c094e20 con 0x7f4d3c18d590 2021-04-09T18:19:58.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d43ec0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c18db30 con 0x7f4d3c180fd0 2021-04-09T18:19:58.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d414db700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0937d0 0x7f4d3c093bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d414db700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0937d0 0x7f4d3c093bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52554/0 (socket says 172.21.15.120:52554) 2021-04-09T18:19:58.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.348 7f4d414db700 1 -- 172.21.15.120:0/1919790389 learned_addr learned my addr 172.21.15.120:0/1919790389 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:58.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d41cdc700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c18d590 0x7f4d3c094800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d424dd700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d3c180fd0 0x7f4d3c1813d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d414db700 1 -- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d3c180fd0 msgr2=0x7f4d3c1813d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d414db700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d3c180fd0 0x7f4d3c1813d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d414db700 1 -- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c18d590 msgr2=0x7f4d3c094800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d414db700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c18d590 0x7f4d3c094800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d414db700 1 -- 172.21.15.120:0/1919790389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c1819f0 con 0x7f4d3c0937d0 2021-04-09T18:19:58.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d414db700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0937d0 0x7f4d3c093bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4d3000b580 tx=0x7f4d3000b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:58.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d3a7fc700 1 -- 172.21.15.120:0/1919790389 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d3000bd10 con 0x7f4d3c0937d0 2021-04-09T18:19:58.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d3a7fc700 1 -- 172.21.15.120:0/1919790389 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30002030 con 0x7f4d3c0937d0 2021-04-09T18:19:58.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3c1819f0 con 0x7f4d3c0937d0 2021-04-09T18:19:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d3a7fc700 1 -- 172.21.15.120:0/1919790389 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d30002550 con 0x7f4d3c0937d0 2021-04-09T18:19:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.349 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c1819f0 con 0x7f4d3c0937d0 2021-04-09T18:19:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.350 7f4d3a7fc700 1 -- 172.21.15.120:0/1919790389 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4d30000c90 con 0x7f4d3c0937d0 2021-04-09T18:19:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.350 7f4d3a7fc700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4d1c018930 0x7f4d1c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.350 7f4d3a7fc700 1 -- 172.21.15.120:0/1919790389 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f4d30032ba0 con 0x7f4d3c0937d0 2021-04-09T18:19:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.350 7f4d41cdc700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4d1c018930 0x7f4d1c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.350 7f4d41cdc700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4d1c018930 0x7f4d1c01ae10 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:58.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.373 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c17a6c0 con 0x7f4d3c0937d0 2021-04-09T18:19:58.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.377 7f4d3a7fc700 1 -- 172.21.15.120:0/1919790389 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4d3001f780 con 0x7f4d3c0937d0 2021-04-09T18:19:58.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.553 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d3c0d6be0 con 0x7f4d3c0937d0 2021-04-09T18:19:58.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.554 7f4d3a7fc700 1 -- 172.21.15.120:0/1919790389 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7f4d30000c90 con 0x7f4d3c0937d0 2021-04-09T18:19:58.554 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:19:58.555 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:19:58.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4d1c018930 msgr2=0x7f4d1c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4d1c018930 0x7f4d1c01ae10 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0937d0 msgr2=0x7f4d3c093bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0937d0 0x7f4d3c093bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4d3000b580 tx=0x7f4d3000b920).stop 2021-04-09T18:19:58.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 shutdown_connections 2021-04-09T18:19:58.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4d1c018930 0x7f4d1c01ae10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d3c180fd0 0x7f4d3c1813d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.559 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d3c0937d0 0x7f4d3c093bd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 --2- 172.21.15.120:0/1919790389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c18d590 0x7f4d3c094800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 >> 172.21.15.120:0/1919790389 conn(0x7f4d3c1859b0 msgr2=0x7f4d3c17e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:58.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 shutdown_connections 2021-04-09T18:19:58.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.556 7f4d43ec0700 1 -- 172.21.15.120:0/1919790389 wait complete. 2021-04-09T18:19:58.566 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-04-09T18:19:58.567 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:19:58.568 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:19:58.584 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:19:58.585 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:19:58.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:19:58.605 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:19:58.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:19:58.715 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2021-04-09T18:19:58.730 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2021-04-09T18:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.749 7f5a05405700 1 Processor -- start 2021-04-09T18:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.749 7f5a05405700 1 -- start start 2021-04-09T18:19:58.774 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.749 7f5a05405700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5a000d6580 0x7f5a001ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.774 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.749 7f5a05405700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a000d7960 con 0x7f5a000d7560 2021-04-09T18:19:58.774 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.749 7f5a05405700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a000d6980 con 0x7f5a000d7160 2021-04-09T18:19:58.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.749 7f5a05405700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a000d6be0 con 0x7f5a000d6580 2021-04-09T18:19:58.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.749 7f59ff87e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5a000d6580 0x7f5a001ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.749 7f59fe87c700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5a000d7560 0x7f5a000d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47484/0 (socket says 172.21.15.120:47484) 2021-04-09T18:19:58.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.749 7f59fe87c700 1 -- 172.21.15.120:0/76508796 learned_addr learned my addr 172.21.15.120:0/76508796 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:58.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f59fe07b700 1 -- 172.21.15.120:0/76508796 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932614490 0 0) 0x7f59f40009b0 con 0x7f5a000d7560 2021-04-09T18:19:58.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f59fe07b700 1 -- 172.21.15.120:0/76508796 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e8002fe0 con 0x7f5a000d7560 2021-04-09T18:19:58.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f59ff87e700 1 -- 172.21.15.120:0/76508796 >> v1:172.21.15.134:6789/0 conn(0x7f5a000d7160 legacy=0x7f5a000d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f59ff87e700 1 -- 172.21.15.120:0/76508796 >> v1:172.21.15.120:6789/0 conn(0x7f5a000d7560 legacy=0x7f5a000d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f59ff87e700 1 -- 172.21.15.120:0/76508796 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000d0f10 con 0x7f5a000d6580 2021-04-09T18:19:58.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f59ff87e700 1 --2- 172.21.15.120:0/76508796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a000d6580 0x7f5a001ac1f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f59f8006ab0 tx=0x7f59f8009b40).ready entity=mon.0 client_cookie=d51e6dc8acfd0233 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:58.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f59fe07b700 1 -- 172.21.15.120:0/76508796 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59f80022e0 con 0x7f5a000d6580 2021-04-09T18:19:58.783 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f59fe07b700 1 -- 172.21.15.120:0/76508796 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f8002660 con 0x7f5a000d6580 2021-04-09T18:19:58.783 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f59fe07b700 1 -- 172.21.15.120:0/76508796 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59f8002b40 con 0x7f5a000d6580 2021-04-09T18:19:58.784 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f5a05405700 1 -- 172.21.15.120:0/76508796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a000d6580 msgr2=0x7f5a001ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.784 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.750 7f5a05405700 1 --2- 172.21.15.120:0/76508796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a000d6580 0x7f5a001ac1f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f59f8006ab0 tx=0x7f59f8009b40).stop 2021-04-09T18:19:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.751 7f5a05405700 1 -- 172.21.15.120:0/76508796 shutdown_connections 2021-04-09T18:19:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.751 7f5a05405700 1 --2- 172.21.15.120:0/76508796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a000d6580 0x7f5a001ac1f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.751 7f5a05405700 1 -- 172.21.15.120:0/76508796 >> 172.21.15.120:0/76508796 conn(0x7f5a000d1590 msgr2=0x7f5a000d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.751 7f5a05405700 1 -- 172.21.15.120:0/76508796 shutdown_connections 2021-04-09T18:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.751 7f5a05405700 1 -- 172.21.15.120:0/76508796 wait complete. 2021-04-09T18:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.769 7f5a05405700 1 Processor -- start 2021-04-09T18:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f5a05405700 1 -- start start 2021-04-09T18:19:58.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f5a05405700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a00191b80 0x7f5a00195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f5a05405700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a001952c0 0x7f5a000902f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f5a05405700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a000b19b0 0x7f5a000b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f5a05405700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00195870 con 0x7f5a001952c0 2021-04-09T18:19:58.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f5a05405700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00196410 con 0x7f5a00191b80 2021-04-09T18:19:58.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f5a05405700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00090910 con 0x7f5a000b19b0 2021-04-09T18:19:58.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f59fe87c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a001952c0 0x7f5a000902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f59fe87c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a001952c0 0x7f5a000902f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52576/0 (socket says 172.21.15.120:52576) 2021-04-09T18:19:58.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f59fe87c700 1 -- 172.21.15.120:0/1924748465 learned_addr learned my addr 172.21.15.120:0/1924748465 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f59ff07d700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a00191b80 0x7f5a00195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.770 7f59ff87e700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a000b19b0 0x7f5a000b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59fe87c700 1 -- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a000b19b0 msgr2=0x7f5a000b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59fe87c700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a000b19b0 0x7f5a000b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59fe87c700 1 -- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a00191b80 msgr2=0x7f5a00195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59fe87c700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a00191b80 0x7f5a00195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59fe87c700 1 -- 172.21.15.120:0/1924748465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000b23d0 con 0x7f5a001952c0 2021-04-09T18:19:58.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59ff07d700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a00191b80 0x7f5a00195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:58.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59fe87c700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a001952c0 0x7f5a000902f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f59f4001c60 tx=0x7f59f400a8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:58.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59e7fff700 1 -- 172.21.15.120:0/1924748465 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59f400acc0 con 0x7f5a001952c0 2021-04-09T18:19:58.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59e7fff700 1 -- 172.21.15.120:0/1924748465 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f4004140 con 0x7f5a001952c0 2021-04-09T18:19:58.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f59e7fff700 1 -- 172.21.15.120:0/1924748465 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59f4004620 con 0x7f5a001952c0 2021-04-09T18:19:58.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f5a05405700 1 -- 172.21.15.120:0/1924748465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a000b23d0 con 0x7f5a001952c0 2021-04-09T18:19:58.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.771 7f5a05405700 1 -- 172.21.15.120:0/1924748465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a000b23d0 con 0x7f5a001952c0 2021-04-09T18:19:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.772 7f59e7fff700 1 -- 172.21.15.120:0/1924748465 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f59f4007f30 con 0x7f5a001952c0 2021-04-09T18:19:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.772 7f59e7fff700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f59e0018930 0x7f59e001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:58.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.772 7f59e7fff700 1 -- 172.21.15.120:0/1924748465 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f59f4032b20 con 0x7f5a001952c0 2021-04-09T18:19:58.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.772 7f59ff07d700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f59e0018930 0x7f59e001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:58.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.772 7f59ff07d700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f59e0018930 0x7f59e001ae10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:58.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.794 7f5a05405700 1 -- 172.21.15.120:0/1924748465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0017f6c0 con 0x7f5a001952c0 2021-04-09T18:19:58.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.798 7f59e7fff700 1 -- 172.21.15.120:0/1924748465 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f59f40009b0 con 0x7f5a001952c0 2021-04-09T18:19:58.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.973 7f5a05405700 1 -- 172.21.15.120:0/1924748465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a0017f6c0 con 0x7f5a001952c0 2021-04-09T18:19:58.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.974 7f59e7fff700 1 -- 172.21.15.120:0/1924748465 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7f59f4007f30 con 0x7f5a001952c0 2021-04-09T18:19:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:19:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:19:58.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 -- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f59e0018930 msgr2=0x7f59e001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f59e0018930 0x7f59e001ae10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 -- 172.21.15.120:0/1924748465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a001952c0 msgr2=0x7f5a000902f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:58.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a001952c0 0x7f5a000902f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f59f4001c60 tx=0x7f59f400a8d0).stop 2021-04-09T18:19:58.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 -- 172.21.15.120:0/1924748465 shutdown_connections 2021-04-09T18:19:58.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f59e0018930 0x7f59e001ae10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a000b19b0 0x7f5a000b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a001952c0 0x7f5a000902f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 --2- 172.21.15.120:0/1924748465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a00191b80 0x7f5a00195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:58.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 -- 172.21.15.120:0/1924748465 >> 172.21.15.120:0/1924748465 conn(0x7f5a0018a9d0 msgr2=0x7f5a00198100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:58.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 -- 172.21.15.120:0/1924748465 shutdown_connections 2021-04-09T18:19:58.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:58.976 7f5a05405700 1 -- 172.21.15.120:0/1924748465 wait complete. 2021-04-09T18:19:58.986 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:19:47.013532', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:19:50.254363', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:19:52.685224', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:19:58.987 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:19:59.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e95bd7700 1 Processor -- start 2021-04-09T18:19:59.155 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e95bd7700 1 -- start start 2021-04-09T18:19:59.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e95bd7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900d7180 0x7f8e900e7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e95bd7700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8e900e70c0 0x7f8e900d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e95bd7700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e900d6c00 con 0x7f8e900d7580 2021-04-09T18:19:59.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e95bd7700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e900d8110 con 0x7f8e900e70c0 2021-04-09T18:19:59.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e95bd7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900e7f20 con 0x7f8e900d7180 2021-04-09T18:19:59.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e8ffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8e900e70c0 0x7f8e900d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e8effd700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f8e900d7580 0x7f8e900d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47498/0 (socket says 172.21.15.120:47498) 2021-04-09T18:19:59.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e8effd700 1 -- 172.21.15.120:0/466229777 learned_addr learned my addr 172.21.15.120:0/466229777 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:59.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.130 7f8e8f7fe700 1 --2- 172.21.15.120:0/466229777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900d7180 0x7f8e900e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e8ffff700 1 -- 172.21.15.120:0/466229777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900d7180 msgr2=0x7f8e900e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:59.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e8ffff700 1 --2- 172.21.15.120:0/466229777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900d7180 0x7f8e900e7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e8ffff700 1 -- 172.21.15.120:0/466229777 >> v1:172.21.15.120:6789/0 conn(0x7f8e900d7580 legacy=0x7f8e900d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e8ffff700 1 -- 172.21.15.120:0/466229777 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e901a2ae0 con 0x7f8e900e70c0 2021-04-09T18:19:59.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e8e7fc700 1 -- 172.21.15.120:0/466229777 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964735851 0 0) 0x7f8e780009b0 con 0x7f8e900d7580 2021-04-09T18:19:59.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e8ffff700 1 --2- 172.21.15.120:0/466229777 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900e70c0 0x7f8e900d5db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f8e80006e30 tx=0x7f8e80009de0).ready entity=mon.0 client_cookie=b90de45219dcc0b6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:59.164 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e8e7fc700 1 -- 172.21.15.120:0/466229777 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e8000b300 con 0x7f8e900e70c0 2021-04-09T18:19:59.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e8e7fc700 1 -- 172.21.15.120:0/466229777 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8000b680 con 0x7f8e900e70c0 2021-04-09T18:19:59.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e8e7fc700 1 -- 172.21.15.120:0/466229777 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e8000bb60 con 0x7f8e900e70c0 2021-04-09T18:19:59.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e95bd7700 1 -- 172.21.15.120:0/466229777 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900e70c0 msgr2=0x7f8e900d5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.131 7f8e95bd7700 1 --2- 172.21.15.120:0/466229777 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900e70c0 0x7f8e900d5db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f8e80006e30 tx=0x7f8e80009de0).stop 2021-04-09T18:19:59.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.132 7f8e95bd7700 1 -- 172.21.15.120:0/466229777 shutdown_connections 2021-04-09T18:19:59.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.132 7f8e95bd7700 1 --2- 172.21.15.120:0/466229777 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900e70c0 0x7f8e900d5db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.132 7f8e95bd7700 1 --2- 172.21.15.120:0/466229777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900d7180 0x7f8e900e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.132 7f8e95bd7700 1 -- 172.21.15.120:0/466229777 >> 172.21.15.120:0/466229777 conn(0x7f8e900d15b0 msgr2=0x7f8e900d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:59.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.132 7f8e95bd7700 1 -- 172.21.15.120:0/466229777 shutdown_connections 2021-04-09T18:19:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.132 7f8e95bd7700 1 -- 172.21.15.120:0/466229777 wait complete. 2021-04-09T18:19:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.151 7f8e95bd7700 1 Processor -- start 2021-04-09T18:19:59.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.151 7f8e95bd7700 1 -- start start 2021-04-09T18:19:59.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.151 7f8e95bd7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e901804d0 0x7f8e900e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.151 7f8e95bd7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900aad70 0x7f8e900ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.151 7f8e95bd7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900df0a0 0x7f8e900df4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.191 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.151 7f8e95bd7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900e13d0 con 0x7f8e900aad70 2021-04-09T18:19:59.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.151 7f8e95bd7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e901808d0 con 0x7f8e901804d0 2021-04-09T18:19:59.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.151 7f8e95bd7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900dfac0 con 0x7f8e900df0a0 2021-04-09T18:19:59.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900aad70 0x7f8e900ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900aad70 0x7f8e900ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52590/0 (socket says 172.21.15.120:52590) 2021-04-09T18:19:59.199 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8effd700 1 -- 172.21.15.120:0/142927055 learned_addr learned my addr 172.21.15.120:0/142927055 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:59.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8ffff700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900df0a0 0x7f8e900df4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8f7fe700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e901804d0 0x7f8e900e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8effd700 1 -- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900df0a0 msgr2=0x7f8e900df4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8effd700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900df0a0 0x7f8e900df4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8effd700 1 -- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e901804d0 msgr2=0x7f8e900e0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8effd700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e901804d0 0x7f8e900e0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8effd700 1 -- 172.21.15.120:0/142927055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e900dfce0 con 0x7f8e900aad70 2021-04-09T18:19:59.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8f7fe700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e901804d0 0x7f8e900e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:19:59.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8ffff700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900df0a0 0x7f8e900df4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:19:59.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e8effd700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900aad70 0x7f8e900ab170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f8e78001c60 tx=0x7f8e78007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:59.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e87fff700 1 -- 172.21.15.120:0/142927055 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e78004140 con 0x7f8e900aad70 2021-04-09T18:19:59.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e87fff700 1 -- 172.21.15.120:0/142927055 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e78004400 con 0x7f8e900aad70 2021-04-09T18:19:59.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e87fff700 1 -- 172.21.15.120:0/142927055 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e78004850 con 0x7f8e900aad70 2021-04-09T18:19:59.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e900dfce0 con 0x7f8e900aad70 2021-04-09T18:19:59.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.152 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e900dfce0 con 0x7f8e900aad70 2021-04-09T18:19:59.208 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.153 7f8e87fff700 1 -- 172.21.15.120:0/142927055 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8e78000dd0 con 0x7f8e900aad70 2021-04-09T18:19:59.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.153 7f8e87fff700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e74018930 0x7f8e7401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.153 7f8e87fff700 1 -- 172.21.15.120:0/142927055 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8e78034d60 con 0x7f8e900aad70 2021-04-09T18:19:59.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.153 7f8e8f7fe700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e74018930 0x7f8e7401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.153 7f8e8f7fe700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e74018930 0x7f8e7401ae10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:59.210 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.176 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e900d8e90 con 0x7f8e900aad70 2021-04-09T18:19:59.210 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.179 7f8e87fff700 1 -- 172.21.15.120:0/142927055 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8e780009b0 con 0x7f8e900aad70 2021-04-09T18:19:59.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.344 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f8e900d8e90 con 0x7f8e900aad70 2021-04-09T18:19:59.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.344 7f8e87fff700 1 -- 172.21.15.120:0/142927055 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8e78000dd0 con 0x7f8e900aad70 2021-04-09T18:19:59.344 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:19:59.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.346 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e74018930 msgr2=0x7f8e7401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.346 7f8e95bd7700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e74018930 0x7f8e7401ae10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.347 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.346 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900aad70 msgr2=0x7f8e900ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.347 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.346 7f8e95bd7700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900aad70 0x7f8e900ab170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f8e78001c60 tx=0x7f8e78007b00).stop 2021-04-09T18:19:59.347 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.347 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 shutdown_connections 2021-04-09T18:19:59.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.347 7f8e95bd7700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8e74018930 0x7f8e7401ae10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.347 7f8e95bd7700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e900df0a0 0x7f8e900df4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.347 7f8e95bd7700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e900aad70 0x7f8e900ab170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.349 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.347 7f8e95bd7700 1 --2- 172.21.15.120:0/142927055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e901804d0 0x7f8e900e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.349 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.347 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 >> 172.21.15.120:0/142927055 conn(0x7f8e900d9910 msgr2=0x7f8e90181580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:59.354 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.347 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 shutdown_connections 2021-04-09T18:19:59.354 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.347 7f8e95bd7700 1 -- 172.21.15.120:0/142927055 wait complete. 2021-04-09T18:19:59.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:19:59.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.499 7fd0a6e19700 1 Processor -- start 2021-04-09T18:19:59.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.499 7fd0a6e19700 1 -- start start 2021-04-09T18:19:59.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a6e19700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a00d7580 0x7fd0a00d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a6e19700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0a00d63d0 0x7fd0a01ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a6e19700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a00d7980 con 0x7fd0a00d7180 2021-04-09T18:19:59.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a6e19700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00d6c00 con 0x7fd0a00d63d0 2021-04-09T18:19:59.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a6e19700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01a2ae0 con 0x7fd0a00d7580 2021-04-09T18:19:59.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a5436700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0a00d63d0 0x7fd0a01ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd09ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a00d7580 0x7fd0a00d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a4c35700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd0a00d7180 0x7fd0a00d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42324/0 (socket says 172.21.15.120:42324) 2021-04-09T18:19:59.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a4c35700 1 -- 172.21.15.120:0/258799998 learned_addr learned my addr 172.21.15.120:0/258799998 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:19:59.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd09ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a00d7580 0x7fd0a00d5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:39260/0 (socket says 172.21.15.120:39260) 2021-04-09T18:19:59.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a5436700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0a00d63d0 0x7fd0a01ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:41432/0 (socket says 172.21.15.120:41432) 2021-04-09T18:19:59.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd09ffff700 1 -- 172.21.15.120:0/258799998 >> v2:172.21.15.134:3300/0 conn(0x7fd0a00d63d0 msgr2=0x7fd0a01ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:59.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd09ffff700 1 --2- 172.21.15.120:0/258799998 >> v2:172.21.15.134:3300/0 conn(0x7fd0a00d63d0 0x7fd0a01ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd09ffff700 1 -- 172.21.15.120:0/258799998 >> v1:172.21.15.134:6789/0 conn(0x7fd0a00d7180 legacy=0x7fd0a00d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd09ffff700 1 -- 172.21.15.120:0/258799998 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00d67d0 con 0x7fd0a00d7580 2021-04-09T18:19:59.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd09f7fe700 1 -- 172.21.15.120:0/258799998 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296464875 0 0) 0x7fd0880010c0 con 0x7fd0a00d7180 2021-04-09T18:19:59.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd0a5436700 1 --2- 172.21.15.120:0/258799998 >> v2:172.21.15.134:3300/0 conn(0x7fd0a00d63d0 0x7fd0a01ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:59.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd09ffff700 1 --2- 172.21.15.120:0/258799998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a00d7580 0x7fd0a00d5db0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd090006650 tx=0x7fd090009a80).ready entity=mon.2 client_cookie=97a1f99eb790ec0b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:59.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.500 7fd09f7fe700 1 -- 172.21.15.120:0/258799998 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0900009b0 con 0x7fd0a00d7580 2021-04-09T18:19:59.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd09f7fe700 1 -- 172.21.15.120:0/258799998 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09000c0c0 con 0x7fd0a00d7580 2021-04-09T18:19:59.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd09f7fe700 1 -- 172.21.15.120:0/258799998 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd09000c510 con 0x7fd0a00d7580 2021-04-09T18:19:59.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd0a6e19700 1 -- 172.21.15.120:0/258799998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a00d7580 msgr2=0x7fd0a00d5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd0a6e19700 1 --2- 172.21.15.120:0/258799998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a00d7580 0x7fd0a00d5db0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd090006650 tx=0x7fd090009a80).stop 2021-04-09T18:19:59.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd0a6e19700 1 -- 172.21.15.120:0/258799998 shutdown_connections 2021-04-09T18:19:59.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd0a6e19700 1 --2- 172.21.15.120:0/258799998 >> v2:172.21.15.134:3300/0 conn(0x7fd0a00d63d0 0x7fd0a01ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd0a6e19700 1 --2- 172.21.15.120:0/258799998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a00d7580 0x7fd0a00d5db0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd0a6e19700 1 -- 172.21.15.120:0/258799998 >> 172.21.15.120:0/258799998 conn(0x7fd0a00d15b0 msgr2=0x7fd0a00d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:59.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd0a6e19700 1 -- 172.21.15.120:0/258799998 shutdown_connections 2021-04-09T18:19:59.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.501 7fd0a6e19700 1 -- 172.21.15.120:0/258799998 wait complete. 2021-04-09T18:19:59.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.520 7fd0a6e19700 1 Processor -- start 2021-04-09T18:19:59.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.520 7fd0a6e19700 1 -- start start 2021-04-09T18:19:59.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a6e19700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a0189450 0x7fd0a00a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a6e19700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00a87f0 0x7fd0a01883f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a6e19700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a0188a10 0x7fd0a0096c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a6e19700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0195640 con 0x7fd0a0189450 2021-04-09T18:19:59.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a6e19700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0189850 con 0x7fd0a00a87f0 2021-04-09T18:19:59.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a6e19700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0189a70 con 0x7fd0a0188a10 2021-04-09T18:19:59.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a4c35700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a0189450 0x7fd0a00a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a4c35700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a0189450 0x7fd0a00a81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52600/0 (socket says 172.21.15.120:52600) 2021-04-09T18:19:59.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a4c35700 1 -- 172.21.15.120:0/2924128224 learned_addr learned my addr 172.21.15.120:0/2924128224 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:59.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a5436700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a0188a10 0x7fd0a0096c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd09ffff700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00a87f0 0x7fd0a01883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a5436700 1 -- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00a87f0 msgr2=0x7fd0a01883f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a5436700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00a87f0 0x7fd0a01883f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a5436700 1 -- 172.21.15.120:0/2924128224 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a0189450 msgr2=0x7fd0a00a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a5436700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a0189450 0x7fd0a00a81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a5436700 1 -- 172.21.15.120:0/2924128224 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00972a0 con 0x7fd0a0188a10 2021-04-09T18:19:59.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a4c35700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a0189450 0x7fd0a00a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:59.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd09ffff700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00a87f0 0x7fd0a01883f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:19:59.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a5436700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a0188a10 0x7fd0a0096c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd09800b8a0 tx=0x7fd09800bc40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:59.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd09d7fa700 1 -- 172.21.15.120:0/2924128224 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd098000f90 con 0x7fd0a0188a10 2021-04-09T18:19:59.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd09d7fa700 1 -- 172.21.15.120:0/2924128224 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0980067b0 con 0x7fd0a0188a10 2021-04-09T18:19:59.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a00972a0 con 0x7fd0a0188a10 2021-04-09T18:19:59.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.521 7fd09d7fa700 1 -- 172.21.15.120:0/2924128224 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0980013e0 con 0x7fd0a0188a10 2021-04-09T18:19:59.544 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.522 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a00972a0 con 0x7fd0a0188a10 2021-04-09T18:19:59.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.522 7fd09d7fa700 1 -- 172.21.15.120:0/2924128224 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd098000df0 con 0x7fd0a0188a10 2021-04-09T18:19:59.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.522 7fd09d7fa700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd084018930 0x7fd08401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.522 7fd09d7fa700 1 -- 172.21.15.120:0/2924128224 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fd098032e00 con 0x7fd0a0188a10 2021-04-09T18:19:59.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.522 7fd0a4c35700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd084018930 0x7fd08401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.523 7fd0a4c35700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd084018930 0x7fd08401ae10 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:59.547 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.545 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a0097e10 con 0x7fd0a0188a10 2021-04-09T18:19:59.547 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.549 7fd09d7fa700 1 -- 172.21.15.120:0/2924128224 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd09800bd80 con 0x7fd0a0188a10 2021-04-09T18:19:59.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.716 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd0a0097e10 con 0x7fd0a0188a10 2021-04-09T18:19:59.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.717 7fd09d7fa700 1 -- 172.21.15.120:0/2924128224 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd098000df0 con 0x7fd0a0188a10 2021-04-09T18:19:59.716 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:19:59.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd084018930 msgr2=0x7fd08401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd084018930 0x7fd08401ae10 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a0188a10 msgr2=0x7fd0a0096c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a0188a10 0x7fd0a0096c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd09800b8a0 tx=0x7fd09800bc40).stop 2021-04-09T18:19:59.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 shutdown_connections 2021-04-09T18:19:59.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd084018930 0x7fd08401ae10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0a0188a10 0x7fd0a0096c80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0a00a87f0 0x7fd0a01883f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 --2- 172.21.15.120:0/2924128224 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a0189450 0x7fd0a00a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.719 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 >> 172.21.15.120:0/2924128224 conn(0x7fd0a00e4b30 msgr2=0x7fd0a017bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:59.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.720 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 shutdown_connections 2021-04-09T18:19:59.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.720 7fd0a6e19700 1 -- 172.21.15.120:0/2924128224 wait complete. 2021-04-09T18:19:59.728 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:19:59.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.872 7f5ff4750700 1 Processor -- start 2021-04-09T18:19:59.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.872 7f5ff4750700 1 -- start start 2021-04-09T18:19:59.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.872 7f5ff4750700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5fec0d7580 0x7f5fec0d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.872 7f5ff4750700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5fec0d63d0 0x7f5fec1ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.872 7f5ff4750700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec0d7980 con 0x7f5fec0d7180 2021-04-09T18:19:59.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.872 7f5ff4750700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec0d8110 con 0x7f5fec0d7580 2021-04-09T18:19:59.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.872 7f5ff4750700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec0d6c00 con 0x7f5fec0d63d0 2021-04-09T18:19:59.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff1d6b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5fec0d7580 0x7f5fec0d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff1d6b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5fec0d7580 0x7f5fec0d5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52612/0 (socket says 172.21.15.120:52612) 2021-04-09T18:19:59.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff1d6b700 1 -- 172.21.15.120:0/1535922265 learned_addr learned my addr 172.21.15.120:0/1535922265 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:59.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff2d6d700 1 --2- 172.21.15.120:0/1535922265 >> v2:172.21.15.134:3300/0 conn(0x7f5fec0d63d0 0x7f5fec1ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff1d6b700 1 -- 172.21.15.120:0/1535922265 >> v2:172.21.15.134:3300/0 conn(0x7f5fec0d63d0 msgr2=0x7f5fec1ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:19:59.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff1d6b700 1 --2- 172.21.15.120:0/1535922265 >> v2:172.21.15.134:3300/0 conn(0x7f5fec0d63d0 0x7f5fec1ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff1d6b700 1 -- 172.21.15.120:0/1535922265 >> v1:172.21.15.134:6789/0 conn(0x7f5fec0d7180 legacy=0x7f5fec0d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff1d6b700 1 -- 172.21.15.120:0/1535922265 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec1a2ae0 con 0x7f5fec0d7580 2021-04-09T18:19:59.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff1d6b700 1 --2- 172.21.15.120:0/1535922265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0d7580 0x7f5fec0d5db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5fdc006700 tx=0x7f5fdc009b80).ready entity=mon.0 client_cookie=4002ec6a7fd3dce5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:59.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff156a700 1 -- 172.21.15.120:0/1535922265 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fdc00c0c0 con 0x7f5fec0d7580 2021-04-09T18:19:59.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff156a700 1 -- 172.21.15.120:0/1535922265 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc00c440 con 0x7f5fec0d7580 2021-04-09T18:19:59.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff156a700 1 -- 172.21.15.120:0/1535922265 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fdc00c920 con 0x7f5fec0d7580 2021-04-09T18:19:59.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff4750700 1 -- 172.21.15.120:0/1535922265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0d7580 msgr2=0x7f5fec0d5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.873 7f5ff4750700 1 --2- 172.21.15.120:0/1535922265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0d7580 0x7f5fec0d5db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5fdc006700 tx=0x7f5fdc009b80).stop 2021-04-09T18:19:59.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.874 7f5ff4750700 1 -- 172.21.15.120:0/1535922265 shutdown_connections 2021-04-09T18:19:59.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.874 7f5ff4750700 1 --2- 172.21.15.120:0/1535922265 >> v2:172.21.15.134:3300/0 conn(0x7f5fec0d63d0 0x7f5fec1ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.874 7f5ff4750700 1 --2- 172.21.15.120:0/1535922265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0d7580 0x7f5fec0d5db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.874 7f5ff4750700 1 -- 172.21.15.120:0/1535922265 >> 172.21.15.120:0/1535922265 conn(0x7f5fec0d15b0 msgr2=0x7f5fec0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:19:59.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.874 7f5ff4750700 1 -- 172.21.15.120:0/1535922265 shutdown_connections 2021-04-09T18:19:59.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.874 7f5ff4750700 1 -- 172.21.15.120:0/1535922265 wait complete. 2021-04-09T18:19:59.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff4750700 1 Processor -- start 2021-04-09T18:19:59.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff4750700 1 -- start start 2021-04-09T18:19:59.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff4750700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec182800 0x7f5fec099590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff4750700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0b3d30 0x7f5fec0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff4750700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5fec0b4750 0x7f5fec09cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff4750700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b4b50 con 0x7f5fec0b3d30 2021-04-09T18:19:59.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff4750700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec099bb0 con 0x7f5fec182800 2021-04-09T18:19:59.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff4750700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec182e70 con 0x7f5fec0b4750 2021-04-09T18:19:59.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff1d6b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0b3d30 0x7f5fec0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff1d6b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0b3d30 0x7f5fec0b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52616/0 (socket says 172.21.15.120:52616) 2021-04-09T18:19:59.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff1d6b700 1 -- 172.21.15.120:0/2737013076 learned_addr learned my addr 172.21.15.120:0/2737013076 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:19:59.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff2d6d700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5fec0b4750 0x7f5fec09cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.893 7f5ff256c700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec182800 0x7f5fec099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5ff1d6b700 1 -- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5fec0b4750 msgr2=0x7f5fec09cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5ff1d6b700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5fec0b4750 0x7f5fec09cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.906 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5ff1d6b700 1 -- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec182800 msgr2=0x7f5fec099590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:19:59.906 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5ff1d6b700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec182800 0x7f5fec099590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:19:59.906 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5ff1d6b700 1 -- 172.21.15.120:0/2737013076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec09d410 con 0x7f5fec0b3d30 2021-04-09T18:19:59.906 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5ff1d6b700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0b3d30 0x7f5fec0b4130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5fdc00b650 tx=0x7f5fdc00b9f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:59.907 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5fe2ffd700 1 -- 172.21.15.120:0/2737013076 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fdc00bde0 con 0x7f5fec0b3d30 2021-04-09T18:19:59.907 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5fe2ffd700 1 -- 172.21.15.120:0/2737013076 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc000c90 con 0x7f5fec0b3d30 2021-04-09T18:19:59.907 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5fe2ffd700 1 -- 172.21.15.120:0/2737013076 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fdc002220 con 0x7f5fec0b3d30 2021-04-09T18:19:59.907 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec09d410 con 0x7f5fec0b3d30 2021-04-09T18:19:59.907 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.894 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec09d410 con 0x7f5fec0b3d30 2021-04-09T18:19:59.908 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.895 7f5fe2ffd700 1 -- 172.21.15.120:0/2737013076 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5fdc009f90 con 0x7f5fec0b3d30 2021-04-09T18:19:59.908 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.895 7f5fe2ffd700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5fd4018930 0x7f5fd401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:19:59.908 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.895 7f5fe2ffd700 1 -- 172.21.15.120:0/2737013076 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5fdc032b30 con 0x7f5fec0b3d30 2021-04-09T18:19:59.908 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.895 7f5ff256c700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5fd4018930 0x7f5fd401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:19:59.909 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.895 7f5ff256c700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5fd4018930 0x7f5fd401ae10 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:19:59.917 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.919 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec099060 con 0x7f5fec0b3d30 2021-04-09T18:19:59.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:19:59.922 7f5fe2ffd700 1 -- 172.21.15.120:0/2737013076 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5fdc0091e0 con 0x7f5fec0b3d30 2021-04-09T18:19:59.996 INFO:tasks.ceph.mon.a.smithi120.stderr:2021-04-09 18:19:59.998 7fcc06764700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds 2021-04-09T18:20:00.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.088 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f5fec099060 con 0x7f5fec0b3d30 2021-04-09T18:20:00.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.088 7f5fe2ffd700 1 -- 172.21.15.120:0/2737013076 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5fdc00bde0 con 0x7f5fec0b3d30 2021-04-09T18:20:00.092 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:00.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5fd4018930 msgr2=0x7f5fd401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:00.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5fd4018930 0x7f5fd401ae10 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0b3d30 msgr2=0x7f5fec0b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:00.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0b3d30 0x7f5fec0b4130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5fdc00b650 tx=0x7f5fdc00b9f0).stop 2021-04-09T18:20:00.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 shutdown_connections 2021-04-09T18:20:00.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5fd4018930 0x7f5fd401ae10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5fec0b4750 0x7f5fec09cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5fec0b3d30 0x7f5fec0b4130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 --2- 172.21.15.120:0/2737013076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec182800 0x7f5fec099590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 >> 172.21.15.120:0/2737013076 conn(0x7f5fec1822c0 msgr2=0x7f5fec09df50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:00.099 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 shutdown_connections 2021-04-09T18:20:00.099 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.091 7f5ff4750700 1 -- 172.21.15.120:0/2737013076 wait complete. 2021-04-09T18:20:00.101 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-04-09T18:20:00.102 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-04-09T18:20:00.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-04-09T18:20:00.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.253 7fc46b15b700 1 Processor -- start 2021-04-09T18:20:00.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.253 7fc46b15b700 1 -- start start 2021-04-09T18:20:00.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc46b15b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc4640d7160 0x7fc4640d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:00.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc46b15b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4640d6190 0x7fc4640d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:00.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc46b15b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640d6be0 con 0x7fc4640d55a0 2021-04-09T18:20:00.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc46b15b700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640d80f0 con 0x7fc4640d7160 2021-04-09T18:20:00.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc46b15b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4641a2ac0 con 0x7fc4640d6190 2021-04-09T18:20:00.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc468f77700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc4640d7160 0x7fc4640d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:00.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc468f77700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc4640d7160 0x7fc4640d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52622/0 (socket says 172.21.15.120:52622) 2021-04-09T18:20:00.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc468f77700 1 -- 172.21.15.120:0/3336445621 learned_addr learned my addr 172.21.15.120:0/3336445621 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:00.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc469778700 1 --2- 172.21.15.120:0/3336445621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4640d6190 0x7fc4640d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:00.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc468f77700 1 -- 172.21.15.120:0/3336445621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4640d6190 msgr2=0x7fc4640d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:00.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc468f77700 1 --2- 172.21.15.120:0/3336445621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4640d6190 0x7fc4640d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc468f77700 1 -- 172.21.15.120:0/3336445621 >> v1:172.21.15.134:6789/0 conn(0x7fc4640d55a0 legacy=0x7fc4640d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:00.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc468f77700 1 -- 172.21.15.120:0/3336445621 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4641a2cb0 con 0x7fc4640d7160 2021-04-09T18:20:00.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.254 7fc468f77700 1 --2- 172.21.15.120:0/3336445621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640d7160 0x7fc4640d7560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc44c006700 tx=0x7fc44c009b00).ready entity=mon.0 client_cookie=dbc8062762fb6fd9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:00.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc4637fe700 1 -- 172.21.15.120:0/3336445621 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc44c00c0c0 con 0x7fc4640d7160 2021-04-09T18:20:00.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc4637fe700 1 -- 172.21.15.120:0/3336445621 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c00c400 con 0x7fc4640d7160 2021-04-09T18:20:00.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc4637fe700 1 -- 172.21.15.120:0/3336445621 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc44c00c8e0 con 0x7fc4640d7160 2021-04-09T18:20:00.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc46b15b700 1 -- 172.21.15.120:0/3336445621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640d7160 msgr2=0x7fc4640d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:00.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc46b15b700 1 --2- 172.21.15.120:0/3336445621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640d7160 0x7fc4640d7560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc44c006700 tx=0x7fc44c009b00).stop 2021-04-09T18:20:00.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc46b15b700 1 -- 172.21.15.120:0/3336445621 shutdown_connections 2021-04-09T18:20:00.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc46b15b700 1 --2- 172.21.15.120:0/3336445621 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4640d6190 0x7fc4640d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.283 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc46b15b700 1 --2- 172.21.15.120:0/3336445621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640d7160 0x7fc4640d7560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.283 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc46b15b700 1 -- 172.21.15.120:0/3336445621 >> 172.21.15.120:0/3336445621 conn(0x7fc4640d1590 msgr2=0x7fc4640d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:00.283 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc46b15b700 1 -- 172.21.15.120:0/3336445621 shutdown_connections 2021-04-09T18:20:00.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.255 7fc46b15b700 1 -- 172.21.15.120:0/3336445621 wait complete. 2021-04-09T18:20:00.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.274 7fc46b15b700 1 Processor -- start 2021-04-09T18:20:00.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.274 7fc46b15b700 1 -- start start 2021-04-09T18:20:00.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc46b15b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc464187670 0x7fc4640a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:00.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc46b15b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4640a5050 0x7fc4640b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:00.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc46b15b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640b5710 0x7fc4641838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:00.311 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc46b15b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640b5b10 con 0x7fc4640b5710 2021-04-09T18:20:00.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc46b15b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640b5d30 con 0x7fc4640a5050 2021-04-09T18:20:00.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc46b15b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640b5f50 con 0x7fc464187670 2021-04-09T18:20:00.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc469778700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640b5710 0x7fc4641838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:00.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc469778700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640b5710 0x7fc4641838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52628/0 (socket says 172.21.15.120:52628) 2021-04-09T18:20:00.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc469778700 1 -- 172.21.15.120:0/29982031 learned_addr learned my addr 172.21.15.120:0/29982031 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:00.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc468f77700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc464187670 0x7fc4640a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:00.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc463fff700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4640a5050 0x7fc4640b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:00.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc469778700 1 -- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc464187670 msgr2=0x7fc4640a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:00.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc469778700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc464187670 0x7fc4640a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc469778700 1 -- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4640a5050 msgr2=0x7fc4640b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:00.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc469778700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4640a5050 0x7fc4640b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc469778700 1 -- 172.21.15.120:0/29982031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc464183ef0 con 0x7fc4640b5710 2021-04-09T18:20:00.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc469778700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640b5710 0x7fc4641838d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fc45c006c60 tx=0x7fc45c00b960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:00.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc4617fa700 1 -- 172.21.15.120:0/29982031 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc45c00bd50 con 0x7fc4640b5710 2021-04-09T18:20:00.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc4617fa700 1 -- 172.21.15.120:0/29982031 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c006800 con 0x7fc4640b5710 2021-04-09T18:20:00.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc46b15b700 1 -- 172.21.15.120:0/29982031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc464183ef0 con 0x7fc4640b5710 2021-04-09T18:20:00.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc4617fa700 1 -- 172.21.15.120:0/29982031 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc45c002220 con 0x7fc4640b5710 2021-04-09T18:20:00.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.275 7fc46b15b700 1 -- 172.21.15.120:0/29982031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc464183ef0 con 0x7fc4640b5710 2021-04-09T18:20:00.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.276 7fc4617fa700 1 -- 172.21.15.120:0/29982031 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc45c005330 con 0x7fc4640b5710 2021-04-09T18:20:00.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.276 7fc4617fa700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc448018930 0x7fc44801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:00.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.276 7fc4617fa700 1 -- 172.21.15.120:0/29982031 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fc45c032b60 con 0x7fc4640b5710 2021-04-09T18:20:00.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.276 7fc468f77700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc448018930 0x7fc44801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:00.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.277 7fc468f77700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc448018930 0x7fc44801ae10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:00.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.300 7fc46b15b700 1 -- 172.21.15.120:0/29982031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4641829e0 con 0x7fc4640b5710 2021-04-09T18:20:00.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.303 7fc4617fa700 1 -- 172.21.15.120:0/29982031 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc45c000bc0 con 0x7fc4640b5710 2021-04-09T18:20:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.521 7fc46b15b700 1 -- 172.21.15.120:0/29982031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc4641829e0 con 0x7fc4640b5710 2021-04-09T18:20:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.523 7fc4617fa700 1 -- 172.21.15.120:0/29982031 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+70607 (secure 0 0 0) 0x7fc45c006800 con 0x7fc4640b5710 2021-04-09T18:20:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:00.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.526 7fc46b15b700 1 -- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc448018930 msgr2=0x7fc44801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:00.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.526 7fc46b15b700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc448018930 0x7fc44801ae10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.526 7fc46b15b700 1 -- 172.21.15.120:0/29982031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640b5710 msgr2=0x7fc4641838d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:00.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.526 7fc46b15b700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640b5710 0x7fc4641838d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fc45c006c60 tx=0x7fc45c00b960).stop 2021-04-09T18:20:00.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.527 7fc46b15b700 1 -- 172.21.15.120:0/29982031 shutdown_connections 2021-04-09T18:20:00.547 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.527 7fc46b15b700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4640b5710 0x7fc4641838d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.547 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.527 7fc46b15b700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4640a5050 0x7fc4640b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.527 7fc46b15b700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc448018930 0x7fc44801ae10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.527 7fc46b15b700 1 --2- 172.21.15.120:0/29982031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc464187670 0x7fc4640a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:00.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.527 7fc46b15b700 1 -- 172.21.15.120:0/29982031 >> 172.21.15.120:0/29982031 conn(0x7fc46418dc90 msgr2=0x7fc46408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:00.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.527 7fc46b15b700 1 -- 172.21.15.120:0/29982031 shutdown_connections 2021-04-09T18:20:00.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:00.527 7fc46b15b700 1 -- 172.21.15.120:0/29982031 wait complete. 2021-04-09T18:20:00.551 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":3,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":23529},{"type":"v1","addr":"172.21.15.134:6801","nonce":23529}]},"active_addr":"172.21.15.134:6801/23529","active_change":"2021-04-09 18:19:32.736784","available":true,"standbys":[{"gid":4104,"name":"y","available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2021-04-09T18:20:00.556 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-04-09T18:20:01.369 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-04-09T18:20:01.541 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.501 7f8c30e2a700 1 Processor -- start 2021-04-09T18:20:01.543 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.501 7f8c30e2a700 1 -- start start 2021-04-09T18:20:01.543 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.501 7f8c30e2a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0dc6b0 0x7f8c2c0d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.543 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.501 7f8c30e2a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8c2c0d6760 0x7f8c2c0d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.544 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.501 7f8c30e2a700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0d61e0 con 0x7f8c2c0eac40 2021-04-09T18:20:01.544 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.501 7f8c30e2a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c100d60 con 0x7f8c2c0d6760 2021-04-09T18:20:01.545 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.501 7f8c30e2a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0eaa10 con 0x7f8c2c0dc6b0 2021-04-09T18:20:01.545 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.501 7f8c2ab13700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f8c2c0eac40 0x7f8c2c088030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47552/0 (socket says 172.21.15.120:47552) 2021-04-09T18:20:01.546 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.501 7f8c2ab13700 1 -- 172.21.15.120:0/3014332441 learned_addr learned my addr 172.21.15.120:0/3014332441 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:01.546 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2a312700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0dc6b0 0x7f8c2c0d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.546 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2b314700 1 --2- 172.21.15.120:0/3014332441 >> v2:172.21.15.134:3300/0 conn(0x7f8c2c0d6760 0x7f8c2c0d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.547 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100919576 0 0) 0x7f8c1c000ce0 con 0x7f8c2c0eac40 2021-04-09T18:20:01.547 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c14002fe0 con 0x7f8c2c0eac40 2021-04-09T18:20:01.548 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2007934068 0 0) 0x7f8c1c0010e0 con 0x7f8c2c0eac40 2021-04-09T18:20:01.548 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0dc6b0 msgr2=0x7f8c2c0d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:01.549 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0dc6b0 0x7f8c2c0d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.549 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 >> v2:172.21.15.134:3300/0 conn(0x7f8c2c0d6760 msgr2=0x7f8c2c0d6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:01.550 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 --2- 172.21.15.120:0/3014332441 >> v2:172.21.15.134:3300/0 conn(0x7f8c2c0d6760 0x7f8c2c0d6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.550 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0dcab0 con 0x7f8c2c0eac40 2021-04-09T18:20:01.550 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2a312700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0dc6b0 0x7f8c2c0d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:01.551 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f8c1c001600 con 0x7f8c2c0eac40 2021-04-09T18:20:01.551 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2ab13700 1 -- 172.21.15.120:0/3014332441 >> v1:172.21.15.120:6789/0 conn(0x7f8c2c0eac40 legacy=0x7f8c2c088030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2021-04-09T18:20:01.552 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2ab13700 1 -- 172.21.15.120:0/3014332441 >> v1:172.21.15.120:6789/0 conn(0x7f8c2c0eac40 legacy=0x7f8c2c088030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:20:01.553 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2ab13700 1 --1- 172.21.15.120:0/3014332441 >> v1:172.21.15.120:6789/0 conn(0x7f8c2c0eac40 0x7f8c2c088030 :-1 s=OPENED pgs=86 cs=1 l=1).handle_message read tag failed 2021-04-09T18:20:01.553 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2ab13700 1 --1- 172.21.15.120:0/3014332441 >> v1:172.21.15.120:6789/0 conn(0x7f8c2c0eac40 0x7f8c2c088030 :-1 s=OPENED pgs=86 cs=1 l=1).fault on lossy channel, failing 2021-04-09T18:20:01.554 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 >> v1:172.21.15.120:6789/0 conn(0x7f8c2c0eac40 legacy=0x7f8c2c088030 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-04-09T18:20:01.554 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c140479f0 0x7f8c14049ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.555 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c1404a740 0x7f8c1404cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.555 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1404d4d0 0x7f8c1404f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.555 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140502a0 con 0x7f8c140479f0 2021-04-09T18:20:01.556 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140504c0 con 0x7f8c1404d4d0 2021-04-09T18:20:01.556 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140506e0 con 0x7f8c1404a740 2021-04-09T18:20:01.556 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2ab13700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c140479f0 0x7f8c14049ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.557 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2a312700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c1404a740 0x7f8c1404cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.557 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2b314700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1404d4d0 0x7f8c1404f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.557 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2ab13700 1 -- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c1404a740 msgr2=0x7f8c1404cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:01.558 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2ab13700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c1404a740 0x7f8c1404cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.558 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2ab13700 1 -- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1404d4d0 msgr2=0x7f8c1404f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:01.558 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.502 7f8c2ab13700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1404d4d0 0x7f8c1404f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.559 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.503 7f8c2ab13700 1 -- 172.21.15.120:0/3014332441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14050980 con 0x7f8c140479f0 2021-04-09T18:20:01.559 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.503 7f8c2ab13700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c140479f0 0x7f8c14049ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8c1c001900 tx=0x7f8c1c007d40).ready entity=mon.0 client_cookie=3b2a60fe49e3050e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:01.560 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.503 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c1c0010e0 con 0x7f8c140479f0 2021-04-09T18:20:01.561 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.503 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c0070c0 con 0x7f8c140479f0 2021-04-09T18:20:01.561 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.503 7f8c29b11700 1 -- 172.21.15.120:0/3014332441 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c1c00a7a0 con 0x7f8c140479f0 2021-04-09T18:20:01.561 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.503 7f8c30e2a700 1 -- 172.21.15.120:0/3014332441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c140479f0 msgr2=0x7f8c14049ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:01.562 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.503 7f8c30e2a700 1 --2- 172.21.15.120:0/3014332441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c140479f0 0x7f8c14049ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8c1c001900 tx=0x7f8c1c007d40).stop 2021-04-09T18:20:01.563 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.503 7f8c2b314700 1 -- 172.21.15.120:0/3014332441 reap_dead start 2021-04-09T18:20:01.564 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.504 7f8c30e2a700 1 -- 172.21.15.120:0/3014332441 shutdown_connections 2021-04-09T18:20:01.564 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.504 7f8c30e2a700 1 -- 172.21.15.120:0/3014332441 >> 172.21.15.120:0/3014332441 conn(0x7f8c2c0e93c0 msgr2=0x7f8c2c100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:01.564 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.504 7f8c30e2a700 1 -- 172.21.15.120:0/3014332441 shutdown_connections 2021-04-09T18:20:01.565 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.504 7f8c30e2a700 1 -- 172.21.15.120:0/3014332441 wait complete. 2021-04-09T18:20:01.565 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.522 7f8c30e2a700 1 Processor -- start 2021-04-09T18:20:01.565 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.522 7f8c30e2a700 1 -- start start 2021-04-09T18:20:01.566 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c30e2a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c2c0c43d0 0x7f8c2c0bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.566 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c30e2a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0bd3b0 0x7f8c2c191b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.567 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c30e2a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c2c0bd7b0 0x7f8c2c1921b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.567 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c30e2a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0bceb0 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.581 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c30e2a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c08c5b0 con 0x7f8c2c0c43d0 2021-04-09T18:20:01.582 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c30e2a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c3fc0 con 0x7f8c2c0bd3b0 2021-04-09T18:20:01.582 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2b314700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c2c0bd7b0 0x7f8c2c1921b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.582 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2b314700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c2c0bd7b0 0x7f8c2c1921b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52656/0 (socket says 172.21.15.120:52656) 2021-04-09T18:20:01.583 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2b314700 1 -- 172.21.15.120:0/1564855797 learned_addr learned my addr 172.21.15.120:0/1564855797 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:01.583 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2a312700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0bd3b0 0x7f8c2c191b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.583 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2ab13700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c2c0c43d0 0x7f8c2c0bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.583 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2b314700 1 -- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0bd3b0 msgr2=0x7f8c2c191b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:01.583 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2b314700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0bd3b0 0x7f8c2c191b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.584 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2b314700 1 -- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c2c0c43d0 msgr2=0x7f8c2c0bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:01.584 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2b314700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c2c0c43d0 0x7f8c2c0bc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.584 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2b314700 1 -- 172.21.15.120:0/1564855797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0bcb00 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.584 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c2b314700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c2c0bd7b0 0x7f8c2c1921b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f8c2400b8e0 tx=0x7f8c2400bc80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:01.585 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.523 7f8c1b7fe700 1 -- 172.21.15.120:0/1564855797 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c24000f60 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.585 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.524 7f8c1b7fe700 1 -- 172.21.15.120:0/1564855797 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2400c2f0 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.585 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.524 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c0bcb00 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.587 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.524 7f8c1b7fe700 1 -- 172.21.15.120:0/1564855797 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c2400c7d0 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.587 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.524 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0bcb00 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.587 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.524 7f8c1b7fe700 1 -- 172.21.15.120:0/1564855797 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8c24000df0 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.587 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.524 7f8c1b7fe700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 0x7f8c1001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.588 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.524 7f8c1b7fe700 1 -- 172.21.15.120:0/1564855797 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8c24032f20 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.588 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.525 7f8c2ab13700 1 -- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 msgr2=0x7f8c1001adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-04-09T18:20:01.588 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.525 7f8c2ab13700 1 -- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 msgr2=0x7f8c1001adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:20:01.589 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.525 7f8c2ab13700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 0x7f8c1001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2021-04-09T18:20:01.589 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.525 7f8c2ab13700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 0x7f8c1001adc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:20:01.590 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.547 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c192ac0 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.590 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.551 7f8c1b7fe700 1 -- 172.21.15.120:0/1564855797 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8c2400bdc0 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.729 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.726 7f8c2ab13700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 0x7f8c1001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.729 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.726 7f8c2ab13700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 0x7f8c1001adc0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:01.730 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.726 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c2c192ac0 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.730 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.727 7f8c1b7fe700 1 -- 172.21.15.120:0/1564855797 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7f8c24001ee0 con 0x7f8c2c0bd7b0 2021-04-09T18:20:01.734 INFO:teuthology.misc.health.smithi120.stdout: 2021-04-09T18:20:01.735 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:20:01.746 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.729 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 msgr2=0x7f8c1001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:01.747 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.729 7f8c30e2a700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 0x7f8c1001adc0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.747 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.729 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c2c0bd7b0 msgr2=0x7f8c2c1921b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:01.748 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.729 7f8c30e2a700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c2c0bd7b0 0x7f8c2c1921b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f8c2400b8e0 tx=0x7f8c2400bc80).stop 2021-04-09T18:20:01.753 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.730 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 shutdown_connections 2021-04-09T18:20:01.754 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.730 7f8c30e2a700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c2c0bd7b0 0x7f8c2c1921b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.755 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.730 7f8c30e2a700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8c10018930 0x7f8c1001adc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.755 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.730 7f8c30e2a700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c2c0bd3b0 0x7f8c2c191b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.756 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.730 7f8c30e2a700 1 --2- 172.21.15.120:0/1564855797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c2c0c43d0 0x7f8c2c0bc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.756 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.730 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 >> 172.21.15.120:0/1564855797 conn(0x7f8c2c0a61a0 msgr2=0x7f8c2c0b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:01.756 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.730 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 shutdown_connections 2021-04-09T18:20:01.757 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:01.730 7f8c30e2a700 1 -- 172.21.15.120:0/1564855797 wait complete. 2021-04-09T18:20:01.770 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-04-09T18:20:01.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:20:01.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18f0ac3700 1 Processor -- start 2021-04-09T18:20:01.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18f0ac3700 1 -- start start 2021-04-09T18:20:01.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18f0ac3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18ec0d7160 0x7f18ec0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18f0ac3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f18ec0d6190 0x7f18ec0d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18f0ac3700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ec0d6be0 con 0x7f18ec0d55a0 2021-04-09T18:20:01.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18f0ac3700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec0d80f0 con 0x7f18ec0d7160 2021-04-09T18:20:01.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18f0ac3700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec1a2ac0 con 0x7f18ec0d6190 2021-04-09T18:20:01.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18ea85e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18ec0d7160 0x7f18ec0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18ea85e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18ec0d7160 0x7f18ec0d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52670/0 (socket says 172.21.15.120:52670) 2021-04-09T18:20:01.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.919 7f18ea85e700 1 -- 172.21.15.120:0/3191476372 learned_addr learned my addr 172.21.15.120:0/3191476372 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:01.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18eb05f700 1 --2- 172.21.15.120:0/3191476372 >> v2:172.21.15.134:3300/0 conn(0x7f18ec0d6190 0x7f18ec0d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18ea85e700 1 -- 172.21.15.120:0/3191476372 >> v2:172.21.15.134:3300/0 conn(0x7f18ec0d6190 msgr2=0x7f18ec0d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:01.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18ea85e700 1 --2- 172.21.15.120:0/3191476372 >> v2:172.21.15.134:3300/0 conn(0x7f18ec0d6190 0x7f18ec0d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18ea85e700 1 -- 172.21.15.120:0/3191476372 >> v1:172.21.15.134:6789/0 conn(0x7f18ec0d55a0 legacy=0x7f18ec0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:01.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18ea85e700 1 -- 172.21.15.120:0/3191476372 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec1ac1f0 con 0x7f18ec0d7160 2021-04-09T18:20:01.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18ea85e700 1 --2- 172.21.15.120:0/3191476372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec0d7160 0x7f18ec0d7560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f18dc006a80 tx=0x7f18dc009f00).ready entity=mon.0 client_cookie=9ca34d0f57a5a132 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:01.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18e985c700 1 -- 172.21.15.120:0/3191476372 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18dc00b5c0 con 0x7f18ec0d7160 2021-04-09T18:20:01.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18e985c700 1 -- 172.21.15.120:0/3191476372 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc00b8c0 con 0x7f18ec0d7160 2021-04-09T18:20:01.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18e985c700 1 -- 172.21.15.120:0/3191476372 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18dc00bda0 con 0x7f18ec0d7160 2021-04-09T18:20:01.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18f0ac3700 1 -- 172.21.15.120:0/3191476372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec0d7160 msgr2=0x7f18ec0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:01.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.920 7f18f0ac3700 1 --2- 172.21.15.120:0/3191476372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec0d7160 0x7f18ec0d7560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f18dc006a80 tx=0x7f18dc009f00).stop 2021-04-09T18:20:01.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.921 7f18f0ac3700 1 -- 172.21.15.120:0/3191476372 shutdown_connections 2021-04-09T18:20:01.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.921 7f18f0ac3700 1 --2- 172.21.15.120:0/3191476372 >> v2:172.21.15.134:3300/0 conn(0x7f18ec0d6190 0x7f18ec0d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.921 7f18f0ac3700 1 --2- 172.21.15.120:0/3191476372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec0d7160 0x7f18ec0d7560 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.921 7f18f0ac3700 1 -- 172.21.15.120:0/3191476372 >> 172.21.15.120:0/3191476372 conn(0x7f18ec0d1590 msgr2=0x7f18ec0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:01.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.921 7f18f0ac3700 1 -- 172.21.15.120:0/3191476372 shutdown_connections 2021-04-09T18:20:01.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.921 7f18f0ac3700 1 -- 172.21.15.120:0/3191476372 wait complete. 2021-04-09T18:20:01.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.940 7f18f0ac3700 1 Processor -- start 2021-04-09T18:20:01.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.940 7f18f0ac3700 1 -- start start 2021-04-09T18:20:01.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18f0ac3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec1986d0 0x7f18ec094570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18f0ac3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18ec0a86c0 0x7f18ec0a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18f0ac3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18ec19ada0 0x7f18ec19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18f0ac3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec19b7c0 con 0x7f18ec1986d0 2021-04-09T18:20:01.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18f0ac3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec094b90 con 0x7f18ec19ada0 2021-04-09T18:20:01.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18f0ac3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec093c40 con 0x7f18ec0a86c0 2021-04-09T18:20:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec1986d0 0x7f18ec094570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec1986d0 0x7f18ec094570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52676/0 (socket says 172.21.15.120:52676) 2021-04-09T18:20:01.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea85e700 1 -- 172.21.15.120:0/2115580498 learned_addr learned my addr 172.21.15.120:0/2115580498 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:01.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18eb05f700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18ec19ada0 0x7f18ec19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea05d700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18ec0a86c0 0x7f18ec0a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea85e700 1 -- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18ec0a86c0 msgr2=0x7f18ec0a8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:01.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea85e700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18ec0a86c0 0x7f18ec0a8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea85e700 1 -- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18ec19ada0 msgr2=0x7f18ec19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea85e700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18ec19ada0 0x7f18ec19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:01.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea85e700 1 -- 172.21.15.120:0/2115580498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec17b1f0 con 0x7f18ec1986d0 2021-04-09T18:20:01.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18ea85e700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec1986d0 0x7f18ec094570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f18dc00b910 tx=0x7f18dc00bcb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.941 7f18db7fe700 1 -- 172.21.15.120:0/2115580498 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18dc00c2f0 con 0x7f18ec1986d0 2021-04-09T18:20:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.942 7f18db7fe700 1 -- 172.21.15.120:0/2115580498 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc00c630 con 0x7f18ec1986d0 2021-04-09T18:20:01.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.942 7f18db7fe700 1 -- 172.21.15.120:0/2115580498 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18dc00cb10 con 0x7f18ec1986d0 2021-04-09T18:20:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.942 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec17b1f0 con 0x7f18ec1986d0 2021-04-09T18:20:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.942 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec17b1f0 con 0x7f18ec1986d0 2021-04-09T18:20:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.942 7f18db7fe700 1 -- 172.21.15.120:0/2115580498 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f18dc005660 con 0x7f18ec1986d0 2021-04-09T18:20:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.943 7f18db7fe700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f18d0018930 0x7f18d001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.943 7f18db7fe700 1 -- 172.21.15.120:0/2115580498 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f18dc01fb40 con 0x7f18ec1986d0 2021-04-09T18:20:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.943 7f18ea05d700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f18d0018930 0x7f18d001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.943 7f18ea05d700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f18d0018930 0x7f18d001ae10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:01.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.965 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec19b7c0 con 0x7f18ec1986d0 2021-04-09T18:20:01.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:01.970 7f18db7fe700 1 -- 172.21.15.120:0/2115580498 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f18dc005660 con 0x7f18ec1986d0 2021-04-09T18:20:02.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.143 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18ec19b7c0 con 0x7f18ec1986d0 2021-04-09T18:20:02.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.144 7f18db7fe700 1 -- 172.21.15.120:0/2115580498 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7f18dc000d30 con 0x7f18ec1986d0 2021-04-09T18:20:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:20:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f18d0018930 msgr2=0x7f18d001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f18d0018930 0x7f18d001ae10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec1986d0 msgr2=0x7f18ec094570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec1986d0 0x7f18ec094570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f18dc00b910 tx=0x7f18dc00bcb0).stop 2021-04-09T18:20:02.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 shutdown_connections 2021-04-09T18:20:02.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18ec19ada0 0x7f18ec19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f18d0018930 0x7f18d001ae10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.152 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18ec0a86c0 0x7f18ec0a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.152 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 --2- 172.21.15.120:0/2115580498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18ec1986d0 0x7f18ec094570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 >> 172.21.15.120:0/2115580498 conn(0x7f18ec185590 msgr2=0x7f18ec19bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:02.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 shutdown_connections 2021-04-09T18:20:02.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.146 7f18f0ac3700 1 -- 172.21.15.120:0/2115580498 wait complete. 2021-04-09T18:20:02.159 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-04-09T18:20:02.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.335 7f76d82c7700 1 Processor -- start 2021-04-09T18:20:02.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.335 7f76d82c7700 1 -- start start 2021-04-09T18:20:02.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d82c7700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f76d00d7160 0x7f76d00d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d82c7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76d00d55a0 0x7f76d00d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d82c7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f76d00d5fc0 0x7f76d00d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d82c7700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d00e80a0 con 0x7f76d00d7160 2021-04-09T18:20:02.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d82c7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d00d80f0 con 0x7f76d00d5fc0 2021-04-09T18:20:02.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d82c7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00d6be0 con 0x7f76d00d55a0 2021-04-09T18:20:02.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d60e3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f76d00d7160 0x7f76d00d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d60e3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f76d00d7160 0x7f76d00d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52684/0 (socket says 172.21.15.120:52684) 2021-04-09T18:20:02.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d60e3700 1 -- 172.21.15.120:0/3913651514 learned_addr learned my addr 172.21.15.120:0/3913651514 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:02.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d58e2700 1 --2- 172.21.15.120:0/3913651514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76d00d55a0 0x7f76d00d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d68e4700 1 --2- 172.21.15.120:0/3913651514 >> v2:172.21.15.134:3300/0 conn(0x7f76d00d5fc0 0x7f76d00d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d60e3700 1 -- 172.21.15.120:0/3913651514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76d00d55a0 msgr2=0x7f76d00d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:02.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d60e3700 1 --2- 172.21.15.120:0/3913651514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76d00d55a0 0x7f76d00d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d60e3700 1 -- 172.21.15.120:0/3913651514 >> v2:172.21.15.134:3300/0 conn(0x7f76d00d5fc0 msgr2=0x7f76d00d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:02.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d60e3700 1 --2- 172.21.15.120:0/3913651514 >> v2:172.21.15.134:3300/0 conn(0x7f76d00d5fc0 0x7f76d00d63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d60e3700 1 -- 172.21.15.120:0/3913651514 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d01a2ac0 con 0x7f76d00d7160 2021-04-09T18:20:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d60e3700 1 --2- 172.21.15.120:0/3913651514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00d7160 0x7f76d00d7560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f76cc006a80 tx=0x7f76cc009e80).ready entity=mon.0 client_cookie=58f9c6b988e5bffc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.336 7f76d50e1700 1 -- 172.21.15.120:0/3913651514 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76cc00b510 con 0x7f76d00d7160 2021-04-09T18:20:02.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d50e1700 1 -- 172.21.15.120:0/3913651514 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc00b7d0 con 0x7f76d00d7160 2021-04-09T18:20:02.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d50e1700 1 -- 172.21.15.120:0/3913651514 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76cc00bcb0 con 0x7f76d00d7160 2021-04-09T18:20:02.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d82c7700 1 -- 172.21.15.120:0/3913651514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00d7160 msgr2=0x7f76d00d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d82c7700 1 --2- 172.21.15.120:0/3913651514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00d7160 0x7f76d00d7560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f76cc006a80 tx=0x7f76cc009e80).stop 2021-04-09T18:20:02.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d82c7700 1 -- 172.21.15.120:0/3913651514 shutdown_connections 2021-04-09T18:20:02.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d82c7700 1 --2- 172.21.15.120:0/3913651514 >> v2:172.21.15.134:3300/0 conn(0x7f76d00d5fc0 0x7f76d00d63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d82c7700 1 --2- 172.21.15.120:0/3913651514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76d00d55a0 0x7f76d00d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d82c7700 1 --2- 172.21.15.120:0/3913651514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00d7160 0x7f76d00d7560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d82c7700 1 -- 172.21.15.120:0/3913651514 >> 172.21.15.120:0/3913651514 conn(0x7f76d00d1590 msgr2=0x7f76d00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:02.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d82c7700 1 -- 172.21.15.120:0/3913651514 shutdown_connections 2021-04-09T18:20:02.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.337 7f76d82c7700 1 -- 172.21.15.120:0/3913651514 wait complete. 2021-04-09T18:20:02.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d82c7700 1 Processor -- start 2021-04-09T18:20:02.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d82c7700 1 -- start start 2021-04-09T18:20:02.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d82c7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d0099c20 0x7f76d00b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d82c7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00b4ad0 0x7f76d017ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d82c7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76d009a020 0x7f76d017d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d82c7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d009b7c0 con 0x7f76d00b4ad0 2021-04-09T18:20:02.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d82c7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d017db10 con 0x7f76d0099c20 2021-04-09T18:20:02.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d82c7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d017dd30 con 0x7f76d009a020 2021-04-09T18:20:02.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d58e2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00b4ad0 0x7f76d017ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d58e2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00b4ad0 0x7f76d017ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52692/0 (socket says 172.21.15.120:52692) 2021-04-09T18:20:02.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d58e2700 1 -- 172.21.15.120:0/4092700841 learned_addr learned my addr 172.21.15.120:0/4092700841 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:02.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d60e3700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d0099c20 0x7f76d00b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.357 7f76d68e4700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76d009a020 0x7f76d017d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76d58e2700 1 -- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76d009a020 msgr2=0x7f76d017d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76d58e2700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76d009a020 0x7f76d017d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76d58e2700 1 -- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d0099c20 msgr2=0x7f76d00b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76d58e2700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d0099c20 0x7f76d00b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76d58e2700 1 -- 172.21.15.120:0/4092700841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d017df50 con 0x7f76d00b4ad0 2021-04-09T18:20:02.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76d58e2700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00b4ad0 0x7f76d017ced0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f76c0006be0 tx=0x7f76c000b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76c6ffd700 1 -- 172.21.15.120:0/4092700841 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76c00064d0 con 0x7f76d00b4ad0 2021-04-09T18:20:02.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76c6ffd700 1 -- 172.21.15.120:0/4092700841 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c000bd80 con 0x7f76d00b4ad0 2021-04-09T18:20:02.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76c6ffd700 1 -- 172.21.15.120:0/4092700841 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76c0002030 con 0x7f76d00b4ad0 2021-04-09T18:20:02.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d017df50 con 0x7f76d00b4ad0 2021-04-09T18:20:02.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d017df50 con 0x7f76d00b4ad0 2021-04-09T18:20:02.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.358 7f76c6ffd700 1 -- 172.21.15.120:0/4092700841 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f76c0006c90 con 0x7f76d00b4ad0 2021-04-09T18:20:02.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.359 7f76c6ffd700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f76b8018930 0x7f76b801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.359 7f76c6ffd700 1 -- 172.21.15.120:0/4092700841 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f76c0032cf0 con 0x7f76d00b4ad0 2021-04-09T18:20:02.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.359 7f76d60e3700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f76b8018930 0x7f76b801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.359 7f76d60e3700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f76b8018930 0x7f76b801adc0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.381 7f76d82c7700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7f76d0062a70 0x7f76d0062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.381 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 --> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76d017db10 con 0x7f76d0062a70 2021-04-09T18:20:02.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.381 7f76d68e4700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7f76d0062a70 0x7f76d0062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.381 7f76d68e4700 1 -- 172.21.15.120:0/4092700841 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7f76d0062a70 msgr2=0x7f76d0062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:20:02.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.381 7f76d68e4700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7f76d0062a70 0x7f76d0062e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.382 7f76c6ffd700 1 -- 172.21.15.120:0/4092700841 <== osd.0 v2:172.21.15.120:6800/24540 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f76c8006a80 con 0x7f76d0062a70 2021-04-09T18:20:02.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.389 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 --> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76d00e2570 con 0x7f76d0062a70 2021-04-09T18:20:02.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.389 7f76c6ffd700 1 -- 172.21.15.120:0/4092700841 <== osd.0 v2:172.21.15.120:6800/24540 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f76c8006580 con 0x7f76d0062a70 2021-04-09T18:20:02.407 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2021-04-09T18:20:02.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7f76d0062a70 msgr2=0x7f76d0062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7f76d0062a70 0x7f76d0062e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f76b8018930 msgr2=0x7f76b801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f76b8018930 0x7f76b801adc0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00b4ad0 msgr2=0x7f76d017ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 --2- 172.21.15.120:0/4092700841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76d00b4ad0 0x7f76d017ced0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f76c0006be0 tx=0x7f76c000b990).stop 2021-04-09T18:20:02.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d68e4700 1 -- 172.21.15.120:0/4092700841 reap_dead start 2021-04-09T18:20:02.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 shutdown_connections 2021-04-09T18:20:02.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 >> 172.21.15.120:0/4092700841 conn(0x7f76d0182250 msgr2=0x7f76d0179b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:02.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 shutdown_connections 2021-04-09T18:20:02.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.390 7f76d82c7700 1 -- 172.21.15.120:0/4092700841 wait complete. 2021-04-09T18:20:02.429 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-04-09T18:20:02.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.592 7f3f9ef90700 1 Processor -- start 2021-04-09T18:20:02.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.592 7f3f9ef90700 1 -- start start 2021-04-09T18:20:02.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.592 7f3f9ef90700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3f980d6580 0x7f3f981ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.592 7f3f9ef90700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980d7960 con 0x7f3f980d7560 2021-04-09T18:20:02.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.592 7f3f9ef90700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980d6980 con 0x7f3f980d7160 2021-04-09T18:20:02.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.592 7f3f9ef90700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f980d6be0 con 0x7f3f980d6580 2021-04-09T18:20:02.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.592 7f3f97fff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3f980d7560 0x7f3f980d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47612/0 (socket says 172.21.15.120:47612) 2021-04-09T18:20:02.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.592 7f3f97fff700 1 -- 172.21.15.120:0/1896670643 learned_addr learned my addr 172.21.15.120:0/1896670643 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:02.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.592 7f3f9d5ad700 1 --2- 172.21.15.120:0/1896670643 >> v2:172.21.15.134:3300/0 conn(0x7f3f980d6580 0x7f3f981ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f977fe700 1 -- 172.21.15.120:0/1896670643 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675997897 0 0) 0x7f3f88001060 con 0x7f3f980d7560 2021-04-09T18:20:02.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f977fe700 1 -- 172.21.15.120:0/1896670643 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f84002fe0 con 0x7f3f980d7560 2021-04-09T18:20:02.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f977fe700 1 -- 172.21.15.120:0/1896670643 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608515207 0 0) 0x7f3f80000c60 con 0x7f3f980d7160 2021-04-09T18:20:02.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f977fe700 1 -- 172.21.15.120:0/1896670643 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f84003210 con 0x7f3f980d7160 2021-04-09T18:20:02.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f9d5ad700 1 -- 172.21.15.120:0/1896670643 >> v1:172.21.15.134:6789/0 conn(0x7f3f980d7160 legacy=0x7f3f980d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f9d5ad700 1 -- 172.21.15.120:0/1896670643 >> v1:172.21.15.120:6789/0 conn(0x7f3f980d7560 legacy=0x7f3f980d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f9d5ad700 1 -- 172.21.15.120:0/1896670643 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f981a2ac0 con 0x7f3f980d6580 2021-04-09T18:20:02.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f9d5ad700 1 --2- 172.21.15.120:0/1896670643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f980d6580 0x7f3f981ac1f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3f90006ad0 tx=0x7f3f90009a50).ready entity=mon.1 client_cookie=bf839b3e347ead34 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f977fe700 1 -- 172.21.15.120:0/1896670643 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f900066a0 con 0x7f3f980d6580 2021-04-09T18:20:02.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f977fe700 1 -- 172.21.15.120:0/1896670643 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90006410 con 0x7f3f980d6580 2021-04-09T18:20:02.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f977fe700 1 -- 172.21.15.120:0/1896670643 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f900024d0 con 0x7f3f980d6580 2021-04-09T18:20:02.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f9ef90700 1 -- 172.21.15.120:0/1896670643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f980d6580 msgr2=0x7f3f981ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.593 7f3f9ef90700 1 --2- 172.21.15.120:0/1896670643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f980d6580 0x7f3f981ac1f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3f90006ad0 tx=0x7f3f90009a50).stop 2021-04-09T18:20:02.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.594 7f3f9ef90700 1 -- 172.21.15.120:0/1896670643 shutdown_connections 2021-04-09T18:20:02.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.594 7f3f9ef90700 1 --2- 172.21.15.120:0/1896670643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f980d6580 0x7f3f981ac1f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.594 7f3f9ef90700 1 -- 172.21.15.120:0/1896670643 >> 172.21.15.120:0/1896670643 conn(0x7f3f980d1590 msgr2=0x7f3f980d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:02.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.594 7f3f9ef90700 1 -- 172.21.15.120:0/1896670643 shutdown_connections 2021-04-09T18:20:02.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.594 7f3f9ef90700 1 -- 172.21.15.120:0/1896670643 wait complete. 2021-04-09T18:20:02.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.612 7f3f9ef90700 1 Processor -- start 2021-04-09T18:20:02.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.612 7f3f9ef90700 1 -- start start 2021-04-09T18:20:02.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9ef90700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f981a0c90 0x7f3f980d9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.649 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9ef90700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f981a1090 0x7f3f980a8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.650 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9ef90700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f980a8870 0x7f3f9818d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.650 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9ef90700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981a1610 con 0x7f3f980a8870 2021-04-09T18:20:02.651 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9ef90700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981a0710 con 0x7f3f981a0c90 2021-04-09T18:20:02.651 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9ef90700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9818c790 con 0x7f3f981a1090 2021-04-09T18:20:02.651 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9d5ad700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f980a8870 0x7f3f9818d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.652 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9d5ad700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f980a8870 0x7f3f9818d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52708/0 (socket says 172.21.15.120:52708) 2021-04-09T18:20:02.652 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9d5ad700 1 -- 172.21.15.120:0/3921087317 learned_addr learned my addr 172.21.15.120:0/3921087317 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:02.652 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f97fff700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f981a1090 0x7f3f980a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.653 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.613 7f3f9cdac700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f981a0c90 0x7f3f980d9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.653 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f9d5ad700 1 -- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f981a1090 msgr2=0x7f3f980a8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f9d5ad700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f981a1090 0x7f3f980a8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f9d5ad700 1 -- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f981a0c90 msgr2=0x7f3f980d9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f9d5ad700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f981a0c90 0x7f3f980d9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f9d5ad700 1 -- 172.21.15.120:0/3921087317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980da3a0 con 0x7f3f980a8870 2021-04-09T18:20:02.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f97fff700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f981a1090 0x7f3f980a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:02.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f9d5ad700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f980a8870 0x7f3f9818d310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f3f9000b690 tx=0x7f3f9000ba30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f957fa700 1 -- 172.21.15.120:0/3921087317 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f90006cd0 con 0x7f3f980a8870 2021-04-09T18:20:02.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f957fa700 1 -- 172.21.15.120:0/3921087317 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90002030 con 0x7f3f980a8870 2021-04-09T18:20:02.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f980da3a0 con 0x7f3f980a8870 2021-04-09T18:20:02.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f957fa700 1 -- 172.21.15.120:0/3921087317 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3f900024c0 con 0x7f3f980a8870 2021-04-09T18:20:02.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f980da3a0 con 0x7f3f980a8870 2021-04-09T18:20:02.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.614 7f3f957fa700 1 -- 172.21.15.120:0/3921087317 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3f90002210 con 0x7f3f980a8870 2021-04-09T18:20:02.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.615 7f3f957fa700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3f7c018930 0x7f3f7c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.661 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.615 7f3f957fa700 1 -- 172.21.15.120:0/3921087317 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f3f90032d20 con 0x7f3f980a8870 2021-04-09T18:20:02.661 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.615 7f3f9cdac700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3f7c018930 0x7f3f7c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.615 7f3f9cdac700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3f7c018930 0x7f3f7c01ae10 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.638 7f3f9ef90700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f3f98062a70 0x7f3f98062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.638 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 --> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f980d8890 con 0x7f3f98062a70 2021-04-09T18:20:02.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.638 7f3f97fff700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f3f98062a70 0x7f3f98062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.638 7f3f97fff700 1 -- 172.21.15.120:0/3921087317 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f3f98062a70 msgr2=0x7f3f98062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:20:02.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.638 7f3f97fff700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f3f98062a70 0x7f3f98062e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.639 7f3f957fa700 1 -- 172.21.15.120:0/3921087317 <== osd.1 v2:172.21.15.120:6808/24588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f3f880097e0 con 0x7f3f98062a70 2021-04-09T18:20:02.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.645 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 --> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3f980da3a0 con 0x7f3f98062a70 2021-04-09T18:20:02.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.646 7f3f957fa700 1 -- 172.21.15.120:0/3921087317 <== osd.1 v2:172.21.15.120:6808/24588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3f880097e0 con 0x7f3f98062a70 2021-04-09T18:20:02.669 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2021-04-09T18:20:02.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f3f98062a70 msgr2=0x7f3f98062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f3f98062a70 0x7f3f98062e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3f7c018930 msgr2=0x7f3f7c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3f7c018930 0x7f3f7c01ae10 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f980a8870 msgr2=0x7f3f9818d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 --2- 172.21.15.120:0/3921087317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f980a8870 0x7f3f9818d310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f3f9000b690 tx=0x7f3f9000ba30).stop 2021-04-09T18:20:02.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9d5ad700 1 -- 172.21.15.120:0/3921087317 reap_dead start 2021-04-09T18:20:02.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 shutdown_connections 2021-04-09T18:20:02.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 >> 172.21.15.120:0/3921087317 conn(0x7f3f98192590 msgr2=0x7f3f98192b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:02.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 shutdown_connections 2021-04-09T18:20:02.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.647 7f3f9ef90700 1 -- 172.21.15.120:0/3921087317 wait complete. 2021-04-09T18:20:02.679 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-04-09T18:20:02.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.824 7f9dfb3d0700 1 Processor -- start 2021-04-09T18:20:02.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9dfb3d0700 1 -- start start 2021-04-09T18:20:02.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9dfb3d0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9df40d7560 0x7f9df40d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9dfb3d0700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9df40d63b0 0x7f9df41ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9dfb3d0700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df40d7960 con 0x7f9df40d7160 2021-04-09T18:20:02.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9dfb3d0700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40d80f0 con 0x7f9df40d7560 2021-04-09T18:20:02.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9dfb3d0700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40d6be0 con 0x7f9df40d63b0 2021-04-09T18:20:02.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9df89eb700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9df40d7560 0x7f9df40d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9df91ec700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9df40d7160 0x7f9df40d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47626/0 (socket says 172.21.15.120:47626) 2021-04-09T18:20:02.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9df91ec700 1 -- 172.21.15.120:0/1479733326 learned_addr learned my addr 172.21.15.120:0/1479733326 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:02.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.825 7f9df99ed700 1 --2- 172.21.15.120:0/1479733326 >> v2:172.21.15.134:3300/0 conn(0x7f9df40d63b0 0x7f9df41ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9debfff700 1 -- 172.21.15.120:0/1479733326 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373045174 0 0) 0x7f9df0000ce0 con 0x7f9df40d7160 2021-04-09T18:20:02.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9debfff700 1 -- 172.21.15.120:0/1479733326 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9de0002fe0 con 0x7f9df40d7160 2021-04-09T18:20:02.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9df89eb700 1 -- 172.21.15.120:0/1479733326 >> v2:172.21.15.134:3300/0 conn(0x7f9df40d63b0 msgr2=0x7f9df41ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:02.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9df89eb700 1 --2- 172.21.15.120:0/1479733326 >> v2:172.21.15.134:3300/0 conn(0x7f9df40d63b0 0x7f9df41ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9df89eb700 1 -- 172.21.15.120:0/1479733326 >> v1:172.21.15.120:6789/0 conn(0x7f9df40d7160 legacy=0x7f9df40d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9df89eb700 1 -- 172.21.15.120:0/1479733326 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df41a2ac0 con 0x7f9df40d7560 2021-04-09T18:20:02.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9df89eb700 1 --2- 172.21.15.120:0/1479733326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40d7560 0x7f9df40d5d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f9de4006650 tx=0x7f9de4009a80).ready entity=mon.0 client_cookie=cc189be996e8efd6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9debfff700 1 -- 172.21.15.120:0/1479733326 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9de40009b0 con 0x7f9df40d7560 2021-04-09T18:20:02.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9debfff700 1 -- 172.21.15.120:0/1479733326 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de400c0c0 con 0x7f9df40d7560 2021-04-09T18:20:02.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9debfff700 1 -- 172.21.15.120:0/1479733326 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9de400c510 con 0x7f9df40d7560 2021-04-09T18:20:02.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9dfb3d0700 1 -- 172.21.15.120:0/1479733326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40d7560 msgr2=0x7f9df40d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.826 7f9dfb3d0700 1 --2- 172.21.15.120:0/1479733326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40d7560 0x7f9df40d5d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f9de4006650 tx=0x7f9de4009a80).stop 2021-04-09T18:20:02.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.827 7f9dfb3d0700 1 -- 172.21.15.120:0/1479733326 shutdown_connections 2021-04-09T18:20:02.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.827 7f9dfb3d0700 1 --2- 172.21.15.120:0/1479733326 >> v2:172.21.15.134:3300/0 conn(0x7f9df40d63b0 0x7f9df41ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.827 7f9dfb3d0700 1 --2- 172.21.15.120:0/1479733326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40d7560 0x7f9df40d5d90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.827 7f9dfb3d0700 1 -- 172.21.15.120:0/1479733326 >> 172.21.15.120:0/1479733326 conn(0x7f9df40d1590 msgr2=0x7f9df40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:02.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.827 7f9dfb3d0700 1 -- 172.21.15.120:0/1479733326 shutdown_connections 2021-04-09T18:20:02.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.827 7f9dfb3d0700 1 -- 172.21.15.120:0/1479733326 wait complete. 2021-04-09T18:20:02.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9dfb3d0700 1 Processor -- start 2021-04-09T18:20:02.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9dfb3d0700 1 -- start start 2021-04-09T18:20:02.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9dfb3d0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9df4184c30 0x7f9df40b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9dfb3d0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df4185030 0x7f9df40b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9dfb3d0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40e34d0 0x7f9df40e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9dfb3d0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df41a14f0 con 0x7f9df40e34d0 2021-04-09T18:20:02.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9dfb3d0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df417f710 con 0x7f9df4185030 2021-04-09T18:20:02.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9dfb3d0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df417fa80 con 0x7f9df4184c30 2021-04-09T18:20:02.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9df99ed700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40e34d0 0x7f9df40e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9df99ed700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40e34d0 0x7f9df40e38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52724/0 (socket says 172.21.15.120:52724) 2021-04-09T18:20:02.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.846 7f9df99ed700 1 -- 172.21.15.120:0/2718114908 learned_addr learned my addr 172.21.15.120:0/2718114908 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:02.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9df91ec700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9df4184c30 0x7f9df40b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9df89eb700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df4185030 0x7f9df40b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9df99ed700 1 -- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9df4184c30 msgr2=0x7f9df40b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9df99ed700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9df4184c30 0x7f9df40b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9df99ed700 1 -- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df4185030 msgr2=0x7f9df40b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9df99ed700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9df4185030 0x7f9df40b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9df99ed700 1 -- 172.21.15.120:0/2718114908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df40b5b80 con 0x7f9df40e34d0 2021-04-09T18:20:02.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9df99ed700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40e34d0 0x7f9df40e38d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9dec00b910 tx=0x7f9dec00bcb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9de9ffb700 1 -- 172.21.15.120:0/2718114908 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9dec006aa0 con 0x7f9df40e34d0 2021-04-09T18:20:02.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9de9ffb700 1 -- 172.21.15.120:0/2718114908 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec0011f0 con 0x7f9df40e34d0 2021-04-09T18:20:02.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df40b5b80 con 0x7f9df40e34d0 2021-04-09T18:20:02.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9de9ffb700 1 -- 172.21.15.120:0/2718114908 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9dec001640 con 0x7f9df40e34d0 2021-04-09T18:20:02.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.847 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df40b5b80 con 0x7f9df40e34d0 2021-04-09T18:20:02.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.848 7f9de9ffb700 1 -- 172.21.15.120:0/2718114908 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9dec0056b0 con 0x7f9df40e34d0 2021-04-09T18:20:02.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.848 7f9de9ffb700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9dd4018930 0x7f9dd401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.848 7f9de9ffb700 1 -- 172.21.15.120:0/2718114908 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f9dec032f00 con 0x7f9df40e34d0 2021-04-09T18:20:02.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.848 7f9df91ec700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9dd4018930 0x7f9dd401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.848 7f9df91ec700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9dd4018930 0x7f9dd401ae10 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.870 7f9dfb3d0700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f9df4062a70 0x7f9df4062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:02.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.871 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 --> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9df417f710 con 0x7f9df4062a70 2021-04-09T18:20:02.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.871 7f9df89eb700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f9df4062a70 0x7f9df4062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:02.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.871 7f9df89eb700 1 -- 172.21.15.120:0/2718114908 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f9df4062a70 msgr2=0x7f9df4062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:20:02.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.871 7f9df89eb700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f9df4062a70 0x7f9df4062e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:02.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.871 7f9de9ffb700 1 -- 172.21.15.120:0/2718114908 <== osd.2 v2:172.21.15.120:6816/24603 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f9de4009080 con 0x7f9df4062a70 2021-04-09T18:20:02.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.878 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 --> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9df40e25e0 con 0x7f9df4062a70 2021-04-09T18:20:02.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.878 7f9de9ffb700 1 -- 172.21.15.120:0/2718114908 <== osd.2 v2:172.21.15.120:6816/24603 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9de4009080 con 0x7f9df4062a70 2021-04-09T18:20:02.884 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2021-04-09T18:20:02.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.879 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f9df4062a70 msgr2=0x7f9df4062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.879 7f9dfb3d0700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f9df4062a70 0x7f9df4062e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.879 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9dd4018930 msgr2=0x7f9dd401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.879 7f9dfb3d0700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9dd4018930 0x7f9dd401ae10 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:02.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.879 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40e34d0 msgr2=0x7f9df40e38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:02.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.879 7f9dfb3d0700 1 --2- 172.21.15.120:0/2718114908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df40e34d0 0x7f9df40e38d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9dec00b910 tx=0x7f9dec00bcb0).stop 2021-04-09T18:20:02.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.879 7f9df99ed700 1 -- 172.21.15.120:0/2718114908 reap_dead start 2021-04-09T18:20:02.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.880 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 shutdown_connections 2021-04-09T18:20:02.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.880 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 >> 172.21.15.120:0/2718114908 conn(0x7f9df4182270 msgr2=0x7f9df40e2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:02.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.880 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 shutdown_connections 2021-04-09T18:20:02.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:02.880 7f9dfb3d0700 1 -- 172.21.15.120:0/2718114908 wait complete. 2021-04-09T18:20:02.894 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-04-09T18:20:03.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.055 7f41adb00700 1 Processor -- start 2021-04-09T18:20:03.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.055 7f41adb00700 1 -- start start 2021-04-09T18:20:03.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.056 7f41adb00700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41a80d7160 0x7f41a80d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.056 7f41adb00700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a80d6be0 con 0x7f41a80d6190 2021-04-09T18:20:03.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.056 7f41adb00700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a81a2ac0 con 0x7f41a80d55a0 2021-04-09T18:20:03.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.056 7f41adb00700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a81a2ce0 con 0x7f41a80d7160 2021-04-09T18:20:03.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.056 7f41a7fff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f41a80d6190 0x7f41a81ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47644/0 (socket says 172.21.15.120:47644) 2021-04-09T18:20:03.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.056 7f41a7fff700 1 -- 172.21.15.120:0/2287432135 learned_addr learned my addr 172.21.15.120:0/2287432135 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:03.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.056 7f41a77fe700 1 --2- 172.21.15.120:0/2287432135 >> v2:172.21.15.134:3300/0 conn(0x7f41a80d7160 0x7f41a80d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.056 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746346339 0 0) 0x7f41a0000d30 con 0x7f41a80d6190 2021-04-09T18:20:03.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.056 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4190002fe0 con 0x7f41a80d6190 2021-04-09T18:20:03.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2421312078 0 0) 0x7f41a0001270 con 0x7f41a80d6190 2021-04-09T18:20:03.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 >> v2:172.21.15.134:3300/0 conn(0x7f41a80d7160 msgr2=0x7f41a80d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:03.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 --2- 172.21.15.120:0/2287432135 >> v2:172.21.15.134:3300/0 conn(0x7f41a80d7160 0x7f41a80d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 >> v1:172.21.15.134:6789/0 conn(0x7f41a80d55a0 legacy=0x7f41a80d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80d6590 con 0x7f41a80d6190 2021-04-09T18:20:03.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f41a0001980 con 0x7f41a80d6190 2021-04-09T18:20:03.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 >> v1:172.21.15.120:6789/0 conn(0x7f41a80d6190 legacy=0x7f41a81ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4190003a60 0x7f4190005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4190006790 0x7f4190008c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4190009590 0x7f419000bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419000c300 con 0x7f4190009590 2021-04-09T18:20:03.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419000c520 con 0x7f4190006790 2021-04-09T18:20:03.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4190050750 con 0x7f4190003a60 2021-04-09T18:20:03.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a7fff700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4190009590 0x7f419000bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a77fe700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4190003a60 0x7f4190005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a6ffd700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4190006790 0x7f4190008c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a7fff700 1 -- 172.21.15.120:0/2287432135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4190003a60 msgr2=0x7f4190005ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:03.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a7fff700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4190003a60 0x7f4190005ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a7fff700 1 -- 172.21.15.120:0/2287432135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4190006790 msgr2=0x7f4190008c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:03.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a7fff700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4190006790 0x7f4190008c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a7fff700 1 -- 172.21.15.120:0/2287432135 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4190050980 con 0x7f4190009590 2021-04-09T18:20:03.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a7fff700 1 -- 172.21.15.120:0/2287432135 reap_dead start 2021-04-09T18:20:03.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a7fff700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4190009590 0x7f419000bab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f41a00020d0 tx=0x7f41a000a310).ready entity=mon.0 client_cookie=8973333aae8616f1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f41a0001930 con 0x7f4190009590 2021-04-09T18:20:03.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a00070c0 con 0x7f4190009590 2021-04-09T18:20:03.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41a67fc700 1 -- 172.21.15.120:0/2287432135 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f41a0007550 con 0x7f4190009590 2021-04-09T18:20:03.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41adb00700 1 -- 172.21.15.120:0/2287432135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4190009590 msgr2=0x7f419000bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.057 7f41adb00700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4190009590 0x7f419000bab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f41a00020d0 tx=0x7f41a000a310).stop 2021-04-09T18:20:03.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.058 7f41adb00700 1 -- 172.21.15.120:0/2287432135 shutdown_connections 2021-04-09T18:20:03.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.058 7f41adb00700 1 --2- 172.21.15.120:0/2287432135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4190009590 0x7f419000bab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.058 7f41adb00700 1 -- 172.21.15.120:0/2287432135 >> 172.21.15.120:0/2287432135 conn(0x7f41a80d1590 msgr2=0x7f41a80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:03.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.058 7f41adb00700 1 -- 172.21.15.120:0/2287432135 shutdown_connections 2021-04-09T18:20:03.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.058 7f41adb00700 1 -- 172.21.15.120:0/2287432135 wait complete. 2021-04-09T18:20:03.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41adb00700 1 Processor -- start 2021-04-09T18:20:03.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41adb00700 1 -- start start 2021-04-09T18:20:03.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41adb00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41a8184c40 0x7f41a80b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41adb00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a8185040 0x7f41a80b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41adb00700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a80b5b80 0x7f41a80e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41adb00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a81846c0 con 0x7f41a8184c40 2021-04-09T18:20:03.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41adb00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a81a1470 con 0x7f41a8185040 2021-04-09T18:20:03.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41adb00700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a817fa90 con 0x7f41a80b5b80 2021-04-09T18:20:03.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41a77fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41a8184c40 0x7f41a80b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.077 7f41a77fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41a8184c40 0x7f41a80b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52746/0 (socket says 172.21.15.120:52746) 2021-04-09T18:20:03.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41a77fe700 1 -- 172.21.15.120:0/2837051741 learned_addr learned my addr 172.21.15.120:0/2837051741 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:03.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41a6ffd700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a8185040 0x7f41a80b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41a7fff700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a80b5b80 0x7f41a80e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41a77fe700 1 -- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a80b5b80 msgr2=0x7f41a80e34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41a77fe700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41a80b5b80 0x7f41a80e34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41a77fe700 1 -- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a8185040 msgr2=0x7f41a80b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41a77fe700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a8185040 0x7f41a80b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41a77fe700 1 -- 172.21.15.120:0/2837051741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80e3af0 con 0x7f41a8184c40 2021-04-09T18:20:03.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41a77fe700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41a8184c40 0x7f41a80b4f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4198006f60 tx=0x7f419800b970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f418ffff700 1 -- 172.21.15.120:0/2837051741 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f419800bd60 con 0x7f41a8184c40 2021-04-09T18:20:03.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f418ffff700 1 -- 172.21.15.120:0/2837051741 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4198000c90 con 0x7f41a8184c40 2021-04-09T18:20:03.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41adb00700 1 -- 172.21.15.120:0/2837051741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a80e3af0 con 0x7f41a8184c40 2021-04-09T18:20:03.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f418ffff700 1 -- 172.21.15.120:0/2837051741 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4198002220 con 0x7f41a8184c40 2021-04-09T18:20:03.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.078 7f41adb00700 1 -- 172.21.15.120:0/2837051741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a80e3af0 con 0x7f41a8184c40 2021-04-09T18:20:03.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.079 7f418ffff700 1 -- 172.21.15.120:0/2837051741 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f41980052e0 con 0x7f41a8184c40 2021-04-09T18:20:03.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.079 7f418ffff700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4188018930 0x7f418801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.079 7f418ffff700 1 -- 172.21.15.120:0/2837051741 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f4198032b50 con 0x7f41a8184c40 2021-04-09T18:20:03.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.079 7f41a6ffd700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4188018930 0x7f418801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.079 7f41a6ffd700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4188018930 0x7f418801ae10 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.102 7f41adb00700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f41a8062a70 0x7f41a8062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.102 7f41adb00700 1 -- 172.21.15.120:0/2837051741 --> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41a81846c0 con 0x7f41a8062a70 2021-04-09T18:20:03.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.102 7f41a7fff700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f41a8062a70 0x7f41a8062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.107 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.102 7f41a7fff700 1 -- 172.21.15.120:0/2837051741 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f41a8062a70 msgr2=0x7f41a8062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:20:03.107 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.102 7f41a7fff700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f41a8062a70 0x7f41a8062e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.107 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.103 7f418ffff700 1 -- 172.21.15.120:0/2837051741 <== osd.3 v2:172.21.15.120:6824/24612 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f41a0001270 con 0x7f41a8062a70 2021-04-09T18:20:03.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.109 7f41adb00700 1 -- 172.21.15.120:0/2837051741 --> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41a81846c0 con 0x7f41a8062a70 2021-04-09T18:20:03.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.110 7f418ffff700 1 -- 172.21.15.120:0/2837051741 <== osd.3 v2:172.21.15.120:6824/24612 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f41a0001270 con 0x7f41a8062a70 2021-04-09T18:20:03.109 INFO:teuthology.orchestra.run.smithi120.stdout:55834574853 2021-04-09T18:20:03.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 -- 172.21.15.120:0/2837051741 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f41a8062a70 msgr2=0x7f41a8062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f41a8062a70 0x7f41a8062e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 -- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4188018930 msgr2=0x7f418801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4188018930 0x7f418801ae10 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 -- 172.21.15.120:0/2837051741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41a8184c40 msgr2=0x7f41a80b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 --2- 172.21.15.120:0/2837051741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41a8184c40 0x7f41a80b4f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4198006f60 tx=0x7f419800b970).stop 2021-04-09T18:20:03.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41a7fff700 1 -- 172.21.15.120:0/2837051741 reap_dead start 2021-04-09T18:20:03.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 -- 172.21.15.120:0/2837051741 shutdown_connections 2021-04-09T18:20:03.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 -- 172.21.15.120:0/2837051741 >> 172.21.15.120:0/2837051741 conn(0x7f41a8182270 msgr2=0x7f41a80e2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:03.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 -- 172.21.15.120:0/2837051741 shutdown_connections 2021-04-09T18:20:03.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.111 7f41adb00700 1 -- 172.21.15.120:0/2837051741 wait complete. 2021-04-09T18:20:03.122 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-04-09T18:20:03.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.265 7f2a42e76700 1 Processor -- start 2021-04-09T18:20:03.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.265 7f2a42e76700 1 -- start start 2021-04-09T18:20:03.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a42e76700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0d7560 0x7f2a3c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a42e76700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a3c0d63b0 0x7f2a3c1ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a42e76700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c0d7960 con 0x7f2a3c0d7160 2021-04-09T18:20:03.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a42e76700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c0d80f0 con 0x7f2a3c0d63b0 2021-04-09T18:20:03.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a42e76700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0d6be0 con 0x7f2a3c0d7560 2021-04-09T18:20:03.310 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a3bfff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0d7560 0x7f2a3c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a41493700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a3c0d63b0 0x7f2a3c1ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a40c92700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2a3c0d7160 0x7f2a3c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42480/0 (socket says 172.21.15.120:42480) 2021-04-09T18:20:03.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a40c92700 1 -- 172.21.15.120:0/999476125 learned_addr learned my addr 172.21.15.120:0/999476125 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:03.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a41493700 1 -- 172.21.15.120:0/999476125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0d7560 msgr2=0x7f2a3c0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:03.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a41493700 1 --2- 172.21.15.120:0/999476125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0d7560 0x7f2a3c0d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a41493700 1 -- 172.21.15.120:0/999476125 >> v1:172.21.15.134:6789/0 conn(0x7f2a3c0d7160 legacy=0x7f2a3c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a41493700 1 -- 172.21.15.120:0/999476125 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c1a2ac0 con 0x7f2a3c0d63b0 2021-04-09T18:20:03.321 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a3b7fe700 1 -- 172.21.15.120:0/999476125 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410267546 0 0) 0x7f2a240010c0 con 0x7f2a3c0d7160 2021-04-09T18:20:03.321 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a3bfff700 1 --2- 172.21.15.120:0/999476125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0d7560 0x7f2a3c0d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:03.321 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.266 7f2a41493700 1 --2- 172.21.15.120:0/999476125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a3c0d63b0 0x7f2a3c1ab1e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2a34006e50 tx=0x7f2a34009e70).ready entity=mon.1 client_cookie=aec3e580c315a4b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.322 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a3b7fe700 1 -- 172.21.15.120:0/999476125 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a34006a20 con 0x7f2a3c0d63b0 2021-04-09T18:20:03.322 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a3b7fe700 1 -- 172.21.15.120:0/999476125 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34006790 con 0x7f2a3c0d63b0 2021-04-09T18:20:03.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a3b7fe700 1 -- 172.21.15.120:0/999476125 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a34000f90 con 0x7f2a3c0d63b0 2021-04-09T18:20:03.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a42e76700 1 -- 172.21.15.120:0/999476125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a3c0d63b0 msgr2=0x7f2a3c1ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a42e76700 1 --2- 172.21.15.120:0/999476125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a3c0d63b0 0x7f2a3c1ab1e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2a34006e50 tx=0x7f2a34009e70).stop 2021-04-09T18:20:03.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a42e76700 1 -- 172.21.15.120:0/999476125 shutdown_connections 2021-04-09T18:20:03.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a42e76700 1 --2- 172.21.15.120:0/999476125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a3c0d63b0 0x7f2a3c1ab1e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a42e76700 1 --2- 172.21.15.120:0/999476125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0d7560 0x7f2a3c0d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a42e76700 1 -- 172.21.15.120:0/999476125 >> 172.21.15.120:0/999476125 conn(0x7f2a3c0d1590 msgr2=0x7f2a3c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:03.326 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a42e76700 1 -- 172.21.15.120:0/999476125 shutdown_connections 2021-04-09T18:20:03.326 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.267 7f2a42e76700 1 -- 172.21.15.120:0/999476125 wait complete. 2021-04-09T18:20:03.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.286 7f2a42e76700 1 Processor -- start 2021-04-09T18:20:03.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.286 7f2a42e76700 1 -- start start 2021-04-09T18:20:03.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.286 7f2a42e76700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0daab0 0x7f2a3c190530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.286 7f2a42e76700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a3c0daeb0 0x7f2a3c18f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.286 7f2a42e76700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a3c190b50 0x7f2a3c18f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.286 7f2a42e76700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c18ffb0 con 0x7f2a3c0daeb0 2021-04-09T18:20:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.286 7f2a42e76700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0db420 con 0x7f2a3c190b50 2021-04-09T18:20:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.286 7f2a42e76700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c19fb10 con 0x7f2a3c0daab0 2021-04-09T18:20:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a3bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a3c0daeb0 0x7f2a3c18f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a3bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a3c0daeb0 0x7f2a3c18f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52758/0 (socket says 172.21.15.120:52758) 2021-04-09T18:20:03.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a40c92700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0daab0 0x7f2a3c190530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a3bfff700 1 -- 172.21.15.120:0/3820516219 learned_addr learned my addr 172.21.15.120:0/3820516219 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a41493700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a3c190b50 0x7f2a3c18f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a3bfff700 1 -- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0daab0 msgr2=0x7f2a3c190530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a3bfff700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0daab0 0x7f2a3c190530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a3bfff700 1 -- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a3c190b50 msgr2=0x7f2a3c18f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a3bfff700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a3c190b50 0x7f2a3c18f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a3bfff700 1 -- 172.21.15.120:0/3820516219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c19fd30 con 0x7f2a3c0daeb0 2021-04-09T18:20:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a40c92700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a3c0daab0 0x7f2a3c190530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a41493700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a3c190b50 0x7f2a3c18f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a3bfff700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a3c0daeb0 0x7f2a3c18f240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2a2c006f40 tx=0x7f2a2c00b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a397fa700 1 -- 172.21.15.120:0/3820516219 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a2c006bd0 con 0x7f2a3c0daeb0 2021-04-09T18:20:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a397fa700 1 -- 172.21.15.120:0/3820516219 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00bd80 con 0x7f2a3c0daeb0 2021-04-09T18:20:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a397fa700 1 -- 172.21.15.120:0/3820516219 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a2c002220 con 0x7f2a3c0daeb0 2021-04-09T18:20:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c19fd30 con 0x7f2a3c0daeb0 2021-04-09T18:20:03.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.287 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c19fd30 con 0x7f2a3c0daeb0 2021-04-09T18:20:03.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.288 7f2a397fa700 1 -- 172.21.15.120:0/3820516219 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2a2c002020 con 0x7f2a3c0daeb0 2021-04-09T18:20:03.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.288 7f2a397fa700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2a20018930 0x7f2a2001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.347 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.288 7f2a397fa700 1 -- 172.21.15.120:0/3820516219 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f2a2c032b90 con 0x7f2a3c0daeb0 2021-04-09T18:20:03.347 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.288 7f2a40c92700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2a20018930 0x7f2a2001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.288 7f2a40c92700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2a20018930 0x7f2a2001ae10 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.349 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.311 7f2a42e76700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f2a3c19fb10 0x7f2a3c062a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.350 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.311 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 --> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a3c0ccbd0 con 0x7f2a3c19fb10 2021-04-09T18:20:03.350 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.312 7f2a41493700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f2a3c19fb10 0x7f2a3c062a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.351 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.312 7f2a41493700 1 -- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f2a3c19fb10 msgr2=0x7f2a3c062a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:20:03.351 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.312 7f2a41493700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f2a3c19fb10 0x7f2a3c062a70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.351 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.312 7f2a397fa700 1 -- 172.21.15.120:0/3820516219 <== osd.4 v2:172.21.15.134:6802/24855 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f2a34009de0 con 0x7f2a3c19fb10 2021-04-09T18:20:03.352 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.321 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 --> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a3c0ccbd0 con 0x7f2a3c19fb10 2021-04-09T18:20:03.352 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.321 7f2a397fa700 1 -- 172.21.15.120:0/3820516219 <== osd.4 v2:172.21.15.134:6802/24855 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2a34009de0 con 0x7f2a3c19fb10 2021-04-09T18:20:03.354 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2021-04-09T18:20:03.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.322 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f2a3c19fb10 msgr2=0x7f2a3c062a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.322 7f2a42e76700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f2a3c19fb10 0x7f2a3c062a70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.322 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2a20018930 msgr2=0x7f2a2001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.322 7f2a42e76700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2a20018930 0x7f2a2001ae10 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.322 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a3c0daeb0 msgr2=0x7f2a3c18f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.322 7f2a42e76700 1 --2- 172.21.15.120:0/3820516219 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a3c0daeb0 0x7f2a3c18f240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2a2c006f40 tx=0x7f2a2c00b990).stop 2021-04-09T18:20:03.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.322 7f2a41493700 1 -- 172.21.15.120:0/3820516219 reap_dead start 2021-04-09T18:20:03.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.323 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 shutdown_connections 2021-04-09T18:20:03.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.323 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 >> 172.21.15.120:0/3820516219 conn(0x7f2a3c0e4b60 msgr2=0x7f2a3c198f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:03.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.323 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 shutdown_connections 2021-04-09T18:20:03.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.323 7f2a42e76700 1 -- 172.21.15.120:0/3820516219 wait complete. 2021-04-09T18:20:03.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-04-09T18:20:03.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.506 7fc487cd3700 1 Processor -- start 2021-04-09T18:20:03.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.506 7fc487cd3700 1 -- start start 2021-04-09T18:20:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.506 7fc487cd3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4800d7160 0x7fc4800e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.506 7fc487cd3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc4800e70a0 0x7fc4800d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.506 7fc487cd3700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800d6be0 con 0x7fc4800d7560 2021-04-09T18:20:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.506 7fc487cd3700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800d80f0 con 0x7fc4800e70a0 2021-04-09T18:20:03.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.506 7fc487cd3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800e7f00 con 0x7fc4800d7160 2021-04-09T18:20:03.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.506 7fc4862f0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc4800e70a0 0x7fc4800d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.506 7fc4852ee700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc4800d7560 0x7fc4800d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47682/0 (socket says 172.21.15.120:47682) 2021-04-09T18:20:03.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc4852ee700 1 -- 172.21.15.120:0/133003159 learned_addr learned my addr 172.21.15.120:0/133003159 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc485aef700 1 --2- 172.21.15.120:0/133003159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4800d7160 0x7fc4800e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc4862f0700 1 -- 172.21.15.120:0/133003159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4800d7160 msgr2=0x7fc4800e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc4862f0700 1 --2- 172.21.15.120:0/133003159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4800d7160 0x7fc4800e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc4862f0700 1 -- 172.21.15.120:0/133003159 >> v1:172.21.15.120:6789/0 conn(0x7fc4800d7560 legacy=0x7fc4800d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc484aed700 1 -- 172.21.15.120:0/133003159 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229002599 0 0) 0x7fc4740009b0 con 0x7fc4800d7560 2021-04-09T18:20:03.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc4862f0700 1 -- 172.21.15.120:0/133003159 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4801a2ac0 con 0x7fc4800e70a0 2021-04-09T18:20:03.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc4862f0700 1 --2- 172.21.15.120:0/133003159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4800e70a0 0x7fc4800d5d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc478006e30 tx=0x7fc478009de0).ready entity=mon.0 client_cookie=7388d36be9bf1ff9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc484aed700 1 -- 172.21.15.120:0/133003159 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc47800b300 con 0x7fc4800e70a0 2021-04-09T18:20:03.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc484aed700 1 -- 172.21.15.120:0/133003159 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800b680 con 0x7fc4800e70a0 2021-04-09T18:20:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc484aed700 1 -- 172.21.15.120:0/133003159 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc47800bb60 con 0x7fc4800e70a0 2021-04-09T18:20:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc487cd3700 1 -- 172.21.15.120:0/133003159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4800e70a0 msgr2=0x7fc4800d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.507 7fc487cd3700 1 --2- 172.21.15.120:0/133003159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4800e70a0 0x7fc4800d5d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc478006e30 tx=0x7fc478009de0).stop 2021-04-09T18:20:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.508 7fc487cd3700 1 -- 172.21.15.120:0/133003159 shutdown_connections 2021-04-09T18:20:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.508 7fc487cd3700 1 --2- 172.21.15.120:0/133003159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4800e70a0 0x7fc4800d5d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.508 7fc487cd3700 1 --2- 172.21.15.120:0/133003159 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4800d7160 0x7fc4800e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.508 7fc487cd3700 1 -- 172.21.15.120:0/133003159 >> 172.21.15.120:0/133003159 conn(0x7fc4800d1590 msgr2=0x7fc4800d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:03.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.508 7fc487cd3700 1 -- 172.21.15.120:0/133003159 shutdown_connections 2021-04-09T18:20:03.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.508 7fc487cd3700 1 -- 172.21.15.120:0/133003159 wait complete. 2021-04-09T18:20:03.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc487cd3700 1 Processor -- start 2021-04-09T18:20:03.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc487cd3700 1 -- start start 2021-04-09T18:20:03.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc487cd3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4801900f0 0x7fc480194140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc487cd3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc480194760 0x7fc4800ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc487cd3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4801904f0 0x7fc4800abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc487cd3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800dac60 con 0x7fc4801900f0 2021-04-09T18:20:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc487cd3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800ac5f0 con 0x7fc480194760 2021-04-09T18:20:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc487cd3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800ac810 con 0x7fc4801904f0 2021-04-09T18:20:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc485aef700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4801900f0 0x7fc480194140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc485aef700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4801900f0 0x7fc480194140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52772/0 (socket says 172.21.15.120:52772) 2021-04-09T18:20:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc485aef700 1 -- 172.21.15.120:0/2214325423 learned_addr learned my addr 172.21.15.120:0/2214325423 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:03.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc4862f0700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4801904f0 0x7fc4800abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.527 7fc4852ee700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc480194760 0x7fc4800ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc485aef700 1 -- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4801904f0 msgr2=0x7fc4800abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc485aef700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4801904f0 0x7fc4800abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.547 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc485aef700 1 -- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc480194760 msgr2=0x7fc4800ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc485aef700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc480194760 0x7fc4800ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc485aef700 1 -- 172.21.15.120:0/2214325423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480192c70 con 0x7fc4801900f0 2021-04-09T18:20:03.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc4852ee700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc480194760 0x7fc4800ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:03.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc485aef700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4801900f0 0x7fc480194140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc470006f60 tx=0x7fc47000b970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc47e7fc700 1 -- 172.21.15.120:0/2214325423 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc47000bd60 con 0x7fc4801900f0 2021-04-09T18:20:03.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc47e7fc700 1 -- 172.21.15.120:0/2214325423 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470000c90 con 0x7fc4801900f0 2021-04-09T18:20:03.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc480192c70 con 0x7fc4801900f0 2021-04-09T18:20:03.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc47e7fc700 1 -- 172.21.15.120:0/2214325423 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc470002220 con 0x7fc4801900f0 2021-04-09T18:20:03.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc480192c70 con 0x7fc4801900f0 2021-04-09T18:20:03.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.528 7fc47e7fc700 1 -- 172.21.15.120:0/2214325423 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc4700052e0 con 0x7fc4801900f0 2021-04-09T18:20:03.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.529 7fc47e7fc700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc460018930 0x7fc46001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.529 7fc47e7fc700 1 -- 172.21.15.120:0/2214325423 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fc470032b50 con 0x7fc4801900f0 2021-04-09T18:20:03.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.529 7fc4852ee700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc460018930 0x7fc46001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.529 7fc4852ee700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc460018930 0x7fc46001ae10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.552 7fc487cd3700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7fc480193820 0x7fc480062a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.552 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 --> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4800d8ee0 con 0x7fc480193820 2021-04-09T18:20:03.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.552 7fc4862f0700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7fc480193820 0x7fc480062a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.552 7fc4862f0700 1 -- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7fc480193820 msgr2=0x7fc480062a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:20:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.552 7fc4862f0700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7fc480193820 0x7fc480062a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.553 7fc47e7fc700 1 -- 172.21.15.120:0/2214325423 <== osd.5 v2:172.21.15.134:6810/24879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7fc478006ad0 con 0x7fc480193820 2021-04-09T18:20:03.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.559 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 --> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc480192c70 con 0x7fc480193820 2021-04-09T18:20:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.560 7fc47e7fc700 1 -- 172.21.15.120:0/2214325423 <== osd.5 v2:172.21.15.134:6810/24879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc478009380 con 0x7fc480193820 2021-04-09T18:20:03.592 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2021-04-09T18:20:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7fc480193820 msgr2=0x7fc480062a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7fc480193820 0x7fc480062a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc460018930 msgr2=0x7fc46001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc460018930 0x7fc46001ae10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4801900f0 msgr2=0x7fc480194140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 --2- 172.21.15.120:0/2214325423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4801900f0 0x7fc480194140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc470006f60 tx=0x7fc47000b970).stop 2021-04-09T18:20:03.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc4862f0700 1 -- 172.21.15.120:0/2214325423 reap_dead start 2021-04-09T18:20:03.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 shutdown_connections 2021-04-09T18:20:03.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 >> 172.21.15.120:0/2214325423 conn(0x7fc480182b80 msgr2=0x7fc48017f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:03.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 shutdown_connections 2021-04-09T18:20:03.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.561 7fc487cd3700 1 -- 172.21.15.120:0/2214325423 wait complete. 2021-04-09T18:20:03.607 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-04-09T18:20:03.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.770 7f51d620d700 1 Processor -- start 2021-04-09T18:20:03.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.770 7f51d620d700 1 -- start start 2021-04-09T18:20:03.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51d620d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51d00d7560 0x7f51d00d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51d620d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f51d00d63b0 0x7f51d01ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51d620d700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d00d7960 con 0x7f51d00d7160 2021-04-09T18:20:03.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51d620d700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d00d80f0 con 0x7f51d00d7560 2021-04-09T18:20:03.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51d620d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d00d6be0 con 0x7f51d00d63b0 2021-04-09T18:20:03.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51c7fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51d00d7560 0x7f51d00d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51c7fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51d00d7560 0x7f51d00d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52788/0 (socket says 172.21.15.120:52788) 2021-04-09T18:20:03.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51c7fff700 1 -- 172.21.15.120:0/1302006089 learned_addr learned my addr 172.21.15.120:0/1302006089 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:03.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51d482a700 1 --2- 172.21.15.120:0/1302006089 >> v2:172.21.15.134:3300/0 conn(0x7f51d00d63b0 0x7f51d01ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51c7fff700 1 -- 172.21.15.120:0/1302006089 >> v2:172.21.15.134:3300/0 conn(0x7f51d00d63b0 msgr2=0x7f51d01ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:03.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51c7fff700 1 --2- 172.21.15.120:0/1302006089 >> v2:172.21.15.134:3300/0 conn(0x7f51d00d63b0 0x7f51d01ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51c7fff700 1 -- 172.21.15.120:0/1302006089 >> v1:172.21.15.134:6789/0 conn(0x7f51d00d7160 legacy=0x7f51d00d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.771 7f51c7fff700 1 -- 172.21.15.120:0/1302006089 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d01a2ac0 con 0x7f51d00d7560 2021-04-09T18:20:03.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.772 7f51c7fff700 1 --2- 172.21.15.120:0/1302006089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00d7560 0x7f51d00d5d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f51b8006700 tx=0x7f51b8009b80).ready entity=mon.0 client_cookie=2b7d895e4f957f14 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.772 7f51cf7fe700 1 -- 172.21.15.120:0/1302006089 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51b800c0c0 con 0x7f51d00d7560 2021-04-09T18:20:03.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.772 7f51cf7fe700 1 -- 172.21.15.120:0/1302006089 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b800c440 con 0x7f51d00d7560 2021-04-09T18:20:03.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.772 7f51cf7fe700 1 -- 172.21.15.120:0/1302006089 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51b800c920 con 0x7f51d00d7560 2021-04-09T18:20:03.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.772 7f51d620d700 1 -- 172.21.15.120:0/1302006089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00d7560 msgr2=0x7f51d00d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.772 7f51d620d700 1 --2- 172.21.15.120:0/1302006089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00d7560 0x7f51d00d5d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f51b8006700 tx=0x7f51b8009b80).stop 2021-04-09T18:20:03.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.773 7f51d620d700 1 -- 172.21.15.120:0/1302006089 shutdown_connections 2021-04-09T18:20:03.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.773 7f51d620d700 1 --2- 172.21.15.120:0/1302006089 >> v2:172.21.15.134:3300/0 conn(0x7f51d00d63b0 0x7f51d01ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.773 7f51d620d700 1 --2- 172.21.15.120:0/1302006089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00d7560 0x7f51d00d5d90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.773 7f51d620d700 1 -- 172.21.15.120:0/1302006089 >> 172.21.15.120:0/1302006089 conn(0x7f51d00d1590 msgr2=0x7f51d00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:03.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.773 7f51d620d700 1 -- 172.21.15.120:0/1302006089 shutdown_connections 2021-04-09T18:20:03.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.773 7f51d620d700 1 -- 172.21.15.120:0/1302006089 wait complete. 2021-04-09T18:20:03.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.791 7f51d620d700 1 Processor -- start 2021-04-09T18:20:03.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.791 7f51d620d700 1 -- start start 2021-04-09T18:20:03.866 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51d620d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00e3cf0 0x7f51d0098410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51d620d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51d00e40f0 0x7f51d0099090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51d620d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51d00b4eb0 0x7f51d00b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51d620d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d0098b10 con 0x7f51d00e3cf0 2021-04-09T18:20:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51d620d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d00996b0 con 0x7f51d00b4eb0 2021-04-09T18:20:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51d620d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d01a14e0 con 0x7f51d00e40f0 2021-04-09T18:20:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51cffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00e3cf0 0x7f51d0098410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51cffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00e3cf0 0x7f51d0098410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52790/0 (socket says 172.21.15.120:52790) 2021-04-09T18:20:03.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51cffff700 1 -- 172.21.15.120:0/3914190287 learned_addr learned my addr 172.21.15.120:0/3914190287 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:03.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51c7fff700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51d00e40f0 0x7f51d0099090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51d482a700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51d00b4eb0 0x7f51d00b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51cffff700 1 -- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51d00e40f0 msgr2=0x7f51d0099090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51cffff700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f51d00e40f0 0x7f51d0099090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51cffff700 1 -- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51d00b4eb0 msgr2=0x7f51d00b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51cffff700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51d00b4eb0 0x7f51d00b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51cffff700 1 -- 172.21.15.120:0/3914190287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d00b58d0 con 0x7f51d00e3cf0 2021-04-09T18:20:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.792 7f51cffff700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00e3cf0 0x7f51d0098410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f51c000b5b0 tx=0x7f51c000b950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.793 7f51cd7fa700 1 -- 172.21.15.120:0/3914190287 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51c000bd40 con 0x7f51d00e3cf0 2021-04-09T18:20:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.793 7f51cd7fa700 1 -- 172.21.15.120:0/3914190287 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0006240 con 0x7f51d00e3cf0 2021-04-09T18:20:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.793 7f51d620d700 1 -- 172.21.15.120:0/3914190287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d00b58d0 con 0x7f51d00e3cf0 2021-04-09T18:20:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.793 7f51cd7fa700 1 -- 172.21.15.120:0/3914190287 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51c0005690 con 0x7f51d00e3cf0 2021-04-09T18:20:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.793 7f51d620d700 1 -- 172.21.15.120:0/3914190287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d00b58d0 con 0x7f51d00e3cf0 2021-04-09T18:20:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.793 7f51cd7fa700 1 -- 172.21.15.120:0/3914190287 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f51c00054a0 con 0x7f51d00e3cf0 2021-04-09T18:20:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.793 7f51cd7fa700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f51b4018930 0x7f51b401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.793 7f51cd7fa700 1 -- 172.21.15.120:0/3914190287 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f51c0032b90 con 0x7f51d00e3cf0 2021-04-09T18:20:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.793 7f51c7fff700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f51b4018930 0x7f51b401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.794 7f51c7fff700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f51b4018930 0x7f51b401ae10 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.916 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.816 7f51d620d700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f51d0062a70 0x7f51d0062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:03.917 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.816 7f51d620d700 1 -- 172.21.15.120:0/3914190287 --> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51d01a14e0 con 0x7f51d0062a70 2021-04-09T18:20:03.917 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.816 7f51d482a700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f51d0062a70 0x7f51d0062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:03.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.816 7f51d482a700 1 -- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f51d0062a70 msgr2=0x7f51d0062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:20:03.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.816 7f51d482a700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f51d0062a70 0x7f51d0062e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:03.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.817 7f51cd7fa700 1 -- 172.21.15.120:0/3914190287 <== osd.6 v2:172.21.15.134:6818/24918 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f51c8006a10 con 0x7f51d0062a70 2021-04-09T18:20:03.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.823 7f51d620d700 1 -- 172.21.15.120:0/3914190287 --> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51d00e25d0 con 0x7f51d0062a70 2021-04-09T18:20:03.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.824 7f51cd7fa700 1 -- 172.21.15.120:0/3914190287 <== osd.6 v2:172.21.15.134:6818/24918 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f51c8006a10 con 0x7f51d0062a70 2021-04-09T18:20:03.920 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2021-04-09T18:20:03.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 -- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f51d0062a70 msgr2=0x7f51d0062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f51d0062a70 0x7f51d0062e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 -- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f51b4018930 msgr2=0x7f51b401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f51b4018930 0x7f51b401ae10 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 -- 172.21.15.120:0/3914190287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00e3cf0 msgr2=0x7f51d0098410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 --2- 172.21.15.120:0/3914190287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51d00e3cf0 0x7f51d0098410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f51c000b5b0 tx=0x7f51c000b950).stop 2021-04-09T18:20:03.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d482a700 1 -- 172.21.15.120:0/3914190287 reap_dead start 2021-04-09T18:20:03.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 -- 172.21.15.120:0/3914190287 shutdown_connections 2021-04-09T18:20:03.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 -- 172.21.15.120:0/3914190287 >> 172.21.15.120:0/3914190287 conn(0x7f51d0182260 msgr2=0x7f51d00e2800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 -- 172.21.15.120:0/3914190287 shutdown_connections 2021-04-09T18:20:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:03.825 7f51d620d700 1 -- 172.21.15.120:0/3914190287 wait complete. 2021-04-09T18:20:03.939 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-04-09T18:20:04.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.138 7fe777f72700 1 Processor -- start 2021-04-09T18:20:04.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.139 7fe777f72700 1 -- start start 2021-04-09T18:20:04.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.139 7fe777f72700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7700d7160 0x7fe7700d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.139 7fe777f72700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe7700d6190 0x7fe7700d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.139 7fe777f72700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7700d6be0 con 0x7fe7700d55a0 2021-04-09T18:20:04.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.139 7fe777f72700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7700d80f0 con 0x7fe7700d6190 2021-04-09T18:20:04.164 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.139 7fe777f72700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7701a2ac0 con 0x7fe7700d7160 2021-04-09T18:20:04.164 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.139 7fe77658f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe7700d6190 0x7fe7700d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.164 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.139 7fe77658f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe7700d6190 0x7fe7700d6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52804/0 (socket says 172.21.15.120:52804) 2021-04-09T18:20:04.164 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.139 7fe77658f700 1 -- 172.21.15.120:0/1488238342 learned_addr learned my addr 172.21.15.120:0/1488238342 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:04.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe775d8e700 1 --2- 172.21.15.120:0/1488238342 >> v2:172.21.15.134:3300/0 conn(0x7fe7700d7160 0x7fe7700d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe77658f700 1 -- 172.21.15.120:0/1488238342 >> v2:172.21.15.134:3300/0 conn(0x7fe7700d7160 msgr2=0x7fe7700d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:04.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe77658f700 1 --2- 172.21.15.120:0/1488238342 >> v2:172.21.15.134:3300/0 conn(0x7fe7700d7160 0x7fe7700d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe77658f700 1 -- 172.21.15.120:0/1488238342 >> v1:172.21.15.134:6789/0 conn(0x7fe7700d55a0 legacy=0x7fe7700d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe77658f700 1 -- 172.21.15.120:0/1488238342 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7701ac1f0 con 0x7fe7700d6190 2021-04-09T18:20:04.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe77658f700 1 --2- 172.21.15.120:0/1488238342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7700d6190 0x7fe7700d6590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe768006b80 tx=0x7fe768009b10).ready entity=mon.0 client_cookie=f44c6e39ba83577e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe774d8c700 1 -- 172.21.15.120:0/1488238342 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe7680022e0 con 0x7fe7700d6190 2021-04-09T18:20:04.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe774d8c700 1 -- 172.21.15.120:0/1488238342 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe768002620 con 0x7fe7700d6190 2021-04-09T18:20:04.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe774d8c700 1 -- 172.21.15.120:0/1488238342 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe768002b00 con 0x7fe7700d6190 2021-04-09T18:20:04.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe777f72700 1 -- 172.21.15.120:0/1488238342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7700d6190 msgr2=0x7fe7700d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.140 7fe777f72700 1 --2- 172.21.15.120:0/1488238342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7700d6190 0x7fe7700d6590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe768006b80 tx=0x7fe768009b10).stop 2021-04-09T18:20:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.141 7fe777f72700 1 -- 172.21.15.120:0/1488238342 shutdown_connections 2021-04-09T18:20:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.141 7fe777f72700 1 --2- 172.21.15.120:0/1488238342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7700d6190 0x7fe7700d6590 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.141 7fe777f72700 1 --2- 172.21.15.120:0/1488238342 >> v2:172.21.15.134:3300/0 conn(0x7fe7700d7160 0x7fe7700d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.141 7fe777f72700 1 -- 172.21.15.120:0/1488238342 >> 172.21.15.120:0/1488238342 conn(0x7fe7700d1590 msgr2=0x7fe7700d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:04.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.141 7fe777f72700 1 -- 172.21.15.120:0/1488238342 shutdown_connections 2021-04-09T18:20:04.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.141 7fe777f72700 1 -- 172.21.15.120:0/1488238342 wait complete. 2021-04-09T18:20:04.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.159 7fe777f72700 1 Processor -- start 2021-04-09T18:20:04.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe777f72700 1 -- start start 2021-04-09T18:20:04.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe777f72700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7700acfa0 0x7fe7700ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe777f72700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77017b220 0x7fe77017b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe777f72700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe770179b50 0x7fe770179f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe777f72700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700e3fb0 con 0x7fe77017b220 2021-04-09T18:20:04.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe777f72700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77019aab0 con 0x7fe7700acfa0 2021-04-09T18:20:04.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe777f72700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700e3b40 con 0x7fe770179b50 2021-04-09T18:20:04.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe77558d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77017b220 0x7fe77017b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe775d8e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7700acfa0 0x7fe7700ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe77558d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77017b220 0x7fe77017b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52808/0 (socket says 172.21.15.120:52808) 2021-04-09T18:20:04.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe77558d700 1 -- 172.21.15.120:0/856204760 learned_addr learned my addr 172.21.15.120:0/856204760 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:04.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe775d8e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7700acfa0 0x7fe7700ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:41642/0 (socket says 172.21.15.120:41642) 2021-04-09T18:20:04.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe77658f700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe770179b50 0x7fe770179f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe77558d700 1 -- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe770179b50 msgr2=0x7fe770179f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe77558d700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe770179b50 0x7fe770179f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe77558d700 1 -- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7700acfa0 msgr2=0x7fe7700ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe77558d700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7700acfa0 0x7fe7700ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.160 7fe77558d700 1 -- 172.21.15.120:0/856204760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77017a570 con 0x7fe77017b220 2021-04-09T18:20:04.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.161 7fe775d8e700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7700acfa0 0x7fe7700ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:04.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.161 7fe77558d700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77017b220 0x7fe77017b620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fe75c00b530 tx=0x7fe75c00b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.161 7fe76e7fc700 1 -- 172.21.15.120:0/856204760 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe75c00bcc0 con 0x7fe77017b220 2021-04-09T18:20:04.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.161 7fe76e7fc700 1 -- 172.21.15.120:0/856204760 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c006020 con 0x7fe77017b220 2021-04-09T18:20:04.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.161 7fe76e7fc700 1 -- 172.21.15.120:0/856204760 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe75c0054a0 con 0x7fe77017b220 2021-04-09T18:20:04.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.161 7fe777f72700 1 -- 172.21.15.120:0/856204760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77017a570 con 0x7fe77017b220 2021-04-09T18:20:04.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.161 7fe777f72700 1 -- 172.21.15.120:0/856204760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77017a570 con 0x7fe77017b220 2021-04-09T18:20:04.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.162 7fe76e7fc700 1 -- 172.21.15.120:0/856204760 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe75c006200 con 0x7fe77017b220 2021-04-09T18:20:04.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.162 7fe76e7fc700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe7580188d0 0x7fe75801add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.162 7fe76e7fc700 1 -- 172.21.15.120:0/856204760 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fe75c032b90 con 0x7fe77017b220 2021-04-09T18:20:04.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.162 7fe775d8e700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe7580188d0 0x7fe75801add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.162 7fe775d8e700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe7580188d0 0x7fe75801add0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.185 7fe777f72700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7fe770062f80 0x7fe770063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.185 7fe777f72700 1 -- 172.21.15.120:0/856204760 --> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7700639a0 con 0x7fe770062f80 2021-04-09T18:20:04.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.185 7fe77658f700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7fe770062f80 0x7fe770063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.185 7fe77658f700 1 -- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7fe770062f80 msgr2=0x7fe770063380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:20:04.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.185 7fe77658f700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7fe770062f80 0x7fe770063380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.186 7fe76e7fc700 1 -- 172.21.15.120:0/856204760 <== osd.7 v2:172.21.15.134:6826/24925 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7fe7680090e0 con 0x7fe770062f80 2021-04-09T18:20:04.199 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.193 7fe777f72700 1 -- 172.21.15.120:0/856204760 --> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7700639a0 con 0x7fe770062f80 2021-04-09T18:20:04.199 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.193 7fe76e7fc700 1 -- 172.21.15.120:0/856204760 <== osd.7 v2:172.21.15.134:6826/24925 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe768006820 con 0x7fe770062f80 2021-04-09T18:20:04.201 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2021-04-09T18:20:04.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 -- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7fe770062f80 msgr2=0x7fe770063380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7fe770062f80 0x7fe770063380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 -- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe7580188d0 msgr2=0x7fe75801add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe7580188d0 0x7fe75801add0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 -- 172.21.15.120:0/856204760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77017b220 msgr2=0x7fe77017b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 --2- 172.21.15.120:0/856204760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77017b220 0x7fe77017b620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fe75c00b530 tx=0x7fe75c00b8d0).stop 2021-04-09T18:20:04.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe77658f700 1 -- 172.21.15.120:0/856204760 reap_dead start 2021-04-09T18:20:04.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 -- 172.21.15.120:0/856204760 shutdown_connections 2021-04-09T18:20:04.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 -- 172.21.15.120:0/856204760 >> 172.21.15.120:0/856204760 conn(0x7fe770182a80 msgr2=0x7fe7700da440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:04.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 -- 172.21.15.120:0/856204760 shutdown_connections 2021-04-09T18:20:04.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.194 7fe777f72700 1 -- 172.21.15.120:0/856204760 wait complete. 2021-04-09T18:20:04.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-04-09T18:20:04.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.350 7f8637de0700 1 Processor -- start 2021-04-09T18:20:04.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.350 7f8637de0700 1 -- start start 2021-04-09T18:20:04.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.350 7f8637de0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86300d7160 0x7f86300e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.350 7f8637de0700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86300d7560 0x7f86300d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.350 7f8637de0700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86300d6be0 con 0x7f86300d5bc0 2021-04-09T18:20:04.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.350 7f8637de0700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86300d80f0 con 0x7f86300d7560 2021-04-09T18:20:04.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.350 7f8637de0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86300e7f00 con 0x7f86300d7160 2021-04-09T18:20:04.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f86363fd700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f86300d5bc0 0x7f86300d5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47730/0 (socket says 172.21.15.120:47730) 2021-04-09T18:20:04.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f86363fd700 1 -- 172.21.15.120:0/3030086097 learned_addr learned my addr 172.21.15.120:0/3030086097 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:04.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8635bfc700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86300d7160 0x7f86300e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f86353fb700 1 --2- 172.21.15.120:0/3030086097 >> v2:172.21.15.134:3300/0 conn(0x7f86300d7560 0x7f86300d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290609669 0 0) 0x7f86280009b0 con 0x7f86300d5bc0 2021-04-09T18:20:04.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f861c002fe0 con 0x7f86300d5bc0 2021-04-09T18:20:04.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4259913159 0 0) 0x7f86280010e0 con 0x7f86300d5bc0 2021-04-09T18:20:04.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86300d7160 msgr2=0x7f86300e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:04.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86300d7160 0x7f86300e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 >> v2:172.21.15.134:3300/0 conn(0x7f86300d7560 msgr2=0x7f86300d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 --2- 172.21.15.120:0/3030086097 >> v2:172.21.15.134:3300/0 conn(0x7f86300d7560 0x7f86300d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86301a2ac0 con 0x7f86300d5bc0 2021-04-09T18:20:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f8628001600 con 0x7f86300d5bc0 2021-04-09T18:20:04.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 >> v1:172.21.15.120:6789/0 conn(0x7f86300d5bc0 legacy=0x7f86300d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861c003a60 0x7f861c005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c04a7a0 0x7f861c04cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f861c04d5a0 0x7f861c04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0502e0 con 0x7f861c003a60 2021-04-09T18:20:04.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c050500 con 0x7f861c04a7a0 2021-04-09T18:20:04.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c050720 con 0x7f861c04d5a0 2021-04-09T18:20:04.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f8635bfc700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861c003a60 0x7f861c005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f86353fb700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c04a7a0 0x7f861c04cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.351 7f86363fd700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f861c04d5a0 0x7f861c04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8635bfc700 1 -- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f861c04d5a0 msgr2=0x7f861c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:04.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8635bfc700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f861c04d5a0 0x7f861c04fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8635bfc700 1 -- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c04a7a0 msgr2=0x7f861c04cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:04.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8635bfc700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c04a7a0 0x7f861c04cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8635bfc700 1 -- 172.21.15.120:0/3030086097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c0509c0 con 0x7f861c003a60 2021-04-09T18:20:04.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8635bfc700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861c003a60 0x7f861c005ef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f862c006f80 tx=0x7f862c009e20).ready entity=mon.0 client_cookie=1947353bbed372ed server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f862c00b510 con 0x7f861c003a60 2021-04-09T18:20:04.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c00b850 con 0x7f861c003a60 2021-04-09T18:20:04.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8634bfa700 1 -- 172.21.15.120:0/3030086097 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f862c00bd30 con 0x7f861c003a60 2021-04-09T18:20:04.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8637de0700 1 -- 172.21.15.120:0/3030086097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861c003a60 msgr2=0x7f861c005ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f8637de0700 1 --2- 172.21.15.120:0/3030086097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861c003a60 0x7f861c005ef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f862c006f80 tx=0x7f862c009e20).stop 2021-04-09T18:20:04.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.352 7f86363fd700 1 -- 172.21.15.120:0/3030086097 reap_dead start 2021-04-09T18:20:04.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.353 7f8637de0700 1 -- 172.21.15.120:0/3030086097 shutdown_connections 2021-04-09T18:20:04.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.353 7f8637de0700 1 -- 172.21.15.120:0/3030086097 >> 172.21.15.120:0/3030086097 conn(0x7f86300d1590 msgr2=0x7f86300d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:04.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.353 7f8637de0700 1 -- 172.21.15.120:0/3030086097 shutdown_connections 2021-04-09T18:20:04.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.353 7f8637de0700 1 -- 172.21.15.120:0/3030086097 wait complete. 2021-04-09T18:20:04.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f8637de0700 1 Processor -- start 2021-04-09T18:20:04.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f8637de0700 1 -- start start 2021-04-09T18:20:04.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f8637de0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8630184c40 0x7f86300b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f8637de0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8630185040 0x7f86300b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f8637de0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86300b5b80 0x7f86300e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f8637de0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86301846c0 con 0x7f86300b5b80 2021-04-09T18:20:04.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f8637de0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86301a1470 con 0x7f8630185040 2021-04-09T18:20:04.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f8637de0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863017fa90 con 0x7f8630184c40 2021-04-09T18:20:04.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f86363fd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86300b5b80 0x7f86300e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f86363fd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86300b5b80 0x7f86300e34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52832/0 (socket says 172.21.15.120:52832) 2021-04-09T18:20:04.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f86363fd700 1 -- 172.21.15.120:0/2723644653 learned_addr learned my addr 172.21.15.120:0/2723644653 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:04.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f8635bfc700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8630184c40 0x7f86300b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.372 7f86353fb700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8630185040 0x7f86300b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f86363fd700 1 -- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8630184c40 msgr2=0x7f86300b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f86363fd700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8630184c40 0x7f86300b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f86363fd700 1 -- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8630185040 msgr2=0x7f86300b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f86363fd700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8630185040 0x7f86300b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f86363fd700 1 -- 172.21.15.120:0/2723644653 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300e3af0 con 0x7f86300b5b80 2021-04-09T18:20:04.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f86363fd700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86300b5b80 0x7f86300e34d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f86280012a0 tx=0x7f862800a880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f86267fc700 1 -- 172.21.15.120:0/2723644653 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86280010a0 con 0x7f86300b5b80 2021-04-09T18:20:04.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f86267fc700 1 -- 172.21.15.120:0/2723644653 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862800ac70 con 0x7f86300b5b80 2021-04-09T18:20:04.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f86267fc700 1 -- 172.21.15.120:0/2723644653 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f86280045b0 con 0x7f86300b5b80 2021-04-09T18:20:04.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f8637de0700 1 -- 172.21.15.120:0/2723644653 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86300e3af0 con 0x7f86300b5b80 2021-04-09T18:20:04.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.373 7f8637de0700 1 -- 172.21.15.120:0/2723644653 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86300e3af0 con 0x7f86300b5b80 2021-04-09T18:20:04.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.374 7f86267fc700 1 -- 172.21.15.120:0/2723644653 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f86280043a0 con 0x7f86300b5b80 2021-04-09T18:20:04.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.374 7f86267fc700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8618018930 0x7f861801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.374 7f86267fc700 1 -- 172.21.15.120:0/2723644653 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8628032b60 con 0x7f86300b5b80 2021-04-09T18:20:04.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.374 7f8635bfc700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8618018930 0x7f861801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.374 7f8635bfc700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8618018930 0x7f861801ae10 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.396 7f8637de0700 1 -- 172.21.15.120:0/2723644653 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86300e43f0 con 0x7f86300b5b80 2021-04-09T18:20:04.465 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.399 7f86267fc700 1 -- 172.21.15.120:0/2723644653 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8628001a20 con 0x7f86300b5b80 2021-04-09T18:20:04.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.584 7f8637de0700 1 -- 172.21.15.120:0/2723644653 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86300e43f0 con 0x7f86300b5b80 2021-04-09T18:20:04.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.585 7f86267fc700 1 -- 172.21.15.120:0/2723644653 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86280043a0 con 0x7f86300b5b80 2021-04-09T18:20:04.585 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2021-04-09T18:20:04.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 -- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8618018930 msgr2=0x7f861801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8618018930 0x7f861801ae10 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 -- 172.21.15.120:0/2723644653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86300b5b80 msgr2=0x7f86300e34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86300b5b80 0x7f86300e34d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f86280012a0 tx=0x7f862800a880).stop 2021-04-09T18:20:04.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 -- 172.21.15.120:0/2723644653 shutdown_connections 2021-04-09T18:20:04.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86300b5b80 0x7f86300e34d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8630185040 0x7f86300b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8618018930 0x7f861801ae10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 --2- 172.21.15.120:0/2723644653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8630184c40 0x7f86300b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 -- 172.21.15.120:0/2723644653 >> 172.21.15.120:0/2723644653 conn(0x7f8630182270 msgr2=0x7f86300e2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:04.593 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 -- 172.21.15.120:0/2723644653 shutdown_connections 2021-04-09T18:20:04.593 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.587 7f8637de0700 1 -- 172.21.15.120:0/2723644653 wait complete. 2021-04-09T18:20:04.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2021-04-09T18:20:04.608 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-04-09T18:20:04.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.753 7fb7af8fc700 1 Processor -- start 2021-04-09T18:20:04.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.753 7fb7af8fc700 1 -- start start 2021-04-09T18:20:04.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.753 7fb7af8fc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb7a80d7560 0x7fb7a80d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.779 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.753 7fb7af8fc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80d63b0 0x7fb7a81ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.753 7fb7af8fc700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a80d7960 con 0x7fb7a80d7160 2021-04-09T18:20:04.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.753 7fb7af8fc700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a80d80f0 con 0x7fb7a80d7560 2021-04-09T18:20:04.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.753 7fb7af8fc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80d6be0 con 0x7fb7a80d63b0 2021-04-09T18:20:04.783 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7ad718700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb7a80d7160 0x7fb7a80d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47748/0 (socket says 172.21.15.120:47748) 2021-04-09T18:20:04.783 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7ad718700 1 -- 172.21.15.120:0/1218218445 learned_addr learned my addr 172.21.15.120:0/1218218445 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:04.784 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7adf19700 1 --2- 172.21.15.120:0/1218218445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80d63b0 0x7fb7a81ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.784 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7acf17700 1 --2- 172.21.15.120:0/1218218445 >> v2:172.21.15.134:3300/0 conn(0x7fb7a80d7560 0x7fb7a80d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.785 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7a7fff700 1 -- 172.21.15.120:0/1218218445 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888714781 0 0) 0x7fb7a0000ce0 con 0x7fb7a80d7160 2021-04-09T18:20:04.785 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7a7fff700 1 -- 172.21.15.120:0/1218218445 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb794002fe0 con 0x7fb7a80d7160 2021-04-09T18:20:04.785 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7adf19700 1 -- 172.21.15.120:0/1218218445 >> v2:172.21.15.134:3300/0 conn(0x7fb7a80d7560 msgr2=0x7fb7a80d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:04.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7adf19700 1 --2- 172.21.15.120:0/1218218445 >> v2:172.21.15.134:3300/0 conn(0x7fb7a80d7560 0x7fb7a80d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7adf19700 1 -- 172.21.15.120:0/1218218445 >> v1:172.21.15.120:6789/0 conn(0x7fb7a80d7160 legacy=0x7fb7a80d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7adf19700 1 -- 172.21.15.120:0/1218218445 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a81a2ac0 con 0x7fb7a80d63b0 2021-04-09T18:20:04.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7acf17700 1 --2- 172.21.15.120:0/1218218445 >> v2:172.21.15.134:3300/0 conn(0x7fb7a80d7560 0x7fb7a80d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:04.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7adf19700 1 --2- 172.21.15.120:0/1218218445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80d63b0 0x7fb7a81ab1e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb790006e50 tx=0x7fb790009e70).ready entity=mon.2 client_cookie=29fa80c1524ca925 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7a7fff700 1 -- 172.21.15.120:0/1218218445 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb790006a20 con 0x7fb7a80d63b0 2021-04-09T18:20:04.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7a7fff700 1 -- 172.21.15.120:0/1218218445 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb790006790 con 0x7fb7a80d63b0 2021-04-09T18:20:04.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7a7fff700 1 -- 172.21.15.120:0/1218218445 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb79000b700 con 0x7fb7a80d63b0 2021-04-09T18:20:04.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7af8fc700 1 -- 172.21.15.120:0/1218218445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80d63b0 msgr2=0x7fb7a81ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.754 7fb7af8fc700 1 --2- 172.21.15.120:0/1218218445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80d63b0 0x7fb7a81ab1e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb790006e50 tx=0x7fb790009e70).stop 2021-04-09T18:20:04.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.755 7fb7af8fc700 1 -- 172.21.15.120:0/1218218445 shutdown_connections 2021-04-09T18:20:04.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.755 7fb7af8fc700 1 --2- 172.21.15.120:0/1218218445 >> v2:172.21.15.134:3300/0 conn(0x7fb7a80d7560 0x7fb7a80d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.755 7fb7af8fc700 1 --2- 172.21.15.120:0/1218218445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80d63b0 0x7fb7a81ab1e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.755 7fb7af8fc700 1 -- 172.21.15.120:0/1218218445 >> 172.21.15.120:0/1218218445 conn(0x7fb7a80d1590 msgr2=0x7fb7a80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:04.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.755 7fb7af8fc700 1 -- 172.21.15.120:0/1218218445 shutdown_connections 2021-04-09T18:20:04.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.755 7fb7af8fc700 1 -- 172.21.15.120:0/1218218445 wait complete. 2021-04-09T18:20:04.794 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.774 7fb7af8fc700 1 Processor -- start 2021-04-09T18:20:04.794 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.774 7fb7af8fc700 1 -- start start 2021-04-09T18:20:04.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.774 7fb7af8fc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80e3c30 0x7fb7a81840a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7af8fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a80a80c0 0x7fb7a80a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7af8fc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7a8097330 0x7fb7a8097730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7af8fc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8096db0 con 0x7fb7a8097330 2021-04-09T18:20:04.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7af8fc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80e4030 con 0x7fb7a80a80c0 2021-04-09T18:20:04.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7af8fc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80e4450 con 0x7fb7a80e3c30 2021-04-09T18:20:04.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7adf19700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7a8097330 0x7fb7a8097730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7adf19700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7a8097330 0x7fb7a8097730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52846/0 (socket says 172.21.15.120:52846) 2021-04-09T18:20:04.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7adf19700 1 -- 172.21.15.120:0/1750818035 learned_addr learned my addr 172.21.15.120:0/1750818035 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:04.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7ad718700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80e3c30 0x7fb7a81840a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7acf17700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a80a80c0 0x7fb7a80a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7adf19700 1 -- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80e3c30 msgr2=0x7fb7a81840a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7adf19700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80e3c30 0x7fb7a81840a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7adf19700 1 -- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a80a80c0 msgr2=0x7fb7a80a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7adf19700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a80a80c0 0x7fb7a80a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7adf19700 1 -- 172.21.15.120:0/1750818035 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a80afe10 con 0x7fb7a8097330 2021-04-09T18:20:04.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7adf19700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7a8097330 0x7fb7a8097730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fb79000b940 tx=0x7fb79000bce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7a5ffb700 1 -- 172.21.15.120:0/1750818035 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb790009130 con 0x7fb7a8097330 2021-04-09T18:20:04.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7a5ffb700 1 -- 172.21.15.120:0/1750818035 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb790009430 con 0x7fb7a8097330 2021-04-09T18:20:04.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7a5ffb700 1 -- 172.21.15.120:0/1750818035 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb790001390 con 0x7fb7a8097330 2021-04-09T18:20:04.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a80afe10 con 0x7fb7a8097330 2021-04-09T18:20:04.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.775 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a80afe10 con 0x7fb7a8097330 2021-04-09T18:20:04.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.776 7fb7a5ffb700 1 -- 172.21.15.120:0/1750818035 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb790009130 con 0x7fb7a8097330 2021-04-09T18:20:04.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.776 7fb7a5ffb700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb78c018930 0x7fb78c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:04.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.776 7fb7a5ffb700 1 -- 172.21.15.120:0/1750818035 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb790035110 con 0x7fb7a8097330 2021-04-09T18:20:04.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.776 7fb7ad718700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb78c018930 0x7fb78c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:04.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.776 7fb7ad718700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb78c018930 0x7fb78c01ae10 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:04.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.799 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a80e4030 con 0x7fb7a8097330 2021-04-09T18:20:04.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.803 7fb7a5ffb700 1 -- 172.21.15.120:0/1750818035 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb790009430 con 0x7fb7a8097330 2021-04-09T18:20:04.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.986 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb7a80e4030 con 0x7fb7a8097330 2021-04-09T18:20:04.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.986 7fb7a5ffb700 1 -- 172.21.15.120:0/1750818035 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb790009430 con 0x7fb7a8097330 2021-04-09T18:20:04.986 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2021-04-09T18:20:04.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb78c018930 msgr2=0x7fb78c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb78c018930 0x7fb78c01ae10 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7a8097330 msgr2=0x7fb7a8097730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:04.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7a8097330 0x7fb7a8097730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fb79000b940 tx=0x7fb79000bce0).stop 2021-04-09T18:20:04.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 shutdown_connections 2021-04-09T18:20:04.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7a8097330 0x7fb7a8097730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a80a80c0 0x7fb7a80a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb78c018930 0x7fb78c01ae10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 --2- 172.21.15.120:0/1750818035 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb7a80e3c30 0x7fb7a81840a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:04.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 >> 172.21.15.120:0/1750818035 conn(0x7fb7a8193d50 msgr2=0x7fb7a819b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:04.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 shutdown_connections 2021-04-09T18:20:04.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:04.989 7fb7af8fc700 1 -- 172.21.15.120:0/1750818035 wait complete. 2021-04-09T18:20:05.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2021-04-09T18:20:05.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-04-09T18:20:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c1573e700 1 Processor -- start 2021-04-09T18:20:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c1573e700 1 -- start start 2021-04-09T18:20:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c1573e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1c100d7160 0x7f1c100d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c1573e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c100d55a0 0x7f1c100d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c1573e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c100d5fc0 0x7f1c100d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c1573e700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100e80a0 con 0x7f1c100d55a0 2021-04-09T18:20:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c1573e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100d80f0 con 0x7f1c100d7160 2021-04-09T18:20:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c1573e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100d6be0 con 0x7f1c100d5fc0 2021-04-09T18:20:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c0ed48700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c100d55a0 0x7f1c100d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c0fd4a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c100d5fc0 0x7f1c100d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c0ed48700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c100d55a0 0x7f1c100d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52854/0 (socket says 172.21.15.120:52854) 2021-04-09T18:20:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c0ed48700 1 -- 172.21.15.120:0/3370310315 learned_addr learned my addr 172.21.15.120:0/3370310315 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.147 7f1c0f549700 1 --2- 172.21.15.120:0/3370310315 >> v2:172.21.15.134:3300/0 conn(0x7f1c100d7160 0x7f1c100d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c0ed48700 1 -- 172.21.15.120:0/3370310315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c100d5fc0 msgr2=0x7f1c100d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c0ed48700 1 --2- 172.21.15.120:0/3370310315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c100d5fc0 0x7f1c100d63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c0ed48700 1 -- 172.21.15.120:0/3370310315 >> v2:172.21.15.134:3300/0 conn(0x7f1c100d7160 msgr2=0x7f1c100d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:05.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c0ed48700 1 --2- 172.21.15.120:0/3370310315 >> v2:172.21.15.134:3300/0 conn(0x7f1c100d7160 0x7f1c100d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c0ed48700 1 -- 172.21.15.120:0/3370310315 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c101a2ac0 con 0x7f1c100d55a0 2021-04-09T18:20:05.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c0ed48700 1 --2- 172.21.15.120:0/3370310315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c100d55a0 0x7f1c100d59a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1bf8006a80 tx=0x7f1bf8009e80).ready entity=mon.0 client_cookie=d8d1c18182aaa2d3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:05.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c0e547700 1 -- 172.21.15.120:0/3370310315 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1bf800b510 con 0x7f1c100d55a0 2021-04-09T18:20:05.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c0e547700 1 -- 172.21.15.120:0/3370310315 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf800b7d0 con 0x7f1c100d55a0 2021-04-09T18:20:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c0e547700 1 -- 172.21.15.120:0/3370310315 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1bf800bcb0 con 0x7f1c100d55a0 2021-04-09T18:20:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c1573e700 1 -- 172.21.15.120:0/3370310315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c100d55a0 msgr2=0x7f1c100d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.148 7f1c1573e700 1 --2- 172.21.15.120:0/3370310315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c100d55a0 0x7f1c100d59a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1bf8006a80 tx=0x7f1bf8009e80).stop 2021-04-09T18:20:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.149 7f1c1573e700 1 -- 172.21.15.120:0/3370310315 shutdown_connections 2021-04-09T18:20:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.149 7f1c1573e700 1 --2- 172.21.15.120:0/3370310315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c100d5fc0 0x7f1c100d63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.149 7f1c1573e700 1 --2- 172.21.15.120:0/3370310315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c100d55a0 0x7f1c100d59a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.149 7f1c1573e700 1 --2- 172.21.15.120:0/3370310315 >> v2:172.21.15.134:3300/0 conn(0x7f1c100d7160 0x7f1c100d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.149 7f1c1573e700 1 -- 172.21.15.120:0/3370310315 >> 172.21.15.120:0/3370310315 conn(0x7f1c100d1590 msgr2=0x7f1c100d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.149 7f1c1573e700 1 -- 172.21.15.120:0/3370310315 shutdown_connections 2021-04-09T18:20:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.149 7f1c1573e700 1 -- 172.21.15.120:0/3370310315 wait complete. 2021-04-09T18:20:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.167 7f1c1573e700 1 Processor -- start 2021-04-09T18:20:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.167 7f1c1573e700 1 -- start start 2021-04-09T18:20:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c1573e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c100b1e60 0x7f1c10196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c1573e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c10197070 0x7f1c10197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c1573e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c10198140 0x7f1c100e3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c1573e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c101975a0 con 0x7f1c10198140 2021-04-09T18:20:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c1573e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1019d3c0 con 0x7f1c100b1e60 2021-04-09T18:20:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c1573e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100e40d0 con 0x7f1c10197070 2021-04-09T18:20:05.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0fd4a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c10198140 0x7f1c100e3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0fd4a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c10198140 0x7f1c100e3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52860/0 (socket says 172.21.15.120:52860) 2021-04-09T18:20:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0fd4a700 1 -- 172.21.15.120:0/2179518026 learned_addr learned my addr 172.21.15.120:0/2179518026 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0f549700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c100b1e60 0x7f1c10196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0ed48700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c10197070 0x7f1c10197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0fd4a700 1 -- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c10197070 msgr2=0x7f1c10197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0fd4a700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c10197070 0x7f1c10197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0fd4a700 1 -- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c100b1e60 msgr2=0x7f1c10196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:05.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0fd4a700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c100b1e60 0x7f1c10196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0fd4a700 1 -- 172.21.15.120:0/2179518026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100e42f0 con 0x7f1c10198140 2021-04-09T18:20:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.168 7f1c0fd4a700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c10198140 0x7f1c100e3ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f1c08006b90 tx=0x7f1c0800b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.169 7f1c07fff700 1 -- 172.21.15.120:0/2179518026 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1c0800bd80 con 0x7f1c10198140 2021-04-09T18:20:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.169 7f1c07fff700 1 -- 172.21.15.120:0/2179518026 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c08002080 con 0x7f1c10198140 2021-04-09T18:20:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.169 7f1c07fff700 1 -- 172.21.15.120:0/2179518026 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1c08002560 con 0x7f1c10198140 2021-04-09T18:20:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.169 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c100e42f0 con 0x7f1c10198140 2021-04-09T18:20:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.169 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c100e42f0 con 0x7f1c10198140 2021-04-09T18:20:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.169 7f1c07fff700 1 -- 172.21.15.120:0/2179518026 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1c080067a0 con 0x7f1c10198140 2021-04-09T18:20:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.169 7f1c07fff700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1bf40188c0 0x7f1bf401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.169 7f1c07fff700 1 -- 172.21.15.120:0/2179518026 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1c08032980 con 0x7f1c10198140 2021-04-09T18:20:05.210 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.170 7f1c0f549700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1bf40188c0 0x7f1bf401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:05.210 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.170 7f1c0f549700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1bf40188c0 0x7f1bf401adc0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.193 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c100d6be0 con 0x7f1c10198140 2021-04-09T18:20:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.197 7f1c07fff700 1 -- 172.21.15.120:0/2179518026 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1c08027c90 con 0x7f1c10198140 2021-04-09T18:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.383 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1c100d6be0 con 0x7f1c10198140 2021-04-09T18:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.384 7f1c07fff700 1 -- 172.21.15.120:0/2179518026 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c08027c90 con 0x7f1c10198140 2021-04-09T18:20:05.386 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2021-04-09T18:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1bf40188c0 msgr2=0x7f1bf401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1bf40188c0 0x7f1bf401adc0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c10198140 msgr2=0x7f1c100e3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c10198140 0x7f1c100e3ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f1c08006b90 tx=0x7f1c0800b990).stop 2021-04-09T18:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 shutdown_connections 2021-04-09T18:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c10198140 0x7f1c100e3ab0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1bf40188c0 0x7f1bf401adc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c10197070 0x7f1c10197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 --2- 172.21.15.120:0/2179518026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c100b1e60 0x7f1c10196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 >> 172.21.15.120:0/2179518026 conn(0x7f1c101a1cd0 msgr2=0x7f1c100e2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 shutdown_connections 2021-04-09T18:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:05.387 7f1c1573e700 1 -- 172.21.15.120:0/2179518026 wait complete. 2021-04-09T18:20:05.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2021-04-09T18:20:06.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-04-09T18:20:06.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.549 7faccce34700 1 Processor -- start 2021-04-09T18:20:06.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.549 7faccce34700 1 -- start start 2021-04-09T18:20:06.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.549 7faccce34700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc80d7160 0x7facc80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.549 7faccce34700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80d6be0 con 0x7facc80e70a0 2021-04-09T18:20:06.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.549 7faccce34700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80e7f00 con 0x7facc80d7560 2021-04-09T18:20:06.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.549 7faccce34700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80d80f0 con 0x7facc80d7160 2021-04-09T18:20:06.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.549 7facc7314700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7facc80e70a0 0x7facc80d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47776/0 (socket says 172.21.15.120:47776) 2021-04-09T18:20:06.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc7314700 1 -- 172.21.15.120:0/3343688143 learned_addr learned my addr 172.21.15.120:0/3343688143 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:06.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc6b13700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc80d7160 0x7facc80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887891280 0 0) 0x7facc0000d30 con 0x7facc80e70a0 2021-04-09T18:20:06.594 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb4002fe0 con 0x7facc80e70a0 2021-04-09T18:20:06.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2084172734 0 0) 0x7facc0001460 con 0x7facc80e70a0 2021-04-09T18:20:06.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc80d7160 msgr2=0x7facc80e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:06.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc80d7160 0x7facc80e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 >> v1:172.21.15.134:6789/0 conn(0x7facc80d7560 legacy=0x7facc80d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc81a2ac0 con 0x7facc80e70a0 2021-04-09T18:20:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7facc0001980 con 0x7facc80e70a0 2021-04-09T18:20:06.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 >> v1:172.21.15.120:6789/0 conn(0x7facc80e70a0 legacy=0x7facc80d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.600 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facb4003aa0 0x7facb4005f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.600 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb4006750 0x7facb4008c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.600 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb4009510 0x7facb400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb400c2c0 con 0x7facb4006750 2021-04-09T18:20:06.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb400c4e0 con 0x7facb4009510 2021-04-09T18:20:06.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc5b11700 1 -- 172.21.15.120:0/3343688143 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb400c700 con 0x7facb4003aa0 2021-04-09T18:20:06.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc6312700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb4006750 0x7facb4008c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.603 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc6b13700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facb4003aa0 0x7facb4005f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.603 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc7314700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb4009510 0x7facb400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.603 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc6312700 1 -- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facb4003aa0 msgr2=0x7facb4005f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:06.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc6312700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facb4003aa0 0x7facb4005f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc6312700 1 -- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb4009510 msgr2=0x7facb400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:06.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc6312700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facb4009510 0x7facb400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.550 7facc6312700 1 -- 172.21.15.120:0/3343688143 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4050970 con 0x7facb4006750 2021-04-09T18:20:06.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.551 7facc6312700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb4006750 0x7facb4008c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7facb0006ac0 tx=0x7facb0009af0).ready entity=mon.0 client_cookie=95a6697d6a181bd3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:06.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.551 7facc5b11700 1 -- 172.21.15.120:0/3343688143 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facb0007280 con 0x7facb4006750 2021-04-09T18:20:06.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.551 7facc5b11700 1 -- 172.21.15.120:0/3343688143 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb0007580 con 0x7facb4006750 2021-04-09T18:20:06.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.551 7facc5b11700 1 -- 172.21.15.120:0/3343688143 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facb0007a60 con 0x7facb4006750 2021-04-09T18:20:06.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.551 7faccce34700 1 -- 172.21.15.120:0/3343688143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb4006750 msgr2=0x7facb4008c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.551 7faccce34700 1 --2- 172.21.15.120:0/3343688143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb4006750 0x7facb4008c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7facb0006ac0 tx=0x7facb0009af0).stop 2021-04-09T18:20:06.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.551 7facc7314700 1 -- 172.21.15.120:0/3343688143 reap_dead start 2021-04-09T18:20:06.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.552 7faccce34700 1 -- 172.21.15.120:0/3343688143 shutdown_connections 2021-04-09T18:20:06.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.552 7faccce34700 1 -- 172.21.15.120:0/3343688143 >> 172.21.15.120:0/3343688143 conn(0x7facc80d1590 msgr2=0x7facc80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:06.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.552 7faccce34700 1 -- 172.21.15.120:0/3343688143 shutdown_connections 2021-04-09T18:20:06.610 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.552 7faccce34700 1 -- 172.21.15.120:0/3343688143 wait complete. 2021-04-09T18:20:06.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.570 7faccce34700 1 Processor -- start 2021-04-09T18:20:06.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.570 7faccce34700 1 -- start start 2021-04-09T18:20:06.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7faccce34700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc819dd80 0x7facc819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7faccce34700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc80b4300 0x7facc80b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7faccce34700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc817ef00 0x7facc817f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7faccce34700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc819a5b0 con 0x7facc819dd80 2021-04-09T18:20:06.635 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7faccce34700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc819a300 con 0x7facc817ef00 2021-04-09T18:20:06.635 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7faccce34700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc819b150 con 0x7facc80b4300 2021-04-09T18:20:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6b13700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc819dd80 0x7facc819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6b13700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc819dd80 0x7facc819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52876/0 (socket says 172.21.15.120:52876) 2021-04-09T18:20:06.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6b13700 1 -- 172.21.15.120:0/3117713178 learned_addr learned my addr 172.21.15.120:0/3117713178 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:06.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc7314700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc817ef00 0x7facc817f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6312700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc80b4300 0x7facc80b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6b13700 1 -- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc80b4300 msgr2=0x7facc80b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.639 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6b13700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc80b4300 0x7facc80b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.639 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6b13700 1 -- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc817ef00 msgr2=0x7facc817f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6b13700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc817ef00 0x7facc817f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6b13700 1 -- 172.21.15.120:0/3117713178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc8189720 con 0x7facc819dd80 2021-04-09T18:20:06.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc7314700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc817ef00 0x7facc817f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:06.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facc6b13700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc819dd80 0x7facc819ab30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7facb8006f60 tx=0x7facb800b970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:06.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.571 7facbf7fe700 1 -- 172.21.15.120:0/3117713178 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facb800bd60 con 0x7facc819dd80 2021-04-09T18:20:06.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.572 7facbf7fe700 1 -- 172.21.15.120:0/3117713178 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8000c90 con 0x7facc819dd80 2021-04-09T18:20:06.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.572 7faccce34700 1 -- 172.21.15.120:0/3117713178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc8189720 con 0x7facc819dd80 2021-04-09T18:20:06.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.572 7facbf7fe700 1 -- 172.21.15.120:0/3117713178 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facb8002220 con 0x7facc819dd80 2021-04-09T18:20:06.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.572 7faccce34700 1 -- 172.21.15.120:0/3117713178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc8189720 con 0x7facc819dd80 2021-04-09T18:20:06.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.572 7facbf7fe700 1 -- 172.21.15.120:0/3117713178 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7facb800a000 con 0x7facc819dd80 2021-04-09T18:20:06.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.572 7facbf7fe700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7facac018930 0x7facac01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.572 7facbf7fe700 1 -- 172.21.15.120:0/3117713178 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7facb8032b50 con 0x7facc819dd80 2021-04-09T18:20:06.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.572 7facc6312700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7facac018930 0x7facac01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.646 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.573 7facc6312700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7facac018930 0x7facac01ae10 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:06.647 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.595 7faccce34700 1 -- 172.21.15.120:0/3117713178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc80e25e0 con 0x7facc819dd80 2021-04-09T18:20:06.647 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.599 7facbf7fe700 1 -- 172.21.15.120:0/3117713178 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7facb8000c90 con 0x7facc819dd80 2021-04-09T18:20:06.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.784 7faccce34700 1 -- 172.21.15.120:0/3117713178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7facc80e25e0 con 0x7facc819dd80 2021-04-09T18:20:06.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.784 7facbf7fe700 1 -- 172.21.15.120:0/3117713178 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7facb8006b00 con 0x7facc819dd80 2021-04-09T18:20:06.783 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2021-04-09T18:20:06.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 -- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7facac018930 msgr2=0x7facac01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7facac018930 0x7facac01ae10 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 -- 172.21.15.120:0/3117713178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc819dd80 msgr2=0x7facc819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc819dd80 0x7facc819ab30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7facb8006f60 tx=0x7facb800b970).stop 2021-04-09T18:20:06.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 -- 172.21.15.120:0/3117713178 shutdown_connections 2021-04-09T18:20:06.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc817ef00 0x7facc817f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7facac018930 0x7facac01ae10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc80b4300 0x7facc80b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 --2- 172.21.15.120:0/3117713178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facc819dd80 0x7facc819ab30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 -- 172.21.15.120:0/3117713178 >> 172.21.15.120:0/3117713178 conn(0x7facc8182270 msgr2=0x7facc80e2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:06.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 -- 172.21.15.120:0/3117713178 shutdown_connections 2021-04-09T18:20:06.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.787 7faccce34700 1 -- 172.21.15.120:0/3117713178 wait complete. 2021-04-09T18:20:06.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.2 2021-04-09T18:20:06.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-04-09T18:20:06.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.939 7f8244c3d700 1 Processor -- start 2021-04-09T18:20:06.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.939 7f8244c3d700 1 -- start start 2021-04-09T18:20:06.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f8244c3d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82400d7560 0x7f82400d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f8244c3d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82400d63b0 0x7f82401ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f8244c3d700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82400d7960 con 0x7f82400d7160 2021-04-09T18:20:06.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f8244c3d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82400d80f0 con 0x7f82400d63b0 2021-04-09T18:20:06.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f8244c3d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82400d6be0 con 0x7f82400d7560 2021-04-09T18:20:06.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823e05d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82400d7560 0x7f82400d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823f05f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82400d63b0 0x7f82401ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823e85e700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f82400d7160 0x7f82400d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42612/0 (socket says 172.21.15.120:42612) 2021-04-09T18:20:06.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823e85e700 1 -- 172.21.15.120:0/3266163208 learned_addr learned my addr 172.21.15.120:0/3266163208 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:06.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823f05f700 1 -- 172.21.15.120:0/3266163208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82400d7560 msgr2=0x7f82400d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:06.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823f05f700 1 --2- 172.21.15.120:0/3266163208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82400d7560 0x7f82400d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823f05f700 1 -- 172.21.15.120:0/3266163208 >> v1:172.21.15.134:6789/0 conn(0x7f82400d7160 legacy=0x7f82400d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823d85c700 1 -- 172.21.15.120:0/3266163208 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199995394 0 0) 0x7f8228001440 con 0x7f82400d7160 2021-04-09T18:20:06.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823f05f700 1 -- 172.21.15.120:0/3266163208 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82401a2ac0 con 0x7f82400d63b0 2021-04-09T18:20:06.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823e05d700 1 --2- 172.21.15.120:0/3266163208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82400d7560 0x7f82400d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:06.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823f05f700 1 --2- 172.21.15.120:0/3266163208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82400d63b0 0x7f82401ab1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8238006ad0 tx=0x7f8238009ad0).ready entity=mon.1 client_cookie=3004fd80ef2afed8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:06.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823d85c700 1 -- 172.21.15.120:0/3266163208 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82380022e0 con 0x7f82400d63b0 2021-04-09T18:20:06.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823d85c700 1 -- 172.21.15.120:0/3266163208 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8238006410 con 0x7f82400d63b0 2021-04-09T18:20:06.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.940 7f823d85c700 1 -- 172.21.15.120:0/3266163208 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8238002620 con 0x7f82400d63b0 2021-04-09T18:20:06.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.941 7f8244c3d700 1 -- 172.21.15.120:0/3266163208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82400d63b0 msgr2=0x7f82401ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.941 7f8244c3d700 1 --2- 172.21.15.120:0/3266163208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82400d63b0 0x7f82401ab1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8238006ad0 tx=0x7f8238009ad0).stop 2021-04-09T18:20:06.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.941 7f8244c3d700 1 -- 172.21.15.120:0/3266163208 shutdown_connections 2021-04-09T18:20:06.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.941 7f8244c3d700 1 --2- 172.21.15.120:0/3266163208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82400d63b0 0x7f82401ab1e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.941 7f8244c3d700 1 --2- 172.21.15.120:0/3266163208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82400d7560 0x7f82400d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.941 7f8244c3d700 1 -- 172.21.15.120:0/3266163208 >> 172.21.15.120:0/3266163208 conn(0x7f82400d1590 msgr2=0x7f82400d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:06.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.941 7f8244c3d700 1 -- 172.21.15.120:0/3266163208 shutdown_connections 2021-04-09T18:20:06.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.941 7f8244c3d700 1 -- 172.21.15.120:0/3266163208 wait complete. 2021-04-09T18:20:06.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.960 7f8244c3d700 1 Processor -- start 2021-04-09T18:20:06.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.960 7f8244c3d700 1 -- start start 2021-04-09T18:20:06.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.960 7f8244c3d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f824018b760 0x7f8240180760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.960 7f8244c3d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f824018bb60 0x7f824018c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.960 7f8244c3d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f824018ccf0 0x7f82400b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.960 7f8244c3d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824018c150 con 0x7f824018b760 2021-04-09T18:20:06.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.960 7f8244c3d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824017e320 con 0x7f824018ccf0 2021-04-09T18:20:06.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.960 7f8244c3d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82400b4310 con 0x7f824018bb60 2021-04-09T18:20:06.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f824018b760 0x7f8240180760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f824018b760 0x7f8240180760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52890/0 (socket says 172.21.15.120:52890) 2021-04-09T18:20:06.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e85e700 1 -- 172.21.15.120:0/3315561896 learned_addr learned my addr 172.21.15.120:0/3315561896 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:06.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e05d700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f824018bb60 0x7f824018c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823f05f700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f824018ccf0 0x7f82400b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:06.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e85e700 1 -- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f824018bb60 msgr2=0x7f824018c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e85e700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f824018bb60 0x7f824018c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e85e700 1 -- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f824018ccf0 msgr2=0x7f82400b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:06.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e85e700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f824018ccf0 0x7f82400b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:06.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e85e700 1 -- 172.21.15.120:0/3315561896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82400b4530 con 0x7f824018b760 2021-04-09T18:20:06.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f823e85e700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f824018b760 0x7f8240180760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f8228007fb0 tx=0x7f822800aad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:06.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f82377fe700 1 -- 172.21.15.120:0/3315561896 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82280048b0 con 0x7f824018b760 2021-04-09T18:20:06.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f82377fe700 1 -- 172.21.15.120:0/3315561896 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82280079c0 con 0x7f824018b760 2021-04-09T18:20:06.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82400b4530 con 0x7f824018b760 2021-04-09T18:20:06.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f82377fe700 1 -- 172.21.15.120:0/3315561896 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82280070c0 con 0x7f824018b760 2021-04-09T18:20:06.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.961 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82400b4530 con 0x7f824018b760 2021-04-09T18:20:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.962 7f82377fe700 1 -- 172.21.15.120:0/3315561896 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f82280046a0 con 0x7f824018b760 2021-04-09T18:20:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.962 7f82377fe700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8224018930 0x7f822401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:06.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.962 7f82377fe700 1 -- 172.21.15.120:0/3315561896 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f82280350f0 con 0x7f824018b760 2021-04-09T18:20:06.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.962 7f823e05d700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8224018930 0x7f822401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.019 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.963 7f823e05d700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8224018930 0x7f822401adc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:07.021 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.986 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82400e25d0 con 0x7f824018b760 2021-04-09T18:20:07.021 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:06.989 7f82377fe700 1 -- 172.21.15.120:0/3315561896 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8228000f90 con 0x7f824018b760 2021-04-09T18:20:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.173 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f82400e25d0 con 0x7f824018b760 2021-04-09T18:20:07.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.173 7f82377fe700 1 -- 172.21.15.120:0/3315561896 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82280046a0 con 0x7f824018b760 2021-04-09T18:20:07.173 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2021-04-09T18:20:07.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8224018930 msgr2=0x7f822401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8224018930 0x7f822401adc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f824018b760 msgr2=0x7f8240180760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f824018b760 0x7f8240180760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f8228007fb0 tx=0x7f822800aad0).stop 2021-04-09T18:20:07.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 shutdown_connections 2021-04-09T18:20:07.194 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f824018ccf0 0x7f82400b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.195 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8224018930 0x7f822401adc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.195 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f824018bb60 0x7f824018c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.195 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 --2- 172.21.15.120:0/3315561896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f824018b760 0x7f8240180760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 >> 172.21.15.120:0/3315561896 conn(0x7f8240199d80 msgr2=0x7f82400e2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:07.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 shutdown_connections 2021-04-09T18:20:07.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.176 7f8244c3d700 1 -- 172.21.15.120:0/3315561896 wait complete. 2021-04-09T18:20:07.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2021-04-09T18:20:07.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-04-09T18:20:07.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.350 7f196ffcd700 1 Processor -- start 2021-04-09T18:20:07.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.350 7f196ffcd700 1 -- start start 2021-04-09T18:20:07.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196ffcd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f196807e700 0x7f1968100210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196ffcd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1968100830 0x7f19680ff080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196ffcd700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19680ffc90 con 0x7f19680ff6a0 2021-04-09T18:20:07.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196ffcd700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19680d79a0 con 0x7f196807e700 2021-04-09T18:20:07.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196ffcd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19680d80e0 con 0x7f1968100830 2021-04-09T18:20:07.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196dde9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f196807e700 0x7f1968100210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196dde9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f196807e700 0x7f1968100210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52898/0 (socket says 172.21.15.120:52898) 2021-04-09T18:20:07.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196dde9700 1 -- 172.21.15.120:0/957791775 learned_addr learned my addr 172.21.15.120:0/957791775 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:07.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196d5e8700 1 --2- 172.21.15.120:0/957791775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1968100830 0x7f19680ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196dde9700 1 -- 172.21.15.120:0/957791775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1968100830 msgr2=0x7f19680ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:07.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196dde9700 1 --2- 172.21.15.120:0/957791775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1968100830 0x7f19680ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196dde9700 1 -- 172.21.15.120:0/957791775 >> v1:172.21.15.134:6789/0 conn(0x7f19680ff6a0 legacy=0x7f19681aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196dde9700 1 -- 172.21.15.120:0/957791775 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19680d2040 con 0x7f196807e700 2021-04-09T18:20:07.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196d5e8700 1 --2- 172.21.15.120:0/957791775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1968100830 0x7f19680ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:07.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196dde9700 1 --2- 172.21.15.120:0/957791775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196807e700 0x7f1968100210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1964006700 tx=0x7f1964009b80).ready entity=mon.0 client_cookie=efefff2e2af8158c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:07.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196cde7700 1 -- 172.21.15.120:0/957791775 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f196400c0c0 con 0x7f196807e700 2021-04-09T18:20:07.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196cde7700 1 -- 172.21.15.120:0/957791775 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196400c440 con 0x7f196807e700 2021-04-09T18:20:07.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.351 7f196cde7700 1 -- 172.21.15.120:0/957791775 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f196400c920 con 0x7f196807e700 2021-04-09T18:20:07.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.352 7f196ffcd700 1 -- 172.21.15.120:0/957791775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196807e700 msgr2=0x7f1968100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.352 7f196ffcd700 1 --2- 172.21.15.120:0/957791775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196807e700 0x7f1968100210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1964006700 tx=0x7f1964009b80).stop 2021-04-09T18:20:07.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.352 7f196ffcd700 1 -- 172.21.15.120:0/957791775 shutdown_connections 2021-04-09T18:20:07.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.352 7f196ffcd700 1 --2- 172.21.15.120:0/957791775 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1968100830 0x7f19680ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.352 7f196ffcd700 1 --2- 172.21.15.120:0/957791775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f196807e700 0x7f1968100210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.352 7f196ffcd700 1 -- 172.21.15.120:0/957791775 >> 172.21.15.120:0/957791775 conn(0x7f19680f0050 msgr2=0x7f19680d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:07.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.352 7f196ffcd700 1 -- 172.21.15.120:0/957791775 shutdown_connections 2021-04-09T18:20:07.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.352 7f196ffcd700 1 -- 172.21.15.120:0/957791775 wait complete. 2021-04-09T18:20:07.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.371 7f196ffcd700 1 Processor -- start 2021-04-09T18:20:07.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.371 7f196ffcd700 1 -- start start 2021-04-09T18:20:07.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.371 7f196ffcd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968180730 0x7f19680ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.371 7f196ffcd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680aed10 0x7f196817eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.371 7f196ffcd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968180b30 0x7f196817f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196ffcd700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196818deb0 con 0x7f1968180730 2021-04-09T18:20:07.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196ffcd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1968190180 con 0x7f1968180b30 2021-04-09T18:20:07.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196ffcd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196818da50 con 0x7f19680aed10 2021-04-09T18:20:07.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196dde9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968180730 0x7f19680ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196dde9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968180730 0x7f19680ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52906/0 (socket says 172.21.15.120:52906) 2021-04-09T18:20:07.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196dde9700 1 -- 172.21.15.120:0/4175094488 learned_addr learned my addr 172.21.15.120:0/4175094488 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:07.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196d5e8700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680aed10 0x7f196817eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196e5ea700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968180b30 0x7f196817f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196dde9700 1 -- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680aed10 msgr2=0x7f196817eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196dde9700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680aed10 0x7f196817eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196dde9700 1 -- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968180b30 msgr2=0x7f196817f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196dde9700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968180b30 0x7f196817f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196dde9700 1 -- 172.21.15.120:0/4175094488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196817fb30 con 0x7f1968180730 2021-04-09T18:20:07.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196e5ea700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968180b30 0x7f196817f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:07.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196dde9700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968180730 0x7f19680ae6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f196400b5e0 tx=0x7f196400b980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:07.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f195a7fc700 1 -- 172.21.15.120:0/4175094488 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f196400bd70 con 0x7f1968180730 2021-04-09T18:20:07.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f195a7fc700 1 -- 172.21.15.120:0/4175094488 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964002030 con 0x7f1968180730 2021-04-09T18:20:07.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196817fb30 con 0x7f1968180730 2021-04-09T18:20:07.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f195a7fc700 1 -- 172.21.15.120:0/4175094488 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1964002550 con 0x7f1968180730 2021-04-09T18:20:07.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.372 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196817fb30 con 0x7f1968180730 2021-04-09T18:20:07.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.373 7f195a7fc700 1 -- 172.21.15.120:0/4175094488 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1964000c90 con 0x7f1968180730 2021-04-09T18:20:07.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.373 7f195a7fc700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1950018930 0x7f195001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.373 7f195a7fc700 1 -- 172.21.15.120:0/4175094488 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1964032bc0 con 0x7f1968180730 2021-04-09T18:20:07.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.373 7f196d5e8700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1950018930 0x7f195001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.373 7f196d5e8700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1950018930 0x7f195001ae10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:07.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.397 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1968179bd0 con 0x7f1968180730 2021-04-09T18:20:07.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.400 7f195a7fc700 1 -- 172.21.15.120:0/4175094488 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f196401f7a0 con 0x7f1968180730 2021-04-09T18:20:07.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.582 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f19680ffc90 con 0x7f1968180730 2021-04-09T18:20:07.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.583 7f195a7fc700 1 -- 172.21.15.120:0/4175094488 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f196401f7a0 con 0x7f1968180730 2021-04-09T18:20:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2021-04-09T18:20:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1950018930 msgr2=0x7f195001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1950018930 0x7f195001ae10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968180730 msgr2=0x7f19680ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968180730 0x7f19680ae6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f196400b5e0 tx=0x7f196400b980).stop 2021-04-09T18:20:07.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 shutdown_connections 2021-04-09T18:20:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1968180b30 0x7f196817f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1950018930 0x7f195001ae10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19680aed10 0x7f196817eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 --2- 172.21.15.120:0/4175094488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968180730 0x7f19680ae6f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 >> 172.21.15.120:0/4175094488 conn(0x7f1968184b90 msgr2=0x7f1968190cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:07.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 shutdown_connections 2021-04-09T18:20:07.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.585 7f196ffcd700 1 -- 172.21.15.120:0/4175094488 wait complete. 2021-04-09T18:20:07.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2021-04-09T18:20:07.608 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-04-09T18:20:07.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.752 7fbf19b88700 1 Processor -- start 2021-04-09T18:20:07.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.752 7fbf19b88700 1 -- start start 2021-04-09T18:20:07.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf19b88700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140d7560 0x7fbf140d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf19b88700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbf140d63b0 0x7fbf141ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf19b88700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf140d7960 con 0x7fbf140d7160 2021-04-09T18:20:07.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf19b88700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf140d80f0 con 0x7fbf140d63b0 2021-04-09T18:20:07.780 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf19b88700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140d6be0 con 0x7fbf140d7560 2021-04-09T18:20:07.780 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf137fe700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbf140d7160 0x7fbf140d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47824/0 (socket says 172.21.15.120:47824) 2021-04-09T18:20:07.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf137fe700 1 -- 172.21.15.120:0/3737673098 learned_addr learned my addr 172.21.15.120:0/3737673098 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:07.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf13fff700 1 --2- 172.21.15.120:0/3737673098 >> v2:172.21.15.134:3300/0 conn(0x7fbf140d63b0 0x7fbf141ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf12ffd700 1 --2- 172.21.15.120:0/3737673098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140d7560 0x7fbf140d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf127fc700 1 -- 172.21.15.120:0/3737673098 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272997996 0 0) 0x7fbf04001060 con 0x7fbf140d7160 2021-04-09T18:20:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf127fc700 1 -- 172.21.15.120:0/3737673098 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbefc002fe0 con 0x7fbf140d7160 2021-04-09T18:20:07.783 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf13fff700 1 -- 172.21.15.120:0/3737673098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140d7560 msgr2=0x7fbf140d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:07.783 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.753 7fbf13fff700 1 --2- 172.21.15.120:0/3737673098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140d7560 0x7fbf140d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.784 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.754 7fbf13fff700 1 -- 172.21.15.120:0/3737673098 >> v1:172.21.15.120:6789/0 conn(0x7fbf140d7160 legacy=0x7fbf140d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.784 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.754 7fbf13fff700 1 -- 172.21.15.120:0/3737673098 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf141a2ac0 con 0x7fbf140d63b0 2021-04-09T18:20:07.784 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.754 7fbf12ffd700 1 --2- 172.21.15.120:0/3737673098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140d7560 0x7fbf140d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:07.785 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.754 7fbf13fff700 1 --2- 172.21.15.120:0/3737673098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf140d63b0 0x7fbf141ab1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbf0c006ad0 tx=0x7fbf0c009ad0).ready entity=mon.1 client_cookie=14d8fb1f8f3a0ca4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:07.785 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.754 7fbf127fc700 1 -- 172.21.15.120:0/3737673098 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbf0c0022e0 con 0x7fbf140d63b0 2021-04-09T18:20:07.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.754 7fbf127fc700 1 -- 172.21.15.120:0/3737673098 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c006410 con 0x7fbf140d63b0 2021-04-09T18:20:07.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.754 7fbf127fc700 1 -- 172.21.15.120:0/3737673098 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbf0c002620 con 0x7fbf140d63b0 2021-04-09T18:20:07.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.754 7fbf19b88700 1 -- 172.21.15.120:0/3737673098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf140d63b0 msgr2=0x7fbf141ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.754 7fbf19b88700 1 --2- 172.21.15.120:0/3737673098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf140d63b0 0x7fbf141ab1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbf0c006ad0 tx=0x7fbf0c009ad0).stop 2021-04-09T18:20:07.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.755 7fbf19b88700 1 -- 172.21.15.120:0/3737673098 shutdown_connections 2021-04-09T18:20:07.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.755 7fbf19b88700 1 --2- 172.21.15.120:0/3737673098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf140d63b0 0x7fbf141ab1e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.755 7fbf19b88700 1 --2- 172.21.15.120:0/3737673098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140d7560 0x7fbf140d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.755 7fbf19b88700 1 -- 172.21.15.120:0/3737673098 >> 172.21.15.120:0/3737673098 conn(0x7fbf140d1590 msgr2=0x7fbf140d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:07.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.755 7fbf19b88700 1 -- 172.21.15.120:0/3737673098 shutdown_connections 2021-04-09T18:20:07.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.755 7fbf19b88700 1 -- 172.21.15.120:0/3737673098 wait complete. 2021-04-09T18:20:07.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.773 7fbf19b88700 1 Processor -- start 2021-04-09T18:20:07.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.773 7fbf19b88700 1 -- start start 2021-04-09T18:20:07.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf19b88700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf141858d0 0x7fbf1417a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf19b88700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf14179bf0 0x7fbf140de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf19b88700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140ad920 0x7fbf140afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf19b88700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140a5470 con 0x7fbf141858d0 2021-04-09T18:20:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf19b88700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1417a1e0 con 0x7fbf14179bf0 2021-04-09T18:20:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf19b88700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1417ad80 con 0x7fbf140ad920 2021-04-09T18:20:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf137fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf141858d0 0x7fbf1417a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf137fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf141858d0 0x7fbf1417a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52918/0 (socket says 172.21.15.120:52918) 2021-04-09T18:20:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf137fe700 1 -- 172.21.15.120:0/2592403688 learned_addr learned my addr 172.21.15.120:0/2592403688 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:07.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf12ffd700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf14179bf0 0x7fbf140de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf13fff700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140ad920 0x7fbf140afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf137fe700 1 -- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140ad920 msgr2=0x7fbf140afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf137fe700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140ad920 0x7fbf140afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf137fe700 1 -- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf14179bf0 msgr2=0x7fbf140de1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf137fe700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf14179bf0 0x7fbf140de1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf137fe700 1 -- 172.21.15.120:0/2592403688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf140de7d0 con 0x7fbf141858d0 2021-04-09T18:20:07.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf12ffd700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf14179bf0 0x7fbf140de1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:20:07.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.774 7fbf137fe700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf141858d0 0x7fbf1417a760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbf04009980 tx=0x7fbf0400bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:07.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.775 7fbefbfff700 1 -- 172.21.15.120:0/2592403688 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbf04006080 con 0x7fbf141858d0 2021-04-09T18:20:07.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.775 7fbefbfff700 1 -- 172.21.15.120:0/2592403688 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04006380 con 0x7fbf141858d0 2021-04-09T18:20:07.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.775 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf140de7d0 con 0x7fbf141858d0 2021-04-09T18:20:07.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.775 7fbefbfff700 1 -- 172.21.15.120:0/2592403688 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbf040049a0 con 0x7fbf141858d0 2021-04-09T18:20:07.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.775 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf140de7d0 con 0x7fbf141858d0 2021-04-09T18:20:07.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.775 7fbefbfff700 1 -- 172.21.15.120:0/2592403688 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbf04006560 con 0x7fbf141858d0 2021-04-09T18:20:07.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.775 7fbefbfff700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbef4018930 0x7fbef401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:07.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.775 7fbefbfff700 1 -- 172.21.15.120:0/2592403688 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fbf04032f10 con 0x7fbf141858d0 2021-04-09T18:20:07.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.776 7fbf12ffd700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbef4018930 0x7fbef401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:07.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.776 7fbf12ffd700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbef4018930 0x7fbef401adc0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:07.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.799 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf140a5470 con 0x7fbf141858d0 2021-04-09T18:20:07.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.802 7fbefbfff700 1 -- 172.21.15.120:0/2592403688 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbf04000d30 con 0x7fbf141858d0 2021-04-09T18:20:07.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.989 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbf140a5470 con 0x7fbf141858d0 2021-04-09T18:20:07.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.989 7fbefbfff700 1 -- 172.21.15.120:0/2592403688 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf04006380 con 0x7fbf141858d0 2021-04-09T18:20:07.987 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2021-04-09T18:20:07.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbef4018930 msgr2=0x7fbef401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbef4018930 0x7fbef401adc0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf141858d0 msgr2=0x7fbf1417a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:07.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf141858d0 0x7fbf1417a760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbf04009980 tx=0x7fbf0400bcd0).stop 2021-04-09T18:20:07.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 shutdown_connections 2021-04-09T18:20:07.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbef4018930 0x7fbef401adc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbf140ad920 0x7fbf140afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:07.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf14179bf0 0x7fbf140de1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 --2- 172.21.15.120:0/2592403688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf141858d0 0x7fbf1417a760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.991 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 >> 172.21.15.120:0/2592403688 conn(0x7fbf140e4b60 msgr2=0x7fbf14198f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:08.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.992 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 shutdown_connections 2021-04-09T18:20:08.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:07.992 7fbf19b88700 1 -- 172.21.15.120:0/2592403688 wait complete. 2021-04-09T18:20:08.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2021-04-09T18:20:08.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-04-09T18:20:08.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.147 7fe1c8b8a700 1 Processor -- start 2021-04-09T18:20:08.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.147 7fe1c8b8a700 1 -- start start 2021-04-09T18:20:08.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.147 7fe1c8b8a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe1c40d7560 0x7fe1c40d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.147 7fe1c8b8a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40d63b0 0x7fe1c41ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.147 7fe1c8b8a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c40d7960 con 0x7fe1c40d7160 2021-04-09T18:20:08.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.147 7fe1c8b8a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c40d80f0 con 0x7fe1c40d7560 2021-04-09T18:20:08.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.147 7fe1c8b8a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c40d6be0 con 0x7fe1c40d63b0 2021-04-09T18:20:08.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c205d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe1c40d7560 0x7fe1c40d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c305f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40d63b0 0x7fe1c41ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c285e700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe1c40d7160 0x7fe1c40d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42658/0 (socket says 172.21.15.120:42658) 2021-04-09T18:20:08.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c205d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe1c40d7560 0x7fe1c40d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:41770/0 (socket says 172.21.15.120:41770) 2021-04-09T18:20:08.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c305f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40d63b0 0x7fe1c41ab1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:39596/0 (socket says 172.21.15.120:39596) 2021-04-09T18:20:08.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c205d700 1 -- 172.21.15.120:0/2446113303 learned_addr learned my addr 172.21.15.120:0/2446113303 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:08.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c205d700 1 -- 172.21.15.120:0/2446113303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40d63b0 msgr2=0x7fe1c41ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:08.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c205d700 1 --2- 172.21.15.120:0/2446113303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40d63b0 0x7fe1c41ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c205d700 1 -- 172.21.15.120:0/2446113303 >> v1:172.21.15.134:6789/0 conn(0x7fe1c40d7160 legacy=0x7fe1c40d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c205d700 1 -- 172.21.15.120:0/2446113303 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c40d0f10 con 0x7fe1c40d7560 2021-04-09T18:20:08.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c185c700 1 -- 172.21.15.120:0/2446113303 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860569524 0 0) 0x7fe1bc000fe0 con 0x7fe1c40d7160 2021-04-09T18:20:08.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c305f700 1 --2- 172.21.15.120:0/2446113303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40d63b0 0x7fe1c41ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:08.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c205d700 1 --2- 172.21.15.120:0/2446113303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c40d7560 0x7fe1c40d5d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe1ac006700 tx=0x7fe1ac009b80).ready entity=mon.1 client_cookie=1501efad903567da server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:08.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c185c700 1 -- 172.21.15.120:0/2446113303 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1ac00c0c0 con 0x7fe1c40d7560 2021-04-09T18:20:08.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c185c700 1 -- 172.21.15.120:0/2446113303 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac00c440 con 0x7fe1c40d7560 2021-04-09T18:20:08.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c185c700 1 -- 172.21.15.120:0/2446113303 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1ac00c920 con 0x7fe1c40d7560 2021-04-09T18:20:08.194 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c8b8a700 1 -- 172.21.15.120:0/2446113303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c40d7560 msgr2=0x7fe1c40d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.195 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.148 7fe1c8b8a700 1 --2- 172.21.15.120:0/2446113303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c40d7560 0x7fe1c40d5d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe1ac006700 tx=0x7fe1ac009b80).stop 2021-04-09T18:20:08.195 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.149 7fe1c8b8a700 1 -- 172.21.15.120:0/2446113303 shutdown_connections 2021-04-09T18:20:08.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.149 7fe1c8b8a700 1 --2- 172.21.15.120:0/2446113303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c40d7560 0x7fe1c40d5d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.149 7fe1c8b8a700 1 --2- 172.21.15.120:0/2446113303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40d63b0 0x7fe1c41ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.149 7fe1c8b8a700 1 -- 172.21.15.120:0/2446113303 >> 172.21.15.120:0/2446113303 conn(0x7fe1c40d1590 msgr2=0x7fe1c40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:08.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.149 7fe1c8b8a700 1 -- 172.21.15.120:0/2446113303 shutdown_connections 2021-04-09T18:20:08.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.149 7fe1c8b8a700 1 -- 172.21.15.120:0/2446113303 wait complete. 2021-04-09T18:20:08.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.168 7fe1c8b8a700 1 Processor -- start 2021-04-09T18:20:08.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.168 7fe1c8b8a700 1 -- start start 2021-04-09T18:20:08.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.168 7fe1c8b8a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40daab0 0x7fe1c4190530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.168 7fe1c8b8a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c40daeb0 0x7fe1c418f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.168 7fe1c8b8a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c4190b50 0x7fe1c418f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.168 7fe1c8b8a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c418ffb0 con 0x7fe1c40daeb0 2021-04-09T18:20:08.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.168 7fe1c8b8a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c40db420 con 0x7fe1c4190b50 2021-04-09T18:20:08.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.168 7fe1c8b8a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c419fb10 con 0x7fe1c40daab0 2021-04-09T18:20:08.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c205d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c40daeb0 0x7fe1c418f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c205d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c40daeb0 0x7fe1c418f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52938/0 (socket says 172.21.15.120:52938) 2021-04-09T18:20:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c285e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40daab0 0x7fe1c4190530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c205d700 1 -- 172.21.15.120:0/2420672344 learned_addr learned my addr 172.21.15.120:0/2420672344 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:08.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c305f700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c4190b50 0x7fe1c418f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c285e700 1 -- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c4190b50 msgr2=0x7fe1c418f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c285e700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c4190b50 0x7fe1c418f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c285e700 1 -- 172.21.15.120:0/2420672344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c40daeb0 msgr2=0x7fe1c418f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c285e700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c40daeb0 0x7fe1c418f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c285e700 1 -- 172.21.15.120:0/2420672344 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c419fd30 con 0x7fe1c40daab0 2021-04-09T18:20:08.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c205d700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c40daeb0 0x7fe1c418f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:08.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c285e700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40daab0 0x7fe1c4190530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe1bc00b810 tx=0x7fe1bc00bbb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:08.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1bb7fe700 1 -- 172.21.15.120:0/2420672344 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1bc004b30 con 0x7fe1c40daab0 2021-04-09T18:20:08.238 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1bb7fe700 1 -- 172.21.15.120:0/2420672344 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc0069f0 con 0x7fe1c40daab0 2021-04-09T18:20:08.238 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c419fd30 con 0x7fe1c40daab0 2021-04-09T18:20:08.238 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1bb7fe700 1 -- 172.21.15.120:0/2420672344 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1bc006220 con 0x7fe1c40daab0 2021-04-09T18:20:08.239 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.169 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c419fd30 con 0x7fe1c40daab0 2021-04-09T18:20:08.239 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.170 7fe1bb7fe700 1 -- 172.21.15.120:0/2420672344 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe1bc0046a0 con 0x7fe1c40daab0 2021-04-09T18:20:08.240 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.170 7fe1bb7fe700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1a8018930 0x7fe1a801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.240 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.170 7fe1bb7fe700 1 -- 172.21.15.120:0/2420672344 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fe1bc032e70 con 0x7fe1c40daab0 2021-04-09T18:20:08.241 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.170 7fe1c205d700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1a8018930 0x7fe1a801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.241 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.170 7fe1c205d700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1a8018930 0x7fe1a801adc0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:08.243 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.193 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c40d98b0 con 0x7fe1c40daab0 2021-04-09T18:20:08.243 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.196 7fe1bb7fe700 1 -- 172.21.15.120:0/2420672344 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe1bc0066f0 con 0x7fe1c40daab0 2021-04-09T18:20:08.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.381 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe1c40d98b0 con 0x7fe1c40daab0 2021-04-09T18:20:08.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.381 7fe1bb7fe700 1 -- 172.21.15.120:0/2420672344 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1bc0069f0 con 0x7fe1c40daab0 2021-04-09T18:20:08.380 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2021-04-09T18:20:08.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1a8018930 msgr2=0x7fe1a801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1a8018930 0x7fe1a801adc0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40daab0 msgr2=0x7fe1c4190530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40daab0 0x7fe1c4190530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe1bc00b810 tx=0x7fe1bc00bbb0).stop 2021-04-09T18:20:08.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 shutdown_connections 2021-04-09T18:20:08.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c4190b50 0x7fe1c418f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1c40daeb0 0x7fe1c418f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1a8018930 0x7fe1a801adc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 --2- 172.21.15.120:0/2420672344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c40daab0 0x7fe1c4190530 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 >> 172.21.15.120:0/2420672344 conn(0x7fe1c40e4b60 msgr2=0x7fe1c4198f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:08.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 shutdown_connections 2021-04-09T18:20:08.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.384 7fe1c8b8a700 1 -- 172.21.15.120:0/2420672344 wait complete. 2021-04-09T18:20:08.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2021-04-09T18:20:08.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-04-09T18:20:08.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.537 7fdd992cb700 1 Processor -- start 2021-04-09T18:20:08.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.537 7fdd992cb700 1 -- start start 2021-04-09T18:20:08.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.538 7fdd992cb700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdd940d7160 0x7fdd940d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.538 7fdd992cb700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdd940d55a0 0x7fdd940d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.538 7fdd992cb700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd940d6be0 con 0x7fdd940d5fc0 2021-04-09T18:20:08.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.538 7fdd992cb700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd940d80f0 con 0x7fdd940d7160 2021-04-09T18:20:08.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.538 7fdd992cb700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd941a2ac0 con 0x7fdd940d55a0 2021-04-09T18:20:08.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.538 7fdd9307d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdd940d7160 0x7fdd940d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.538 7fdd9307d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdd940d7160 0x7fdd940d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52944/0 (socket says 172.21.15.120:52944) 2021-04-09T18:20:08.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.538 7fdd9307d700 1 -- 172.21.15.120:0/4138730742 learned_addr learned my addr 172.21.15.120:0/4138730742 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:08.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.538 7fdd9287c700 1 --2- 172.21.15.120:0/4138730742 >> v2:172.21.15.134:3300/0 conn(0x7fdd940d55a0 0x7fdd940d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd9307d700 1 -- 172.21.15.120:0/4138730742 >> v2:172.21.15.134:3300/0 conn(0x7fdd940d55a0 msgr2=0x7fdd940d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:08.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd9307d700 1 --2- 172.21.15.120:0/4138730742 >> v2:172.21.15.134:3300/0 conn(0x7fdd940d55a0 0x7fdd940d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd9307d700 1 -- 172.21.15.120:0/4138730742 >> v1:172.21.15.134:6789/0 conn(0x7fdd940d5fc0 legacy=0x7fdd940d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd9307d700 1 -- 172.21.15.120:0/4138730742 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd941ac1f0 con 0x7fdd940d7160 2021-04-09T18:20:08.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd9307d700 1 --2- 172.21.15.120:0/4138730742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940d7160 0x7fdd940d7560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fdd84006700 tx=0x7fdd84009b80).ready entity=mon.0 client_cookie=661b7b3113fd6025 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:08.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd9207b700 1 -- 172.21.15.120:0/4138730742 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd8400c0c0 con 0x7fdd940d7160 2021-04-09T18:20:08.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd9207b700 1 -- 172.21.15.120:0/4138730742 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400c440 con 0x7fdd940d7160 2021-04-09T18:20:08.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd9207b700 1 -- 172.21.15.120:0/4138730742 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd8400c920 con 0x7fdd940d7160 2021-04-09T18:20:08.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd992cb700 1 -- 172.21.15.120:0/4138730742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940d7160 msgr2=0x7fdd940d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.539 7fdd992cb700 1 --2- 172.21.15.120:0/4138730742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940d7160 0x7fdd940d7560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fdd84006700 tx=0x7fdd84009b80).stop 2021-04-09T18:20:08.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.540 7fdd992cb700 1 -- 172.21.15.120:0/4138730742 shutdown_connections 2021-04-09T18:20:08.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.540 7fdd992cb700 1 --2- 172.21.15.120:0/4138730742 >> v2:172.21.15.134:3300/0 conn(0x7fdd940d55a0 0x7fdd940d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.540 7fdd992cb700 1 --2- 172.21.15.120:0/4138730742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940d7160 0x7fdd940d7560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.540 7fdd992cb700 1 -- 172.21.15.120:0/4138730742 >> 172.21.15.120:0/4138730742 conn(0x7fdd940d1590 msgr2=0x7fdd940d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:08.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.540 7fdd992cb700 1 -- 172.21.15.120:0/4138730742 shutdown_connections 2021-04-09T18:20:08.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.540 7fdd992cb700 1 -- 172.21.15.120:0/4138730742 wait complete. 2021-04-09T18:20:08.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.558 7fdd992cb700 1 Processor -- start 2021-04-09T18:20:08.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.558 7fdd992cb700 1 -- start start 2021-04-09T18:20:08.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd992cb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd9418eae0 0x7fdd94097b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd992cb700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd94098130 0x7fdd940e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd992cb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd940e40e0 0x7fdd940b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd992cb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94098650 con 0x7fdd9418eae0 2021-04-09T18:20:08.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd992cb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940b55f0 con 0x7fdd940e40e0 2021-04-09T18:20:08.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd992cb700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940b5810 con 0x7fdd94098130 2021-04-09T18:20:08.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9307d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd9418eae0 0x7fdd94097b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9307d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd9418eae0 0x7fdd94097b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52950/0 (socket says 172.21.15.120:52950) 2021-04-09T18:20:08.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9307d700 1 -- 172.21.15.120:0/3790260644 learned_addr learned my addr 172.21.15.120:0/3790260644 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:08.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9287c700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd94098130 0x7fdd940e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9387e700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd940e40e0 0x7fdd940b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9307d700 1 -- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd94098130 msgr2=0x7fdd940e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9307d700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd94098130 0x7fdd940e3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9307d700 1 -- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd940e40e0 msgr2=0x7fdd940b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9307d700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd940e40e0 0x7fdd940b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9307d700 1 -- 172.21.15.120:0/3790260644 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940b5a30 con 0x7fdd9418eae0 2021-04-09T18:20:08.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.559 7fdd9307d700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd9418eae0 0x7fdd94097b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdd8400b650 tx=0x7fdd8400b9f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:08.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.560 7fdd7bfff700 1 -- 172.21.15.120:0/3790260644 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd8400bde0 con 0x7fdd9418eae0 2021-04-09T18:20:08.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.560 7fdd7bfff700 1 -- 172.21.15.120:0/3790260644 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd84000c90 con 0x7fdd9418eae0 2021-04-09T18:20:08.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.560 7fdd7bfff700 1 -- 172.21.15.120:0/3790260644 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd84002220 con 0x7fdd9418eae0 2021-04-09T18:20:08.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.560 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd940b5a30 con 0x7fdd9418eae0 2021-04-09T18:20:08.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.560 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd940b5a30 con 0x7fdd9418eae0 2021-04-09T18:20:08.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.560 7fdd7bfff700 1 -- 172.21.15.120:0/3790260644 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdd84009f90 con 0x7fdd9418eae0 2021-04-09T18:20:08.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.560 7fdd7bfff700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdd740188c0 0x7fdd7401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.561 7fdd7bfff700 1 -- 172.21.15.120:0/3790260644 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fdd84032b30 con 0x7fdd9418eae0 2021-04-09T18:20:08.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.561 7fdd9287c700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdd740188c0 0x7fdd7401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.561 7fdd9287c700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdd740188c0 0x7fdd7401adc0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:08.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.584 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd940e25d0 con 0x7fdd9418eae0 2021-04-09T18:20:08.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.587 7fdd7bfff700 1 -- 172.21.15.120:0/3790260644 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdd840091e0 con 0x7fdd9418eae0 2021-04-09T18:20:08.771 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.774 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdd940e25d0 con 0x7fdd9418eae0 2021-04-09T18:20:08.772 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.774 7fdd7bfff700 1 -- 172.21.15.120:0/3790260644 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd8400bde0 con 0x7fdd9418eae0 2021-04-09T18:20:08.773 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2021-04-09T18:20:08.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdd740188c0 msgr2=0x7fdd7401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdd740188c0 0x7fdd7401adc0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd9418eae0 msgr2=0x7fdd94097b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd9418eae0 0x7fdd94097b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdd8400b650 tx=0x7fdd8400b9f0).stop 2021-04-09T18:20:08.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 shutdown_connections 2021-04-09T18:20:08.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd940e40e0 0x7fdd940b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdd740188c0 0x7fdd7401adc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdd94098130 0x7fdd940e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 --2- 172.21.15.120:0/3790260644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd9418eae0 0x7fdd94097b10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 >> 172.21.15.120:0/3790260644 conn(0x7fdd94199d80 msgr2=0x7fdd940e2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:08.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 shutdown_connections 2021-04-09T18:20:08.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.777 7fdd992cb700 1 -- 172.21.15.120:0/3790260644 wait complete. 2021-04-09T18:20:08.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2021-04-09T18:20:08.793 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-04-09T18:20:08.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:20:08.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.933 7f54a5793700 1 Processor -- start 2021-04-09T18:20:08.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.933 7f54a5793700 1 -- start start 2021-04-09T18:20:08.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.933 7f54a5793700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00eac40 0x7f54a00dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.933 7f54a5793700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f54a00d6760 0x7f54a00d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.933 7f54a5793700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00d61e0 con 0x7f54a00d1b40 2021-04-09T18:20:08.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.933 7f54a5793700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a00eaa10 con 0x7f54a00d6760 2021-04-09T18:20:08.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.933 7f54a5793700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00f38e0 con 0x7f54a00eac40 2021-04-09T18:20:08.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549ed73700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f54a00d1b40 0x7f54a0088000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47874/0 (socket says 172.21.15.120:47874) 2021-04-09T18:20:08.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549ed73700 1 -- 172.21.15.120:0/1498655332 learned_addr learned my addr 172.21.15.120:0/1498655332 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:08.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549fd75700 1 --2- 172.21.15.120:0/1498655332 >> v2:172.21.15.134:3300/0 conn(0x7f54a00d6760 0x7f54a00d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549f574700 1 --2- 172.21.15.120:0/1498655332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00eac40 0x7f54a00dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549e572700 1 -- 172.21.15.120:0/1498655332 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088567779 0 0) 0x7f54940009b0 con 0x7f54a00d1b40 2021-04-09T18:20:08.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549e572700 1 -- 172.21.15.120:0/1498655332 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5488002fe0 con 0x7f54a00d1b40 2021-04-09T18:20:08.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549fd75700 1 -- 172.21.15.120:0/1498655332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00eac40 msgr2=0x7f54a00dc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:08.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549fd75700 1 --2- 172.21.15.120:0/1498655332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00eac40 0x7f54a00dc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549e572700 1 -- 172.21.15.120:0/1498655332 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4165138107 0 0) 0x7f5494001010 con 0x7f54a00d1b40 2021-04-09T18:20:08.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549fd75700 1 -- 172.21.15.120:0/1498655332 >> v1:172.21.15.120:6789/0 conn(0x7f54a00d1b40 legacy=0x7f54a0088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549fd75700 1 -- 172.21.15.120:0/1498655332 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a00887f0 con 0x7f54a00d6760 2021-04-09T18:20:08.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549f574700 1 --2- 172.21.15.120:0/1498655332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00eac40 0x7f54a00dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:08.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549fd75700 1 --2- 172.21.15.120:0/1498655332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00d6760 0x7f54a00d6b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5498006ad0 tx=0x7f5498009ad0).ready entity=mon.1 client_cookie=3706644cad2d2100 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:08.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549e572700 1 -- 172.21.15.120:0/1498655332 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54980022e0 con 0x7f54a00d6760 2021-04-09T18:20:08.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549e572700 1 -- 172.21.15.120:0/1498655332 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5498006410 con 0x7f54a00d6760 2021-04-09T18:20:08.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.934 7f549e572700 1 -- 172.21.15.120:0/1498655332 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5498002620 con 0x7f54a00d6760 2021-04-09T18:20:08.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.935 7f54a5793700 1 -- 172.21.15.120:0/1498655332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00d6760 msgr2=0x7f54a00d6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.935 7f54a5793700 1 --2- 172.21.15.120:0/1498655332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00d6760 0x7f54a00d6b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5498006ad0 tx=0x7f5498009ad0).stop 2021-04-09T18:20:08.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.935 7f54a5793700 1 -- 172.21.15.120:0/1498655332 shutdown_connections 2021-04-09T18:20:08.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.935 7f54a5793700 1 --2- 172.21.15.120:0/1498655332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00d6760 0x7f54a00d6b60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.935 7f54a5793700 1 --2- 172.21.15.120:0/1498655332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00eac40 0x7f54a00dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.935 7f54a5793700 1 -- 172.21.15.120:0/1498655332 >> 172.21.15.120:0/1498655332 conn(0x7f54a00e93c0 msgr2=0x7f54a0100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:08.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.935 7f54a5793700 1 -- 172.21.15.120:0/1498655332 shutdown_connections 2021-04-09T18:20:08.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.935 7f54a5793700 1 -- 172.21.15.120:0/1498655332 wait complete. 2021-04-09T18:20:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.954 7f54a5793700 1 Processor -- start 2021-04-09T18:20:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.954 7f54a5793700 1 -- start start 2021-04-09T18:20:08.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f54a5793700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00c39c0 0x7f54a0095450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f54a5793700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54a0095a70 0x7f54a00941d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f54a5793700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00947f0 0x7f54a0191c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f54a5793700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00c3200 con 0x7f54a0095a70 2021-04-09T18:20:08.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f54a5793700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00c3550 con 0x7f54a00947f0 2021-04-09T18:20:08.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f54a5793700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a0192230 con 0x7f54a00c39c0 2021-04-09T18:20:08.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549ed73700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54a0095a70 0x7f54a00941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549ed73700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54a0095a70 0x7f54a00941d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52966/0 (socket says 172.21.15.120:52966) 2021-04-09T18:20:08.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549ed73700 1 -- 172.21.15.120:0/466300057 learned_addr learned my addr 172.21.15.120:0/466300057 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:08.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549fd75700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00947f0 0x7f54a0191c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549f574700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00c39c0 0x7f54a0095450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549ed73700 1 -- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00c39c0 msgr2=0x7f54a0095450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549ed73700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00c39c0 0x7f54a0095450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549ed73700 1 -- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00947f0 msgr2=0x7f54a0191c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:08.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549ed73700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00947f0 0x7f54a0191c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:08.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549ed73700 1 -- 172.21.15.120:0/466300057 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0192450 con 0x7f54a0095a70 2021-04-09T18:20:08.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.955 7f549ed73700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54a0095a70 0x7f54a00941d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f5494001c60 tx=0x7f549400a8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:08.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.956 7f5487fff700 1 -- 172.21.15.120:0/466300057 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f549400acc0 con 0x7f54a0095a70 2021-04-09T18:20:08.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.956 7f5487fff700 1 -- 172.21.15.120:0/466300057 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5494004140 con 0x7f54a0095a70 2021-04-09T18:20:08.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.956 7f54a5793700 1 -- 172.21.15.120:0/466300057 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a0192450 con 0x7f54a0095a70 2021-04-09T18:20:08.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.956 7f5487fff700 1 -- 172.21.15.120:0/466300057 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5494004620 con 0x7f54a0095a70 2021-04-09T18:20:08.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.956 7f54a5793700 1 -- 172.21.15.120:0/466300057 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a0192450 con 0x7f54a0095a70 2021-04-09T18:20:08.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.956 7f5487fff700 1 -- 172.21.15.120:0/466300057 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5494000d10 con 0x7f54a0095a70 2021-04-09T18:20:08.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.956 7f5487fff700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5480018930 0x7f548001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:08.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.956 7f5487fff700 1 -- 172.21.15.120:0/466300057 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5494032cd0 con 0x7f54a0095a70 2021-04-09T18:20:08.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.957 7f549f574700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5480018930 0x7f548001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:08.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.957 7f549f574700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5480018930 0x7f548001ae10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:08.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.980 7f54a5793700 1 -- 172.21.15.120:0/466300057 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a0094c80 con 0x7f54a0095a70 2021-04-09T18:20:08.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:08.983 7f5487fff700 1 -- 172.21.15.120:0/466300057 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f54940009b0 con 0x7f54a0095a70 2021-04-09T18:20:09.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.158 7f54a5793700 1 -- 172.21.15.120:0/466300057 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f54a00c3550 con 0x7f5480018930 2021-04-09T18:20:09.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.162 7f5487fff700 1 -- 172.21.15.120:0/466300057 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+77283 (crc 0 0 0) 0x7f5490000ce0 con 0x7f5480018930 2021-04-09T18:20:09.165 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2021-04-09T18:20:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:09.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 -- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5480018930 msgr2=0x7f548001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5480018930 0x7f548001ae10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 -- 172.21.15.120:0/466300057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54a0095a70 msgr2=0x7f54a00941d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54a0095a70 0x7f54a00941d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f5494001c60 tx=0x7f549400a8d0).stop 2021-04-09T18:20:09.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 -- 172.21.15.120:0/466300057 shutdown_connections 2021-04-09T18:20:09.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00947f0 0x7f54a0191c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54a0095a70 0x7f54a00941d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5480018930 0x7f548001ae10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 --2- 172.21.15.120:0/466300057 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54a00c39c0 0x7f54a0095450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 -- 172.21.15.120:0/466300057 >> 172.21.15.120:0/466300057 conn(0x7f54a00ab640 msgr2=0x7f54a009fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:09.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 -- 172.21.15.120:0/466300057 shutdown_connections 2021-04-09T18:20:09.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.168 7f54a5793700 1 -- 172.21.15.120:0/466300057 wait complete. 2021-04-09T18:20:09.200 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2021-04-09 18:20:08.744472","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8390464,"kb_used_data":1792,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584256,"statfs":{"total":773094113280,"available":764502278144,"internally_reserved":8589934592,"allocated":1835008,"data_stored":660344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000586"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671990","last_change":"2021-04-09 18:19:48.659214","last_active":"2021-04-09 18:19:54.671990","last_peered":"2021-04-09 18:19:54.671990","last_clean":"2021-04-09 18:19:54.671990","last_became_active":"2021-04-09 18:19:48.658812","last_became_peered":"2021-04-09 18:19:48.658812","last_unstale":"2021-04-09 18:19:54.671990","last_undegraded":"2021-04-09 18:19:54.671990","last_fullsized":"2021-04-09 18:19:54.671990","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734141","last_change":"2021-04-09 18:19:51.674918","last_active":"2021-04-09 18:20:03.734141","last_peered":"2021-04-09 18:20:03.734141","last_clean":"2021-04-09 18:20:03.734141","last_became_active":"2021-04-09 18:19:51.674416","last_became_peered":"2021-04-09 18:19:51.674416","last_unstale":"2021-04-09 18:20:03.734141","last_undegraded":"2021-04-09 18:20:03.734141","last_fullsized":"2021-04-09 18:20:03.734141","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687668","last_change":"2021-04-09 18:19:54.682596","last_active":"2021-04-09 18:19:54.687668","last_peered":"2021-04-09 18:19:54.687668","last_clean":"2021-04-09 18:19:54.687668","last_became_active":"2021-04-09 18:19:54.682305","last_became_peered":"2021-04-09 18:19:54.682305","last_unstale":"2021-04-09 18:19:54.687668","last_undegraded":"2021-04-09 18:19:54.687668","last_fullsized":"2021-04-09 18:19:54.687668","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671958","last_change":"2021-04-09 18:19:48.659288","last_active":"2021-04-09 18:19:54.671958","last_peered":"2021-04-09 18:19:54.671958","last_clean":"2021-04-09 18:19:54.671958","last_became_active":"2021-04-09 18:19:48.658917","last_became_peered":"2021-04-09 18:19:48.658917","last_unstale":"2021-04-09 18:19:54.671958","last_undegraded":"2021-04-09 18:19:54.671958","last_fullsized":"2021-04-09 18:19:54.671958","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"22'6","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735716","last_change":"2021-04-09 18:19:51.675020","last_active":"2021-04-09 18:20:03.735716","last_peered":"2021-04-09 18:20:03.735716","last_clean":"2021-04-09 18:20:03.735716","last_became_active":"2021-04-09 18:19:51.674681","last_became_peered":"2021-04-09 18:19:51.674681","last_unstale":"2021-04-09 18:20:03.735716","last_undegraded":"2021-04-09 18:20:03.735716","last_fullsized":"2021-04-09 18:20:03.735716","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688301","last_change":"2021-04-09 18:19:54.681265","last_active":"2021-04-09 18:19:54.688301","last_peered":"2021-04-09 18:19:54.688301","last_clean":"2021-04-09 18:19:54.688301","last_became_active":"2021-04-09 18:19:54.680726","last_became_peered":"2021-04-09 18:19:54.680726","last_unstale":"2021-04-09 18:19:54.688301","last_undegraded":"2021-04-09 18:19:54.688301","last_fullsized":"2021-04-09 18:19:54.688301","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685391","last_change":"2021-04-09 18:19:54.680273","last_active":"2021-04-09 18:19:54.685391","last_peered":"2021-04-09 18:19:54.685391","last_clean":"2021-04-09 18:19:54.685391","last_became_active":"2021-04-09 18:19:54.679793","last_became_peered":"2021-04-09 18:19:54.679793","last_unstale":"2021-04-09 18:19:54.685391","last_undegraded":"2021-04-09 18:19:54.685391","last_fullsized":"2021-04-09 18:19:54.685391","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672282","last_change":"2021-04-09 18:19:48.670446","last_active":"2021-04-09 18:19:54.672282","last_peered":"2021-04-09 18:19:54.672282","last_clean":"2021-04-09 18:19:54.672282","last_became_active":"2021-04-09 18:19:48.670077","last_became_peered":"2021-04-09 18:19:48.670077","last_unstale":"2021-04-09 18:19:54.672282","last_undegraded":"2021-04-09 18:19:54.672282","last_fullsized":"2021-04-09 18:19:54.672282","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.732647","last_change":"2021-04-09 18:19:51.668684","last_active":"2021-04-09 18:20:03.732647","last_peered":"2021-04-09 18:20:03.732647","last_clean":"2021-04-09 18:20:03.732647","last_became_active":"2021-04-09 18:19:51.668425","last_became_peered":"2021-04-09 18:19:51.668425","last_unstale":"2021-04-09 18:20:03.732647","last_undegraded":"2021-04-09 18:20:03.732647","last_fullsized":"2021-04-09 18:20:03.732647","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685459","last_change":"2021-04-09 18:19:54.678757","last_active":"2021-04-09 18:19:54.685459","last_peered":"2021-04-09 18:19:54.685459","last_clean":"2021-04-09 18:19:54.685459","last_became_active":"2021-04-09 18:19:54.678420","last_became_peered":"2021-04-09 18:19:54.678420","last_unstale":"2021-04-09 18:19:54.685459","last_undegraded":"2021-04-09 18:19:54.685459","last_fullsized":"2021-04-09 18:19:54.685459","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672124","last_change":"2021-04-09 18:19:48.660463","last_active":"2021-04-09 18:19:54.672124","last_peered":"2021-04-09 18:19:54.672124","last_clean":"2021-04-09 18:19:54.672124","last_became_active":"2021-04-09 18:19:48.660038","last_became_peered":"2021-04-09 18:19:48.660038","last_unstale":"2021-04-09 18:19:54.672124","last_undegraded":"2021-04-09 18:19:54.672124","last_fullsized":"2021-04-09 18:19:54.672124","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735889","last_change":"2021-04-09 18:19:51.670965","last_active":"2021-04-09 18:20:03.735889","last_peered":"2021-04-09 18:20:03.735889","last_clean":"2021-04-09 18:20:03.735889","last_became_active":"2021-04-09 18:19:51.670767","last_became_peered":"2021-04-09 18:19:51.670767","last_unstale":"2021-04-09 18:20:03.735889","last_undegraded":"2021-04-09 18:20:03.735889","last_fullsized":"2021-04-09 18:20:03.735889","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674910","last_change":"2021-04-09 18:19:48.668518","last_active":"2021-04-09 18:19:54.674910","last_peered":"2021-04-09 18:19:54.674910","last_clean":"2021-04-09 18:19:54.674910","last_became_active":"2021-04-09 18:19:48.668225","last_became_peered":"2021-04-09 18:19:48.668225","last_unstale":"2021-04-09 18:19:54.674910","last_undegraded":"2021-04-09 18:19:54.674910","last_fullsized":"2021-04-09 18:19:54.674910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'5","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734821","last_change":"2021-04-09 18:19:51.675432","last_active":"2021-04-09 18:20:03.734821","last_peered":"2021-04-09 18:20:03.734821","last_clean":"2021-04-09 18:20:03.734821","last_became_active":"2021-04-09 18:19:51.675161","last_became_peered":"2021-04-09 18:19:51.675161","last_unstale":"2021-04-09 18:20:03.734821","last_undegraded":"2021-04-09 18:20:03.734821","last_fullsized":"2021-04-09 18:20:03.734821","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685526","last_change":"2021-04-09 18:19:54.680136","last_active":"2021-04-09 18:19:54.685526","last_peered":"2021-04-09 18:19:54.685526","last_clean":"2021-04-09 18:19:54.685526","last_became_active":"2021-04-09 18:19:54.679654","last_became_peered":"2021-04-09 18:19:54.679654","last_unstale":"2021-04-09 18:19:54.685526","last_undegraded":"2021-04-09 18:19:54.685526","last_fullsized":"2021-04-09 18:19:54.685526","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674829","last_change":"2021-04-09 18:19:48.659172","last_active":"2021-04-09 18:19:54.674829","last_peered":"2021-04-09 18:19:54.674829","last_clean":"2021-04-09 18:19:54.674829","last_became_active":"2021-04-09 18:19:48.658788","last_became_peered":"2021-04-09 18:19:48.658788","last_unstale":"2021-04-09 18:19:54.674829","last_undegraded":"2021-04-09 18:19:54.674829","last_fullsized":"2021-04-09 18:19:54.674829","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:19:55.096291","last_change":"2021-04-09 18:19:51.675238","last_active":"2021-04-09 18:19:55.096291","last_peered":"2021-04-09 18:19:55.096291","last_clean":"2021-04-09 18:19:55.096291","last_became_active":"2021-04-09 18:19:51.674810","last_became_peered":"2021-04-09 18:19:51.674810","last_unstale":"2021-04-09 18:19:55.096291","last_undegraded":"2021-04-09 18:19:55.096291","last_fullsized":"2021-04-09 18:19:55.096291","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687598","last_change":"2021-04-09 18:19:54.680226","last_active":"2021-04-09 18:19:54.687598","last_peered":"2021-04-09 18:19:54.687598","last_clean":"2021-04-09 18:19:54.687598","last_became_active":"2021-04-09 18:19:54.679836","last_became_peered":"2021-04-09 18:19:54.679836","last_unstale":"2021-04-09 18:19:54.687598","last_undegraded":"2021-04-09 18:19:54.687598","last_fullsized":"2021-04-09 18:19:54.687598","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.676168","last_change":"2021-04-09 18:19:51.679961","last_active":"2021-04-09 18:19:54.676168","last_peered":"2021-04-09 18:19:54.676168","last_clean":"2021-04-09 18:19:54.676168","last_became_active":"2021-04-09 18:19:51.679689","last_became_peered":"2021-04-09 18:19:51.679689","last_unstale":"2021-04-09 18:19:54.676168","last_undegraded":"2021-04-09 18:19:54.676168","last_fullsized":"2021-04-09 18:19:54.676168","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674925","last_change":"2021-04-09 18:19:48.668812","last_active":"2021-04-09 18:19:54.674925","last_peered":"2021-04-09 18:19:54.674925","last_clean":"2021-04-09 18:19:54.674925","last_became_active":"2021-04-09 18:19:48.668474","last_became_peered":"2021-04-09 18:19:48.668474","last_unstale":"2021-04-09 18:19:54.674925","last_undegraded":"2021-04-09 18:19:54.674925","last_fullsized":"2021-04-09 18:19:54.674925","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688310","last_change":"2021-04-09 18:19:54.681340","last_active":"2021-04-09 18:19:54.688310","last_peered":"2021-04-09 18:19:54.688310","last_clean":"2021-04-09 18:19:54.688310","last_became_active":"2021-04-09 18:19:54.680877","last_became_peered":"2021-04-09 18:19:54.680877","last_unstale":"2021-04-09 18:19:54.688310","last_undegraded":"2021-04-09 18:19:54.688310","last_fullsized":"2021-04-09 18:19:54.688310","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735473","last_change":"2021-04-09 18:19:51.675129","last_active":"2021-04-09 18:20:03.735473","last_peered":"2021-04-09 18:20:03.735473","last_clean":"2021-04-09 18:20:03.735473","last_became_active":"2021-04-09 18:19:51.674771","last_became_peered":"2021-04-09 18:19:51.674771","last_unstale":"2021-04-09 18:20:03.735473","last_undegraded":"2021-04-09 18:20:03.735473","last_fullsized":"2021-04-09 18:20:03.735473","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672077","last_change":"2021-04-09 18:19:48.660437","last_active":"2021-04-09 18:19:54.672077","last_peered":"2021-04-09 18:19:54.672077","last_clean":"2021-04-09 18:19:54.672077","last_became_active":"2021-04-09 18:19:48.660180","last_became_peered":"2021-04-09 18:19:48.660180","last_unstale":"2021-04-09 18:19:54.672077","last_undegraded":"2021-04-09 18:19:54.672077","last_fullsized":"2021-04-09 18:19:54.672077","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685605","last_change":"2021-04-09 18:19:54.679817","last_active":"2021-04-09 18:19:54.685605","last_peered":"2021-04-09 18:19:54.685605","last_clean":"2021-04-09 18:19:54.685605","last_became_active":"2021-04-09 18:19:54.679420","last_became_peered":"2021-04-09 18:19:54.679420","last_unstale":"2021-04-09 18:19:54.685605","last_undegraded":"2021-04-09 18:19:54.685605","last_fullsized":"2021-04-09 18:19:54.685605","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":215.762}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]}]}} 2021-04-09T18:20:09.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:20:09.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.346 7fa58e07a700 1 Processor -- start 2021-04-09T18:20:09.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.346 7fa58e07a700 1 -- start start 2021-04-09T18:20:09.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa58e07a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880d7160 0x7fa5880e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa58e07a700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880d6be0 con 0x7fa5880e70a0 2021-04-09T18:20:09.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa58e07a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880e7f00 con 0x7fa5880d7560 2021-04-09T18:20:09.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa58e07a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880d80f0 con 0x7fa5880d7160 2021-04-09T18:20:09.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa587fff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa5880e70a0 0x7fa5880d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47886/0 (socket says 172.21.15.120:47886) 2021-04-09T18:20:09.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa587fff700 1 -- 172.21.15.120:0/1868416279 learned_addr learned my addr 172.21.15.120:0/1868416279 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:09.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa5877fe700 1 --2- 172.21.15.120:0/1868416279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880d7160 0x7fa5880e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa5867fc700 1 -- 172.21.15.120:0/1868416279 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054023337 0 0) 0x7fa5800009b0 con 0x7fa5880e70a0 2021-04-09T18:20:09.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa5867fc700 1 -- 172.21.15.120:0/1868416279 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa568002fe0 con 0x7fa5880e70a0 2021-04-09T18:20:09.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa5867fc700 1 -- 172.21.15.120:0/1868416279 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 443553485 0 0) 0x7fa580000ef0 con 0x7fa5880e70a0 2021-04-09T18:20:09.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa5877fe700 1 -- 172.21.15.120:0/1868416279 >> v1:172.21.15.134:6789/0 conn(0x7fa5880d7560 legacy=0x7fa5880d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa5877fe700 1 -- 172.21.15.120:0/1868416279 >> v1:172.21.15.120:6789/0 conn(0x7fa5880e70a0 legacy=0x7fa5880d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.347 7fa5877fe700 1 -- 172.21.15.120:0/1868416279 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5881a2ac0 con 0x7fa5880d7160 2021-04-09T18:20:09.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.348 7fa5877fe700 1 --2- 172.21.15.120:0/1868416279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880d7160 0x7fa5880e78e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa5780069d0 tx=0x7fa578009e40).ready entity=mon.2 client_cookie=fcf3229088fbc4de server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:09.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.348 7fa5867fc700 1 -- 172.21.15.120:0/1868416279 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa57800b510 con 0x7fa5880d7160 2021-04-09T18:20:09.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.348 7fa5867fc700 1 -- 172.21.15.120:0/1868416279 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57800b890 con 0x7fa5880d7160 2021-04-09T18:20:09.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.348 7fa5867fc700 1 -- 172.21.15.120:0/1868416279 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa57800bd70 con 0x7fa5880d7160 2021-04-09T18:20:09.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.348 7fa58e07a700 1 -- 172.21.15.120:0/1868416279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880d7160 msgr2=0x7fa5880e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.348 7fa58e07a700 1 --2- 172.21.15.120:0/1868416279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880d7160 0x7fa5880e78e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa5780069d0 tx=0x7fa578009e40).stop 2021-04-09T18:20:09.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.348 7fa58e07a700 1 -- 172.21.15.120:0/1868416279 shutdown_connections 2021-04-09T18:20:09.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.348 7fa58e07a700 1 --2- 172.21.15.120:0/1868416279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5880d7160 0x7fa5880e78e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.348 7fa58e07a700 1 -- 172.21.15.120:0/1868416279 >> 172.21.15.120:0/1868416279 conn(0x7fa5880d1590 msgr2=0x7fa5880d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:09.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.349 7fa58e07a700 1 -- 172.21.15.120:0/1868416279 shutdown_connections 2021-04-09T18:20:09.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.349 7fa58e07a700 1 -- 172.21.15.120:0/1868416279 wait complete. 2021-04-09T18:20:09.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.367 7fa58e07a700 1 Processor -- start 2021-04-09T18:20:09.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.367 7fa58e07a700 1 -- start start 2021-04-09T18:20:09.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa58e07a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa588199ee0 0x7fa5880aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa58e07a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880ad4d0 0x7fa58817b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa58e07a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa58819a2e0 0x7fa58817bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa58e07a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5881999e0 con 0x7fa588199ee0 2021-04-09T18:20:09.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa58e07a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa588197480 con 0x7fa5880ad4d0 2021-04-09T18:20:09.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa58e07a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58817c190 con 0x7fa58819a2e0 2021-04-09T18:20:09.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa5877fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa588199ee0 0x7fa5880aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa5877fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa588199ee0 0x7fa5880aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52978/0 (socket says 172.21.15.120:52978) 2021-04-09T18:20:09.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa5877fe700 1 -- 172.21.15.120:0/475504696 learned_addr learned my addr 172.21.15.120:0/475504696 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:09.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa587fff700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa58819a2e0 0x7fa58817bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa586ffd700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880ad4d0 0x7fa58817b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa5877fe700 1 -- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa58819a2e0 msgr2=0x7fa58817bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa5877fe700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa58819a2e0 0x7fa58817bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa5877fe700 1 -- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880ad4d0 msgr2=0x7fa58817b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa5877fe700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880ad4d0 0x7fa58817b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa5877fe700 1 -- 172.21.15.120:0/475504696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58817c3b0 con 0x7fa588199ee0 2021-04-09T18:20:09.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa5877fe700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa588199ee0 0x7fa5880aceb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa578009f40 tx=0x7fa57800bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:09.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa57ffff700 1 -- 172.21.15.120:0/475504696 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa57800c2f0 con 0x7fa588199ee0 2021-04-09T18:20:09.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa57ffff700 1 -- 172.21.15.120:0/475504696 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57800c5f0 con 0x7fa588199ee0 2021-04-09T18:20:09.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa58e07a700 1 -- 172.21.15.120:0/475504696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58817c3b0 con 0x7fa588199ee0 2021-04-09T18:20:09.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa57ffff700 1 -- 172.21.15.120:0/475504696 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa57800cad0 con 0x7fa588199ee0 2021-04-09T18:20:09.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.368 7fa58e07a700 1 -- 172.21.15.120:0/475504696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58817c3b0 con 0x7fa588199ee0 2021-04-09T18:20:09.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.369 7fa57ffff700 1 -- 172.21.15.120:0/475504696 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa57800c2f0 con 0x7fa588199ee0 2021-04-09T18:20:09.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.369 7fa57ffff700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa560018930 0x7fa56001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.369 7fa57ffff700 1 -- 172.21.15.120:0/475504696 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa578032ef0 con 0x7fa588199ee0 2021-04-09T18:20:09.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.369 7fa586ffd700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa560018930 0x7fa56001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.370 7fa586ffd700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa560018930 0x7fa56001ae10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:09.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.393 7fa58e07a700 1 -- 172.21.15.120:0/475504696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5880ccbd0 con 0x7fa588199ee0 2021-04-09T18:20:09.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.396 7fa57ffff700 1 -- 172.21.15.120:0/475504696 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa57800be10 con 0x7fa588199ee0 2021-04-09T18:20:09.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.573 7fa58e07a700 1 -- 172.21.15.120:0/475504696 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fa5880ccbd0 con 0x7fa560018930 2021-04-09T18:20:09.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.576 7fa57ffff700 1 -- 172.21.15.120:0/475504696 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+77283 (crc 0 0 0) 0x7fa570006e60 con 0x7fa560018930 2021-04-09T18:20:09.574 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2021-04-09T18:20:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:09.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 -- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa560018930 msgr2=0x7fa56001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa560018930 0x7fa56001ae10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 -- 172.21.15.120:0/475504696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa588199ee0 msgr2=0x7fa5880aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa588199ee0 0x7fa5880aceb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa578009f40 tx=0x7fa57800bcd0).stop 2021-04-09T18:20:09.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 -- 172.21.15.120:0/475504696 shutdown_connections 2021-04-09T18:20:09.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa560018930 0x7fa56001ae10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa58819a2e0 0x7fa58817bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5880ad4d0 0x7fa58817b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.603 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 --2- 172.21.15.120:0/475504696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa588199ee0 0x7fa5880aceb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.603 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 -- 172.21.15.120:0/475504696 >> 172.21.15.120:0/475504696 conn(0x7fa588183960 msgr2=0x7fa588187490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:09.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 -- 172.21.15.120:0/475504696 shutdown_connections 2021-04-09T18:20:09.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.578 7fa58e07a700 1 -- 172.21.15.120:0/475504696 wait complete. 2021-04-09T18:20:09.614 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2021-04-09 18:20:08.744472","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8390464,"kb_used_data":1792,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584256,"statfs":{"total":773094113280,"available":764502278144,"internally_reserved":8589934592,"allocated":1835008,"data_stored":660344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000586"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671990","last_change":"2021-04-09 18:19:48.659214","last_active":"2021-04-09 18:19:54.671990","last_peered":"2021-04-09 18:19:54.671990","last_clean":"2021-04-09 18:19:54.671990","last_became_active":"2021-04-09 18:19:48.658812","last_became_peered":"2021-04-09 18:19:48.658812","last_unstale":"2021-04-09 18:19:54.671990","last_undegraded":"2021-04-09 18:19:54.671990","last_fullsized":"2021-04-09 18:19:54.671990","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734141","last_change":"2021-04-09 18:19:51.674918","last_active":"2021-04-09 18:20:03.734141","last_peered":"2021-04-09 18:20:03.734141","last_clean":"2021-04-09 18:20:03.734141","last_became_active":"2021-04-09 18:19:51.674416","last_became_peered":"2021-04-09 18:19:51.674416","last_unstale":"2021-04-09 18:20:03.734141","last_undegraded":"2021-04-09 18:20:03.734141","last_fullsized":"2021-04-09 18:20:03.734141","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687668","last_change":"2021-04-09 18:19:54.682596","last_active":"2021-04-09 18:19:54.687668","last_peered":"2021-04-09 18:19:54.687668","last_clean":"2021-04-09 18:19:54.687668","last_became_active":"2021-04-09 18:19:54.682305","last_became_peered":"2021-04-09 18:19:54.682305","last_unstale":"2021-04-09 18:19:54.687668","last_undegraded":"2021-04-09 18:19:54.687668","last_fullsized":"2021-04-09 18:19:54.687668","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671958","last_change":"2021-04-09 18:19:48.659288","last_active":"2021-04-09 18:19:54.671958","last_peered":"2021-04-09 18:19:54.671958","last_clean":"2021-04-09 18:19:54.671958","last_became_active":"2021-04-09 18:19:48.658917","last_became_peered":"2021-04-09 18:19:48.658917","last_unstale":"2021-04-09 18:19:54.671958","last_undegraded":"2021-04-09 18:19:54.671958","last_fullsized":"2021-04-09 18:19:54.671958","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"22'6","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735716","last_change":"2021-04-09 18:19:51.675020","last_active":"2021-04-09 18:20:03.735716","last_peered":"2021-04-09 18:20:03.735716","last_clean":"2021-04-09 18:20:03.735716","last_became_active":"2021-04-09 18:19:51.674681","last_became_peered":"2021-04-09 18:19:51.674681","last_unstale":"2021-04-09 18:20:03.735716","last_undegraded":"2021-04-09 18:20:03.735716","last_fullsized":"2021-04-09 18:20:03.735716","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688301","last_change":"2021-04-09 18:19:54.681265","last_active":"2021-04-09 18:19:54.688301","last_peered":"2021-04-09 18:19:54.688301","last_clean":"2021-04-09 18:19:54.688301","last_became_active":"2021-04-09 18:19:54.680726","last_became_peered":"2021-04-09 18:19:54.680726","last_unstale":"2021-04-09 18:19:54.688301","last_undegraded":"2021-04-09 18:19:54.688301","last_fullsized":"2021-04-09 18:19:54.688301","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685391","last_change":"2021-04-09 18:19:54.680273","last_active":"2021-04-09 18:19:54.685391","last_peered":"2021-04-09 18:19:54.685391","last_clean":"2021-04-09 18:19:54.685391","last_became_active":"2021-04-09 18:19:54.679793","last_became_peered":"2021-04-09 18:19:54.679793","last_unstale":"2021-04-09 18:19:54.685391","last_undegraded":"2021-04-09 18:19:54.685391","last_fullsized":"2021-04-09 18:19:54.685391","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672282","last_change":"2021-04-09 18:19:48.670446","last_active":"2021-04-09 18:19:54.672282","last_peered":"2021-04-09 18:19:54.672282","last_clean":"2021-04-09 18:19:54.672282","last_became_active":"2021-04-09 18:19:48.670077","last_became_peered":"2021-04-09 18:19:48.670077","last_unstale":"2021-04-09 18:19:54.672282","last_undegraded":"2021-04-09 18:19:54.672282","last_fullsized":"2021-04-09 18:19:54.672282","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.732647","last_change":"2021-04-09 18:19:51.668684","last_active":"2021-04-09 18:20:03.732647","last_peered":"2021-04-09 18:20:03.732647","last_clean":"2021-04-09 18:20:03.732647","last_became_active":"2021-04-09 18:19:51.668425","last_became_peered":"2021-04-09 18:19:51.668425","last_unstale":"2021-04-09 18:20:03.732647","last_undegraded":"2021-04-09 18:20:03.732647","last_fullsized":"2021-04-09 18:20:03.732647","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685459","last_change":"2021-04-09 18:19:54.678757","last_active":"2021-04-09 18:19:54.685459","last_peered":"2021-04-09 18:19:54.685459","last_clean":"2021-04-09 18:19:54.685459","last_became_active":"2021-04-09 18:19:54.678420","last_became_peered":"2021-04-09 18:19:54.678420","last_unstale":"2021-04-09 18:19:54.685459","last_undegraded":"2021-04-09 18:19:54.685459","last_fullsized":"2021-04-09 18:19:54.685459","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672124","last_change":"2021-04-09 18:19:48.660463","last_active":"2021-04-09 18:19:54.672124","last_peered":"2021-04-09 18:19:54.672124","last_clean":"2021-04-09 18:19:54.672124","last_became_active":"2021-04-09 18:19:48.660038","last_became_peered":"2021-04-09 18:19:48.660038","last_unstale":"2021-04-09 18:19:54.672124","last_undegraded":"2021-04-09 18:19:54.672124","last_fullsized":"2021-04-09 18:19:54.672124","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735889","last_change":"2021-04-09 18:19:51.670965","last_active":"2021-04-09 18:20:03.735889","last_peered":"2021-04-09 18:20:03.735889","last_clean":"2021-04-09 18:20:03.735889","last_became_active":"2021-04-09 18:19:51.670767","last_became_peered":"2021-04-09 18:19:51.670767","last_unstale":"2021-04-09 18:20:03.735889","last_undegraded":"2021-04-09 18:20:03.735889","last_fullsized":"2021-04-09 18:20:03.735889","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674910","last_change":"2021-04-09 18:19:48.668518","last_active":"2021-04-09 18:19:54.674910","last_peered":"2021-04-09 18:19:54.674910","last_clean":"2021-04-09 18:19:54.674910","last_became_active":"2021-04-09 18:19:48.668225","last_became_peered":"2021-04-09 18:19:48.668225","last_unstale":"2021-04-09 18:19:54.674910","last_undegraded":"2021-04-09 18:19:54.674910","last_fullsized":"2021-04-09 18:19:54.674910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'5","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734821","last_change":"2021-04-09 18:19:51.675432","last_active":"2021-04-09 18:20:03.734821","last_peered":"2021-04-09 18:20:03.734821","last_clean":"2021-04-09 18:20:03.734821","last_became_active":"2021-04-09 18:19:51.675161","last_became_peered":"2021-04-09 18:19:51.675161","last_unstale":"2021-04-09 18:20:03.734821","last_undegraded":"2021-04-09 18:20:03.734821","last_fullsized":"2021-04-09 18:20:03.734821","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685526","last_change":"2021-04-09 18:19:54.680136","last_active":"2021-04-09 18:19:54.685526","last_peered":"2021-04-09 18:19:54.685526","last_clean":"2021-04-09 18:19:54.685526","last_became_active":"2021-04-09 18:19:54.679654","last_became_peered":"2021-04-09 18:19:54.679654","last_unstale":"2021-04-09 18:19:54.685526","last_undegraded":"2021-04-09 18:19:54.685526","last_fullsized":"2021-04-09 18:19:54.685526","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674829","last_change":"2021-04-09 18:19:48.659172","last_active":"2021-04-09 18:19:54.674829","last_peered":"2021-04-09 18:19:54.674829","last_clean":"2021-04-09 18:19:54.674829","last_became_active":"2021-04-09 18:19:48.658788","last_became_peered":"2021-04-09 18:19:48.658788","last_unstale":"2021-04-09 18:19:54.674829","last_undegraded":"2021-04-09 18:19:54.674829","last_fullsized":"2021-04-09 18:19:54.674829","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:19:55.096291","last_change":"2021-04-09 18:19:51.675238","last_active":"2021-04-09 18:19:55.096291","last_peered":"2021-04-09 18:19:55.096291","last_clean":"2021-04-09 18:19:55.096291","last_became_active":"2021-04-09 18:19:51.674810","last_became_peered":"2021-04-09 18:19:51.674810","last_unstale":"2021-04-09 18:19:55.096291","last_undegraded":"2021-04-09 18:19:55.096291","last_fullsized":"2021-04-09 18:19:55.096291","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687598","last_change":"2021-04-09 18:19:54.680226","last_active":"2021-04-09 18:19:54.687598","last_peered":"2021-04-09 18:19:54.687598","last_clean":"2021-04-09 18:19:54.687598","last_became_active":"2021-04-09 18:19:54.679836","last_became_peered":"2021-04-09 18:19:54.679836","last_unstale":"2021-04-09 18:19:54.687598","last_undegraded":"2021-04-09 18:19:54.687598","last_fullsized":"2021-04-09 18:19:54.687598","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.676168","last_change":"2021-04-09 18:19:51.679961","last_active":"2021-04-09 18:19:54.676168","last_peered":"2021-04-09 18:19:54.676168","last_clean":"2021-04-09 18:19:54.676168","last_became_active":"2021-04-09 18:19:51.679689","last_became_peered":"2021-04-09 18:19:51.679689","last_unstale":"2021-04-09 18:19:54.676168","last_undegraded":"2021-04-09 18:19:54.676168","last_fullsized":"2021-04-09 18:19:54.676168","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674925","last_change":"2021-04-09 18:19:48.668812","last_active":"2021-04-09 18:19:54.674925","last_peered":"2021-04-09 18:19:54.674925","last_clean":"2021-04-09 18:19:54.674925","last_became_active":"2021-04-09 18:19:48.668474","last_became_peered":"2021-04-09 18:19:48.668474","last_unstale":"2021-04-09 18:19:54.674925","last_undegraded":"2021-04-09 18:19:54.674925","last_fullsized":"2021-04-09 18:19:54.674925","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688310","last_change":"2021-04-09 18:19:54.681340","last_active":"2021-04-09 18:19:54.688310","last_peered":"2021-04-09 18:19:54.688310","last_clean":"2021-04-09 18:19:54.688310","last_became_active":"2021-04-09 18:19:54.680877","last_became_peered":"2021-04-09 18:19:54.680877","last_unstale":"2021-04-09 18:19:54.688310","last_undegraded":"2021-04-09 18:19:54.688310","last_fullsized":"2021-04-09 18:19:54.688310","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735473","last_change":"2021-04-09 18:19:51.675129","last_active":"2021-04-09 18:20:03.735473","last_peered":"2021-04-09 18:20:03.735473","last_clean":"2021-04-09 18:20:03.735473","last_became_active":"2021-04-09 18:19:51.674771","last_became_peered":"2021-04-09 18:19:51.674771","last_unstale":"2021-04-09 18:20:03.735473","last_undegraded":"2021-04-09 18:20:03.735473","last_fullsized":"2021-04-09 18:20:03.735473","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672077","last_change":"2021-04-09 18:19:48.660437","last_active":"2021-04-09 18:19:54.672077","last_peered":"2021-04-09 18:19:54.672077","last_clean":"2021-04-09 18:19:54.672077","last_became_active":"2021-04-09 18:19:48.660180","last_became_peered":"2021-04-09 18:19:48.660180","last_unstale":"2021-04-09 18:19:54.672077","last_undegraded":"2021-04-09 18:19:54.672077","last_fullsized":"2021-04-09 18:19:54.672077","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685605","last_change":"2021-04-09 18:19:54.679817","last_active":"2021-04-09 18:19:54.685605","last_peered":"2021-04-09 18:19:54.685605","last_clean":"2021-04-09 18:19:54.685605","last_became_active":"2021-04-09 18:19:54.679420","last_became_peered":"2021-04-09 18:19:54.679420","last_unstale":"2021-04-09 18:19:54.685605","last_undegraded":"2021-04-09 18:19:54.685605","last_fullsized":"2021-04-09 18:19:54.685605","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":215.762}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]}]}} 2021-04-09T18:20:09.634 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json-pretty 2021-04-09T18:20:09.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.775 7f0d486da700 1 Processor -- start 2021-04-09T18:20:09.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.775 7f0d486da700 1 -- start start 2021-04-09T18:20:09.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.775 7f0d486da700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0d400ff080 0x7f0d400ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.775 7f0d486da700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0d401a9160 0x7f0d401ab570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.775 7f0d486da700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d400ffc90 con 0x7f0d4007e700 2021-04-09T18:20:09.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.775 7f0d486da700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d400d80e0 con 0x7f0d401a9160 2021-04-09T18:20:09.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.775 7f0d486da700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d400d2040 con 0x7f0d400ff080 2021-04-09T18:20:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d46cf7700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0d401a9160 0x7f0d401ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d46cf7700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0d401a9160 0x7f0d401ab570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52988/0 (socket says 172.21.15.120:52988) 2021-04-09T18:20:09.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d46cf7700 1 -- 172.21.15.120:0/1801747831 learned_addr learned my addr 172.21.15.120:0/1801747831 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:09.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d45cf5700 1 --2- 172.21.15.120:0/1801747831 >> v2:172.21.15.134:3300/0 conn(0x7f0d400ff080 0x7f0d400ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d46cf7700 1 -- 172.21.15.120:0/1801747831 >> v2:172.21.15.134:3300/0 conn(0x7f0d400ff080 msgr2=0x7f0d400ff480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:09.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d46cf7700 1 --2- 172.21.15.120:0/1801747831 >> v2:172.21.15.134:3300/0 conn(0x7f0d400ff080 0x7f0d400ff480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d46cf7700 1 -- 172.21.15.120:0/1801747831 >> v1:172.21.15.134:6789/0 conn(0x7f0d4007e700 legacy=0x7f0d40100210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d46cf7700 1 -- 172.21.15.120:0/1801747831 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4007eb00 con 0x7f0d401a9160 2021-04-09T18:20:09.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d46cf7700 1 --2- 172.21.15.120:0/1801747831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d401a9160 0x7f0d401ab570 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0d38006b80 tx=0x7f0d38009b90).ready entity=mon.0 client_cookie=bf73ece5a9befe0f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:09.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d454f4700 1 -- 172.21.15.120:0/1801747831 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d380022e0 con 0x7f0d401a9160 2021-04-09T18:20:09.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d454f4700 1 -- 172.21.15.120:0/1801747831 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d38002620 con 0x7f0d401a9160 2021-04-09T18:20:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d454f4700 1 -- 172.21.15.120:0/1801747831 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d38002b00 con 0x7f0d401a9160 2021-04-09T18:20:09.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d486da700 1 -- 172.21.15.120:0/1801747831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d401a9160 msgr2=0x7f0d401ab570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.776 7f0d486da700 1 --2- 172.21.15.120:0/1801747831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d401a9160 0x7f0d401ab570 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0d38006b80 tx=0x7f0d38009b90).stop 2021-04-09T18:20:09.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.777 7f0d486da700 1 -- 172.21.15.120:0/1801747831 shutdown_connections 2021-04-09T18:20:09.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.777 7f0d486da700 1 --2- 172.21.15.120:0/1801747831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d401a9160 0x7f0d401ab570 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.777 7f0d486da700 1 --2- 172.21.15.120:0/1801747831 >> v2:172.21.15.134:3300/0 conn(0x7f0d400ff080 0x7f0d400ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.777 7f0d486da700 1 -- 172.21.15.120:0/1801747831 >> 172.21.15.120:0/1801747831 conn(0x7f0d400f0050 msgr2=0x7f0d400d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:09.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.777 7f0d486da700 1 -- 172.21.15.120:0/1801747831 shutdown_connections 2021-04-09T18:20:09.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.777 7f0d486da700 1 -- 172.21.15.120:0/1801747831 wait complete. 2021-04-09T18:20:09.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d486da700 1 Processor -- start 2021-04-09T18:20:09.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d486da700 1 -- start start 2021-04-09T18:20:09.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d486da700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d4009b6b0 0x7f0d40188cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d486da700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d400b2630 0x7f0d4019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d486da700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d4019f0d0 0x7f0d4019ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d486da700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401892f0 con 0x7f0d4009b6b0 2021-04-09T18:20:09.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d486da700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4019e410 con 0x7f0d400b2630 2021-04-09T18:20:09.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d486da700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4019e630 con 0x7f0d4019f0d0 2021-04-09T18:20:09.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d464f6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d4009b6b0 0x7f0d40188cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d464f6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d4009b6b0 0x7f0d40188cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52992/0 (socket says 172.21.15.120:52992) 2021-04-09T18:20:09.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.796 7f0d464f6700 1 -- 172.21.15.120:0/2244761947 learned_addr learned my addr 172.21.15.120:0/2244761947 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:09.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d46cf7700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d4019f0d0 0x7f0d4019ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d45cf5700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d400b2630 0x7f0d4019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d464f6700 1 -- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d4019f0d0 msgr2=0x7f0d4019ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d464f6700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d4019f0d0 0x7f0d4019ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d464f6700 1 -- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d400b2630 msgr2=0x7f0d4019d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:09.840 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d464f6700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d400b2630 0x7f0d4019d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:09.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d464f6700 1 -- 172.21.15.120:0/2244761947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4019e850 con 0x7f0d4009b6b0 2021-04-09T18:20:09.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d46cf7700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d4019f0d0 0x7f0d4019ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:09.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d45cf5700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d400b2630 0x7f0d4019d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:09.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d464f6700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d4009b6b0 0x7f0d40188cd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f0d3c0099a0 tx=0x7f0d3c00bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:09.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d36ffd700 1 -- 172.21.15.120:0/2244761947 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d3c003030 con 0x7f0d4009b6b0 2021-04-09T18:20:09.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d36ffd700 1 -- 172.21.15.120:0/2244761947 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0011f0 con 0x7f0d4009b6b0 2021-04-09T18:20:09.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d486da700 1 -- 172.21.15.120:0/2244761947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4019e850 con 0x7f0d4009b6b0 2021-04-09T18:20:09.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d36ffd700 1 -- 172.21.15.120:0/2244761947 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0d3c0016d0 con 0x7f0d4009b6b0 2021-04-09T18:20:09.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.797 7f0d486da700 1 -- 172.21.15.120:0/2244761947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4019e850 con 0x7f0d4009b6b0 2021-04-09T18:20:09.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.798 7f0d36ffd700 1 -- 172.21.15.120:0/2244761947 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0d3c00a000 con 0x7f0d4009b6b0 2021-04-09T18:20:09.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.798 7f0d36ffd700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0d280188c0 0x7f0d2801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:09.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.798 7f0d36ffd700 1 -- 172.21.15.120:0/2244761947 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0d3c032c90 con 0x7f0d4009b6b0 2021-04-09T18:20:09.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.798 7f0d45cf5700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0d280188c0 0x7f0d2801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:09.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.798 7f0d45cf5700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0d280188c0 0x7f0d2801adc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:09.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.821 7f0d486da700 1 -- 172.21.15.120:0/2244761947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4018fc90 con 0x7f0d4009b6b0 2021-04-09T18:20:09.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.825 7f0d36ffd700 1 -- 172.21.15.120:0/2244761947 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0d3c003020 con 0x7f0d4009b6b0 2021-04-09T18:20:09.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.996 7f0d486da700 1 -- 172.21.15.120:0/2244761947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0d4018fc90 con 0x7f0d4009b6b0 2021-04-09T18:20:09.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:09.999 7f0d36ffd700 1 -- 172.21.15.120:0/2244761947 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+211660 (secure 0 0 0) 0x7f0d3c00a000 con 0x7f0d4009b6b0 2021-04-09T18:20:10.005 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:10.006 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2021-04-09T18:20:10.007 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "dcbe2161-e5ca-44be-8661-d46578834d60", 2021-04-09T18:20:10.007 INFO:teuthology.orchestra.run.smithi120.stdout: "health": { 2021-04-09T18:20:10.007 INFO:teuthology.orchestra.run.smithi120.stdout: "checks": {}, 2021-04-09T18:20:10.008 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "HEALTH_OK" 2021-04-09T18:20:10.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.008 INFO:teuthology.orchestra.run.smithi120.stdout: "election_epoch": 4, 2021-04-09T18:20:10.009 INFO:teuthology.orchestra.run.smithi120.stdout: "quorum": [ 2021-04-09T18:20:10.009 INFO:teuthology.orchestra.run.smithi120.stdout: 0, 2021-04-09T18:20:10.014 INFO:teuthology.orchestra.run.smithi120.stdout: 1, 2021-04-09T18:20:10.014 INFO:teuthology.orchestra.run.smithi120.stdout: 2 2021-04-09T18:20:10.015 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:10.015 INFO:teuthology.orchestra.run.smithi120.stdout: "quorum_names": [ 2021-04-09T18:20:10.016 INFO:teuthology.orchestra.run.smithi120.stdout: "a", 2021-04-09T18:20:10.017 INFO:teuthology.orchestra.run.smithi120.stdout: "b", 2021-04-09T18:20:10.017 INFO:teuthology.orchestra.run.smithi120.stdout: "c" 2021-04-09T18:20:10.018 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:10.018 INFO:teuthology.orchestra.run.smithi120.stdout: "quorum_age": 39, 2021-04-09T18:20:10.019 INFO:teuthology.orchestra.run.smithi120.stdout: "monmap": { 2021-04-09T18:20:10.019 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 1, 2021-04-09T18:20:10.025 INFO:teuthology.orchestra.run.smithi120.stdout: "min_mon_release_name": "14", 2021-04-09T18:20:10.025 INFO:teuthology.orchestra.run.smithi120.stdout: "num_mons": 3 2021-04-09T18:20:10.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.026 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap": { 2021-04-09T18:20:10.026 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap": { 2021-04-09T18:20:10.026 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 22, 2021-04-09T18:20:10.026 INFO:teuthology.orchestra.run.smithi120.stdout: "num_osds": 8, 2021-04-09T18:20:10.026 INFO:teuthology.orchestra.run.smithi120.stdout: "num_up_osds": 8, 2021-04-09T18:20:10.027 INFO:teuthology.orchestra.run.smithi120.stdout: "num_in_osds": 8, 2021-04-09T18:20:10.027 INFO:teuthology.orchestra.run.smithi120.stdout: "num_remapped_pgs": 0 2021-04-09T18:20:10.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.028 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap": { 2021-04-09T18:20:10.028 INFO:teuthology.orchestra.run.smithi120.stdout: "pgs_by_state": [ 2021-04-09T18:20:10.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.032 INFO:teuthology.orchestra.run.smithi120.stdout: "state_name": "active+clean", 2021-04-09T18:20:10.032 INFO:teuthology.orchestra.run.smithi120.stdout: "count": 24 2021-04-09T18:20:10.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.033 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:10.033 INFO:teuthology.orchestra.run.smithi120.stdout: "num_pgs": 24, 2021-04-09T18:20:10.034 INFO:teuthology.orchestra.run.smithi120.stdout: "num_pools": 3, 2021-04-09T18:20:10.034 INFO:teuthology.orchestra.run.smithi120.stdout: "num_objects": 21, 2021-04-09T18:20:10.034 INFO:teuthology.orchestra.run.smithi120.stdout: "data_bytes": 2286, 2021-04-09T18:20:10.034 INFO:teuthology.orchestra.run.smithi120.stdout: "bytes_used": 8591835136, 2021-04-09T18:20:10.037 INFO:teuthology.orchestra.run.smithi120.stdout: "bytes_avail": 764502278144, 2021-04-09T18:20:10.038 INFO:teuthology.orchestra.run.smithi120.stdout: "bytes_total": 773094113280 2021-04-09T18:20:10.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.038 INFO:teuthology.orchestra.run.smithi120.stdout: "fsmap": { 2021-04-09T18:20:10.038 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 7, 2021-04-09T18:20:10.039 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1, 2021-04-09T18:20:10.039 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2021-04-09T18:20:10.039 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2021-04-09T18:20:10.039 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 1, 2021-04-09T18:20:10.040 INFO:teuthology.orchestra.run.smithi120.stdout: "by_rank": [ 2021-04-09T18:20:10.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.041 INFO:teuthology.orchestra.run.smithi120.stdout: "filesystem_id": 1, 2021-04-09T18:20:10.042 INFO:teuthology.orchestra.run.smithi120.stdout: "rank": 0, 2021-04-09T18:20:10.043 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "b", 2021-04-09T18:20:10.043 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "up:active", 2021-04-09T18:20:10.044 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 4292 2021-04-09T18:20:10.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.045 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:10.046 INFO:teuthology.orchestra.run.smithi120.stdout: "up:standby": 1 2021-04-09T18:20:10.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.046 INFO:teuthology.orchestra.run.smithi120.stdout: "mgrmap": { 2021-04-09T18:20:10.047 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 3, 2021-04-09T18:20:10.047 INFO:teuthology.orchestra.run.smithi120.stdout: "active_gid": 4106, 2021-04-09T18:20:10.048 INFO:teuthology.orchestra.run.smithi120.stdout: "active_name": "x", 2021-04-09T18:20:10.048 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addrs": { 2021-04-09T18:20:10.051 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2021-04-09T18:20:10.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2021-04-09T18:20:10.057 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.134:6800", 2021-04-09T18:20:10.058 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 23529 2021-04-09T18:20:10.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2021-04-09T18:20:10.060 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.134:6801", 2021-04-09T18:20:10.061 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 23529 2021-04-09T18:20:10.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.062 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2021-04-09T18:20:10.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.063 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addr": "172.21.15.134:6801/23529", 2021-04-09T18:20:10.063 INFO:teuthology.orchestra.run.smithi120.stdout: "active_change": "2021-04-09 18:19:32.736784", 2021-04-09T18:20:10.064 INFO:teuthology.orchestra.run.smithi120.stdout: "available": true, 2021-04-09T18:20:10.064 INFO:teuthology.orchestra.run.smithi120.stdout: "standbys": [ 2021-04-09T18:20:10.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.065 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 4104, 2021-04-09T18:20:10.065 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "y", 2021-04-09T18:20:10.066 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2021-04-09T18:20:10.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.067 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2021-04-09T18:20:10.068 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:10.068 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:10.069 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:10.070 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:10.071 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:10.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:10.072 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.073 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:10.073 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.078 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.079 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.079 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2021-04-09T18:20:10.080 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.082 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.084 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2021-04-09T18:20:10.084 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2021-04-09T18:20:10.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.085 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.086 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.086 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.087 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.087 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.088 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.089 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2021-04-09T18:20:10.089 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.090 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.102 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2021-04-09T18:20:10.103 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2021-04-09T18:20:10.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.104 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.105 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2021-04-09T18:20:10.105 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.106 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.106 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.107 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2021-04-09T18:20:10.107 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.108 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.108 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.114 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2021-04-09T18:20:10.114 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2021-04-09T18:20:10.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.114 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.115 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.115 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.115 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.116 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.116 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2021-04-09T18:20:10.116 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.116 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.117 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2021-04-09T18:20:10.117 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2021-04-09T18:20:10.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.117 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.118 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.118 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.118 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.119 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.119 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2021-04-09T18:20:10.119 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.120 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.120 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2021-04-09T18:20:10.120 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2021-04-09T18:20:10.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:10.122 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.123 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2021-04-09T18:20:10.123 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.123 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.123 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.124 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2021-04-09T18:20:10.124 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.124 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.125 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2021-04-09T18:20:10.125 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2021-04-09T18:20:10.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.125 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.126 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.126 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.126 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.127 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.127 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2021-04-09T18:20:10.127 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.127 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.127 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.128 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2021-04-09T18:20:10.128 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2021-04-09T18:20:10.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.129 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.129 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.129 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.130 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.130 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.130 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2021-04-09T18:20:10.130 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.130 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.131 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.131 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2021-04-09T18:20:10.131 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2021-04-09T18:20:10.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.133 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.135 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.135 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.136 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.136 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.136 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2021-04-09T18:20:10.136 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.137 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.137 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.138 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ansible", 2021-04-09T18:20:10.139 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:10.141 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:10.141 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:10.142 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:10.142 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:10.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.146 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.146 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.146 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.147 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.147 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.147 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.148 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.148 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.149 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.149 INFO:teuthology.orchestra.run.smithi120.stdout: "server_url": { 2021-04-09T18:20:10.150 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_url", 2021-04-09T18:20:10.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.150 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.150 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.150 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.151 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.151 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.151 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.152 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.152 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.152 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.153 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.154 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:10.154 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:10.154 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.154 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.155 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.155 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.155 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.156 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.156 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.157 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.157 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.157 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.158 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_server": { 2021-04-09T18:20:10.158 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_server", 2021-04-09T18:20:10.158 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.158 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.158 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.159 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.159 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.159 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.159 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.160 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.160 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.160 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.160 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.169 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2021-04-09T18:20:10.170 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:10.170 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:10.170 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:10.171 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2021-04-09T18:20:10.172 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2021-04-09T18:20:10.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.172 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.173 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:10.173 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.173 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.173 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.174 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2021-04-09T18:20:10.174 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.174 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.175 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2021-04-09T18:20:10.175 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2021-04-09T18:20:10.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.175 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.176 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2021-04-09T18:20:10.176 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.176 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.176 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.177 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2021-04-09T18:20:10.178 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:10.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.178 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.180 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2021-04-09T18:20:10.180 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2021-04-09T18:20:10.181 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:10.181 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.181 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.181 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:10.181 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:10.182 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:10.182 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.182 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-04-09T18:20:10.182 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:10.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.183 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.183 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2021-04-09T18:20:10.184 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2021-04-09T18:20:10.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:10.184 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.192 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2021-04-09T18:20:10.193 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:10.201 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2021-04-09T18:20:10.201 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.201 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-04-09T18:20:10.241 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.242 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.243 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2021-04-09T18:20:10.244 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2021-04-09T18:20:10.244 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.244 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.245 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.245 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2021-04-09T18:20:10.246 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.246 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.246 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.249 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-04-09T18:20:10.249 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-04-09T18:20:10.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.250 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.252 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2021-04-09T18:20:10.252 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2021-04-09T18:20:10.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:10.253 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.253 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.254 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2021-04-09T18:20:10.254 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2021-04-09T18:20:10.254 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2021-04-09T18:20:10.255 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.255 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2021-04-09T18:20:10.255 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-04-09T18:20:10.256 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.256 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.257 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2021-04-09T18:20:10.257 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2021-04-09T18:20:10.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.258 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.259 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.259 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2400", 2021-04-09T18:20:10.260 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.260 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.260 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.261 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2021-04-09T18:20:10.269 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:10.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.270 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.271 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2021-04-09T18:20:10.271 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2021-04-09T18:20:10.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:10.272 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.273 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2021-04-09T18:20:10.273 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:10.283 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:10.284 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.284 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-04-09T18:20:10.284 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:10.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.285 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.285 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2021-04-09T18:20:10.285 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2021-04-09T18:20:10.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:10.286 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.286 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:10.287 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.287 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.287 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.287 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-04-09T18:20:10.289 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.290 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.290 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2021-04-09T18:20:10.291 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2021-04-09T18:20:10.291 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.296 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.297 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "none", 2021-04-09T18:20:10.297 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.298 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.298 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:10.298 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2021-04-09T18:20:10.299 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2021-04-09T18:20:10.299 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap" 2021-04-09T18:20:10.300 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:10.304 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2021-04-09T18:20:10.305 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.306 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.306 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2021-04-09T18:20:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2021-04-09T18:20:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-04-09T18:20:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-04-09T18:20:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2021-04-09T18:20:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2021-04-09T18:20:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2021-04-09T18:20:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-04-09T18:20:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_iterations": { 2021-04-09T18:20:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_iterations", 2021-04-09T18:20:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2021-04-09T18:20:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimization iterations", 2021-04-09T18:20:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2021-04-09T18:20:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2021-04-09T18:20:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2021-04-09T18:20:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2021-04-09T18:20:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2021-04-09T18:20:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2021-04-09T18:20:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2021-04-09T18:20:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2021-04-09T18:20:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2021-04-09T18:20:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2021-04-09T18:20:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2021-04-09T18:20:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2021-04-09T18:20:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2021-04-09T18:20:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2021-04-09T18:20:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-04-09T18:20:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-04-09T18:20:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2021-04-09T18:20:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2021-04-09T18:20:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_cephfs": { 2021-04-09T18:20:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-04-09T18:20:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_iscsi": { 2021-04-09T18:20:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-04-09T18:20:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_mirroring": { 2021-04-09T18:20:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-04-09T18:20:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rbd": { 2021-04-09T18:20:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-04-09T18:20:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rgw": { 2021-04-09T18:20:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-04-09T18:20:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-04-09T18:20:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-04-09T18:20:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2021-04-09T18:20:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2021-04-09T18:20:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-04-09T18:20:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-04-09T18:20:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2021-04-09T18:20:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2021-04-09T18:20:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2021-04-09T18:20:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2021-04-09T18:20:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.560 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.561 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.561 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.566 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-04-09T18:20:10.566 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-04-09T18:20:10.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.567 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.568 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.568 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.569 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.569 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.569 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.570 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.570 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.571 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.572 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-04-09T18:20:10.573 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-04-09T18:20:10.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.573 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.574 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:10.575 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.576 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.576 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.577 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.577 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.578 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.579 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-04-09T18:20:10.580 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-04-09T18:20:10.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.581 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.582 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.583 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.583 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.584 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.584 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.584 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.585 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.585 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.586 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.586 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2021-04-09T18:20:10.587 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2021-04-09T18:20:10.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.588 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.588 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.589 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.589 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.589 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.590 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.591 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.593 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.593 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.594 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.595 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2021-04-09T18:20:10.595 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-04-09T18:20:10.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:10.596 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.596 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2021-04-09T18:20:10.597 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.597 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.597 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.598 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.599 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.621 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.622 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2021-04-09T18:20:10.622 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2021-04-09T18:20:10.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.622 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.623 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.623 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.623 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.624 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.624 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.624 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.625 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.625 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.625 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-04-09T18:20:10.626 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-04-09T18:20:10.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.626 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.626 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:10.627 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.627 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.627 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.627 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.628 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.628 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.632 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_HOST": { 2021-04-09T18:20:10.633 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_HOST", 2021-04-09T18:20:10.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.635 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.639 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.639 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.640 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.640 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.640 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.641 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.642 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.643 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_PORT": { 2021-04-09T18:20:10.643 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_PORT", 2021-04-09T18:20:10.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:10.644 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.644 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "80", 2021-04-09T18:20:10.644 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.645 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.645 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.646 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.646 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.646 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.647 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SCHEME": { 2021-04-09T18:20:10.647 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SCHEME", 2021-04-09T18:20:10.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.647 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.648 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.648 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "http", 2021-04-09T18:20:10.648 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.648 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.648 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.649 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.649 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.649 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.649 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.650 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2021-04-09T18:20:10.650 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2021-04-09T18:20:10.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.650 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.651 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.651 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.651 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.651 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.652 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.652 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.652 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.653 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.654 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2021-04-09T18:20:10.654 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2021-04-09T18:20:10.654 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.659 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.660 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.660 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.661 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.661 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.661 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.661 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.662 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.662 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_USER_ID": { 2021-04-09T18:20:10.662 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_USER_ID", 2021-04-09T18:20:10.663 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.663 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.664 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.664 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.664 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.664 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.665 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.665 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.665 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.665 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.666 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2021-04-09T18:20:10.666 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2021-04-09T18:20:10.666 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.666 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.667 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.667 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.668 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.668 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.668 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.668 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.669 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.669 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.674 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2021-04-09T18:20:10.674 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2021-04-09T18:20:10.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.675 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.675 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.675 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:10.677 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.677 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2021-04-09T18:20:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2021-04-09T18:20:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2021-04-09T18:20:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2021-04-09T18:20:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2021-04-09T18:20:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:10.714 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:10.714 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:10.715 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.716 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.716 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2021-04-09T18:20:10.717 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.717 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.717 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.718 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.718 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.719 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.720 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.720 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:10.721 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:10.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.722 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.722 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.722 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.723 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.723 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.723 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.724 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.724 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.725 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.726 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2021-04-09T18:20:10.727 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2021-04-09T18:20:10.727 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:10.728 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.728 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.729 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2021-04-09T18:20:10.729 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.730 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.731 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.731 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.732 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.733 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.734 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2021-04-09T18:20:10.734 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2021-04-09T18:20:10.734 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.735 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.735 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.736 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2021-04-09T18:20:10.737 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.737 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.738 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:10.738 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2021-04-09T18:20:10.739 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2021-04-09T18:20:10.739 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:10.739 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.740 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.741 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.741 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.742 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2021-04-09T18:20:10.742 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2021-04-09T18:20:10.743 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:10.743 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.744 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.744 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2021-04-09T18:20:10.744 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2021-04-09T18:20:10.745 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2021-04-09T18:20:10.745 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.746 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.746 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.747 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.748 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.749 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2021-04-09T18:20:10.749 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2021-04-09T18:20:10.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.750 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.750 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.750 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.751 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.752 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.752 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.752 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.753 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.753 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.753 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.754 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:10.755 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:10.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.755 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.756 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.756 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.757 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.757 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.758 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.758 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.758 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.759 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.762 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "deepsea", 2021-04-09T18:20:10.762 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:10.762 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:10.763 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:10.763 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_eauth": { 2021-04-09T18:20:10.763 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_eauth", 2021-04-09T18:20:10.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.764 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.764 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.765 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "sharedsecret", 2021-04-09T18:20:10.765 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.766 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.766 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.766 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.767 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.768 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.769 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_password": { 2021-04-09T18:20:10.769 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_password", 2021-04-09T18:20:10.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.770 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.771 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.772 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.773 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.773 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.774 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.774 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.776 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.776 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.779 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_url": { 2021-04-09T18:20:10.779 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_url", 2021-04-09T18:20:10.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.780 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.781 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.781 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.782 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.782 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.783 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.784 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.784 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.785 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.785 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_username": { 2021-04-09T18:20:10.786 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_username", 2021-04-09T18:20:10.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.787 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.787 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.788 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.788 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.790 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.790 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.791 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.791 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.794 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2021-04-09T18:20:10.795 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:10.795 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:10.796 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:10.796 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2021-04-09T18:20:10.796 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2021-04-09T18:20:10.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.797 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.798 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:10.799 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.799 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.799 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.800 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2021-04-09T18:20:10.801 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.802 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.803 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2021-04-09T18:20:10.803 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2021-04-09T18:20:10.804 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:10.805 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.806 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2021-04-09T18:20:10.806 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.806 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.807 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.807 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-04-09T18:20:10.808 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.809 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.809 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2021-04-09T18:20:10.810 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2021-04-09T18:20:10.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.811 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.812 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.812 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2021-04-09T18:20:10.813 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.813 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.814 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.814 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2021-04-09T18:20:10.814 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.822 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.823 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2021-04-09T18:20:10.823 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2021-04-09T18:20:10.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:10.824 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.825 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2021-04-09T18:20:10.825 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.830 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.830 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.831 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2021-04-09T18:20:10.831 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.833 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.834 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2021-04-09T18:20:10.834 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2021-04-09T18:20:10.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:10.835 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.836 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:10.836 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.837 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.838 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.838 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2021-04-09T18:20:10.838 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.839 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.839 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.840 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2021-04-09T18:20:10.841 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2021-04-09T18:20:10.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:10.842 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.843 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:10.843 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.844 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.844 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.845 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-04-09T18:20:10.845 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.846 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.846 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.847 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:10.848 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:10.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:10.849 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.849 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.850 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:10.850 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.850 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.851 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.851 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2021-04-09T18:20:10.852 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.852 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.853 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.854 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2021-04-09T18:20:10.855 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2021-04-09T18:20:10.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:10.856 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.856 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:10.856 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2021-04-09T18:20:10.857 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.857 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.867 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.868 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-04-09T18:20:10.868 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.869 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.869 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.872 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cloud", 2021-04-09T18:20:10.872 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:10.872 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:10.873 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:10.873 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_cert_context": { 2021-04-09T18:20:10.874 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cert_context", 2021-04-09T18:20:10.875 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.875 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.876 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.877 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.877 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.878 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.878 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.878 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.880 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.881 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_default_authority": { 2021-04-09T18:20:10.881 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_default_authority", 2021-04-09T18:20:10.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.883 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.884 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:10.885 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.886 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.886 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.886 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.887 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.888 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.889 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_password": { 2021-04-09T18:20:10.890 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_password", 2021-04-09T18:20:10.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.891 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.892 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.892 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.892 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.893 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.893 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.894 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.894 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.896 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.896 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_port": { 2021-04-09T18:20:10.897 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_port", 2021-04-09T18:20:10.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.898 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.899 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31400", 2021-04-09T18:20:10.899 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.899 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.900 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.901 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.902 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.902 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.903 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_retrieve_prediction_interval": { 2021-04-09T18:20:10.904 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-04-09T18:20:10.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.904 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.905 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:10.905 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.907 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.908 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.908 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.909 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.909 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.909 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.910 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_server": { 2021-04-09T18:20:10.912 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_server", 2021-04-09T18:20:10.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.914 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.915 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.916 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.917 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.917 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.918 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.918 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.919 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.920 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_ssl_target_name_override": { 2021-04-09T18:20:10.920 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_ssl_target_name_override", 2021-04-09T18:20:10.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.921 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_metrics_interval": { 2021-04-09T18:20:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_metrics_interval", 2021-04-09T18:20:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_smart_interval": { 2021-04-09T18:20:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_smart_interval", 2021-04-09T18:20:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_user": { 2021-04-09T18:20:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_user", 2021-04-09T18:20:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2021-04-09T18:20:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2021-04-09T18:20:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2021-04-09T18:20:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2021-04-09T18:20:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2021-04-09T18:20:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2021-04-09T18:20:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2021-04-09T18:20:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2021-04-09T18:20:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2021-04-09T18:20:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2021-04-09T18:20:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2021-04-09T18:20:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2021-04-09T18:20:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2021-04-09T18:20:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2021-04-09T18:20:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2021-04-09T18:20:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2021-04-09T18:20:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2021-04-09T18:20:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2021-04-09T18:20:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2021-04-09T18:20:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2021-04-09T18:20:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2021-04-09T18:20:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2021-04-09T18:20:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2021-04-09T18:20:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2021-04-09T18:20:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2021-04-09T18:20:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2021-04-09T18:20:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2021-04-09T18:20:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2021-04-09T18:20:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2021-04-09T18:20:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2021-04-09T18:20:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2021-04-09T18:20:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2021-04-09T18:20:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2021-04-09T18:20:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2021-04-09T18:20:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2021-04-09T18:20:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2021-04-09T18:20:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2021-04-09T18:20:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2021-04-09T18:20:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2021-04-09T18:20:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2021-04-09T18:20:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2021-04-09T18:20:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2021-04-09T18:20:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2021-04-09T18:20:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2021-04-09T18:20:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2021-04-09T18:20:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2021-04-09T18:20:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2021-04-09T18:20:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2021-04-09T18:20:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2021-04-09T18:20:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator_cli", 2021-04-09T18:20:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2021-04-09T18:20:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2021-04-09T18:20:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2021-04-09T18:20:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2021-04-09T18:20:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2021-04-09T18:20:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2021-04-09T18:20:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2021-04-09T18:20:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2021-04-09T18:20:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "persist_interval": { 2021-04-09T18:20:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "persist_interval", 2021-04-09T18:20:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to persist completed events", 2021-04-09T18:20:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2021-04-09T18:20:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2021-04-09T18:20:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2021-04-09T18:20:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.197 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.199 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2021-04-09T18:20:11.199 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-04-09T18:20:11.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.200 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.200 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2021-04-09T18:20:11.201 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.201 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.202 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.202 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.202 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.202 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.203 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.203 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2021-04-09T18:20:11.203 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2021-04-09T18:20:11.204 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.204 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.204 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.204 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.205 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.205 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.205 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.205 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.205 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.206 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.206 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:11.207 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:11.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.207 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.207 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.208 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.208 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.208 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.208 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.209 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.209 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.209 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.224 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:11.224 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:11.224 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.225 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.225 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.225 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.228 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.228 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.228 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.229 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.229 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.229 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.230 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2021-04-09T18:20:11.230 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2021-04-09T18:20:11.230 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.230 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.231 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.231 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.231 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.231 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.231 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.232 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.232 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.232 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.233 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2021-04-09T18:20:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.235 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.235 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:11.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.236 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2021-04-09T18:20:11.236 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.236 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.237 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.237 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:11.237 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:11.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.242 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.243 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.243 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.243 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.243 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.244 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.244 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.244 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2021-04-09T18:20:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2021-04-09T18:20:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2021-04-09T18:20:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2021-04-09T18:20:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2021-04-09T18:20:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2021-04-09T18:20:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2021-04-09T18:20:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2021-04-09T18:20:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2021-04-09T18:20:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2021-04-09T18:20:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2021-04-09T18:20:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2021-04-09T18:20:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2021-04-09T18:20:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2021-04-09T18:20:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2021-04-09T18:20:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2021-04-09T18:20:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2021-04-09T18:20:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2021-04-09T18:20:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2021-04-09T18:20:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2021-04-09T18:20:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2021-04-09T18:20:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2021-04-09T18:20:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2021-04-09T18:20:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2021-04-09T18:20:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2021-04-09T18:20:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.293 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.293 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.293 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.293 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.293 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.295 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh", 2021-04-09T18:20:11.295 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.295 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.295 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.295 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_cache_timeout_min": { 2021-04-09T18:20:11.296 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_cache_timeout_min", 2021-04-09T18:20:11.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.296 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.301 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.302 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.302 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.302 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.302 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.303 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.303 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.303 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.303 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2021-04-09T18:20:11.304 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2021-04-09T18:20:11.304 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.304 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.304 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.304 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.305 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.305 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.305 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.305 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.306 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.306 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.312 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2021-04-09T18:20:11.312 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.312 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.313 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:11.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.313 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2021-04-09T18:20:11.314 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.314 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.314 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.314 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2021-04-09T18:20:11.314 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2021-04-09T18:20:11.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.322 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.323 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.323 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-04-09T18:20:11.323 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.323 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.323 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.324 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.324 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.324 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.325 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:11.325 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:11.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:11.325 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.326 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2021-04-09T18:20:11.326 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.326 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.327 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.327 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.327 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.332 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.333 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2021-04-09T18:20:11.334 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.335 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.335 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.336 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2021-04-09T18:20:11.336 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2021-04-09T18:20:11.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.336 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.337 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.337 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.337 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.337 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.338 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2021-04-09T18:20:11.343 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.343 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.343 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.344 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2021-04-09T18:20:11.344 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2021-04-09T18:20:11.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.344 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.345 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.345 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.345 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.346 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.346 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.346 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.349 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.349 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2021-04-09T18:20:11.350 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2021-04-09T18:20:11.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.350 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.351 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.359 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.360 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.360 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.361 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.361 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.362 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.362 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.363 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2021-04-09T18:20:11.364 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2021-04-09T18:20:11.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.365 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.366 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:11.366 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.367 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.367 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.368 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.368 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.369 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.380 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2021-04-09T18:20:11.380 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2021-04-09T18:20:11.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.381 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.381 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:11.381 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.382 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.382 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.382 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.382 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.382 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.383 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.383 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2021-04-09T18:20:11.383 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2021-04-09T18:20:11.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.384 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.384 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:11.385 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.391 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.391 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.391 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.392 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.392 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.392 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2021-04-09T18:20:11.393 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2021-04-09T18:20:11.393 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.393 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.393 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.394 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-04-09T18:20:11.394 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.394 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.394 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.394 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.395 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.395 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.401 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.402 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:11.402 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:11.402 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.402 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.403 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:11.403 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.403 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.404 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.404 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.404 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.404 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.404 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.405 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:11.405 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:11.405 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.405 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.408 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.408 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2021-04-09T18:20:11.408 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2021-04-09T18:20:11.408 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.409 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.409 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.409 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.410 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.410 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2021-04-09T18:20:11.410 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2021-04-09T18:20:11.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.411 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.411 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.415 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2021-04-09T18:20:11.416 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.416 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.420 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.420 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.420 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.421 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.421 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2021-04-09T18:20:11.422 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2021-04-09T18:20:11.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.422 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.423 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:11.423 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.423 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.424 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.424 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.424 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.424 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.425 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2021-04-09T18:20:11.425 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2021-04-09T18:20:11.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.425 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.426 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:11.426 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.426 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.433 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.433 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.433 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.434 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.434 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2021-04-09T18:20:11.434 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2021-04-09T18:20:11.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.435 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.435 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:11.435 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.436 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.436 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.443 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.443 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.444 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.444 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2021-04-09T18:20:11.445 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2021-04-09T18:20:11.445 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.445 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.445 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.445 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-04-09T18:20:11.446 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.446 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.446 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.446 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.447 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.447 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.447 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.452 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2021-04-09T18:20:11.453 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.454 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.454 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:11.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.455 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2021-04-09T18:20:11.456 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.456 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.457 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.457 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2021-04-09T18:20:11.457 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2021-04-09T18:20:11.458 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.459 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.459 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.460 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2021-04-09T18:20:11.460 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.461 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.461 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.461 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2021-04-09T18:20:11.462 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.462 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.463 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.465 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2021-04-09T18:20:11.466 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.466 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.466 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.467 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2021-04-09T18:20:11.467 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2021-04-09T18:20:11.467 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.468 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.468 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.469 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.469 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.470 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.470 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.471 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.471 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.471 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.472 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.473 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:11.473 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:11.473 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:11.474 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.475 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:11.475 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.476 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.476 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.477 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.477 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.478 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.480 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2021-04-09T18:20:11.480 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2021-04-09T18:20:11.480 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.481 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.482 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:11.482 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.483 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.483 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.484 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.484 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.485 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.486 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2021-04-09T18:20:11.487 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2021-04-09T18:20:11.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.487 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.488 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2021-04-09T18:20:11.489 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.489 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.490 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.491 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.491 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.492 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.492 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.493 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2021-04-09T18:20:11.493 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2021-04-09T18:20:11.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.494 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.496 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-04-09T18:20:11.497 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.497 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.498 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.498 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.499 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.499 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.502 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2021-04-09T18:20:11.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.503 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:11.503 INFO:teuthology.orchestra.run.smithi120.stdout: "modules": [ 2021-04-09T18:20:11.503 INFO:teuthology.orchestra.run.smithi120.stdout: "iostat", 2021-04-09T18:20:11.504 INFO:teuthology.orchestra.run.smithi120.stdout: "restful" 2021-04-09T18:20:11.504 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:11.505 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2021-04-09T18:20:11.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.505 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2021-04-09T18:20:11.506 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.507 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.507 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.508 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:11.508 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:11.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:11.509 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.510 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:11.510 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.511 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.512 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.512 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2021-04-09T18:20:11.513 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.513 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.514 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.515 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2021-04-09T18:20:11.516 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2021-04-09T18:20:11.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.518 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.518 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.519 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.519 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.520 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.520 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.520 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2021-04-09T18:20:11.521 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.522 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.522 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.523 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2021-04-09T18:20:11.524 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2021-04-09T18:20:11.524 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.524 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.525 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.525 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2021-04-09T18:20:11.526 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.526 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.527 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.527 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2021-04-09T18:20:11.528 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.528 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.529 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.530 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2021-04-09T18:20:11.530 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2021-04-09T18:20:11.531 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.531 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.531 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.532 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.533 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.533 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.534 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.534 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2021-04-09T18:20:11.535 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.535 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.536 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2021-04-09T18:20:11.537 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2021-04-09T18:20:11.537 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.538 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.539 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.539 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.540 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.540 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.540 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.541 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2021-04-09T18:20:11.541 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.542 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.544 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2021-04-09T18:20:11.544 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2021-04-09T18:20:11.545 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.545 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.545 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.546 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2021-04-09T18:20:11.546 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.547 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.547 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.548 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2021-04-09T18:20:11.548 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.548 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.549 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.550 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2021-04-09T18:20:11.554 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2021-04-09T18:20:11.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.555 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.556 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.557 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.557 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.558 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.558 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2021-04-09T18:20:11.558 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.559 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.567 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.567 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2021-04-09T18:20:11.567 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2021-04-09T18:20:11.568 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.568 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.568 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.569 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.569 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.569 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.569 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2021-04-09T18:20:11.569 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2021-04-09T18:20:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2021-04-09T18:20:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2021-04-09T18:20:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ansible", 2021-04-09T18:20:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "server_url": { 2021-04-09T18:20:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_url", 2021-04-09T18:20:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_server": { 2021-04-09T18:20:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_server", 2021-04-09T18:20:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2021-04-09T18:20:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2021-04-09T18:20:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2021-04-09T18:20:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2021-04-09T18:20:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2021-04-09T18:20:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2021-04-09T18:20:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2021-04-09T18:20:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2021-04-09T18:20:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2021-04-09T18:20:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2021-04-09T18:20:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-04-09T18:20:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2021-04-09T18:20:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2021-04-09T18:20:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2021-04-09T18:20:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2021-04-09T18:20:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-04-09T18:20:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.708 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2021-04-09T18:20:11.717 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2021-04-09T18:20:11.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.718 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.719 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2021-04-09T18:20:11.720 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.720 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.721 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.721 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-04-09T18:20:11.722 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-04-09T18:20:11.722 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.722 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.723 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2021-04-09T18:20:11.724 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2021-04-09T18:20:11.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:11.724 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.725 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2021-04-09T18:20:11.726 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2021-04-09T18:20:11.726 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2021-04-09T18:20:11.726 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.727 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2021-04-09T18:20:11.727 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-04-09T18:20:11.728 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.728 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.729 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2021-04-09T18:20:11.738 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2021-04-09T18:20:11.738 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.739 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.740 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2400", 2021-04-09T18:20:11.752 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.752 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.755 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.755 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2021-04-09T18:20:11.756 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:11.756 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.756 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.757 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2021-04-09T18:20:11.758 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2021-04-09T18:20:11.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:11.758 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.759 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2021-04-09T18:20:11.760 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:11.760 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:11.761 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.761 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-04-09T18:20:11.761 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:11.774 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.774 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.775 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2021-04-09T18:20:11.775 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2021-04-09T18:20:11.776 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:11.776 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.776 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.777 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:11.777 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.778 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.778 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.794 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-04-09T18:20:11.794 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.795 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.795 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2021-04-09T18:20:11.795 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2021-04-09T18:20:11.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.796 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.796 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "none", 2021-04-09T18:20:11.796 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.797 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.797 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:11.797 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2021-04-09T18:20:11.797 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2021-04-09T18:20:11.797 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap" 2021-04-09T18:20:11.798 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:11.798 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2021-04-09T18:20:11.798 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.799 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.799 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2021-04-09T18:20:11.799 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2021-04-09T18:20:11.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.800 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.800 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.800 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.801 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.801 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.801 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-04-09T18:20:11.801 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.802 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.802 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:11.802 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:11.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:11.803 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.810 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.810 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:11.810 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.810 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-04-09T18:20:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2021-04-09T18:20:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2021-04-09T18:20:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2021-04-09T18:20:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-04-09T18:20:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_iterations": { 2021-04-09T18:20:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_iterations", 2021-04-09T18:20:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2021-04-09T18:20:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimization iterations", 2021-04-09T18:20:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2021-04-09T18:20:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2021-04-09T18:20:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2021-04-09T18:20:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2021-04-09T18:20:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2021-04-09T18:20:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2021-04-09T18:20:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2021-04-09T18:20:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2021-04-09T18:20:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2021-04-09T18:20:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2021-04-09T18:20:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2021-04-09T18:20:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2021-04-09T18:20:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.854 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2021-04-09T18:20:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2021-04-09T18:20:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-04-09T18:20:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-04-09T18:20:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2021-04-09T18:20:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2021-04-09T18:20:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_cephfs": { 2021-04-09T18:20:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-04-09T18:20:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_iscsi": { 2021-04-09T18:20:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-04-09T18:20:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_mirroring": { 2021-04-09T18:20:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-04-09T18:20:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rbd": { 2021-04-09T18:20:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-04-09T18:20:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rgw": { 2021-04-09T18:20:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-04-09T18:20:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-04-09T18:20:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-04-09T18:20:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2021-04-09T18:20:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2021-04-09T18:20:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-04-09T18:20:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-04-09T18:20:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2021-04-09T18:20:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2021-04-09T18:20:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2021-04-09T18:20:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2021-04-09T18:20:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-04-09T18:20:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-04-09T18:20:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-04-09T18:20:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-04-09T18:20:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-04-09T18:20:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-04-09T18:20:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2021-04-09T18:20:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2021-04-09T18:20:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2021-04-09T18:20:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-04-09T18:20:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2021-04-09T18:20:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2021-04-09T18:20:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2021-04-09T18:20:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-04-09T18:20:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-04-09T18:20:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_HOST": { 2021-04-09T18:20:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_HOST", 2021-04-09T18:20:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_PORT": { 2021-04-09T18:20:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_PORT", 2021-04-09T18:20:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "80", 2021-04-09T18:20:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SCHEME": { 2021-04-09T18:20:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SCHEME", 2021-04-09T18:20:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "http", 2021-04-09T18:20:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2021-04-09T18:20:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2021-04-09T18:20:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2021-04-09T18:20:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2021-04-09T18:20:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_USER_ID": { 2021-04-09T18:20:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_USER_ID", 2021-04-09T18:20:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2021-04-09T18:20:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2021-04-09T18:20:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2021-04-09T18:20:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2021-04-09T18:20:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2021-04-09T18:20:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2021-04-09T18:20:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2021-04-09T18:20:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2021-04-09T18:20:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2021-04-09T18:20:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2021-04-09T18:20:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.250 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.251 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.251 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.251 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.252 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.253 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.254 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:12.254 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:12.260 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.261 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.262 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:12.262 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.271 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.272 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.272 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.272 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.282 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.283 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2021-04-09T18:20:12.284 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2021-04-09T18:20:12.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.285 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.286 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2021-04-09T18:20:12.286 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.287 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.287 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.288 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.288 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.288 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.289 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.290 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2021-04-09T18:20:12.290 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2021-04-09T18:20:12.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.291 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.291 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.311 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2021-04-09T18:20:12.312 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.312 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.312 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:12.312 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2021-04-09T18:20:12.313 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2021-04-09T18:20:12.313 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:12.313 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.313 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.314 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.314 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.314 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2021-04-09T18:20:12.314 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2021-04-09T18:20:12.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.315 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.324 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2021-04-09T18:20:12.324 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2021-04-09T18:20:12.324 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2021-04-09T18:20:12.325 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.325 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.325 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.325 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.326 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.326 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2021-04-09T18:20:12.326 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2021-04-09T18:20:12.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.327 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.327 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.327 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.328 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.328 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.328 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.328 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.329 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.329 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.329 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:12.330 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:12.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.330 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.330 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.331 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.331 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.331 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.331 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.332 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.332 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.332 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.333 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "deepsea", 2021-04-09T18:20:12.333 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.334 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.334 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.334 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_eauth": { 2021-04-09T18:20:12.334 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_eauth", 2021-04-09T18:20:12.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.335 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "sharedsecret", 2021-04-09T18:20:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_password": { 2021-04-09T18:20:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_password", 2021-04-09T18:20:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_url": { 2021-04-09T18:20:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_url", 2021-04-09T18:20:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_username": { 2021-04-09T18:20:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_username", 2021-04-09T18:20:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2021-04-09T18:20:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2021-04-09T18:20:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2021-04-09T18:20:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2021-04-09T18:20:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2021-04-09T18:20:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2021-04-09T18:20:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2021-04-09T18:20:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-04-09T18:20:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.388 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2021-04-09T18:20:12.388 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2021-04-09T18:20:12.389 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.389 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.390 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.391 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2021-04-09T18:20:12.391 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.392 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.392 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.392 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2021-04-09T18:20:12.393 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.394 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.394 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2021-04-09T18:20:12.395 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2021-04-09T18:20:12.395 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:12.396 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.396 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.396 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2021-04-09T18:20:12.397 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.397 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.397 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.398 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2021-04-09T18:20:12.398 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.399 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.400 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2021-04-09T18:20:12.401 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2021-04-09T18:20:12.401 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:12.401 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.402 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.402 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:12.403 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.403 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.403 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.404 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2021-04-09T18:20:12.404 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.404 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.405 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.405 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2021-04-09T18:20:12.406 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2021-04-09T18:20:12.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.407 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.407 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:12.408 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.408 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.408 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.409 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-04-09T18:20:12.409 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.410 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.411 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:12.411 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:12.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:12.412 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.413 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:12.413 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.414 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.414 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.415 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2021-04-09T18:20:12.415 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.415 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.416 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.416 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2021-04-09T18:20:12.417 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2021-04-09T18:20:12.417 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:12.417 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.418 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2021-04-09T18:20:12.418 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.419 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.419 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.420 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-04-09T18:20:12.420 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.421 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.423 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cloud", 2021-04-09T18:20:12.423 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.424 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.424 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.425 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_cert_context": { 2021-04-09T18:20:12.425 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cert_context", 2021-04-09T18:20:12.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.426 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.426 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.427 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.427 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.427 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.428 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.428 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.428 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.429 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.429 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_default_authority": { 2021-04-09T18:20:12.430 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_default_authority", 2021-04-09T18:20:12.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.430 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.431 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.431 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:12.431 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.433 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.433 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.433 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.434 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.434 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.435 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_password": { 2021-04-09T18:20:12.435 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_password", 2021-04-09T18:20:12.436 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.436 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.436 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.437 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.437 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.438 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.445 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.451 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.451 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.452 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.453 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_port": { 2021-04-09T18:20:12.453 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_port", 2021-04-09T18:20:12.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.454 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.454 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31400", 2021-04-09T18:20:12.456 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.456 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.456 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.457 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.457 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.458 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.459 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_retrieve_prediction_interval": { 2021-04-09T18:20:12.459 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-04-09T18:20:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.460 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.461 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:12.462 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.462 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.462 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.463 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.463 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.464 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.464 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.476 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_server": { 2021-04-09T18:20:12.477 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_server", 2021-04-09T18:20:12.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.477 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.478 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.478 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.478 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.479 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.479 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.485 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.486 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.493 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.494 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_ssl_target_name_override": { 2021-04-09T18:20:12.494 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_ssl_target_name_override", 2021-04-09T18:20:12.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.495 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.495 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:12.496 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.496 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.496 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.496 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.496 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.497 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.498 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_metrics_interval": { 2021-04-09T18:20:12.498 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_metrics_interval", 2021-04-09T18:20:12.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.499 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.499 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:12.499 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.500 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.500 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.500 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.500 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.500 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.501 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.501 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_smart_interval": { 2021-04-09T18:20:12.501 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_smart_interval", 2021-04-09T18:20:12.502 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.502 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.502 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:12.502 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.503 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.503 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.503 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.503 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.504 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.504 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.504 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_user": { 2021-04-09T18:20:12.505 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_user", 2021-04-09T18:20:12.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.505 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.506 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.506 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.506 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.506 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.506 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.507 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.508 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.508 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:12.509 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:12.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.509 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.509 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.510 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:12.510 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.510 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.510 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.510 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.511 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.511 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.511 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.512 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.512 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2021-04-09T18:20:12.512 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.513 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.513 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.513 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2021-04-09T18:20:12.513 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2021-04-09T18:20:12.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.514 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.514 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:12.514 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.515 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.515 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.515 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.515 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.516 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.516 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.516 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:12.516 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:12.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.517 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.517 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.517 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:12.517 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.518 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.518 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.519 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.519 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.519 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.519 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.520 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2021-04-09T18:20:12.521 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2021-04-09T18:20:12.521 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2021-04-09T18:20:12.521 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.521 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2021-04-09T18:20:12.522 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2021-04-09T18:20:12.522 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.522 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.522 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.523 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2021-04-09T18:20:12.523 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.523 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.524 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.524 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.524 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.524 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.524 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.525 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2021-04-09T18:20:12.525 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2021-04-09T18:20:12.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.526 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.526 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2021-04-09T18:20:12.526 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.527 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.527 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.527 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.527 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.527 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.528 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.539 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2021-04-09T18:20:12.539 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2021-04-09T18:20:12.540 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.540 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.540 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.540 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:12.541 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.541 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.541 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.541 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.541 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.542 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.542 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:12.543 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:12.543 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.543 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.543 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.543 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2021-04-09T18:20:12.544 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.544 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.544 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.544 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.545 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.545 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.545 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.545 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:12.546 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:12.546 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.546 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.546 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.547 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:12.547 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.547 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.547 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.548 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.548 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.548 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.548 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.549 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2021-04-09T18:20:12.556 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2021-04-09T18:20:12.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.557 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.557 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.557 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2021-04-09T18:20:12.557 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.557 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.558 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.558 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.558 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.558 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.559 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.570 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:12.571 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:12.571 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.571 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.571 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.572 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2021-04-09T18:20:12.572 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.572 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.572 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.573 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.573 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.573 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.574 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2021-04-09T18:20:12.574 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2021-04-09T18:20:12.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.574 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.575 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.575 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:12.575 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.575 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.575 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.576 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.576 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.576 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.576 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.577 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:12.577 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:12.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.577 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.578 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:12.578 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.578 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.578 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.579 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.579 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.579 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.580 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2021-04-09T18:20:12.580 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2021-04-09T18:20:12.580 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.586 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.586 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2021-04-09T18:20:12.586 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.587 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.587 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.587 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.587 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.588 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.588 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.589 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2021-04-09T18:20:12.589 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.589 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.590 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:12.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.590 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2021-04-09T18:20:12.590 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.602 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.602 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:12.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.603 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2021-04-09T18:20:12.603 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.603 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.603 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.604 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2021-04-09T18:20:12.604 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2021-04-09T18:20:12.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.604 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.605 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2021-04-09T18:20:12.605 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.605 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.605 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.606 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2021-04-09T18:20:12.606 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.606 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.606 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.607 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2021-04-09T18:20:12.607 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2021-04-09T18:20:12.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.607 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.608 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.608 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.608 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.608 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.609 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2021-04-09T18:20:12.609 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.609 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.610 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2021-04-09T18:20:12.610 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2021-04-09T18:20:12.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.610 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.611 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2021-04-09T18:20:12.621 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.621 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.622 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.622 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2021-04-09T18:20:12.623 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.623 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.624 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2021-04-09T18:20:12.624 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2021-04-09T18:20:12.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.624 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.625 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2021-04-09T18:20:12.625 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.625 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.626 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.626 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2021-04-09T18:20:12.626 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.626 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.627 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2021-04-09T18:20:12.627 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2021-04-09T18:20:12.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.628 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.628 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.628 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.628 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.629 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.629 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2021-04-09T18:20:12.629 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.629 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.630 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.630 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2021-04-09T18:20:12.630 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2021-04-09T18:20:12.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.631 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.639 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2021-04-09T18:20:12.640 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.640 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.640 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.640 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2021-04-09T18:20:12.641 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.641 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.641 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.642 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator_cli", 2021-04-09T18:20:12.642 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.643 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.643 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.643 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2021-04-09T18:20:12.644 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2021-04-09T18:20:12.644 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.644 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.645 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.645 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.645 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.645 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.645 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.646 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.646 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.647 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2021-04-09T18:20:12.648 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.648 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.648 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.648 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:12.648 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:12.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.649 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.649 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:12.649 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.650 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.650 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.650 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.650 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.651 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.651 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.652 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2021-04-09T18:20:12.652 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.652 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.652 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.653 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:12.653 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:12.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.659 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.659 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:12.659 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.660 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.660 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.660 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.660 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.660 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.661 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.661 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2021-04-09T18:20:12.661 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2021-04-09T18:20:12.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.662 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.662 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2021-04-09T18:20:12.662 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.663 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.663 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.663 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2021-04-09T18:20:12.663 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.664 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.665 INFO:teuthology.orchestra.run.smithi120.stdout: "persist_interval": { 2021-04-09T18:20:12.665 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "persist_interval", 2021-04-09T18:20:12.665 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:12.665 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.666 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:12.666 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:12.666 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.666 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.666 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.667 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to persist completed events", 2021-04-09T18:20:12.667 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.671 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.672 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2021-04-09T18:20:12.672 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.672 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.673 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.673 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2021-04-09T18:20:12.673 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2021-04-09T18:20:12.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.674 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.674 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.675 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.675 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.675 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.675 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.676 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.676 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.676 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2021-04-09T18:20:12.677 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-04-09T18:20:12.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.677 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.677 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2021-04-09T18:20:12.678 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.678 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.678 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.678 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.679 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.679 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.680 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2021-04-09T18:20:12.680 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2021-04-09T18:20:12.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.680 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.680 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.681 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.681 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.681 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.681 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.681 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.682 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.682 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.683 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:12.683 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:12.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.708 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.708 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.708 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.709 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.709 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.709 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.709 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.710 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.710 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.710 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:12.711 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:12.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.711 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.712 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.712 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.712 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.712 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.712 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.713 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.713 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.713 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.714 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2021-04-09T18:20:12.714 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2021-04-09T18:20:12.714 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.714 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.715 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.715 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.715 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.716 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.716 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.716 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.717 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.718 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2021-04-09T18:20:12.718 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.719 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.719 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:12.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.720 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2021-04-09T18:20:12.720 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.720 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.721 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.721 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:12.721 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:12.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.722 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.722 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.722 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.722 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.723 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.723 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.723 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.723 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.724 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.740 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.740 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.740 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2021-04-09T18:20:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2021-04-09T18:20:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2021-04-09T18:20:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2021-04-09T18:20:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2021-04-09T18:20:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2021-04-09T18:20:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2021-04-09T18:20:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2021-04-09T18:20:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2021-04-09T18:20:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2021-04-09T18:20:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2021-04-09T18:20:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2021-04-09T18:20:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2021-04-09T18:20:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2021-04-09T18:20:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2021-04-09T18:20:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2021-04-09T18:20:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2021-04-09T18:20:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2021-04-09T18:20:12.806 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2021-04-09T18:20:12.806 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.807 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.808 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:12.808 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.808 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2021-04-09T18:20:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2021-04-09T18:20:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2021-04-09T18:20:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2021-04-09T18:20:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2021-04-09T18:20:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2021-04-09T18:20:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.850 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.852 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.854 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh", 2021-04-09T18:20:12.854 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.855 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.856 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.856 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_cache_timeout_min": { 2021-04-09T18:20:12.857 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_cache_timeout_min", 2021-04-09T18:20:12.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.858 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.858 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.859 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.859 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.860 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.860 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.860 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.861 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.862 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.863 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2021-04-09T18:20:12.863 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2021-04-09T18:20:12.864 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.864 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.866 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:12.867 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.867 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.868 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.868 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.868 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.869 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.869 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.871 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2021-04-09T18:20:12.872 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.872 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.873 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:12.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.874 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2021-04-09T18:20:12.874 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.875 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.875 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.876 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2021-04-09T18:20:12.876 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2021-04-09T18:20:12.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.877 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.878 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-04-09T18:20:12.879 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.879 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.879 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.880 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.880 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.881 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.881 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.882 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:12.882 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:12.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:12.883 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.884 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2021-04-09T18:20:12.885 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.885 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.886 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.886 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.886 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.891 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.893 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2021-04-09T18:20:12.894 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.894 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.895 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:12.895 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2021-04-09T18:20:12.895 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2021-04-09T18:20:12.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.896 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.897 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.897 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:12.898 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.899 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.899 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.900 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2021-04-09T18:20:12.900 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.901 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.902 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2021-04-09T18:20:12.902 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2021-04-09T18:20:12.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.903 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.904 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:12.904 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.905 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.905 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.906 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.906 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.907 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.908 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2021-04-09T18:20:12.915 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2021-04-09T18:20:12.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.916 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.916 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:12.916 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.917 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.917 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.918 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.918 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.918 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.919 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2021-04-09T18:20:12.919 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2021-04-09T18:20:12.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.919 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.920 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:12.920 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.920 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.920 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.921 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.921 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.921 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.922 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2021-04-09T18:20:12.922 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2021-04-09T18:20:12.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.922 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.925 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:12.925 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.925 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.926 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.926 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.927 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.928 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.928 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.929 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2021-04-09T18:20:12.929 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2021-04-09T18:20:12.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.930 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.930 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:12.931 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.931 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.932 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.932 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.932 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.933 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.933 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2021-04-09T18:20:12.933 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2021-04-09T18:20:12.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.934 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-04-09T18:20:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2021-04-09T18:20:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2021-04-09T18:20:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2021-04-09T18:20:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2021-04-09T18:20:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2021-04-09T18:20:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2021-04-09T18:20:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2021-04-09T18:20:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2021-04-09T18:20:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2021-04-09T18:20:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2021-04-09T18:20:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2021-04-09T18:20:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2021-04-09T18:20:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2021-04-09T18:20:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-04-09T18:20:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2021-04-09T18:20:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2021-04-09T18:20:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2021-04-09T18:20:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2021-04-09T18:20:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2021-04-09T18:20:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2021-04-09T18:20:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2021-04-09T18:20:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2021-04-09T18:20:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2021-04-09T18:20:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2021-04-09T18:20:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2021-04-09T18:20:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2021-04-09T18:20:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2021-04-09T18:20:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2021-04-09T18:20:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:13.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:13.045 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:13.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:13.046 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2021-04-09T18:20:13.046 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2021-04-09T18:20:13.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:13.047 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:13.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:13.047 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-04-09T18:20:13.047 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:13.047 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:13.048 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:13.054 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:13.054 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:13.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:13.055 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:13.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:13.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:13.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:13.056 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:13.057 INFO:teuthology.orchestra.run.smithi120.stdout: "services": {}, 2021-04-09T18:20:13.057 INFO:teuthology.orchestra.run.smithi120.stdout: "always_on_modules": { 2021-04-09T18:20:13.057 INFO:teuthology.orchestra.run.smithi120.stdout: "nautilus": [ 2021-04-09T18:20:13.058 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2021-04-09T18:20:13.058 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2021-04-09T18:20:13.058 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2021-04-09T18:20:13.059 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator_cli", 2021-04-09T18:20:13.059 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2021-04-09T18:20:13.059 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2021-04-09T18:20:13.059 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2021-04-09T18:20:13.060 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2021-04-09T18:20:13.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2021-04-09T18:20:13.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:13.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:13.060 INFO:teuthology.orchestra.run.smithi120.stdout: "servicemap": { 2021-04-09T18:20:13.061 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 1, 2021-04-09T18:20:13.061 INFO:teuthology.orchestra.run.smithi120.stdout: "modified": "0.000000", 2021-04-09T18:20:13.061 INFO:teuthology.orchestra.run.smithi120.stdout: "services": {} 2021-04-09T18:20:13.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:13.062 INFO:teuthology.orchestra.run.smithi120.stdout: "progress_events": {} 2021-04-09T18:20:13.062 INFO:teuthology.orchestra.run.smithi120.stdout:} 2021-04-09T18:20:13.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.006 7f0d486da700 1 -- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0d280188c0 msgr2=0x7f0d2801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.006 7f0d486da700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0d280188c0 0x7f0d2801adc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.006 7f0d486da700 1 -- 172.21.15.120:0/2244761947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d4009b6b0 msgr2=0x7f0d40188cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.006 7f0d486da700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d4009b6b0 0x7f0d40188cd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f0d3c0099a0 tx=0x7f0d3c00bcf0).stop 2021-04-09T18:20:13.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.007 7f0d486da700 1 -- 172.21.15.120:0/2244761947 shutdown_connections 2021-04-09T18:20:13.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.007 7f0d486da700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0d280188c0 0x7f0d2801adc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.007 7f0d486da700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0d4019f0d0 0x7f0d4019ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.007 7f0d486da700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d400b2630 0x7f0d4019d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.007 7f0d486da700 1 --2- 172.21.15.120:0/2244761947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d4009b6b0 0x7f0d40188cd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.007 7f0d486da700 1 -- 172.21.15.120:0/2244761947 >> 172.21.15.120:0/2244761947 conn(0x7f0d4018dd30 msgr2=0x7f0d4009bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:13.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.007 7f0d486da700 1 -- 172.21.15.120:0/2244761947 shutdown_connections 2021-04-09T18:20:13.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:10.007 7f0d486da700 1 -- 172.21.15.120:0/2244761947 wait complete. 2021-04-09T18:20:13.069 INFO:tasks.ceph.ceph_manager.ceph:{'fsid': 'dcbe2161-e5ca-44be-8661-d46578834d60', 'health': {'checks': {}, 'status': 'HEALTH_OK'}, 'election_epoch': 4, 'quorum': [0, 1, 2], 'quorum_names': ['a', 'b', 'c'], 'quorum_age': 39, 'monmap': {'epoch': 1, 'min_mon_release_name': '14', 'num_mons': 3}, 'osdmap': {'osdmap': {'epoch': 22, 'num_osds': 8, 'num_up_osds': 8, 'num_in_osds': 8, 'num_remapped_pgs': 0}}, 'pgmap': {'pgs_by_state': [{'state_name': 'active+clean', 'count': 24}], 'num_pgs': 24, 'num_pools': 3, 'num_objects': 21, 'data_bytes': 2286, 'bytes_used': 8591835136, 'bytes_avail': 764502278144, 'bytes_total': 773094113280}, 'fsmap': {'epoch': 7, 'id': 1, 'up': 1, 'in': 1, 'max': 1, 'by_rank': [{'filesystem_id': 1, 'rank': 0, 'name': 'b', 'status': 'up:active', 'gid': 4292}], 'up:standby': 1}, 'mgrmap': {'epoch': 3, 'active_gid': 4106, 'active_name': 'x', 'active_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 23529}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 23529}]}, 'active_addr': '172.21.15.134:6801/23529', 'active_change': '2021-04-09 18:19:32.736784', 'available': True, 'standbys': [{'gid': 4104, 'name': 'y', 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}]}], 'modules': ['iostat', 'restful'], 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}], 'services': {}, 'always_on_modules': {'nautilus': ['balancer', 'crash', 'devicehealth', 'orchestrator_cli', 'progress', 'rbd_support', 'status', 'volumes']}}, 'servicemap': {'epoch': 1, 'modified': '0.000000', 'services': {}}, 'progress_events': {}} 2021-04-09T18:20:13.073 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-04-09T18:20:13.073 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-04-09T18:20:13.074 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph health 2021-04-09T18:20:13.232 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.214 7fba3d8a9700 1 Processor -- start 2021-04-09T18:20:13.232 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.214 7fba3d8a9700 1 -- start start 2021-04-09T18:20:13.233 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba3d8a9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba380d1b10 0x7fba380d5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.233 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba3d8a9700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba380d61b0 con 0x7fba380dc680 2021-04-09T18:20:13.233 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba3d8a9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba380dca80 con 0x7fba380eac10 2021-04-09T18:20:13.234 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba3d8a9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba380f38b0 con 0x7fba380d1b10 2021-04-09T18:20:13.234 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba36d73700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fba380dc680 0x7fba380d6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47916/0 (socket says 172.21.15.120:47916) 2021-04-09T18:20:13.234 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba36d73700 1 -- 172.21.15.120:0/598432852 learned_addr learned my addr 172.21.15.120:0/598432852 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:13.234 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba37d75700 1 --2- 172.21.15.120:0/598432852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba380d1b10 0x7fba380d5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.234 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba36572700 1 -- 172.21.15.120:0/598432852 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703081309 0 0) 0x7fba20000ce0 con 0x7fba380dc680 2021-04-09T18:20:13.235 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba36572700 1 -- 172.21.15.120:0/598432852 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba18002fe0 con 0x7fba380dc680 2021-04-09T18:20:13.235 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.215 7fba36572700 1 -- 172.21.15.120:0/598432852 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559404928 0 0) 0x7fba28000fe0 con 0x7fba380eac10 2021-04-09T18:20:13.235 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba36572700 1 -- 172.21.15.120:0/598432852 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba18003210 con 0x7fba380eac10 2021-04-09T18:20:13.235 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba36572700 1 -- 172.21.15.120:0/598432852 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1733748383 0 0) 0x7fba20000ed0 con 0x7fba380dc680 2021-04-09T18:20:13.236 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba37d75700 1 -- 172.21.15.120:0/598432852 >> v1:172.21.15.134:6789/0 conn(0x7fba380eac10 legacy=0x7fba38088030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.236 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba37d75700 1 -- 172.21.15.120:0/598432852 >> v1:172.21.15.120:6789/0 conn(0x7fba380dc680 legacy=0x7fba380d6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.236 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba37d75700 1 -- 172.21.15.120:0/598432852 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba380d1280 con 0x7fba380d1b10 2021-04-09T18:20:13.236 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba37d75700 1 --2- 172.21.15.120:0/598432852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba380d1b10 0x7fba380d5560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fba30006ad0 tx=0x7fba30009ad0).ready entity=mon.2 client_cookie=5a6550f6f9b92fb8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:13.237 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba36572700 1 -- 172.21.15.120:0/598432852 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba300022e0 con 0x7fba380d1b10 2021-04-09T18:20:13.237 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba36572700 1 -- 172.21.15.120:0/598432852 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30006410 con 0x7fba380d1b10 2021-04-09T18:20:13.237 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba36572700 1 -- 172.21.15.120:0/598432852 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba30000c10 con 0x7fba380d1b10 2021-04-09T18:20:13.237 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba3d8a9700 1 -- 172.21.15.120:0/598432852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba380d1b10 msgr2=0x7fba380d5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.238 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.216 7fba3d8a9700 1 --2- 172.21.15.120:0/598432852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba380d1b10 0x7fba380d5560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fba30006ad0 tx=0x7fba30009ad0).stop 2021-04-09T18:20:13.238 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.217 7fba3d8a9700 1 -- 172.21.15.120:0/598432852 shutdown_connections 2021-04-09T18:20:13.238 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.217 7fba3d8a9700 1 --2- 172.21.15.120:0/598432852 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba380d1b10 0x7fba380d5560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.238 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.217 7fba3d8a9700 1 -- 172.21.15.120:0/598432852 >> 172.21.15.120:0/598432852 conn(0x7fba380e9390 msgr2=0x7fba38100540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:13.238 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.217 7fba3d8a9700 1 -- 172.21.15.120:0/598432852 shutdown_connections 2021-04-09T18:20:13.239 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.217 7fba3d8a9700 1 -- 172.21.15.120:0/598432852 wait complete. 2021-04-09T18:20:13.243 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.235 7fba3d8a9700 1 Processor -- start 2021-04-09T18:20:13.244 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba3d8a9700 1 -- start start 2021-04-09T18:20:13.244 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba3d8a9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba3809c190 0x7fba3809b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.244 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba3d8a9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3809c590 0x7fba3818fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.245 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba3d8a9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba38089a30 0x7fba38089e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.245 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba3d8a9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3809bc10 con 0x7fba38089a30 2021-04-09T18:20:13.245 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba3d8a9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba380990a0 con 0x7fba3809c590 2021-04-09T18:20:13.245 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba3d8a9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba38190400 con 0x7fba3809c190 2021-04-09T18:20:13.246 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba37d75700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba38089a30 0x7fba38089e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.246 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba37d75700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba38089a30 0x7fba38089e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53010/0 (socket says 172.21.15.120:53010) 2021-04-09T18:20:13.246 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba37d75700 1 -- 172.21.15.120:0/1461870864 learned_addr learned my addr 172.21.15.120:0/1461870864 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:13.246 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba37574700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba3809c190 0x7fba3809b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.247 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.236 7fba36d73700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3809c590 0x7fba3818fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.247 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba37d75700 1 -- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba3809c190 msgr2=0x7fba3809b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.247 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba37d75700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba3809c190 0x7fba3809b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.247 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba37d75700 1 -- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3809c590 msgr2=0x7fba3818fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.248 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba37d75700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3809c590 0x7fba3818fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.248 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba37d75700 1 -- 172.21.15.120:0/1461870864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba38197ad0 con 0x7fba38089a30 2021-04-09T18:20:13.248 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba37d75700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba38089a30 0x7fba38089e30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fba3000b610 tx=0x7fba3000b9b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:13.248 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba2ffff700 1 -- 172.21.15.120:0/1461870864 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba30002030 con 0x7fba38089a30 2021-04-09T18:20:13.249 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba2ffff700 1 -- 172.21.15.120:0/1461870864 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30002330 con 0x7fba38089a30 2021-04-09T18:20:13.249 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3809bc10 con 0x7fba38089a30 2021-04-09T18:20:13.249 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba2ffff700 1 -- 172.21.15.120:0/1461870864 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba30002780 con 0x7fba38089a30 2021-04-09T18:20:13.249 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.237 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3809bc10 con 0x7fba38089a30 2021-04-09T18:20:13.255 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.238 7fba2ffff700 1 -- 172.21.15.120:0/1461870864 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fba30000a70 con 0x7fba38089a30 2021-04-09T18:20:13.256 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.238 7fba2ffff700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fba100188c0 0x7fba1001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.256 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.238 7fba2ffff700 1 -- 172.21.15.120:0/1461870864 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fba30032bc0 con 0x7fba38089a30 2021-04-09T18:20:13.256 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.238 7fba37574700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fba100188c0 0x7fba1001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.256 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.238 7fba37574700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fba100188c0 0x7fba1001adc0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:13.264 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.260 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba38088540 con 0x7fba38089a30 2021-04-09T18:20:13.265 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.264 7fba2ffff700 1 -- 172.21.15.120:0/1461870864 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fba3001f7a0 con 0x7fba38089a30 2021-04-09T18:20:13.434 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.437 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health"} v 0) v1 -- 0x7fba38088540 con 0x7fba38089a30 2021-04-09T18:20:13.435 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.437 7fba2ffff700 1 -- 172.21.15.120:0/1461870864 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health"}]=0 v0) v1 ==== 54+0+10 (secure 0 0 0) 0x7fba3000bda0 con 0x7fba38089a30 2021-04-09T18:20:13.436 INFO:teuthology.misc.health.smithi120.stdout:HEALTH_OK 2021-04-09T18:20:13.438 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fba100188c0 msgr2=0x7fba1001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.439 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fba100188c0 0x7fba1001adc0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.439 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba38089a30 msgr2=0x7fba38089e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.440 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba38089a30 0x7fba38089e30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fba3000b610 tx=0x7fba3000b9b0).stop 2021-04-09T18:20:13.440 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 shutdown_connections 2021-04-09T18:20:13.441 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba38089a30 0x7fba38089e30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.441 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3809c590 0x7fba3818fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.441 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fba100188c0 0x7fba1001adc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.442 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 --2- 172.21.15.120:0/1461870864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba3809c190 0x7fba3809b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.442 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 >> 172.21.15.120:0/1461870864 conn(0x7fba380c1120 msgr2=0x7fba38088770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:13.443 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 shutdown_connections 2021-04-09T18:20:13.443 INFO:teuthology.misc.health.smithi120.stderr:2021-04-09 18:20:13.440 7fba3d8a9700 1 -- 172.21.15.120:0/1461870864 wait complete. 2021-04-09T18:20:13.448 DEBUG:teuthology.misc:Ceph health: HEALTH_OK 2021-04-09T18:20:13.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:20:13.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.598 7f442d6fd700 1 Processor -- start 2021-04-09T18:20:13.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.598 7f442d6fd700 1 -- start start 2021-04-09T18:20:13.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f442d6fd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f44280d7160 0x7f44280d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f442d6fd700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44280d6be0 con 0x7f44280d6190 2021-04-09T18:20:13.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f442d6fd700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44281a2ac0 con 0x7f44280d55a0 2021-04-09T18:20:13.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f442d6fd700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44281a2ce0 con 0x7f44280d7160 2021-04-09T18:20:13.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f44272bf700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f44280d7160 0x7f44280d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f4427ac0700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f44280d6190 0x7f44281ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47928/0 (socket says 172.21.15.120:47928) 2021-04-09T18:20:13.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f4427ac0700 1 -- 172.21.15.120:0/114055280 learned_addr learned my addr 172.21.15.120:0/114055280 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:13.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f44272bf700 1 -- 172.21.15.120:0/114055280 >> v1:172.21.15.134:6789/0 conn(0x7f44280d55a0 legacy=0x7f44280d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f44272bf700 1 -- 172.21.15.120:0/114055280 >> v1:172.21.15.120:6789/0 conn(0x7f44280d6190 legacy=0x7f44281ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f44272bf700 1 -- 172.21.15.120:0/114055280 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280d6590 con 0x7f44280d7160 2021-04-09T18:20:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.599 7f44262bd700 1 -- 172.21.15.120:0/114055280 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275233436 0 0) 0x7f44200009b0 con 0x7f44280d6190 2021-04-09T18:20:13.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f44272bf700 1 --2- 172.21.15.120:0/114055280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44280d7160 0x7f44280d7560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f44180069d0 tx=0x7f4418009dc0).ready entity=mon.0 client_cookie=ce440508ee4073ab server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:13.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f44262bd700 1 -- 172.21.15.120:0/114055280 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f441800b510 con 0x7f44280d7160 2021-04-09T18:20:13.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f44262bd700 1 -- 172.21.15.120:0/114055280 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4418006ac0 con 0x7f44280d7160 2021-04-09T18:20:13.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f44262bd700 1 -- 172.21.15.120:0/114055280 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f441800ba80 con 0x7f44280d7160 2021-04-09T18:20:13.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f442d6fd700 1 -- 172.21.15.120:0/114055280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44280d7160 msgr2=0x7f44280d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f442d6fd700 1 --2- 172.21.15.120:0/114055280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44280d7160 0x7f44280d7560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f44180069d0 tx=0x7f4418009dc0).stop 2021-04-09T18:20:13.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f442d6fd700 1 -- 172.21.15.120:0/114055280 shutdown_connections 2021-04-09T18:20:13.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f442d6fd700 1 --2- 172.21.15.120:0/114055280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44280d7160 0x7f44280d7560 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f442d6fd700 1 -- 172.21.15.120:0/114055280 >> 172.21.15.120:0/114055280 conn(0x7f44280d1590 msgr2=0x7f44280d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.600 7f442d6fd700 1 -- 172.21.15.120:0/114055280 shutdown_connections 2021-04-09T18:20:13.635 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.601 7f442d6fd700 1 -- 172.21.15.120:0/114055280 wait complete. 2021-04-09T18:20:13.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.619 7f442d6fd700 1 Processor -- start 2021-04-09T18:20:13.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.619 7f442d6fd700 1 -- start start 2021-04-09T18:20:13.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f442d6fd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4428186ed0 0x7f4428180850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f442d6fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4428180e70 0x7f44280b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f442d6fd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44281872d0 0x7f44280b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f442d6fd700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4428186950 con 0x7f4428186ed0 2021-04-09T18:20:13.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f442d6fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280b2450 con 0x7f4428180e70 2021-04-09T18:20:13.639 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f442d6fd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44280b2630 con 0x7f44281872d0 2021-04-09T18:20:13.639 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f44272bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4428186ed0 0x7f4428180850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f44272bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4428186ed0 0x7f4428180850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53020/0 (socket says 172.21.15.120:53020) 2021-04-09T18:20:13.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f44272bf700 1 -- 172.21.15.120:0/126299520 learned_addr learned my addr 172.21.15.120:0/126299520 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:13.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f4427ac0700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44281872d0 0x7f44280b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f4426abe700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4428180e70 0x7f44280b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f44272bf700 1 -- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44281872d0 msgr2=0x7f44280b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f44272bf700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44281872d0 0x7f44280b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f44272bf700 1 -- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4428180e70 msgr2=0x7f44280b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f44272bf700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4428180e70 0x7f44280b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f44272bf700 1 -- 172.21.15.120:0/126299520 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442819d110 con 0x7f4428186ed0 2021-04-09T18:20:13.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f4427ac0700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44281872d0 0x7f44280b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:13.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f4426abe700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4428180e70 0x7f44280b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:13.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f44272bf700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4428186ed0 0x7f4428180850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f44180099e0 tx=0x7f441800bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f440ffff700 1 -- 172.21.15.120:0/126299520 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4418006030 con 0x7f4428186ed0 2021-04-09T18:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f440ffff700 1 -- 172.21.15.120:0/126299520 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44180062f0 con 0x7f4428186ed0 2021-04-09T18:20:13.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f440ffff700 1 -- 172.21.15.120:0/126299520 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4418005660 con 0x7f4428186ed0 2021-04-09T18:20:13.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f442d6fd700 1 -- 172.21.15.120:0/126299520 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442819d110 con 0x7f4428186ed0 2021-04-09T18:20:13.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.620 7f442d6fd700 1 -- 172.21.15.120:0/126299520 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442819d110 con 0x7f4428186ed0 2021-04-09T18:20:13.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.621 7f440ffff700 1 -- 172.21.15.120:0/126299520 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f44180064d0 con 0x7f4428186ed0 2021-04-09T18:20:13.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.621 7f440ffff700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f44080188d0 0x7f440801add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.621 7f440ffff700 1 -- 172.21.15.120:0/126299520 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f4418032f90 con 0x7f4428186ed0 2021-04-09T18:20:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.622 7f4426abe700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f44080188d0 0x7f440801add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.622 7f4426abe700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f44080188d0 0x7f440801add0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:13.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.645 7f442d6fd700 1 -- 172.21.15.120:0/126299520 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442817f360 con 0x7f4428186ed0 2021-04-09T18:20:13.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.649 7f440ffff700 1 -- 172.21.15.120:0/126299520 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f441800be10 con 0x7f4428186ed0 2021-04-09T18:20:13.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.826 7f442d6fd700 1 -- 172.21.15.120:0/126299520 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f442817f360 con 0x7f4428186ed0 2021-04-09T18:20:13.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.826 7f440ffff700 1 -- 172.21.15.120:0/126299520 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7f44180062f0 con 0x7f4428186ed0 2021-04-09T18:20:13.825 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:13.826 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:20:13.840 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 -- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f44080188d0 msgr2=0x7f440801add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f44080188d0 0x7f440801add0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 -- 172.21.15.120:0/126299520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4428186ed0 msgr2=0x7f4428180850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:13.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4428186ed0 0x7f4428180850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f44180099e0 tx=0x7f441800bcd0).stop 2021-04-09T18:20:13.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 -- 172.21.15.120:0/126299520 shutdown_connections 2021-04-09T18:20:13.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f44080188d0 0x7f440801add0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44281872d0 0x7f44280b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4428180e70 0x7f44280b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 --2- 172.21.15.120:0/126299520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4428186ed0 0x7f4428180850 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:13.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 -- 172.21.15.120:0/126299520 >> 172.21.15.120:0/126299520 conn(0x7f44280945f0 msgr2=0x7f4428097cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:13.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 -- 172.21.15.120:0/126299520 shutdown_connections 2021-04-09T18:20:13.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:13.829 7f442d6fd700 1 -- 172.21.15.120:0/126299520 wait complete. 2021-04-09T18:20:13.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:19:47.013532', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:19:50.254363', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:19:52.685224', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:20:13.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:20:14.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.000 7fd1cb884700 1 Processor -- start 2021-04-09T18:20:14.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.000 7fd1cb884700 1 -- start start 2021-04-09T18:20:14.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1cb884700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c40d7180 0x7fd1c40e7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1cb884700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd1c40e70c0 0x7fd1c40d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1cb884700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40d6c00 con 0x7fd1c40d7580 2021-04-09T18:20:14.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1cb884700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c40d8110 con 0x7fd1c40e70c0 2021-04-09T18:20:14.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1cb884700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40e7f20 con 0x7fd1c40d7180 2021-04-09T18:20:14.031 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c96a0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c40d7180 0x7fd1c40e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.031 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c9ea1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd1c40e70c0 0x7fd1c40d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.031 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c96a0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c40d7180 0x7fd1c40e7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:39692/0 (socket says 172.21.15.120:39692) 2021-04-09T18:20:14.032 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c9ea1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd1c40e70c0 0x7fd1c40d5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:41866/0 (socket says 172.21.15.120:41866) 2021-04-09T18:20:14.032 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c8e9f700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd1c40d7580 0x7fd1c40d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42760/0 (socket says 172.21.15.120:42760) 2021-04-09T18:20:14.033 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c96a0700 1 -- 172.21.15.120:0/1402523763 learned_addr learned my addr 172.21.15.120:0/1402523763 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:14.033 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c96a0700 1 -- 172.21.15.120:0/1402523763 >> v2:172.21.15.134:3300/0 conn(0x7fd1c40e70c0 msgr2=0x7fd1c40d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:14.034 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c96a0700 1 --2- 172.21.15.120:0/1402523763 >> v2:172.21.15.134:3300/0 conn(0x7fd1c40e70c0 0x7fd1c40d5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.034 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c96a0700 1 -- 172.21.15.120:0/1402523763 >> v1:172.21.15.134:6789/0 conn(0x7fd1c40d7580 legacy=0x7fd1c40d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.034 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c96a0700 1 -- 172.21.15.120:0/1402523763 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c41a2ae0 con 0x7fd1c40d7180 2021-04-09T18:20:14.034 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1b7fff700 1 -- 172.21.15.120:0/1402523763 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408243262 0 0) 0x7fd1c00009b0 con 0x7fd1c40d7580 2021-04-09T18:20:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.001 7fd1c9ea1700 1 --2- 172.21.15.120:0/1402523763 >> v2:172.21.15.134:3300/0 conn(0x7fd1c40e70c0 0x7fd1c40d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.002 7fd1c96a0700 1 --2- 172.21.15.120:0/1402523763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c40d7180 0x7fd1c40e7900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd1b8006a80 tx=0x7fd1b8009f00).ready entity=mon.2 client_cookie=5c043d27c4868a8c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.002 7fd1b7fff700 1 -- 172.21.15.120:0/1402523763 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1b800b5c0 con 0x7fd1c40d7180 2021-04-09T18:20:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.002 7fd1b7fff700 1 -- 172.21.15.120:0/1402523763 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b800b8c0 con 0x7fd1c40d7180 2021-04-09T18:20:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.002 7fd1b7fff700 1 -- 172.21.15.120:0/1402523763 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1b800bda0 con 0x7fd1c40d7180 2021-04-09T18:20:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.002 7fd1cb884700 1 -- 172.21.15.120:0/1402523763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c40d7180 msgr2=0x7fd1c40e7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.002 7fd1cb884700 1 --2- 172.21.15.120:0/1402523763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c40d7180 0x7fd1c40e7900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd1b8006a80 tx=0x7fd1b8009f00).stop 2021-04-09T18:20:14.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.003 7fd1cb884700 1 -- 172.21.15.120:0/1402523763 shutdown_connections 2021-04-09T18:20:14.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.003 7fd1cb884700 1 --2- 172.21.15.120:0/1402523763 >> v2:172.21.15.134:3300/0 conn(0x7fd1c40e70c0 0x7fd1c40d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.003 7fd1cb884700 1 --2- 172.21.15.120:0/1402523763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c40d7180 0x7fd1c40e7900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.003 7fd1cb884700 1 -- 172.21.15.120:0/1402523763 >> 172.21.15.120:0/1402523763 conn(0x7fd1c40d15b0 msgr2=0x7fd1c40d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:14.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.003 7fd1cb884700 1 -- 172.21.15.120:0/1402523763 shutdown_connections 2021-04-09T18:20:14.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.003 7fd1cb884700 1 -- 172.21.15.120:0/1402523763 wait complete. 2021-04-09T18:20:14.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.021 7fd1cb884700 1 Processor -- start 2021-04-09T18:20:14.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1cb884700 1 -- start start 2021-04-09T18:20:14.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1cb884700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c41804d0 0x7fd1c40e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1cb884700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1c40aad70 0x7fd1c40ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1cb884700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c40df0a0 0x7fd1c40df4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1cb884700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40e13d0 con 0x7fd1c40df0a0 2021-04-09T18:20:14.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1cb884700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c41808d0 con 0x7fd1c40aad70 2021-04-09T18:20:14.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1cb884700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40dfac0 con 0x7fd1c41804d0 2021-04-09T18:20:14.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1c9ea1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c40df0a0 0x7fd1c40df4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1c9ea1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c40df0a0 0x7fd1c40df4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53036/0 (socket says 172.21.15.120:53036) 2021-04-09T18:20:14.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1c9ea1700 1 -- 172.21.15.120:0/2682917715 learned_addr learned my addr 172.21.15.120:0/2682917715 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:14.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1c8e9f700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1c40aad70 0x7fd1c40ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.022 7fd1c96a0700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c41804d0 0x7fd1c40e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1c9ea1700 1 -- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c41804d0 msgr2=0x7fd1c40e0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1c9ea1700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c41804d0 0x7fd1c40e0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1c9ea1700 1 -- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1c40aad70 msgr2=0x7fd1c40ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1c9ea1700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1c40aad70 0x7fd1c40ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1c9ea1700 1 -- 172.21.15.120:0/2682917715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40dfce0 con 0x7fd1c40df0a0 2021-04-09T18:20:14.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1c9ea1700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c40df0a0 0x7fd1c40df4a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fd1bc00b580 tx=0x7fd1bc00b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:14.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1b5ffb700 1 -- 172.21.15.120:0/2682917715 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1bc00bd10 con 0x7fd1c40df0a0 2021-04-09T18:20:14.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1b5ffb700 1 -- 172.21.15.120:0/2682917715 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00bd10 con 0x7fd1c40df0a0 2021-04-09T18:20:14.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c40dfce0 con 0x7fd1c40df0a0 2021-04-09T18:20:14.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1b5ffb700 1 -- 172.21.15.120:0/2682917715 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1bc006720 con 0x7fd1c40df0a0 2021-04-09T18:20:14.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.023 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c40dfce0 con 0x7fd1c40df0a0 2021-04-09T18:20:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.024 7fd1b5ffb700 1 -- 172.21.15.120:0/2682917715 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd1bc006720 con 0x7fd1c40df0a0 2021-04-09T18:20:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.024 7fd1b5ffb700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1a4018930 0x7fd1a401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.024 7fd1b5ffb700 1 -- 172.21.15.120:0/2682917715 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fd1bc032be0 con 0x7fd1c40df0a0 2021-04-09T18:20:14.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.024 7fd1c96a0700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1a4018930 0x7fd1a401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.024 7fd1c96a0700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1a4018930 0x7fd1a401ae10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:14.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.047 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c40d8e90 con 0x7fd1c40df0a0 2021-04-09T18:20:14.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.050 7fd1b5ffb700 1 -- 172.21.15.120:0/2682917715 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd1bc000e70 con 0x7fd1c40df0a0 2021-04-09T18:20:14.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.217 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fd1c40d8e90 con 0x7fd1c40df0a0 2021-04-09T18:20:14.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.218 7fd1b5ffb700 1 -- 172.21.15.120:0/2682917715 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd1bc006720 con 0x7fd1c40df0a0 2021-04-09T18:20:14.217 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:14.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1a4018930 msgr2=0x7fd1a401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1a4018930 0x7fd1a401ae10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c40df0a0 msgr2=0x7fd1c40df4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c40df0a0 0x7fd1c40df4a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fd1bc00b580 tx=0x7fd1bc00b920).stop 2021-04-09T18:20:14.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 shutdown_connections 2021-04-09T18:20:14.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c40df0a0 0x7fd1c40df4a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.242 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1c40aad70 0x7fd1c40ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.242 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1a4018930 0x7fd1a401ae10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.242 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 --2- 172.21.15.120:0/2682917715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1c41804d0 0x7fd1c40e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.243 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.220 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 >> 172.21.15.120:0/2682917715 conn(0x7fd1c40d9910 msgr2=0x7fd1c4181580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:14.243 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.221 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 shutdown_connections 2021-04-09T18:20:14.243 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.221 7fd1cb884700 1 -- 172.21.15.120:0/2682917715 wait complete. 2021-04-09T18:20:14.245 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:20:14.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.405 7f178ae57700 1 Processor -- start 2021-04-09T18:20:14.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.405 7f178ae57700 1 -- start start 2021-04-09T18:20:14.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.405 7f178ae57700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17840d7180 0x7f17840e7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.405 7f178ae57700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f17840d7580 0x7f17840d55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.405 7f178ae57700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17840d6c00 con 0x7f17840d5be0 2021-04-09T18:20:14.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.405 7f178ae57700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17840d8110 con 0x7f17840d7580 2021-04-09T18:20:14.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.405 7f178ae57700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17840e7f20 con 0x7f17840d7180 2021-04-09T18:20:14.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f1783fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f17840d7580 0x7f17840d55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f1783fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f17840d7580 0x7f17840d55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53042/0 (socket says 172.21.15.120:53042) 2021-04-09T18:20:14.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f1783fff700 1 -- 172.21.15.120:0/836260289 learned_addr learned my addr 172.21.15.120:0/836260289 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:14.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f1788c73700 1 --2- 172.21.15.120:0/836260289 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17840d7180 0x7f17840e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f1783fff700 1 -- 172.21.15.120:0/836260289 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17840d7180 msgr2=0x7f17840e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:14.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f1783fff700 1 --2- 172.21.15.120:0/836260289 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17840d7180 0x7f17840e7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f1783fff700 1 -- 172.21.15.120:0/836260289 >> v1:172.21.15.134:6789/0 conn(0x7f17840d5be0 legacy=0x7f17840d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f1783fff700 1 -- 172.21.15.120:0/836260289 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17841a2ae0 con 0x7f17840d7580 2021-04-09T18:20:14.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f17837fe700 1 -- 172.21.15.120:0/836260289 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136687514 0 0) 0x7f177c0009b0 con 0x7f17840d5be0 2021-04-09T18:20:14.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f1783fff700 1 --2- 172.21.15.120:0/836260289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840d7580 0x7f17840d55c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1774006a80 tx=0x7f1774009e80).ready entity=mon.0 client_cookie=bcfbfe8d941d0e17 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:14.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f17837fe700 1 -- 172.21.15.120:0/836260289 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f177400b510 con 0x7f17840d7580 2021-04-09T18:20:14.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f17837fe700 1 -- 172.21.15.120:0/836260289 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400b7d0 con 0x7f17840d7580 2021-04-09T18:20:14.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f17837fe700 1 -- 172.21.15.120:0/836260289 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f177400bcb0 con 0x7f17840d7580 2021-04-09T18:20:14.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f178ae57700 1 -- 172.21.15.120:0/836260289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840d7580 msgr2=0x7f17840d55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.406 7f178ae57700 1 --2- 172.21.15.120:0/836260289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840d7580 0x7f17840d55c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1774006a80 tx=0x7f1774009e80).stop 2021-04-09T18:20:14.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.407 7f178ae57700 1 -- 172.21.15.120:0/836260289 shutdown_connections 2021-04-09T18:20:14.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.407 7f178ae57700 1 --2- 172.21.15.120:0/836260289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840d7580 0x7f17840d55c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.407 7f178ae57700 1 --2- 172.21.15.120:0/836260289 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17840d7180 0x7f17840e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.407 7f178ae57700 1 -- 172.21.15.120:0/836260289 >> 172.21.15.120:0/836260289 conn(0x7f17840d15b0 msgr2=0x7f17840d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:14.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.407 7f178ae57700 1 -- 172.21.15.120:0/836260289 shutdown_connections 2021-04-09T18:20:14.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.407 7f178ae57700 1 -- 172.21.15.120:0/836260289 wait complete. 2021-04-09T18:20:14.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.426 7f178ae57700 1 Processor -- start 2021-04-09T18:20:14.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.426 7f178ae57700 1 -- start start 2021-04-09T18:20:14.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.426 7f178ae57700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17841804d0 0x7f17840e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.426 7f178ae57700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17840aad70 0x7f17840ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.426 7f178ae57700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840df0a0 0x7f17840df4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f178ae57700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17840e13d0 con 0x7f17840df0a0 2021-04-09T18:20:14.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f178ae57700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17841808d0 con 0x7f17840aad70 2021-04-09T18:20:14.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f178ae57700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17840dfac0 con 0x7f17841804d0 2021-04-09T18:20:14.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1789474700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840df0a0 0x7f17840df4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.444 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1789474700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840df0a0 0x7f17840df4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53050/0 (socket says 172.21.15.120:53050) 2021-04-09T18:20:14.444 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1789474700 1 -- 172.21.15.120:0/3382554473 learned_addr learned my addr 172.21.15.120:0/3382554473 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:14.444 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1788c73700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17841804d0 0x7f17840e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.444 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1783fff700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17840aad70 0x7f17840ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.445 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1789474700 1 -- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17841804d0 msgr2=0x7f17840e0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.445 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1789474700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17841804d0 0x7f17840e0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.445 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1789474700 1 -- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17840aad70 msgr2=0x7f17840ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.445 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1789474700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17840aad70 0x7f17840ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.445 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1789474700 1 -- 172.21.15.120:0/3382554473 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840dfce0 con 0x7f17840df0a0 2021-04-09T18:20:14.446 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1783fff700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17840aad70 0x7f17840ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:14.446 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f1789474700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840df0a0 0x7f17840df4a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f177c006f00 tx=0x7f177c00b940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:14.446 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f17817fa700 1 -- 172.21.15.120:0/3382554473 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f177c006030 con 0x7f17840df0a0 2021-04-09T18:20:14.446 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f17817fa700 1 -- 172.21.15.120:0/3382554473 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c0062f0 con 0x7f17840df0a0 2021-04-09T18:20:14.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f178ae57700 1 -- 172.21.15.120:0/3382554473 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17840dfce0 con 0x7f17840df0a0 2021-04-09T18:20:14.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f17817fa700 1 -- 172.21.15.120:0/3382554473 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f177c005770 con 0x7f17840df0a0 2021-04-09T18:20:14.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.427 7f178ae57700 1 -- 172.21.15.120:0/3382554473 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17840dfce0 con 0x7f17840df0a0 2021-04-09T18:20:14.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.428 7f17817fa700 1 -- 172.21.15.120:0/3382554473 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f177c000d30 con 0x7f17840df0a0 2021-04-09T18:20:14.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.428 7f17817fa700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1768018930 0x7f176801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.448 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.428 7f17817fa700 1 -- 172.21.15.120:0/3382554473 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f177c032ba0 con 0x7f17840df0a0 2021-04-09T18:20:14.448 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.428 7f1788c73700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1768018930 0x7f176801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.448 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.428 7f1788c73700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1768018930 0x7f176801ae10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:14.449 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.452 7f178ae57700 1 -- 172.21.15.120:0/3382554473 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17840d8e90 con 0x7f17840df0a0 2021-04-09T18:20:14.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.455 7f17817fa700 1 -- 172.21.15.120:0/3382554473 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f177c006b90 con 0x7f17840df0a0 2021-04-09T18:20:14.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.621 7f178ae57700 1 -- 172.21.15.120:0/3382554473 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f17840d8e90 con 0x7f17840df0a0 2021-04-09T18:20:14.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.622 7f17817fa700 1 -- 172.21.15.120:0/3382554473 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f177c00bd30 con 0x7f17840df0a0 2021-04-09T18:20:14.625 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:14.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 -- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1768018930 msgr2=0x7f176801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1768018930 0x7f176801ae10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 -- 172.21.15.120:0/3382554473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840df0a0 msgr2=0x7f17840df4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840df0a0 0x7f17840df4a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f177c006f00 tx=0x7f177c00b940).stop 2021-04-09T18:20:14.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 -- 172.21.15.120:0/3382554473 shutdown_connections 2021-04-09T18:20:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17840df0a0 0x7f17840df4a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17840aad70 0x7f17840ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1768018930 0x7f176801ae10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 --2- 172.21.15.120:0/3382554473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17841804d0 0x7f17840e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 -- 172.21.15.120:0/3382554473 >> 172.21.15.120:0/3382554473 conn(0x7f17840d9910 msgr2=0x7f1784181580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:14.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 -- 172.21.15.120:0/3382554473 shutdown_connections 2021-04-09T18:20:14.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.624 7f178ae57700 1 -- 172.21.15.120:0/3382554473 wait complete. 2021-04-09T18:20:14.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:20:14.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9cabb9700 1 Processor -- start 2021-04-09T18:20:14.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9cabb9700 1 -- start start 2021-04-09T18:20:14.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9cabb9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa9c40d7180 0x7fa9c40d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9cabb9700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa9c40d55c0 0x7fa9c40d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9cabb9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c40d5fe0 0x7fa9c40d63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9cabb9700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c40e80c0 con 0x7fa9c40d7180 2021-04-09T18:20:14.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9cabb9700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c40d8110 con 0x7fa9c40d55c0 2021-04-09T18:20:14.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9cabb9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c40d6c00 con 0x7fa9c40d5fe0 2021-04-09T18:20:14.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9c89d5700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa9c40d7180 0x7fa9c40d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9c89d5700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa9c40d7180 0x7fa9c40d7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53054/0 (socket says 172.21.15.120:53054) 2021-04-09T18:20:14.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9c89d5700 1 -- 172.21.15.120:0/1862456517 learned_addr learned my addr 172.21.15.120:0/1862456517 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:14.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9c3fff700 1 --2- 172.21.15.120:0/1862456517 >> v2:172.21.15.134:3300/0 conn(0x7fa9c40d55c0 0x7fa9c40d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.779 7fa9c91d6700 1 --2- 172.21.15.120:0/1862456517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c40d5fe0 0x7fa9c40d63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c89d5700 1 -- 172.21.15.120:0/1862456517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c40d5fe0 msgr2=0x7fa9c40d63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:14.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c89d5700 1 --2- 172.21.15.120:0/1862456517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c40d5fe0 0x7fa9c40d63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c89d5700 1 -- 172.21.15.120:0/1862456517 >> v2:172.21.15.134:3300/0 conn(0x7fa9c40d55c0 msgr2=0x7fa9c40d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:14.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c89d5700 1 --2- 172.21.15.120:0/1862456517 >> v2:172.21.15.134:3300/0 conn(0x7fa9c40d55c0 0x7fa9c40d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c89d5700 1 -- 172.21.15.120:0/1862456517 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c41a2ae0 con 0x7fa9c40d7180 2021-04-09T18:20:14.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c3fff700 1 --2- 172.21.15.120:0/1862456517 >> v2:172.21.15.134:3300/0 conn(0x7fa9c40d55c0 0x7fa9c40d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:14.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c89d5700 1 --2- 172.21.15.120:0/1862456517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40d7180 0x7fa9c40d7580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa9ac006700 tx=0x7fa9ac009b00).ready entity=mon.0 client_cookie=60b9e18a14267b5a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:14.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c37fe700 1 -- 172.21.15.120:0/1862456517 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9ac00c0c0 con 0x7fa9c40d7180 2021-04-09T18:20:14.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c37fe700 1 -- 172.21.15.120:0/1862456517 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac00c400 con 0x7fa9c40d7180 2021-04-09T18:20:14.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9c37fe700 1 -- 172.21.15.120:0/1862456517 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9ac00c8e0 con 0x7fa9c40d7180 2021-04-09T18:20:14.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9cabb9700 1 -- 172.21.15.120:0/1862456517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40d7180 msgr2=0x7fa9c40d7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.780 7fa9cabb9700 1 --2- 172.21.15.120:0/1862456517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40d7180 0x7fa9c40d7580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa9ac006700 tx=0x7fa9ac009b00).stop 2021-04-09T18:20:14.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.781 7fa9cabb9700 1 -- 172.21.15.120:0/1862456517 shutdown_connections 2021-04-09T18:20:14.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.781 7fa9cabb9700 1 --2- 172.21.15.120:0/1862456517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c40d5fe0 0x7fa9c40d63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.781 7fa9cabb9700 1 --2- 172.21.15.120:0/1862456517 >> v2:172.21.15.134:3300/0 conn(0x7fa9c40d55c0 0x7fa9c40d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.781 7fa9cabb9700 1 --2- 172.21.15.120:0/1862456517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40d7180 0x7fa9c40d7580 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.781 7fa9cabb9700 1 -- 172.21.15.120:0/1862456517 >> 172.21.15.120:0/1862456517 conn(0x7fa9c40d15b0 msgr2=0x7fa9c40d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:14.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.781 7fa9cabb9700 1 -- 172.21.15.120:0/1862456517 shutdown_connections 2021-04-09T18:20:14.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.781 7fa9cabb9700 1 -- 172.21.15.120:0/1862456517 wait complete. 2021-04-09T18:20:14.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.799 7fa9cabb9700 1 Processor -- start 2021-04-09T18:20:14.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.799 7fa9cabb9700 1 -- start start 2021-04-09T18:20:14.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9cabb9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40b24b0 0x7fa9c4186240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9cabb9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c4186860 0x7fa9c4184b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9cabb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9c41892d0 0x7fa9c4185150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9cabb9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4185cc0 con 0x7fa9c40b24b0 2021-04-09T18:20:14.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9cabb9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4185770 con 0x7fa9c41892d0 2021-04-09T18:20:14.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9cabb9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4188cf0 con 0x7fa9c4186860 2021-04-09T18:20:14.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9c89d5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40b24b0 0x7fa9c4186240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9c89d5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40b24b0 0x7fa9c4186240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53058/0 (socket says 172.21.15.120:53058) 2021-04-09T18:20:14.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9c89d5700 1 -- 172.21.15.120:0/2342504660 learned_addr learned my addr 172.21.15.120:0/2342504660 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:14.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9c91d6700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9c41892d0 0x7fa9c4185150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.800 7fa9c3fff700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c4186860 0x7fa9c4184b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9c89d5700 1 -- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c4186860 msgr2=0x7fa9c4184b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9c89d5700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c4186860 0x7fa9c4184b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9c89d5700 1 -- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9c41892d0 msgr2=0x7fa9c4185150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:14.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9c89d5700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9c41892d0 0x7fa9c4185150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:14.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9c89d5700 1 -- 172.21.15.120:0/2342504660 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c40b9be0 con 0x7fa9c40b24b0 2021-04-09T18:20:14.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9c89d5700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40b24b0 0x7fa9c4186240 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa9ac006f20 tx=0x7fa9ac00b9e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:14.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9c17fa700 1 -- 172.21.15.120:0/2342504660 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9ac00bdd0 con 0x7fa9c40b24b0 2021-04-09T18:20:14.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c40b9be0 con 0x7fa9c40b24b0 2021-04-09T18:20:14.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9c17fa700 1 -- 172.21.15.120:0/2342504660 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac009440 con 0x7fa9c40b24b0 2021-04-09T18:20:14.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9c17fa700 1 -- 172.21.15.120:0/2342504660 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9ac006440 con 0x7fa9c40b24b0 2021-04-09T18:20:14.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.801 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c40b9be0 con 0x7fa9c40b24b0 2021-04-09T18:20:14.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.802 7fa9c17fa700 1 -- 172.21.15.120:0/2342504660 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa9ac0052e0 con 0x7fa9c40b24b0 2021-04-09T18:20:14.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.802 7fa9c17fa700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9a8018930 0x7fa9a801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:14.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.802 7fa9c17fa700 1 -- 172.21.15.120:0/2342504660 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa9ac032b20 con 0x7fa9c40b24b0 2021-04-09T18:20:14.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.802 7fa9c3fff700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9a8018930 0x7fa9a801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:14.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.803 7fa9c3fff700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9a8018930 0x7fa9a801ae10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:14.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.825 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c4185a90 con 0x7fa9c40b24b0 2021-04-09T18:20:14.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.828 7fa9c17fa700 1 -- 172.21.15.120:0/2342504660 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa9ac006030 con 0x7fa9c40b24b0 2021-04-09T18:20:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.998 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fa9c4185a90 con 0x7fa9c40b24b0 2021-04-09T18:20:14.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:14.999 7fa9c17fa700 1 -- 172.21.15.120:0/2342504660 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa9ac00bdd0 con 0x7fa9c40b24b0 2021-04-09T18:20:14.997 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:15.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9a8018930 msgr2=0x7fa9a801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:15.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9a8018930 0x7fa9a801ae10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40b24b0 msgr2=0x7fa9c4186240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:15.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40b24b0 0x7fa9c4186240 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa9ac006f20 tx=0x7fa9ac00b9e0).stop 2021-04-09T18:20:15.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 shutdown_connections 2021-04-09T18:20:15.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9c41892d0 0x7fa9c4185150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9a8018930 0x7fa9a801ae10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.021 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9c4186860 0x7fa9c4184b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.021 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 --2- 172.21.15.120:0/2342504660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9c40b24b0 0x7fa9c4186240 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 >> 172.21.15.120:0/2342504660 conn(0x7fa9c41822b0 msgr2=0x7fa9c4195ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:15.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 shutdown_connections 2021-04-09T18:20:15.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.001 7fa9cabb9700 1 -- 172.21.15.120:0/2342504660 wait complete. 2021-04-09T18:20:15.053 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:15.218 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.200 7f9ae942f700 1 Processor -- start 2021-04-09T18:20:15.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.200 7f9ae942f700 1 -- start start 2021-04-09T18:20:15.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae942f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9ae40d7160 0x7f9ae40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:15.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae942f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9ae40d55a0 0x7f9ae40d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:15.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae942f700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae40d6be0 con 0x7f9ae40d5fc0 2021-04-09T18:20:15.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae942f700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae40d80f0 con 0x7f9ae40d55a0 2021-04-09T18:20:15.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae942f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae41a2ac0 con 0x7f9ae40d7160 2021-04-09T18:20:15.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae287c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9ae40d55a0 0x7f9ae40d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:15.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae387e700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9ae40d5fc0 0x7f9ae40d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47984/0 (socket says 172.21.15.120:47984) 2021-04-09T18:20:15.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae387e700 1 -- 172.21.15.120:0/2965100764 learned_addr learned my addr 172.21.15.120:0/2965100764 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:15.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae307d700 1 --2- 172.21.15.120:0/2965100764 >> v2:172.21.15.134:3300/0 conn(0x7f9ae40d7160 0x7f9ae40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:15.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae287c700 1 -- 172.21.15.120:0/2965100764 >> v2:172.21.15.134:3300/0 conn(0x7f9ae40d7160 msgr2=0x7f9ae40d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:15.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae287c700 1 --2- 172.21.15.120:0/2965100764 >> v2:172.21.15.134:3300/0 conn(0x7f9ae40d7160 0x7f9ae40d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae287c700 1 -- 172.21.15.120:0/2965100764 >> v1:172.21.15.120:6789/0 conn(0x7f9ae40d5fc0 legacy=0x7f9ae40d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:15.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae287c700 1 -- 172.21.15.120:0/2965100764 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae41ac1f0 con 0x7f9ae40d55a0 2021-04-09T18:20:15.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae207b700 1 -- 172.21.15.120:0/2965100764 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277751298 0 0) 0x7f9adc0009b0 con 0x7f9ae40d5fc0 2021-04-09T18:20:15.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.201 7f9ae287c700 1 --2- 172.21.15.120:0/2965100764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae40d55a0 0x7f9ae40d59a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f9ad8006650 tx=0x7f9ad8009a00).ready entity=mon.0 client_cookie=80bb80b8a913ee6c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:15.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae207b700 1 -- 172.21.15.120:0/2965100764 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ad8009df0 con 0x7f9ae40d55a0 2021-04-09T18:20:15.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae207b700 1 -- 172.21.15.120:0/2965100764 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad80009b0 con 0x7f9ae40d55a0 2021-04-09T18:20:15.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae207b700 1 -- 172.21.15.120:0/2965100764 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ad800c2b0 con 0x7f9ae40d55a0 2021-04-09T18:20:15.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae942f700 1 -- 172.21.15.120:0/2965100764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae40d55a0 msgr2=0x7f9ae40d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:15.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae942f700 1 --2- 172.21.15.120:0/2965100764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae40d55a0 0x7f9ae40d59a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f9ad8006650 tx=0x7f9ad8009a00).stop 2021-04-09T18:20:15.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae942f700 1 -- 172.21.15.120:0/2965100764 shutdown_connections 2021-04-09T18:20:15.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae942f700 1 --2- 172.21.15.120:0/2965100764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae40d55a0 0x7f9ae40d59a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae942f700 1 --2- 172.21.15.120:0/2965100764 >> v2:172.21.15.134:3300/0 conn(0x7f9ae40d7160 0x7f9ae40d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae942f700 1 -- 172.21.15.120:0/2965100764 >> 172.21.15.120:0/2965100764 conn(0x7f9ae40d1590 msgr2=0x7f9ae40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:15.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae942f700 1 -- 172.21.15.120:0/2965100764 shutdown_connections 2021-04-09T18:20:15.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.202 7f9ae942f700 1 -- 172.21.15.120:0/2965100764 wait complete. 2021-04-09T18:20:15.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.221 7f9ae942f700 1 Processor -- start 2021-04-09T18:20:15.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.221 7f9ae942f700 1 -- start start 2021-04-09T18:20:15.235 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae942f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae417b4b0 0x7f9ae418b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:15.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae942f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 0x7f9ae4189d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:15.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae942f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae418bb80 0x7f9ae418a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:15.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae942f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae417be20 con 0x7f9ae417b8b0 2021-04-09T18:20:15.237 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae942f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae418a970 con 0x7f9ae417b4b0 2021-04-09T18:20:15.237 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae942f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae418ab90 con 0x7f9ae418bb80 2021-04-09T18:20:15.237 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae287c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 0x7f9ae4189d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:15.238 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae287c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 0x7f9ae4189d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53078/0 (socket says 172.21.15.120:53078) 2021-04-09T18:20:15.238 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae287c700 1 -- 172.21.15.120:0/1838553562 learned_addr learned my addr 172.21.15.120:0/1838553562 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:15.250 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae287c700 1 -- 172.21.15.120:0/1838553562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 msgr2=0x7f9ae4189d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-04-09T18:20:15.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae287c700 1 -- 172.21.15.120:0/1838553562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 msgr2=0x7f9ae4189d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:20:15.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae287c700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 0x7f9ae4189d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:20:15.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae387e700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae418bb80 0x7f9ae418a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae307d700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae417b4b0 0x7f9ae418b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae287c700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 0x7f9ae4189d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:20:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae307d700 1 -- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae418bb80 msgr2=0x7f9ae418a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae307d700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae418bb80 0x7f9ae418a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae307d700 1 -- 172.21.15.120:0/1838553562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 msgr2=0x7f9ae4189d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-04-09T18:20:15.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae307d700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 0x7f9ae4189d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae307d700 1 -- 172.21.15.120:0/1838553562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae418adb0 con 0x7f9ae417b4b0 2021-04-09T18:20:15.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.222 7f9ae307d700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae417b4b0 0x7f9ae418b560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f9ad40098a0 tx=0x7f9ad400bc20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:15.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.223 7f9acbfff700 1 -- 172.21.15.120:0/1838553562 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ad4006030 con 0x7f9ae417b4b0 2021-04-09T18:20:15.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.223 7f9acbfff700 1 -- 172.21.15.120:0/1838553562 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad4006370 con 0x7f9ae417b4b0 2021-04-09T18:20:15.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.223 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae418adb0 con 0x7f9ae417b4b0 2021-04-09T18:20:15.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.223 7f9acbfff700 1 -- 172.21.15.120:0/1838553562 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ad40058e0 con 0x7f9ae417b4b0 2021-04-09T18:20:15.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.223 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae418adb0 con 0x7f9ae417b4b0 2021-04-09T18:20:15.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.223 7f9acbfff700 1 -- 172.21.15.120:0/1838553562 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9ad4006550 con 0x7f9ae417b4b0 2021-04-09T18:20:15.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.223 7f9acbfff700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9ac4018900 0x7f9ac401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:15.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.223 7f9acbfff700 1 -- 172.21.15.120:0/1838553562 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f9ad4032e60 con 0x7f9ae417b4b0 2021-04-09T18:20:15.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.224 7f9ae287c700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9ac4018900 0x7f9ac401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:15.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.224 7f9ae287c700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9ac4018900 0x7f9ac401adc0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:15.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.247 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae418a970 con 0x7f9ae417b4b0 2021-04-09T18:20:15.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.251 7f9acbfff700 1 -- 172.21.15.120:0/1838553562 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9ad400bd60 con 0x7f9ae417b4b0 2021-04-09T18:20:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.430 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ae418a970 con 0x7f9ae417b4b0 2021-04-09T18:20:15.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.431 7f9acbfff700 1 -- 172.21.15.120:0/1838553562 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2104 (secure 0 0 0) 0x7f9ad4006350 con 0x7f9ae417b4b0 2021-04-09T18:20:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:15.429 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:04.724179","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4292":{"gid":4292,"name":"b","rank":0,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1933604370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1933604370},{"type":"v1","addr":"172.21.15.134:6835","nonce":1933604370}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2021-04-09T18:20:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9ac4018900 msgr2=0x7f9ac401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:15.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9ac4018900 0x7f9ac401adc0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae417b4b0 msgr2=0x7f9ae418b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:15.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae417b4b0 0x7f9ae418b560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f9ad40098a0 tx=0x7f9ad400bc20).stop 2021-04-09T18:20:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 shutdown_connections 2021-04-09T18:20:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9ac4018900 0x7f9ac401adc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae418bb80 0x7f9ae418a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ae417b8b0 0x7f9ae4189d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 --2- 172.21.15.120:0/1838553562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae417b4b0 0x7f9ae418b560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:15.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 >> 172.21.15.120:0/1838553562 conn(0x7f9ae4185580 msgr2=0x7f9ae4188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:15.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 shutdown_connections 2021-04-09T18:20:15.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:15.433 7f9ae942f700 1 -- 172.21.15.120:0/1838553562 wait complete. 2021-04-09T18:20:15.650 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:19:55.049244', 'modified': '2021-04-09 18:20:04.724179', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4292}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4292': {'gid': 4292, 'name': 'b', 'rank': 0, 'incarnation': 6, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6835/1933604370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1933604370}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1933604370}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:20:15.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:20:15.652 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:20:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2021-04-09T18:20:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "dcbe2161-e5ca-44be-8661-d46578834d60", 2021-04-09T18:20:15.807 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2021-04-09T18:20:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 4292, 2021-04-09T18:20:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2021-04-09T18:20:15.808 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2021-04-09T18:20:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 12.085039993000001, 2021-04-09T18:20:15.809 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 7, 2021-04-09T18:20:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 22, 2021-04-09T18:20:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 22, 2021-04-09T18:20:15.810 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 17.074354221 2021-04-09T18:20:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:} 2021-04-09T18:20:15.825 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "dcbe2161-e5ca-44be-8661-d46578834d60", "whoami": 0, "id": 4292, "want_state": "up:active", "state": "up:active", "rank_uptime": 12.085039993000001, "mdsmap_epoch": 7, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "uptime": 17.074354221 } 2021-04-09T18:20:15.826 INFO:teuthology.run_tasks:Running task mds_thrash... 2021-04-09T18:20:15.881 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:20:16.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.029 7f99797e9700 1 Processor -- start 2021-04-09T18:20:16.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.029 7f99797e9700 1 -- start start 2021-04-09T18:20:16.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f99797e9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f99740d7160 0x7f99740d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f99797e9700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99740d6be0 con 0x7f99740d6190 2021-04-09T18:20:16.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f99797e9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99741a2ac0 con 0x7f99740d55a0 2021-04-09T18:20:16.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f99797e9700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99741a2ce0 con 0x7f99740d7160 2021-04-09T18:20:16.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f9973574700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f99740d7160 0x7f99740d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f9973d75700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f99740d6190 0x7f99741ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48000/0 (socket says 172.21.15.120:48000) 2021-04-09T18:20:16.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f9973d75700 1 -- 172.21.15.120:0/2620293899 learned_addr learned my addr 172.21.15.120:0/2620293899 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:16.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f9973574700 1 -- 172.21.15.120:0/2620293899 >> v1:172.21.15.134:6789/0 conn(0x7f99740d55a0 legacy=0x7f99740d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f9973574700 1 -- 172.21.15.120:0/2620293899 >> v1:172.21.15.120:6789/0 conn(0x7f99740d6190 legacy=0x7f99741ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f9973574700 1 -- 172.21.15.120:0/2620293899 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740d6590 con 0x7f99740d7160 2021-04-09T18:20:16.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f9972572700 1 -- 172.21.15.120:0/2620293899 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702932389 0 0) 0x7f996c000d30 con 0x7f99740d6190 2021-04-09T18:20:16.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.030 7f9973574700 1 --2- 172.21.15.120:0/2620293899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99740d7160 0x7f99740d7560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9964006650 tx=0x7f9964009a00).ready entity=mon.0 client_cookie=58681121cedabb1c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:16.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f9972572700 1 -- 172.21.15.120:0/2620293899 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9964009df0 con 0x7f99740d7160 2021-04-09T18:20:16.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f9972572700 1 -- 172.21.15.120:0/2620293899 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99640009b0 con 0x7f99740d7160 2021-04-09T18:20:16.077 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f9972572700 1 -- 172.21.15.120:0/2620293899 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f996400c2b0 con 0x7f99740d7160 2021-04-09T18:20:16.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f99797e9700 1 -- 172.21.15.120:0/2620293899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99740d7160 msgr2=0x7f99740d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f99797e9700 1 --2- 172.21.15.120:0/2620293899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99740d7160 0x7f99740d7560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9964006650 tx=0x7f9964009a00).stop 2021-04-09T18:20:16.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f99797e9700 1 -- 172.21.15.120:0/2620293899 shutdown_connections 2021-04-09T18:20:16.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f99797e9700 1 --2- 172.21.15.120:0/2620293899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99740d7160 0x7f99740d7560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f99797e9700 1 -- 172.21.15.120:0/2620293899 >> 172.21.15.120:0/2620293899 conn(0x7f99740d1590 msgr2=0x7f99740d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:16.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f99797e9700 1 -- 172.21.15.120:0/2620293899 shutdown_connections 2021-04-09T18:20:16.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.031 7f99797e9700 1 -- 172.21.15.120:0/2620293899 wait complete. 2021-04-09T18:20:16.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.050 7f99797e9700 1 Processor -- start 2021-04-09T18:20:16.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.050 7f99797e9700 1 -- start start 2021-04-09T18:20:16.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.050 7f99797e9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99741953c0 0x7f9974186940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.050 7f99797e9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9974186f60 0x7f9974180560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.050 7f99797e9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9974180b80 0x7f99741852a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.050 7f99797e9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974186440 con 0x7f9974186f60 2021-04-09T18:20:16.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.050 7f99797e9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974180f80 con 0x7f99741953c0 2021-04-09T18:20:16.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.050 7f99797e9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99741811a0 con 0x7f9974180b80 2021-04-09T18:20:16.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9972d73700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9974186f60 0x7f9974180560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9972d73700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9974186f60 0x7f9974180560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53094/0 (socket says 172.21.15.120:53094) 2021-04-09T18:20:16.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9972d73700 1 -- 172.21.15.120:0/3243425307 learned_addr learned my addr 172.21.15.120:0/3243425307 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:16.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9973574700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99741953c0 0x7f9974186940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9973d75700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9974180b80 0x7f99741852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9972d73700 1 -- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9974180b80 msgr2=0x7f99741852a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9972d73700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9974180b80 0x7f99741852a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9972d73700 1 -- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99741953c0 msgr2=0x7f9974186940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9972d73700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99741953c0 0x7f9974186940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9972d73700 1 -- 172.21.15.120:0/3243425307 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974185900 con 0x7f9974186f60 2021-04-09T18:20:16.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f9972d73700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9974186f60 0x7f9974180560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f9968006ed0 tx=0x7f996800b960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:16.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f995bfff700 1 -- 172.21.15.120:0/3243425307 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9968006020 con 0x7f9974186f60 2021-04-09T18:20:16.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f995bfff700 1 -- 172.21.15.120:0/3243425307 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9968006360 con 0x7f9974186f60 2021-04-09T18:20:16.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f99797e9700 1 -- 172.21.15.120:0/3243425307 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9974185900 con 0x7f9974186f60 2021-04-09T18:20:16.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f995bfff700 1 -- 172.21.15.120:0/3243425307 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9968005730 con 0x7f9974186f60 2021-04-09T18:20:16.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.051 7f99797e9700 1 -- 172.21.15.120:0/3243425307 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9974185900 con 0x7f9974186f60 2021-04-09T18:20:16.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.052 7f995bfff700 1 -- 172.21.15.120:0/3243425307 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f99680054b0 con 0x7f9974186f60 2021-04-09T18:20:16.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.052 7f995bfff700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9954018930 0x7f995401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.052 7f995bfff700 1 -- 172.21.15.120:0/3243425307 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f9968032ba0 con 0x7f9974186f60 2021-04-09T18:20:16.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.052 7f9973574700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9954018930 0x7f995401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.052 7f9973574700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9954018930 0x7f995401ae10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:16.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.076 7f99797e9700 1 -- 172.21.15.120:0/3243425307 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9974186180 con 0x7f9974186f60 2021-04-09T18:20:16.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.079 7f995bfff700 1 -- 172.21.15.120:0/3243425307 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9968006020 con 0x7f9974186f60 2021-04-09T18:20:16.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.254 7f99797e9700 1 -- 172.21.15.120:0/3243425307 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9974186180 con 0x7f9974186f60 2021-04-09T18:20:16.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.255 7f995bfff700 1 -- 172.21.15.120:0/3243425307 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7f9968006340 con 0x7f9974186f60 2021-04-09T18:20:16.253 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:16.254 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:20:16.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 -- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9954018930 msgr2=0x7f995401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9954018930 0x7f995401ae10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 -- 172.21.15.120:0/3243425307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9974186f60 msgr2=0x7f9974180560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9974186f60 0x7f9974180560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f9968006ed0 tx=0x7f996800b960).stop 2021-04-09T18:20:16.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 -- 172.21.15.120:0/3243425307 shutdown_connections 2021-04-09T18:20:16.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9954018930 0x7f995401ae10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9974180b80 0x7f99741852a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9974186f60 0x7f9974180560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 --2- 172.21.15.120:0/3243425307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99741953c0 0x7f9974186940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 -- 172.21.15.120:0/3243425307 >> 172.21.15.120:0/3243425307 conn(0x7f99740945f0 msgr2=0x7f9974097cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:16.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 -- 172.21.15.120:0/3243425307 shutdown_connections 2021-04-09T18:20:16.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.257 7f99797e9700 1 -- 172.21.15.120:0/3243425307 wait complete. 2021-04-09T18:20:16.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:19:47.013532', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:19:50.254363', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:19:52.685224', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:20:16.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:20:16.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.432 7f614bfe9700 1 Processor -- start 2021-04-09T18:20:16.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.432 7f614bfe9700 1 -- start start 2021-04-09T18:20:16.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f614bfe9700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61440d65a0 0x7f61441ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f614bfe9700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61440d7980 con 0x7f61440d7580 2021-04-09T18:20:16.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f614bfe9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61440d69a0 con 0x7f61440d7180 2021-04-09T18:20:16.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f614bfe9700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61440d6c00 con 0x7f61440d65a0 2021-04-09T18:20:16.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f614a606700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61440d65a0 0x7f61441ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f6149604700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f61440d7580 0x7f61440d5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48016/0 (socket says 172.21.15.120:48016) 2021-04-09T18:20:16.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f6149604700 1 -- 172.21.15.120:0/2865539919 learned_addr learned my addr 172.21.15.120:0/2865539919 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:16.460 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f6149e05700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f61440d7180 0x7f61440d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42828/0 (socket says 172.21.15.120:42828) 2021-04-09T18:20:16.460 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f6148e03700 1 -- 172.21.15.120:0/2865539919 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442144457 0 0) 0x7f61340009b0 con 0x7f61440d7580 2021-04-09T18:20:16.460 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f614a606700 1 -- 172.21.15.120:0/2865539919 >> v1:172.21.15.134:6789/0 conn(0x7f61440d7180 legacy=0x7f61440d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.433 7f614a606700 1 -- 172.21.15.120:0/2865539919 >> v1:172.21.15.120:6789/0 conn(0x7f61440d7580 legacy=0x7f61440d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.434 7f614a606700 1 -- 172.21.15.120:0/2865539919 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61441a2ae0 con 0x7f61440d65a0 2021-04-09T18:20:16.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.434 7f614a606700 1 --2- 172.21.15.120:0/2865539919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61440d65a0 0x7f61441ac210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f613c006ad0 tx=0x7f613c009a50).ready entity=mon.1 client_cookie=5b20292b4c5e8d25 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:16.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.434 7f6148e03700 1 -- 172.21.15.120:0/2865539919 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f613c0066a0 con 0x7f61440d65a0 2021-04-09T18:20:16.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.434 7f6148e03700 1 -- 172.21.15.120:0/2865539919 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c006410 con 0x7f61440d65a0 2021-04-09T18:20:16.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.434 7f6148e03700 1 -- 172.21.15.120:0/2865539919 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f613c000c10 con 0x7f61440d65a0 2021-04-09T18:20:16.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.434 7f614bfe9700 1 -- 172.21.15.120:0/2865539919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61440d65a0 msgr2=0x7f61441ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.434 7f614bfe9700 1 --2- 172.21.15.120:0/2865539919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61440d65a0 0x7f61441ac210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f613c006ad0 tx=0x7f613c009a50).stop 2021-04-09T18:20:16.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.435 7f614bfe9700 1 -- 172.21.15.120:0/2865539919 shutdown_connections 2021-04-09T18:20:16.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.435 7f614bfe9700 1 --2- 172.21.15.120:0/2865539919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61440d65a0 0x7f61441ac210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.465 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.435 7f614bfe9700 1 -- 172.21.15.120:0/2865539919 >> 172.21.15.120:0/2865539919 conn(0x7f61440d15b0 msgr2=0x7f61440d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:16.465 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.435 7f614bfe9700 1 -- 172.21.15.120:0/2865539919 shutdown_connections 2021-04-09T18:20:16.466 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.435 7f614bfe9700 1 -- 172.21.15.120:0/2865539919 wait complete. 2021-04-09T18:20:16.466 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.453 7f614bfe9700 1 Processor -- start 2021-04-09T18:20:16.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614bfe9700 1 -- start start 2021-04-09T18:20:16.490 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614bfe9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6144179cb0 0x7f614418ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.491 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614bfe9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614417a500 0x7f614409b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.491 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614bfe9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614417a900 0x7f614409bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.491 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614bfe9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61440aaa50 con 0x7f614417a900 2021-04-09T18:20:16.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614bfe9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614409c2e0 con 0x7f6144179cb0 2021-04-09T18:20:16.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614bfe9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614409c500 con 0x7f614417a500 2021-04-09T18:20:16.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614a606700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614417a900 0x7f614409bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614a606700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614417a900 0x7f614409bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53110/0 (socket says 172.21.15.120:53110) 2021-04-09T18:20:16.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614a606700 1 -- 172.21.15.120:0/2173787720 learned_addr learned my addr 172.21.15.120:0/2173787720 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:16.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f6149604700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614417a500 0x7f614409b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f6149e05700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6144179cb0 0x7f614418ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614a606700 1 -- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614417a500 msgr2=0x7f614409b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614a606700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614417a500 0x7f614409b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.454 7f614a606700 1 -- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6144179cb0 msgr2=0x7f614418ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.455 7f614a606700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6144179cb0 0x7f614418ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.455 7f614a606700 1 -- 172.21.15.120:0/2173787720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614409c720 con 0x7f614417a900 2021-04-09T18:20:16.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.455 7f614a606700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614417a900 0x7f614409bcc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f613c009fc0 tx=0x7f613c00b940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:16.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.455 7f613a7fc700 1 -- 172.21.15.120:0/2173787720 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f613c006cd0 con 0x7f614417a900 2021-04-09T18:20:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.455 7f613a7fc700 1 -- 172.21.15.120:0/2173787720 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c000a70 con 0x7f614417a900 2021-04-09T18:20:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.455 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614409c720 con 0x7f614417a900 2021-04-09T18:20:16.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.455 7f613a7fc700 1 -- 172.21.15.120:0/2173787720 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f613c006cd0 con 0x7f614417a900 2021-04-09T18:20:16.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.455 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614409c720 con 0x7f614417a900 2021-04-09T18:20:16.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.455 7f613a7fc700 1 -- 172.21.15.120:0/2173787720 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f613c006cd0 con 0x7f614417a900 2021-04-09T18:20:16.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.456 7f613a7fc700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f612c018930 0x7f612c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.456 7f613a7fc700 1 -- 172.21.15.120:0/2173787720 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f613c032b70 con 0x7f614417a900 2021-04-09T18:20:16.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.456 7f6149e05700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f612c018930 0x7f612c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.456 7f6149e05700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f612c018930 0x7f612c01ae10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:16.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.479 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61440aaa50 con 0x7f614417a900 2021-04-09T18:20:16.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.482 7f613a7fc700 1 -- 172.21.15.120:0/2173787720 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f613c006560 con 0x7f614417a900 2021-04-09T18:20:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.650 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f61440aaa50 con 0x7f614417a900 2021-04-09T18:20:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.651 7f613a7fc700 1 -- 172.21.15.120:0/2173787720 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f613c000a70 con 0x7f614417a900 2021-04-09T18:20:16.649 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:16.652 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f612c018930 msgr2=0x7f612c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.652 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f612c018930 0x7f612c01ae10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.653 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614417a900 msgr2=0x7f614409bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.653 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614417a900 0x7f614409bcc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f613c009fc0 tx=0x7f613c00b940).stop 2021-04-09T18:20:16.653 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 shutdown_connections 2021-04-09T18:20:16.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614417a900 0x7f614409bcc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f612c018930 0x7f612c01ae10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f614417a500 0x7f614409b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 --2- 172.21.15.120:0/2173787720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6144179cb0 0x7f614418ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.653 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 >> 172.21.15.120:0/2173787720 conn(0x7f614417ebe0 msgr2=0x7f61440a11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:16.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.654 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 shutdown_connections 2021-04-09T18:20:16.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.654 7f614bfe9700 1 -- 172.21.15.120:0/2173787720 wait complete. 2021-04-09T18:20:16.661 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:20:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.808 7fd100c24700 1 Processor -- start 2021-04-09T18:20:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.808 7fd100c24700 1 -- start start 2021-04-09T18:20:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.808 7fd100c24700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd0fc0d7180 0x7fd0fc0d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.808 7fd100c24700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc0d55c0 0x7fd0fc0d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.808 7fd100c24700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0d6c00 con 0x7fd0fc0d5fe0 2021-04-09T18:20:16.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.808 7fd100c24700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc0d8110 con 0x7fd0fc0d7180 2021-04-09T18:20:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.808 7fd100c24700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1a2ae0 con 0x7fd0fc0d55c0 2021-04-09T18:20:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fa85e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd0fc0d7180 0x7fd0fc0d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fa05d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc0d55c0 0x7fd0fc0d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fb05f700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd0fc0d5fe0 0x7fd0fc0d63e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42846/0 (socket says 172.21.15.120:42846) 2021-04-09T18:20:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fa85e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd0fc0d7180 0x7fd0fc0d7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53114/0 (socket says 172.21.15.120:53114) 2021-04-09T18:20:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fb05f700 1 -- 172.21.15.120:0/1651469620 learned_addr learned my addr 172.21.15.120:0/1651469620 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:16.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fa85e700 1 -- 172.21.15.120:0/1651469620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc0d55c0 msgr2=0x7fd0fc0d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:16.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fa85e700 1 --2- 172.21.15.120:0/1651469620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc0d55c0 0x7fd0fc0d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fa85e700 1 -- 172.21.15.120:0/1651469620 >> v1:172.21.15.134:6789/0 conn(0x7fd0fc0d5fe0 legacy=0x7fd0fc0d63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fa85e700 1 -- 172.21.15.120:0/1651469620 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc1ac210 con 0x7fd0fc0d7180 2021-04-09T18:20:16.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fa05d700 1 --2- 172.21.15.120:0/1651469620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc0d55c0 0x7fd0fc0d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:16.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.809 7fd0fa85e700 1 --2- 172.21.15.120:0/1651469620 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc0d7180 0x7fd0fc0d7580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd0f4006650 tx=0x7fd0f4009a80).ready entity=mon.0 client_cookie=476e56b19c4333ad server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:16.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.810 7fd0f985c700 1 -- 172.21.15.120:0/1651469620 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0f40009b0 con 0x7fd0fc0d7180 2021-04-09T18:20:16.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.810 7fd0f985c700 1 -- 172.21.15.120:0/1651469620 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f400c0c0 con 0x7fd0fc0d7180 2021-04-09T18:20:16.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.810 7fd0f985c700 1 -- 172.21.15.120:0/1651469620 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0f400c510 con 0x7fd0fc0d7180 2021-04-09T18:20:16.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.810 7fd100c24700 1 -- 172.21.15.120:0/1651469620 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc0d7180 msgr2=0x7fd0fc0d7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.810 7fd100c24700 1 --2- 172.21.15.120:0/1651469620 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc0d7180 0x7fd0fc0d7580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd0f4006650 tx=0x7fd0f4009a80).stop 2021-04-09T18:20:16.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.811 7fd100c24700 1 -- 172.21.15.120:0/1651469620 shutdown_connections 2021-04-09T18:20:16.865 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.811 7fd100c24700 1 --2- 172.21.15.120:0/1651469620 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc0d55c0 0x7fd0fc0d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.811 7fd100c24700 1 --2- 172.21.15.120:0/1651469620 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc0d7180 0x7fd0fc0d7580 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.811 7fd100c24700 1 -- 172.21.15.120:0/1651469620 >> 172.21.15.120:0/1651469620 conn(0x7fd0fc0d15b0 msgr2=0x7fd0fc0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:16.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.811 7fd100c24700 1 -- 172.21.15.120:0/1651469620 shutdown_connections 2021-04-09T18:20:16.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.811 7fd100c24700 1 -- 172.21.15.120:0/1651469620 wait complete. 2021-04-09T18:20:16.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.830 7fd100c24700 1 Processor -- start 2021-04-09T18:20:16.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.830 7fd100c24700 1 -- start start 2021-04-09T18:20:16.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd100c24700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc09b120 0x7fd0fc0e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd100c24700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc0e40c0 0x7fd0fc0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd100c24700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc09b520 0x7fd0fc0b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd100c24700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc09dce0 con 0x7fd0fc09b120 2021-04-09T18:20:16.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd100c24700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc09aba0 con 0x7fd0fc0e40c0 2021-04-09T18:20:16.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd100c24700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0b5c50 con 0x7fd0fc09b520 2021-04-09T18:20:16.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc09b120 0x7fd0fc0e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc09b120 0x7fd0fc0e3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53120/0 (socket says 172.21.15.120:53120) 2021-04-09T18:20:16.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa85e700 1 -- 172.21.15.120:0/1696195368 learned_addr learned my addr 172.21.15.120:0/1696195368 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:16.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fb05f700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc09b520 0x7fd0fc0b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa05d700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc0e40c0 0x7fd0fc0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa85e700 1 -- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc09b520 msgr2=0x7fd0fc0b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa85e700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc09b520 0x7fd0fc0b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa85e700 1 -- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc0e40c0 msgr2=0x7fd0fc0b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:16.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa85e700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc0e40c0 0x7fd0fc0b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:16.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa85e700 1 -- 172.21.15.120:0/1696195368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0b5e30 con 0x7fd0fc09b120 2021-04-09T18:20:16.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa05d700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc0e40c0 0x7fd0fc0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:16.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0fa85e700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc09b120 0x7fd0fc0e3aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd0f4009650 tx=0x7fd0f400b8e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:16.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0f37fe700 1 -- 172.21.15.120:0/1696195368 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0f40093a0 con 0x7fd0fc09b120 2021-04-09T18:20:16.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0f37fe700 1 -- 172.21.15.120:0/1696195368 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f4006070 con 0x7fd0fc09b120 2021-04-09T18:20:16.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd100c24700 1 -- 172.21.15.120:0/1696195368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc0b5e30 con 0x7fd0fc09b120 2021-04-09T18:20:16.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd0f37fe700 1 -- 172.21.15.120:0/1696195368 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0f40052e0 con 0x7fd0fc09b120 2021-04-09T18:20:16.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.831 7fd100c24700 1 -- 172.21.15.120:0/1696195368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc0b5e30 con 0x7fd0fc09b120 2021-04-09T18:20:16.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.833 7fd0f37fe700 1 -- 172.21.15.120:0/1696195368 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd0f4009300 con 0x7fd0fc09b120 2021-04-09T18:20:16.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.833 7fd0f37fe700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd0e00188c0 0x7fd0e001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:16.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.833 7fd0f37fe700 1 -- 172.21.15.120:0/1696195368 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fd0f40328e0 con 0x7fd0fc09b120 2021-04-09T18:20:16.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.833 7fd0fa05d700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd0e00188c0 0x7fd0e001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:16.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.833 7fd0fa05d700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd0e00188c0 0x7fd0e001adc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:16.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.854 7fd100c24700 1 -- 172.21.15.120:0/1696195368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc0e25b0 con 0x7fd0fc09b120 2021-04-09T18:20:16.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:16.858 7fd0f37fe700 1 -- 172.21.15.120:0/1696195368 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd0f4000940 con 0x7fd0fc09b120 2021-04-09T18:20:17.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.025 7fd100c24700 1 -- 172.21.15.120:0/1696195368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd0fc0e25b0 con 0x7fd0fc09b120 2021-04-09T18:20:17.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.025 7fd0f37fe700 1 -- 172.21.15.120:0/1696195368 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd0f4009300 con 0x7fd0fc09b120 2021-04-09T18:20:17.024 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:17.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.027 7fd100c24700 1 -- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd0e00188c0 msgr2=0x7fd0e001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.027 7fd100c24700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd0e00188c0 0x7fd0e001adc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.032 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.027 7fd100c24700 1 -- 172.21.15.120:0/1696195368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc09b120 msgr2=0x7fd0fc0e3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.032 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.027 7fd100c24700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc09b120 0x7fd0fc0e3aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd0f4009650 tx=0x7fd0f400b8e0).stop 2021-04-09T18:20:17.033 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.028 7fd100c24700 1 -- 172.21.15.120:0/1696195368 shutdown_connections 2021-04-09T18:20:17.033 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.028 7fd100c24700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd0e00188c0 0x7fd0e001adc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.034 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.028 7fd100c24700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0fc09b520 0x7fd0fc0b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.034 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.028 7fd100c24700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc0e40c0 0x7fd0fc0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.035 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.028 7fd100c24700 1 --2- 172.21.15.120:0/1696195368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0fc09b120 0x7fd0fc0e3aa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.035 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.028 7fd100c24700 1 -- 172.21.15.120:0/1696195368 >> 172.21.15.120:0/1696195368 conn(0x7fd0fc1822c0 msgr2=0x7fd0fc09df50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:17.035 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.028 7fd100c24700 1 -- 172.21.15.120:0/1696195368 shutdown_connections 2021-04-09T18:20:17.036 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.028 7fd100c24700 1 -- 172.21.15.120:0/1696195368 wait complete. 2021-04-09T18:20:17.042 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:20:17.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.189 7fbc9abc5700 1 Processor -- start 2021-04-09T18:20:17.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.189 7fbc9abc5700 1 -- start start 2021-04-09T18:20:17.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc9abc5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbc940d7180 0x7fbc940d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc9abc5700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc940d55c0 0x7fbc940d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc9abc5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc940d5fe0 0x7fbc940d63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc9abc5700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc940e80c0 con 0x7fbc940d55c0 2021-04-09T18:20:17.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc9abc5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc940d8110 con 0x7fbc940d7180 2021-04-09T18:20:17.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc9abc5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc940d6c00 con 0x7fbc940d5fe0 2021-04-09T18:20:17.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc93fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc940d55c0 0x7fbc940d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc93fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc940d55c0 0x7fbc940d59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53128/0 (socket says 172.21.15.120:53128) 2021-04-09T18:20:17.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc93fff700 1 -- 172.21.15.120:0/1505981128 learned_addr learned my addr 172.21.15.120:0/1505981128 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:17.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc991e2700 1 --2- 172.21.15.120:0/1505981128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc940d5fe0 0x7fbc940d63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc989e1700 1 --2- 172.21.15.120:0/1505981128 >> v2:172.21.15.134:3300/0 conn(0x7fbc940d7180 0x7fbc940d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc93fff700 1 -- 172.21.15.120:0/1505981128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc940d5fe0 msgr2=0x7fbc940d63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:17.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc93fff700 1 --2- 172.21.15.120:0/1505981128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc940d5fe0 0x7fbc940d63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc93fff700 1 -- 172.21.15.120:0/1505981128 >> v2:172.21.15.134:3300/0 conn(0x7fbc940d7180 msgr2=0x7fbc940d7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:17.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc93fff700 1 --2- 172.21.15.120:0/1505981128 >> v2:172.21.15.134:3300/0 conn(0x7fbc940d7180 0x7fbc940d7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.240 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc93fff700 1 -- 172.21.15.120:0/1505981128 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc941a2ae0 con 0x7fbc940d55c0 2021-04-09T18:20:17.241 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc93fff700 1 --2- 172.21.15.120:0/1505981128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940d55c0 0x7fbc940d59c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fbc84006a80 tx=0x7fbc84009f00).ready entity=mon.0 client_cookie=bb492347103454d2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:17.241 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc937fe700 1 -- 172.21.15.120:0/1505981128 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc8400b5c0 con 0x7fbc940d55c0 2021-04-09T18:20:17.242 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc937fe700 1 -- 172.21.15.120:0/1505981128 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8400b8c0 con 0x7fbc940d55c0 2021-04-09T18:20:17.242 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc937fe700 1 -- 172.21.15.120:0/1505981128 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc8400bda0 con 0x7fbc940d55c0 2021-04-09T18:20:17.243 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc9abc5700 1 -- 172.21.15.120:0/1505981128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940d55c0 msgr2=0x7fbc940d59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.243 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.190 7fbc9abc5700 1 --2- 172.21.15.120:0/1505981128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940d55c0 0x7fbc940d59c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fbc84006a80 tx=0x7fbc84009f00).stop 2021-04-09T18:20:17.243 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.191 7fbc9abc5700 1 -- 172.21.15.120:0/1505981128 shutdown_connections 2021-04-09T18:20:17.244 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.191 7fbc9abc5700 1 --2- 172.21.15.120:0/1505981128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc940d5fe0 0x7fbc940d63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.244 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.191 7fbc9abc5700 1 --2- 172.21.15.120:0/1505981128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940d55c0 0x7fbc940d59c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.245 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.191 7fbc9abc5700 1 --2- 172.21.15.120:0/1505981128 >> v2:172.21.15.134:3300/0 conn(0x7fbc940d7180 0x7fbc940d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.245 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.191 7fbc9abc5700 1 -- 172.21.15.120:0/1505981128 >> 172.21.15.120:0/1505981128 conn(0x7fbc940d15b0 msgr2=0x7fbc940d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:17.246 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.191 7fbc9abc5700 1 -- 172.21.15.120:0/1505981128 shutdown_connections 2021-04-09T18:20:17.246 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.191 7fbc9abc5700 1 -- 172.21.15.120:0/1505981128 wait complete. 2021-04-09T18:20:17.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.210 7fbc9abc5700 1 Processor -- start 2021-04-09T18:20:17.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.210 7fbc9abc5700 1 -- start start 2021-04-09T18:20:17.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.210 7fbc9abc5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc9409b120 0x7fbc940e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.210 7fbc9abc5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940e40c0 0x7fbc940b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.210 7fbc9abc5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9409b520 0x7fbc940b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.249 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.210 7fbc9abc5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9409dce0 con 0x7fbc940e40c0 2021-04-09T18:20:17.249 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.210 7fbc9abc5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9409aba0 con 0x7fbc9409b520 2021-04-09T18:20:17.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.210 7fbc9abc5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc940b5c50 con 0x7fbc9409b120 2021-04-09T18:20:17.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc93fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940e40c0 0x7fbc940b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc93fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940e40c0 0x7fbc940b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53132/0 (socket says 172.21.15.120:53132) 2021-04-09T18:20:17.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc93fff700 1 -- 172.21.15.120:0/1999025809 learned_addr learned my addr 172.21.15.120:0/1999025809 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:17.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc989e1700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc9409b120 0x7fbc940e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc991e2700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9409b520 0x7fbc940b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc93fff700 1 -- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc9409b120 msgr2=0x7fbc940e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc93fff700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc9409b120 0x7fbc940e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.271 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc93fff700 1 -- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9409b520 msgr2=0x7fbc940b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.273 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc93fff700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9409b520 0x7fbc940b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc93fff700 1 -- 172.21.15.120:0/1999025809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc940b5e30 con 0x7fbc940e40c0 2021-04-09T18:20:17.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc989e1700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc9409b120 0x7fbc940e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:17.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc991e2700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9409b520 0x7fbc940b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:17.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc93fff700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940e40c0 0x7fbc940b5010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fbc84009450 tx=0x7fbc8400bd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:17.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc917fa700 1 -- 172.21.15.120:0/1999025809 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc84006e40 con 0x7fbc940e40c0 2021-04-09T18:20:17.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc917fa700 1 -- 172.21.15.120:0/1999025809 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8400be60 con 0x7fbc940e40c0 2021-04-09T18:20:17.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc940b5e30 con 0x7fbc940e40c0 2021-04-09T18:20:17.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc917fa700 1 -- 172.21.15.120:0/1999025809 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc8400c4e0 con 0x7fbc940e40c0 2021-04-09T18:20:17.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.211 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc940b5e30 con 0x7fbc940e40c0 2021-04-09T18:20:17.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.212 7fbc917fa700 1 -- 172.21.15.120:0/1999025809 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbc84001010 con 0x7fbc940e40c0 2021-04-09T18:20:17.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.212 7fbc917fa700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbc78018930 0x7fbc7801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.212 7fbc917fa700 1 -- 172.21.15.120:0/1999025809 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fbc84032ee0 con 0x7fbc940e40c0 2021-04-09T18:20:17.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.212 7fbc989e1700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbc78018930 0x7fbc7801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.213 7fbc989e1700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbc78018930 0x7fbc7801ae10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:17.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.236 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc940e25b0 con 0x7fbc940e40c0 2021-04-09T18:20:17.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.239 7fbc917fa700 1 -- 172.21.15.120:0/1999025809 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbc8401fac0 con 0x7fbc940e40c0 2021-04-09T18:20:17.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.404 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fbc940e25b0 con 0x7fbc940e40c0 2021-04-09T18:20:17.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.404 7fbc917fa700 1 -- 172.21.15.120:0/1999025809 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbc84001010 con 0x7fbc940e40c0 2021-04-09T18:20:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:17.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbc78018930 msgr2=0x7fbc7801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbc78018930 0x7fbc7801ae10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940e40c0 msgr2=0x7fbc940b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940e40c0 0x7fbc940b5010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fbc84009450 tx=0x7fbc8400bd20).stop 2021-04-09T18:20:17.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 shutdown_connections 2021-04-09T18:20:17.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc9409b520 0x7fbc940b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc940e40c0 0x7fbc940b5010 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbc78018930 0x7fbc7801ae10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 --2- 172.21.15.120:0/1999025809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbc9409b120 0x7fbc940e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 >> 172.21.15.120:0/1999025809 conn(0x7fbc941822c0 msgr2=0x7fbc9409df50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:17.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 shutdown_connections 2021-04-09T18:20:17.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.407 7fbc9abc5700 1 -- 172.21.15.120:0/1999025809 wait complete. 2021-04-09T18:20:17.428 INFO:tasks.mds_thrash:mds thrasher using random seed: 1617992417 2021-04-09T18:20:17.429 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:20:17.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.577 7fc8c2343700 1 Processor -- start 2021-04-09T18:20:17.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.578 7fc8c2343700 1 -- start start 2021-04-09T18:20:17.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.578 7fc8c2343700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc0d7160 0x7fc8bc0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.578 7fc8c2343700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0d6be0 con 0x7fc8bc0d7560 2021-04-09T18:20:17.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.578 7fc8c2343700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0e7f00 con 0x7fc8bc0e70a0 2021-04-09T18:20:17.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.578 7fc8c2343700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0d80f0 con 0x7fc8bc0d7160 2021-04-09T18:20:17.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.578 7fc8b3fff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc8bc0d7560 0x7fc8bc0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48052/0 (socket says 172.21.15.120:48052) 2021-04-09T18:20:17.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.578 7fc8b3fff700 1 -- 172.21.15.120:0/785541227 learned_addr learned my addr 172.21.15.120:0/785541227 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:17.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.578 7fc8bbfff700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc0d7160 0x7fc8bc0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.578 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200389784 0 0) 0x7fc8a4000ce0 con 0x7fc8bc0d7560 2021-04-09T18:20:17.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a8002fe0 con 0x7fc8bc0d7560 2021-04-09T18:20:17.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296407609 0 0) 0x7fc8b4000f90 con 0x7fc8bc0e70a0 2021-04-09T18:20:17.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a8003210 con 0x7fc8bc0e70a0 2021-04-09T18:20:17.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1835660334 0 0) 0x7fc8a4000ed0 con 0x7fc8bc0d7560 2021-04-09T18:20:17.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc0d7160 msgr2=0x7fc8bc0e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:17.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc0d7160 0x7fc8bc0e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 >> v1:172.21.15.134:6789/0 conn(0x7fc8bc0e70a0 legacy=0x7fc8bc0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc1a2ac0 con 0x7fc8bc0d7560 2021-04-09T18:20:17.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7fc8a4001620 con 0x7fc8bc0d7560 2021-04-09T18:20:17.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 >> v1:172.21.15.120:6789/0 conn(0x7fc8bc0d7560 legacy=0x7fc8bc0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a8003b90 0x7fc8a8005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8a80067a0 0x7fc8a8008ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8a80095a0 0x7fc8a800ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80502f0 con 0x7fc8a80067a0 2021-04-09T18:20:17.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80504d0 con 0x7fc8a8003b90 2021-04-09T18:20:17.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80506f0 con 0x7fc8a80095a0 2021-04-09T18:20:17.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8b3fff700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8a80067a0 0x7fc8a8008ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8bbfff700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a8003b90 0x7fc8a8005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8c0960700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8a80095a0 0x7fc8a800ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8b3fff700 1 -- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8a80095a0 msgr2=0x7fc8a800ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:17.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8b3fff700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8a80095a0 0x7fc8a800ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.652 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8b3fff700 1 -- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a8003b90 msgr2=0x7fc8a8005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:17.652 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8b3fff700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a8003b90 0x7fc8a8005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.652 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8b3fff700 1 -- 172.21.15.120:0/785541227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a8050990 con 0x7fc8a80067a0 2021-04-09T18:20:17.653 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.579 7fc8b3fff700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8a80067a0 0x7fc8a8008ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fc8a40018d0 tx=0x7fc8a4007d50).ready entity=mon.0 client_cookie=316fca097eb3f941 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:17.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8a4000ed0 con 0x7fc8a80067a0 2021-04-09T18:20:17.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a40070c0 con 0x7fc8a80067a0 2021-04-09T18:20:17.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8bb7fe700 1 -- 172.21.15.120:0/785541227 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8a400a710 con 0x7fc8a80067a0 2021-04-09T18:20:17.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8c2343700 1 -- 172.21.15.120:0/785541227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8a80067a0 msgr2=0x7fc8a8008ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8c2343700 1 --2- 172.21.15.120:0/785541227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8a80067a0 0x7fc8a8008ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fc8a40018d0 tx=0x7fc8a4007d50).stop 2021-04-09T18:20:17.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8c0960700 1 -- 172.21.15.120:0/785541227 reap_dead start 2021-04-09T18:20:17.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8c2343700 1 -- 172.21.15.120:0/785541227 shutdown_connections 2021-04-09T18:20:17.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8c2343700 1 -- 172.21.15.120:0/785541227 >> 172.21.15.120:0/785541227 conn(0x7fc8bc0d1590 msgr2=0x7fc8bc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:17.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8c2343700 1 -- 172.21.15.120:0/785541227 shutdown_connections 2021-04-09T18:20:17.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.580 7fc8c2343700 1 -- 172.21.15.120:0/785541227 wait complete. 2021-04-09T18:20:17.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.599 7fc8c2343700 1 Processor -- start 2021-04-09T18:20:17.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.599 7fc8c2343700 1 -- start start 2021-04-09T18:20:17.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c2343700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8bc08a9b0 0x7fc8bc08b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c2343700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc0b1fe0 0x7fc8bc0b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c2343700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8bc183f10 0x7fc8bc184310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c2343700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc197600 con 0x7fc8bc183f10 2021-04-09T18:20:17.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c2343700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc08ae30 con 0x7fc8bc08a9b0 2021-04-09T18:20:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c2343700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc08b990 con 0x7fc8bc0b1fe0 2021-04-09T18:20:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c0960700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8bc183f10 0x7fc8bc184310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c0960700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8bc183f10 0x7fc8bc184310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53154/0 (socket says 172.21.15.120:53154) 2021-04-09T18:20:17.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c0960700 1 -- 172.21.15.120:0/2545954166 learned_addr learned my addr 172.21.15.120:0/2545954166 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:17.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8bbfff700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8bc08a9b0 0x7fc8bc08b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8b3fff700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc0b1fe0 0x7fc8bc0b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c0960700 1 -- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc0b1fe0 msgr2=0x7fc8bc0b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c0960700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc0b1fe0 0x7fc8bc0b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c0960700 1 -- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8bc08a9b0 msgr2=0x7fc8bc08b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c0960700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8bc08a9b0 0x7fc8bc08b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c0960700 1 -- 172.21.15.120:0/2545954166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc1971c0 con 0x7fc8bc183f10 2021-04-09T18:20:17.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c0960700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8bc183f10 0x7fc8bc184310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fc8b400c860 tx=0x7fc8b400cc00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:17.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8b97fa700 1 -- 172.21.15.120:0/2545954166 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8b4006bd0 con 0x7fc8bc183f10 2021-04-09T18:20:17.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8b97fa700 1 -- 172.21.15.120:0/2545954166 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4003030 con 0x7fc8bc183f10 2021-04-09T18:20:17.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc1971c0 con 0x7fc8bc183f10 2021-04-09T18:20:17.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.600 7fc8b97fa700 1 -- 172.21.15.120:0/2545954166 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc8b4001680 con 0x7fc8bc183f10 2021-04-09T18:20:17.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.601 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc1971c0 con 0x7fc8bc183f10 2021-04-09T18:20:17.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.601 7fc8b97fa700 1 -- 172.21.15.120:0/2545954166 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc8b4001400 con 0x7fc8bc183f10 2021-04-09T18:20:17.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.601 7fc8b97fa700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc8a0018930 0x7fc8a001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.601 7fc8b97fa700 1 -- 172.21.15.120:0/2545954166 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fc8b4032ed0 con 0x7fc8bc183f10 2021-04-09T18:20:17.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.601 7fc8bbfff700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc8a0018930 0x7fc8a001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.602 7fc8bbfff700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc8a0018930 0x7fc8a001adc0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:17.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.624 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc182a20 con 0x7fc8bc183f10 2021-04-09T18:20:17.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.627 7fc8b97fa700 1 -- 172.21.15.120:0/2545954166 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc8b40011f0 con 0x7fc8bc183f10 2021-04-09T18:20:17.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.804 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8bc182a20 con 0x7fc8bc183f10 2021-04-09T18:20:17.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.805 7fc8b97fa700 1 -- 172.21.15.120:0/2545954166 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7fc8b4002f10 con 0x7fc8bc183f10 2021-04-09T18:20:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:17.803 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:20:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc8a0018930 msgr2=0x7fc8a001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc8a0018930 0x7fc8a001adc0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8bc183f10 msgr2=0x7fc8bc184310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8bc183f10 0x7fc8bc184310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fc8b400c860 tx=0x7fc8b400cc00).stop 2021-04-09T18:20:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 shutdown_connections 2021-04-09T18:20:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8bc183f10 0x7fc8bc184310 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc8a0018930 0x7fc8a001adc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc0b1fe0 0x7fc8bc0b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 --2- 172.21.15.120:0/2545954166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8bc08a9b0 0x7fc8bc08b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:17.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 >> 172.21.15.120:0/2545954166 conn(0x7fc8bc18dcd0 msgr2=0x7fc8bc187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:17.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 shutdown_connections 2021-04-09T18:20:17.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.807 7fc8c2343700 1 -- 172.21.15.120:0/2545954166 wait complete. 2021-04-09T18:20:17.816 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:19:47.013532', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:19:50.254363', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:19:52.685224', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:20:17.817 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:20:17.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.963 7f6cb47e5700 1 Processor -- start 2021-04-09T18:20:17.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.963 7f6cb47e5700 1 -- start start 2021-04-09T18:20:17.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.964 7f6cb47e5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6cac0d65a0 0x7f6cac1ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:17.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.964 7f6cb47e5700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac0d7980 con 0x7f6cac0d7580 2021-04-09T18:20:17.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.964 7f6cb47e5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac0d69a0 con 0x7f6cac0d7180 2021-04-09T18:20:17.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.964 7f6cb47e5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac0d6c00 con 0x7f6cac0d65a0 2021-04-09T18:20:17.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.964 7f6cb1e00700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6cac0d7580 0x7f6cac0d5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48070/0 (socket says 172.21.15.120:48070) 2021-04-09T18:20:17.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.964 7f6cb1e00700 1 -- 172.21.15.120:0/3451196332 learned_addr learned my addr 172.21.15.120:0/3451196332 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:17.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.964 7f6cb2e02700 1 --2- 172.21.15.120:0/3451196332 >> v2:172.21.15.134:3300/0 conn(0x7f6cac0d65a0 0x7f6cac1ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:17.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb15ff700 1 -- 172.21.15.120:0/3451196332 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246339636 0 0) 0x7f6ca8000ce0 con 0x7f6cac0d7580 2021-04-09T18:20:17.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb15ff700 1 -- 172.21.15.120:0/3451196332 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c98002fe0 con 0x7f6cac0d7580 2021-04-09T18:20:17.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb15ff700 1 -- 172.21.15.120:0/3451196332 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026895532 0 0) 0x7f6c9c000c60 con 0x7f6cac0d7180 2021-04-09T18:20:17.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb15ff700 1 -- 172.21.15.120:0/3451196332 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c98003210 con 0x7f6cac0d7180 2021-04-09T18:20:17.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb15ff700 1 -- 172.21.15.120:0/3451196332 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1358797661 0 0) 0x7f6ca8000ed0 con 0x7f6cac0d7580 2021-04-09T18:20:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb2e02700 1 -- 172.21.15.120:0/3451196332 >> v1:172.21.15.134:6789/0 conn(0x7f6cac0d7180 legacy=0x7f6cac0d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb2e02700 1 -- 172.21.15.120:0/3451196332 >> v1:172.21.15.120:6789/0 conn(0x7f6cac0d7580 legacy=0x7f6cac0d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb2e02700 1 -- 172.21.15.120:0/3451196332 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac1a2ae0 con 0x7f6cac0d65a0 2021-04-09T18:20:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb2e02700 1 --2- 172.21.15.120:0/3451196332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cac0d65a0 0x7f6cac1ac210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6ca4006e50 tx=0x7f6ca4009e70).ready entity=mon.1 client_cookie=cee3bff1d911b6a9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb15ff700 1 -- 172.21.15.120:0/3451196332 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6ca4006a20 con 0x7f6cac0d65a0 2021-04-09T18:20:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb15ff700 1 -- 172.21.15.120:0/3451196332 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca4006790 con 0x7f6cac0d65a0 2021-04-09T18:20:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb15ff700 1 -- 172.21.15.120:0/3451196332 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6ca400b700 con 0x7f6cac0d65a0 2021-04-09T18:20:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb47e5700 1 -- 172.21.15.120:0/3451196332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cac0d65a0 msgr2=0x7f6cac1ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.965 7f6cb47e5700 1 --2- 172.21.15.120:0/3451196332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cac0d65a0 0x7f6cac1ac210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6ca4006e50 tx=0x7f6ca4009e70).stop 2021-04-09T18:20:18.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.966 7f6cb47e5700 1 -- 172.21.15.120:0/3451196332 shutdown_connections 2021-04-09T18:20:18.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.966 7f6cb47e5700 1 --2- 172.21.15.120:0/3451196332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cac0d65a0 0x7f6cac1ac210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.015 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.966 7f6cb47e5700 1 -- 172.21.15.120:0/3451196332 >> 172.21.15.120:0/3451196332 conn(0x7f6cac0d15b0 msgr2=0x7f6cac0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.966 7f6cb47e5700 1 -- 172.21.15.120:0/3451196332 shutdown_connections 2021-04-09T18:20:18.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.966 7f6cb47e5700 1 -- 172.21.15.120:0/3451196332 wait complete. 2021-04-09T18:20:18.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.985 7f6cb47e5700 1 Processor -- start 2021-04-09T18:20:18.020 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.985 7f6cb47e5700 1 -- start start 2021-04-09T18:20:18.020 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb47e5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cac17bd50 0x7f6cac0e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb47e5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cac17c150 0x7f6cac0e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb47e5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0b5120 0x7f6cac0b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb47e5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac17c6d0 con 0x7f6cac0b5120 2021-04-09T18:20:18.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb47e5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac17b7d0 con 0x7f6cac17bd50 2021-04-09T18:20:18.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb47e5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac1919c0 con 0x7f6cac17c150 2021-04-09T18:20:18.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb2e02700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0b5120 0x7f6cac0b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb2e02700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0b5120 0x7f6cac0b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53166/0 (socket says 172.21.15.120:53166) 2021-04-09T18:20:18.035 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb2e02700 1 -- 172.21.15.120:0/284242861 learned_addr learned my addr 172.21.15.120:0/284242861 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:18.035 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb1e00700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cac17c150 0x7f6cac0e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.036 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb2601700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cac17bd50 0x7f6cac0e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.036 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb2e02700 1 -- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cac17c150 msgr2=0x7f6cac0e3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.036 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb2e02700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cac17c150 0x7f6cac0e3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb2e02700 1 -- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cac17bd50 msgr2=0x7f6cac0e34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb2e02700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cac17bd50 0x7f6cac0e34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.986 7f6cb2e02700 1 -- 172.21.15.120:0/284242861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac17b450 con 0x7f6cac0b5120 2021-04-09T18:20:18.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.987 7f6cb2e02700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0b5120 0x7f6cac0b5520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f6ca40099f0 tx=0x7f6ca400bc90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:18.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.987 7f6ca2ffd700 1 -- 172.21.15.120:0/284242861 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6ca40090c0 con 0x7f6cac0b5120 2021-04-09T18:20:18.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.987 7f6ca2ffd700 1 -- 172.21.15.120:0/284242861 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca4000df0 con 0x7f6cac0b5120 2021-04-09T18:20:18.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.987 7f6ca2ffd700 1 -- 172.21.15.120:0/284242861 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6ca4001390 con 0x7f6cac0b5120 2021-04-09T18:20:18.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.987 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac17b450 con 0x7f6cac0b5120 2021-04-09T18:20:18.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.987 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac17b450 con 0x7f6cac0b5120 2021-04-09T18:20:18.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.987 7f6ca2ffd700 1 -- 172.21.15.120:0/284242861 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6ca40011a0 con 0x7f6cac0b5120 2021-04-09T18:20:18.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.988 7f6ca2ffd700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c94018930 0x7f6c9401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.988 7f6ca2ffd700 1 -- 172.21.15.120:0/284242861 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f6ca4032f00 con 0x7f6cac0b5120 2021-04-09T18:20:18.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.988 7f6cb2601700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c94018930 0x7f6c9401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:17.988 7f6cb2601700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c94018930 0x7f6c9401adc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:18.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.010 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac0e25a0 con 0x7f6cac0b5120 2021-04-09T18:20:18.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.013 7f6ca2ffd700 1 -- 172.21.15.120:0/284242861 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6ca4001ee0 con 0x7f6cac0b5120 2021-04-09T18:20:18.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.180 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f6cac0d6c00 con 0x7f6cac0b5120 2021-04-09T18:20:18.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.181 7f6ca2ffd700 1 -- 172.21.15.120:0/284242861 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6ca400bdd0 con 0x7f6cac0b5120 2021-04-09T18:20:18.179 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:18.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c94018930 msgr2=0x7f6c9401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c94018930 0x7f6c9401adc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0b5120 msgr2=0x7f6cac0b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0b5120 0x7f6cac0b5520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f6ca40099f0 tx=0x7f6ca400bc90).stop 2021-04-09T18:20:18.349 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 shutdown_connections 2021-04-09T18:20:18.349 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0b5120 0x7f6cac0b5520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.349 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c94018930 0x7f6c9401adc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.350 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cac17c150 0x7f6cac0e3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.350 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 --2- 172.21.15.120:0/284242861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cac17bd50 0x7f6cac0e34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.351 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 >> 172.21.15.120:0/284242861 conn(0x7f6cac1a1c60 msgr2=0x7f6cac19e860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:18.353 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 shutdown_connections 2021-04-09T18:20:18.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.183 7f6cb47e5700 1 -- 172.21.15.120:0/284242861 wait complete. 2021-04-09T18:20:18.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:20:18.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.512 7ff3f6124700 1 Processor -- start 2021-04-09T18:20:18.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3f6124700 1 -- start start 2021-04-09T18:20:18.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3f6124700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff3f00d7580 0x7ff3f00d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3f6124700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00d63d0 0x7ff3f01ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3f6124700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f00d7980 con 0x7ff3f00d7180 2021-04-09T18:20:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3f6124700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00d6c00 con 0x7ff3f00d7580 2021-04-09T18:20:18.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3f6124700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01a2ae0 con 0x7ff3f00d63d0 2021-04-09T18:20:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3eeffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff3f00d7580 0x7ff3f00d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.539 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3effff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00d63d0 0x7ff3f01ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3eeffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff3f00d7580 0x7ff3f00d5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:42014/0 (socket says 172.21.15.120:42014) 2021-04-09T18:20:18.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.513 7ff3eeffd700 1 -- 172.21.15.120:0/3740647609 learned_addr learned my addr 172.21.15.120:0/3740647609 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:18.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3effff700 1 -- 172.21.15.120:0/3740647609 >> v2:172.21.15.134:3300/0 conn(0x7ff3f00d7580 msgr2=0x7ff3f00d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:18.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3effff700 1 --2- 172.21.15.120:0/3740647609 >> v2:172.21.15.134:3300/0 conn(0x7ff3f00d7580 0x7ff3f00d5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3effff700 1 -- 172.21.15.120:0/3740647609 >> v1:172.21.15.134:6789/0 conn(0x7ff3f00d7180 legacy=0x7ff3f00d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3ee7fc700 1 -- 172.21.15.120:0/3740647609 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322929860 0 0) 0x7ff3e0000fe0 con 0x7ff3f00d7180 2021-04-09T18:20:18.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3effff700 1 -- 172.21.15.120:0/3740647609 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00d67d0 con 0x7ff3f00d63d0 2021-04-09T18:20:18.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3effff700 1 --2- 172.21.15.120:0/3740647609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00d63d0 0x7ff3f01ab200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff3e8006ad0 tx=0x7ff3e8009ad0).ready entity=mon.2 client_cookie=e74e4d8a6e5408ef server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:18.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3ee7fc700 1 -- 172.21.15.120:0/3740647609 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3e80022e0 con 0x7ff3f00d63d0 2021-04-09T18:20:18.554 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3ee7fc700 1 -- 172.21.15.120:0/3740647609 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e8006410 con 0x7ff3f00d63d0 2021-04-09T18:20:18.554 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3f6124700 1 -- 172.21.15.120:0/3740647609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00d63d0 msgr2=0x7ff3f01ab200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3ee7fc700 1 -- 172.21.15.120:0/3740647609 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3e8000c10 con 0x7ff3f00d63d0 2021-04-09T18:20:18.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.514 7ff3f6124700 1 --2- 172.21.15.120:0/3740647609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00d63d0 0x7ff3f01ab200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff3e8006ad0 tx=0x7ff3e8009ad0).stop 2021-04-09T18:20:18.559 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.515 7ff3f6124700 1 -- 172.21.15.120:0/3740647609 shutdown_connections 2021-04-09T18:20:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.515 7ff3f6124700 1 --2- 172.21.15.120:0/3740647609 >> v2:172.21.15.134:3300/0 conn(0x7ff3f00d7580 0x7ff3f00d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.515 7ff3f6124700 1 --2- 172.21.15.120:0/3740647609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00d63d0 0x7ff3f01ab200 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.515 7ff3f6124700 1 -- 172.21.15.120:0/3740647609 >> 172.21.15.120:0/3740647609 conn(0x7ff3f00d15b0 msgr2=0x7ff3f00d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:18.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.515 7ff3f6124700 1 -- 172.21.15.120:0/3740647609 shutdown_connections 2021-04-09T18:20:18.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.515 7ff3f6124700 1 -- 172.21.15.120:0/3740647609 wait complete. 2021-04-09T18:20:18.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3f6124700 1 Processor -- start 2021-04-09T18:20:18.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3f6124700 1 -- start start 2021-04-09T18:20:18.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3f6124700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00db3e0 0x7ff3f00daa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3f6124700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3f01a0620 0x7ff3f019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3f6124700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3f01a0a20 0x7ff3f019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3f6124700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01a0fa0 con 0x7ff3f01a0620 2021-04-09T18:20:18.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3f6124700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01a00a0 con 0x7ff3f01a0a20 2021-04-09T18:20:18.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3f6124700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f019fac0 con 0x7ff3f00db3e0 2021-04-09T18:20:18.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3eeffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3f01a0620 0x7ff3f019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3eeffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3f01a0620 0x7ff3f019ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53180/0 (socket says 172.21.15.120:53180) 2021-04-09T18:20:18.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3eeffd700 1 -- 172.21.15.120:0/3852809842 learned_addr learned my addr 172.21.15.120:0/3852809842 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:18.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3effff700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3f01a0a20 0x7ff3f019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.534 7ff3ef7fe700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00db3e0 0x7ff3f00daa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3eeffd700 1 -- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00db3e0 msgr2=0x7ff3f00daa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3eeffd700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00db3e0 0x7ff3f00daa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3eeffd700 1 -- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3f01a0a20 msgr2=0x7ff3f019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3eeffd700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3f01a0a20 0x7ff3f019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3eeffd700 1 -- 172.21.15.120:0/3852809842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f019fca0 con 0x7ff3f01a0620 2021-04-09T18:20:18.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3eeffd700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3f01a0620 0x7ff3f019ee80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ff3e400b5e0 tx=0x7ff3e400b980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:18.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3d7fff700 1 -- 172.21.15.120:0/3852809842 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3e400bd70 con 0x7ff3f01a0620 2021-04-09T18:20:18.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3d7fff700 1 -- 172.21.15.120:0/3852809842 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e4002030 con 0x7ff3f01a0620 2021-04-09T18:20:18.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f019fca0 con 0x7ff3f01a0620 2021-04-09T18:20:18.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3d7fff700 1 -- 172.21.15.120:0/3852809842 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff3e4002550 con 0x7ff3f01a0620 2021-04-09T18:20:18.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.535 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f019fca0 con 0x7ff3f01a0620 2021-04-09T18:20:18.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.536 7ff3d7fff700 1 -- 172.21.15.120:0/3852809842 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff3e4002210 con 0x7ff3f01a0620 2021-04-09T18:20:18.603 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.536 7ff3d7fff700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3d00188d0 0x7ff3d001add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.603 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.536 7ff3d7fff700 1 -- 172.21.15.120:0/3852809842 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff3e4032bd0 con 0x7ff3f01a0620 2021-04-09T18:20:18.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.536 7ff3ef7fe700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3d00188d0 0x7ff3d001add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.536 7ff3ef7fe700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3d00188d0 0x7ff3d001add0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:18.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.559 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f01a00a0 con 0x7ff3f01a0620 2021-04-09T18:20:18.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.562 7ff3d7fff700 1 -- 172.21.15.120:0/3852809842 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff3e4002240 con 0x7ff3f01a0620 2021-04-09T18:20:18.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.728 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7ff3f01a00a0 con 0x7ff3f01a0620 2021-04-09T18:20:18.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.729 7ff3d7fff700 1 -- 172.21.15.120:0/3852809842 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff3e4002030 con 0x7ff3f01a0620 2021-04-09T18:20:18.727 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3d00188d0 msgr2=0x7ff3d001add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3d00188d0 0x7ff3d001add0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3f01a0620 msgr2=0x7ff3f019ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3f01a0620 0x7ff3f019ee80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ff3e400b5e0 tx=0x7ff3e400b980).stop 2021-04-09T18:20:18.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 shutdown_connections 2021-04-09T18:20:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3f01a0a20 0x7ff3f019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3f01a0620 0x7ff3f019ee80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3d00188d0 0x7ff3d001add0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 --2- 172.21.15.120:0/3852809842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3f00db3e0 0x7ff3f00daa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 >> 172.21.15.120:0/3852809842 conn(0x7ff3f00e1870 msgr2=0x7ff3f00db8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:18.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 shutdown_connections 2021-04-09T18:20:18.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.731 7ff3f6124700 1 -- 172.21.15.120:0/3852809842 wait complete. 2021-04-09T18:20:18.759 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:20:18.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.918 7f648c711700 1 Processor -- start 2021-04-09T18:20:18.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.918 7f648c711700 1 -- start start 2021-04-09T18:20:18.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f648c711700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64840d7180 0x7f64840e7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f648c711700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f64840e70c0 0x7f64840d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f648c711700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64840d6c00 con 0x7f64840d7580 2021-04-09T18:20:18.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f648c711700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64840d8110 con 0x7f64840e70c0 2021-04-09T18:20:18.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f648c711700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64840e7f20 con 0x7f64840d7180 2021-04-09T18:20:18.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f648a52d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64840d7180 0x7f64840e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f648ad2e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f64840e70c0 0x7f64840d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:18.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f6489d2c700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f64840d7580 0x7f64840d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42920/0 (socket says 172.21.15.120:42920) 2021-04-09T18:20:18.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f648a52d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64840d7180 0x7f64840e7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:39852/0 (socket says 172.21.15.120:39852) 2021-04-09T18:20:18.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f648ad2e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f64840e70c0 0x7f64840d5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:42026/0 (socket says 172.21.15.120:42026) 2021-04-09T18:20:18.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.919 7f6489d2c700 1 -- 172.21.15.120:0/2066554389 learned_addr learned my addr 172.21.15.120:0/2066554389 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:18.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648952b700 1 -- 172.21.15.120:0/2066554389 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639098830 0 0) 0x7f64740009b0 con 0x7f64840d7580 2021-04-09T18:20:18.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648952b700 1 -- 172.21.15.120:0/2066554389 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6470002fe0 con 0x7f64840d7580 2021-04-09T18:20:18.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648a52d700 1 -- 172.21.15.120:0/2066554389 >> v2:172.21.15.134:3300/0 conn(0x7f64840e70c0 msgr2=0x7f64840d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:18.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648a52d700 1 --2- 172.21.15.120:0/2066554389 >> v2:172.21.15.134:3300/0 conn(0x7f64840e70c0 0x7f64840d5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648a52d700 1 -- 172.21.15.120:0/2066554389 >> v1:172.21.15.134:6789/0 conn(0x7f64840d7580 legacy=0x7f64840d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648a52d700 1 -- 172.21.15.120:0/2066554389 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64841a2ae0 con 0x7f64840d7180 2021-04-09T18:20:18.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648ad2e700 1 --2- 172.21.15.120:0/2066554389 >> v2:172.21.15.134:3300/0 conn(0x7f64840e70c0 0x7f64840d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:18.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648a52d700 1 --2- 172.21.15.120:0/2066554389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64840d7180 0x7f64840e7900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6480006650 tx=0x7f6480009a80).ready entity=mon.2 client_cookie=fbc5b471728011b3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:18.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648952b700 1 -- 172.21.15.120:0/2066554389 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64800009b0 con 0x7f64840d7180 2021-04-09T18:20:18.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648952b700 1 -- 172.21.15.120:0/2066554389 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648000c0c0 con 0x7f64840d7180 2021-04-09T18:20:18.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648952b700 1 -- 172.21.15.120:0/2066554389 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f648000c510 con 0x7f64840d7180 2021-04-09T18:20:18.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648c711700 1 -- 172.21.15.120:0/2066554389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64840d7180 msgr2=0x7f64840e7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:18.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.920 7f648c711700 1 --2- 172.21.15.120:0/2066554389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64840d7180 0x7f64840e7900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6480006650 tx=0x7f6480009a80).stop 2021-04-09T18:20:18.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.921 7f648c711700 1 -- 172.21.15.120:0/2066554389 shutdown_connections 2021-04-09T18:20:18.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.921 7f648c711700 1 --2- 172.21.15.120:0/2066554389 >> v2:172.21.15.134:3300/0 conn(0x7f64840e70c0 0x7f64840d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.921 7f648c711700 1 --2- 172.21.15.120:0/2066554389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f64840d7180 0x7f64840e7900 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:18.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.921 7f648c711700 1 -- 172.21.15.120:0/2066554389 >> 172.21.15.120:0/2066554389 conn(0x7f64840d15b0 msgr2=0x7f64840d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:18.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.921 7f648c711700 1 -- 172.21.15.120:0/2066554389 shutdown_connections 2021-04-09T18:20:18.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.921 7f648c711700 1 -- 172.21.15.120:0/2066554389 wait complete. 2021-04-09T18:20:18.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648c711700 1 Processor -- start 2021-04-09T18:20:18.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648c711700 1 -- start start 2021-04-09T18:20:18.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648c711700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648417bd50 0x7f64840e3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648c711700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f648417c150 0x7f64840e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648c711700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64840b5120 0x7f64840b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:18.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648c711700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648417c6d0 con 0x7f64840b5120 2021-04-09T18:20:18.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648c711700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648417b7d0 con 0x7f648417bd50 2021-04-09T18:20:18.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648c711700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64841919c0 con 0x7f648417c150 2021-04-09T18:20:19.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648ad2e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64840b5120 0x7f64840b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648a52d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648417bd50 0x7f64840e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648ad2e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64840b5120 0x7f64840b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53198/0 (socket says 172.21.15.120:53198) 2021-04-09T18:20:19.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f6489d2c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f648417c150 0x7f64840e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.940 7f648ad2e700 1 -- 172.21.15.120:0/1384413505 learned_addr learned my addr 172.21.15.120:0/1384413505 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f648ad2e700 1 -- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f648417c150 msgr2=0x7f64840e3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f648ad2e700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f648417c150 0x7f64840e3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f648ad2e700 1 -- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648417bd50 msgr2=0x7f64840e3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f648ad2e700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648417bd50 0x7f64840e3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f648ad2e700 1 -- 172.21.15.120:0/1384413505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648417b450 con 0x7f64840b5120 2021-04-09T18:20:19.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f648a52d700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648417bd50 0x7f64840e3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:19.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f648ad2e700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64840b5120 0x7f64840b5520 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f647c00b970 tx=0x7f647c00bd10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:19.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f647affd700 1 -- 172.21.15.120:0/1384413505 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f647c000f90 con 0x7f64840b5120 2021-04-09T18:20:19.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f647affd700 1 -- 172.21.15.120:0/1384413505 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c006aa0 con 0x7f64840b5120 2021-04-09T18:20:19.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f648c711700 1 -- 172.21.15.120:0/1384413505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648417b450 con 0x7f64840b5120 2021-04-09T18:20:19.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f647affd700 1 -- 172.21.15.120:0/1384413505 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f647c0015f0 con 0x7f64840b5120 2021-04-09T18:20:19.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.941 7f648c711700 1 -- 172.21.15.120:0/1384413505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648417b450 con 0x7f64840b5120 2021-04-09T18:20:19.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.942 7f647affd700 1 -- 172.21.15.120:0/1384413505 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f647c000e70 con 0x7f64840b5120 2021-04-09T18:20:19.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.942 7f647affd700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f646c018930 0x7f646c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.942 7f647affd700 1 -- 172.21.15.120:0/1384413505 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f647c032ed0 con 0x7f64840b5120 2021-04-09T18:20:19.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.942 7f648a52d700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f646c018930 0x7f646c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.942 7f648a52d700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f646c018930 0x7f646c01ae10 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:19.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.965 7f648c711700 1 -- 172.21.15.120:0/1384413505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64840e2560 con 0x7f64840b5120 2021-04-09T18:20:19.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:18.969 7f647affd700 1 -- 172.21.15.120:0/1384413505 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f647c0066f0 con 0x7f64840b5120 2021-04-09T18:20:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.137 7f648c711700 1 -- 172.21.15.120:0/1384413505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f64840e2560 con 0x7f64840b5120 2021-04-09T18:20:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.137 7f647affd700 1 -- 172.21.15.120:0/1384413505 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f647c006aa0 con 0x7f64840b5120 2021-04-09T18:20:19.135 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:19.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 -- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f646c018930 msgr2=0x7f646c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f646c018930 0x7f646c01ae10 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 -- 172.21.15.120:0/1384413505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64840b5120 msgr2=0x7f64840b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64840b5120 0x7f64840b5520 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f647c00b970 tx=0x7f647c00bd10).stop 2021-04-09T18:20:19.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 -- 172.21.15.120:0/1384413505 shutdown_connections 2021-04-09T18:20:19.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64840b5120 0x7f64840b5520 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f646c018930 0x7f646c01ae10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f648417c150 0x7f64840e3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 --2- 172.21.15.120:0/1384413505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648417bd50 0x7f64840e3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 -- 172.21.15.120:0/1384413505 >> 172.21.15.120:0/1384413505 conn(0x7f64841a1c60 msgr2=0x7f648419e860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 -- 172.21.15.120:0/1384413505 shutdown_connections 2021-04-09T18:20:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.140 7f648c711700 1 -- 172.21.15.120:0/1384413505 wait complete. 2021-04-09T18:20:19.147 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2021-04-09T18:20:19.148 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:19.311 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.289 7f5e28bc1700 1 Processor -- start 2021-04-09T18:20:19.311 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.289 7f5e28bc1700 1 -- start start 2021-04-09T18:20:19.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.289 7f5e28bc1700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5e240d7560 0x7f5e240d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.289 7f5e28bc1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5e240d63b0 0x7f5e241ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.289 7f5e28bc1700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e240d7960 con 0x7f5e240d7160 2021-04-09T18:20:19.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.289 7f5e28bc1700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e240d80f0 con 0x7f5e240d7560 2021-04-09T18:20:19.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.289 7f5e28bc1700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e240d6be0 con 0x7f5e240d63b0 2021-04-09T18:20:19.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2205d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5e240d7560 0x7f5e240d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2205d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5e240d7560 0x7f5e240d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53206/0 (socket says 172.21.15.120:53206) 2021-04-09T18:20:19.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2285e700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5e240d7160 0x7f5e240d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48114/0 (socket says 172.21.15.120:48114) 2021-04-09T18:20:19.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2205d700 1 -- 172.21.15.120:0/3713180788 learned_addr learned my addr 172.21.15.120:0/3713180788 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:19.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2305f700 1 --2- 172.21.15.120:0/3713180788 >> v2:172.21.15.134:3300/0 conn(0x7f5e240d63b0 0x7f5e241ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.321 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2205d700 1 -- 172.21.15.120:0/3713180788 >> v2:172.21.15.134:3300/0 conn(0x7f5e240d63b0 msgr2=0x7f5e241ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:19.322 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2205d700 1 --2- 172.21.15.120:0/3713180788 >> v2:172.21.15.134:3300/0 conn(0x7f5e240d63b0 0x7f5e241ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.322 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2205d700 1 -- 172.21.15.120:0/3713180788 >> v1:172.21.15.120:6789/0 conn(0x7f5e240d7160 legacy=0x7f5e240d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2205d700 1 -- 172.21.15.120:0/3713180788 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e241a2ac0 con 0x7f5e240d7560 2021-04-09T18:20:19.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2185c700 1 -- 172.21.15.120:0/3713180788 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197986318 0 0) 0x7f5e18000ce0 con 0x7f5e240d7160 2021-04-09T18:20:19.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2205d700 1 --2- 172.21.15.120:0/3713180788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240d7560 0x7f5e240d5d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f5e14006700 tx=0x7f5e14009b00).ready entity=mon.0 client_cookie=111d1b7fd77cc635 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:19.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2185c700 1 -- 172.21.15.120:0/3713180788 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e1400c0c0 con 0x7f5e240d7560 2021-04-09T18:20:19.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2185c700 1 -- 172.21.15.120:0/3713180788 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1400c400 con 0x7f5e240d7560 2021-04-09T18:20:19.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e2185c700 1 -- 172.21.15.120:0/3713180788 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e1400c8e0 con 0x7f5e240d7560 2021-04-09T18:20:19.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e28bc1700 1 -- 172.21.15.120:0/3713180788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240d7560 msgr2=0x7f5e240d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.290 7f5e28bc1700 1 --2- 172.21.15.120:0/3713180788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240d7560 0x7f5e240d5d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f5e14006700 tx=0x7f5e14009b00).stop 2021-04-09T18:20:19.326 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.291 7f5e28bc1700 1 -- 172.21.15.120:0/3713180788 shutdown_connections 2021-04-09T18:20:19.326 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.291 7f5e28bc1700 1 --2- 172.21.15.120:0/3713180788 >> v2:172.21.15.134:3300/0 conn(0x7f5e240d63b0 0x7f5e241ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.327 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.291 7f5e28bc1700 1 --2- 172.21.15.120:0/3713180788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240d7560 0x7f5e240d5d90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.327 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.291 7f5e28bc1700 1 -- 172.21.15.120:0/3713180788 >> 172.21.15.120:0/3713180788 conn(0x7f5e240d1590 msgr2=0x7f5e240d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:19.327 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.291 7f5e28bc1700 1 -- 172.21.15.120:0/3713180788 shutdown_connections 2021-04-09T18:20:19.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.291 7f5e28bc1700 1 -- 172.21.15.120:0/3713180788 wait complete. 2021-04-09T18:20:19.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e28bc1700 1 Processor -- start 2021-04-09T18:20:19.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e28bc1700 1 -- start start 2021-04-09T18:20:19.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e28bc1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e24187670 0x7f5e240a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e28bc1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240a5050 0x7f5e240b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e28bc1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240b5710 0x7f5e241838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e28bc1700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240b5b10 con 0x7f5e240b5710 2021-04-09T18:20:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e28bc1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240b5d30 con 0x7f5e240a5050 2021-04-09T18:20:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e28bc1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240b5f50 con 0x7f5e24187670 2021-04-09T18:20:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e2305f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240b5710 0x7f5e241838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e2305f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240b5710 0x7f5e241838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53210/0 (socket says 172.21.15.120:53210) 2021-04-09T18:20:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e2305f700 1 -- 172.21.15.120:0/2521009923 learned_addr learned my addr 172.21.15.120:0/2521009923 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e2285e700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e24187670 0x7f5e240a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.310 7f5e2205d700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240a5050 0x7f5e240b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e2305f700 1 -- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e24187670 msgr2=0x7f5e240a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e2305f700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e24187670 0x7f5e240a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e2305f700 1 -- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240a5050 msgr2=0x7f5e240b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e2305f700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240a5050 0x7f5e240b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e2305f700 1 -- 172.21.15.120:0/2521009923 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e24183ef0 con 0x7f5e240b5710 2021-04-09T18:20:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e2305f700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240b5710 0x7f5e241838d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f5e1c00b910 tx=0x7f5e1c00bcb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e137fe700 1 -- 172.21.15.120:0/2521009923 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e1c006aa0 con 0x7f5e240b5710 2021-04-09T18:20:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e137fe700 1 -- 172.21.15.120:0/2521009923 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c0011f0 con 0x7f5e240b5710 2021-04-09T18:20:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e24183ef0 con 0x7f5e240b5710 2021-04-09T18:20:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e137fe700 1 -- 172.21.15.120:0/2521009923 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e1c001640 con 0x7f5e240b5710 2021-04-09T18:20:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.311 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e24183ef0 con 0x7f5e240b5710 2021-04-09T18:20:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.312 7f5e137fe700 1 -- 172.21.15.120:0/2521009923 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5e1c0013d0 con 0x7f5e240b5710 2021-04-09T18:20:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.312 7f5e137fe700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e08018930 0x7f5e0801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.312 7f5e137fe700 1 -- 172.21.15.120:0/2521009923 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5e1c032f30 con 0x7f5e240b5710 2021-04-09T18:20:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.312 7f5e2285e700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e08018930 0x7f5e0801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.312 7f5e2285e700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e08018930 0x7f5e0801adc0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:19.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.335 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e241829e0 con 0x7f5e240b5710 2021-04-09T18:20:19.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.339 7f5e137fe700 1 -- 172.21.15.120:0/2521009923 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5e1c00bdf0 con 0x7f5e240b5710 2021-04-09T18:20:19.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.515 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e241829e0 con 0x7f5e240b5710 2021-04-09T18:20:19.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.515 7f5e137fe700 1 -- 172.21.15.120:0/2521009923 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2104 (secure 0 0 0) 0x7f5e1c0011f0 con 0x7f5e240b5710 2021-04-09T18:20:19.514 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2021-04-09T18:20:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:19.515 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:04.724179","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4292":{"gid":4292,"name":"b","rank":0,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1933604370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1933604370},{"type":"v1","addr":"172.21.15.134:6835","nonce":1933604370}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e08018930 msgr2=0x7f5e0801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e08018930 0x7f5e0801adc0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240b5710 msgr2=0x7f5e241838d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240b5710 0x7f5e241838d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f5e1c00b910 tx=0x7f5e1c00bcb0).stop 2021-04-09T18:20:19.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 shutdown_connections 2021-04-09T18:20:19.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e240b5710 0x7f5e241838d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240a5050 0x7f5e240b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e08018930 0x7f5e0801adc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 --2- 172.21.15.120:0/2521009923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e24187670 0x7f5e240a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 >> 172.21.15.120:0/2521009923 conn(0x7f5e2418dc90 msgr2=0x7f5e2408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:19.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 shutdown_connections 2021-04-09T18:20:19.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.518 7f5e28bc1700 1 -- 172.21.15.120:0/2521009923 wait complete. 2021-04-09T18:20:19.526 INFO:tasks.mds_thrash:Ready to start thrashing 2021-04-09T18:20:19.527 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2021-04-09T18:20:19.527 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:20:19.535 INFO:tasks.mds_thrash.daemon_watchdog:watchdog starting 2021-04-09T18:20:19.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.681 7f1bc3a20700 1 Processor -- start 2021-04-09T18:20:19.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.681 7f1bc3a20700 1 -- start start 2021-04-09T18:20:19.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc3a20700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1bbc0d7160 0x7f1bbc0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc3a20700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0d55a0 0x7f1bbc0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc3a20700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc0d6be0 con 0x7f1bbc0d5fc0 2021-04-09T18:20:19.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc3a20700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc0d80f0 con 0x7f1bbc0d7160 2021-04-09T18:20:19.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc3a20700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc1a2ac0 con 0x7f1bbc0d55a0 2021-04-09T18:20:19.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc183c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1bbc0d7160 0x7f1bbc0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc183c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1bbc0d7160 0x7f1bbc0d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53216/0 (socket says 172.21.15.120:53216) 2021-04-09T18:20:19.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc183c700 1 -- 172.21.15.120:0/2976175175 learned_addr learned my addr 172.21.15.120:0/2976175175 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:19.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc103b700 1 --2- 172.21.15.120:0/2976175175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0d55a0 0x7f1bbc0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc183c700 1 -- 172.21.15.120:0/2976175175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0d55a0 msgr2=0x7f1bbc0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:19.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc183c700 1 --2- 172.21.15.120:0/2976175175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0d55a0 0x7f1bbc0d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc083a700 1 -- 172.21.15.120:0/2976175175 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252323278 0 0) 0x7f1bac0009b0 con 0x7f1bbc0d5fc0 2021-04-09T18:20:19.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc183c700 1 -- 172.21.15.120:0/2976175175 >> v1:172.21.15.134:6789/0 conn(0x7f1bbc0d5fc0 legacy=0x7f1bbc0d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc183c700 1 -- 172.21.15.120:0/2976175175 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc1a2cb0 con 0x7f1bbc0d7160 2021-04-09T18:20:19.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc103b700 1 --2- 172.21.15.120:0/2976175175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0d55a0 0x7f1bbc0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:19.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc183c700 1 --2- 172.21.15.120:0/2976175175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc0d7160 0x7f1bbc0d7560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1bb4006a80 tx=0x7f1bb4009f00).ready entity=mon.0 client_cookie=599c06c33e916187 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:19.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc083a700 1 -- 172.21.15.120:0/2976175175 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1bb400b5c0 con 0x7f1bbc0d7160 2021-04-09T18:20:19.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc083a700 1 -- 172.21.15.120:0/2976175175 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb400b8c0 con 0x7f1bbc0d7160 2021-04-09T18:20:19.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.682 7f1bc083a700 1 -- 172.21.15.120:0/2976175175 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1bb400bda0 con 0x7f1bbc0d7160 2021-04-09T18:20:19.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.683 7f1bc3a20700 1 -- 172.21.15.120:0/2976175175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc0d7160 msgr2=0x7f1bbc0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.683 7f1bc3a20700 1 --2- 172.21.15.120:0/2976175175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc0d7160 0x7f1bbc0d7560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1bb4006a80 tx=0x7f1bb4009f00).stop 2021-04-09T18:20:19.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.683 7f1bc3a20700 1 -- 172.21.15.120:0/2976175175 shutdown_connections 2021-04-09T18:20:19.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.683 7f1bc3a20700 1 --2- 172.21.15.120:0/2976175175 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0d55a0 0x7f1bbc0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.683 7f1bc3a20700 1 --2- 172.21.15.120:0/2976175175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc0d7160 0x7f1bbc0d7560 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.683 7f1bc3a20700 1 -- 172.21.15.120:0/2976175175 >> 172.21.15.120:0/2976175175 conn(0x7f1bbc0d1590 msgr2=0x7f1bbc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:19.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.683 7f1bc3a20700 1 -- 172.21.15.120:0/2976175175 shutdown_connections 2021-04-09T18:20:19.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.683 7f1bc3a20700 1 -- 172.21.15.120:0/2976175175 wait complete. 2021-04-09T18:20:19.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc3a20700 1 Processor -- start 2021-04-09T18:20:19.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc3a20700 1 -- start start 2021-04-09T18:20:19.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc3a20700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc187670 0x7f1bbc0a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc3a20700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0a5050 0x7f1bbc0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc3a20700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bbc0b5710 0x7f1bbc1838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc3a20700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc0b5b10 con 0x7f1bbc187670 2021-04-09T18:20:19.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc3a20700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc0b5d30 con 0x7f1bbc0b5710 2021-04-09T18:20:19.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc3a20700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc0b5f50 con 0x7f1bbc0a5050 2021-04-09T18:20:19.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc183c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc187670 0x7f1bbc0a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc183c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc187670 0x7f1bbc0a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53224/0 (socket says 172.21.15.120:53224) 2021-04-09T18:20:19.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.702 7f1bc183c700 1 -- 172.21.15.120:0/4230310488 learned_addr learned my addr 172.21.15.120:0/4230310488 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:19.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc103b700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0a5050 0x7f1bbc0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc203d700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bbc0b5710 0x7f1bbc1838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc183c700 1 -- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0a5050 msgr2=0x7f1bbc0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc183c700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0a5050 0x7f1bbc0b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc183c700 1 -- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bbc0b5710 msgr2=0x7f1bbc1838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc183c700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bbc0b5710 0x7f1bbc1838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc183c700 1 -- 172.21.15.120:0/4230310488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc183ef0 con 0x7f1bbc187670 2021-04-09T18:20:19.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc183c700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc187670 0x7f1bbc0a4a30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1bb400b840 tx=0x7f1bb400bc50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:19.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bba7fc700 1 -- 172.21.15.120:0/4230310488 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1bb4010700 con 0x7f1bbc187670 2021-04-09T18:20:19.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bba7fc700 1 -- 172.21.15.120:0/4230310488 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb4010980 con 0x7f1bbc187670 2021-04-09T18:20:19.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc183ef0 con 0x7f1bbc187670 2021-04-09T18:20:19.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bba7fc700 1 -- 172.21.15.120:0/4230310488 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1bb4010dd0 con 0x7f1bbc187670 2021-04-09T18:20:19.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.703 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc183ef0 con 0x7f1bbc187670 2021-04-09T18:20:19.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.704 7f1bba7fc700 1 -- 172.21.15.120:0/4230310488 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1bb4001010 con 0x7f1bbc187670 2021-04-09T18:20:19.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.704 7f1bba7fc700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1b9c018930 0x7f1b9c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:19.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.704 7f1bba7fc700 1 -- 172.21.15.120:0/4230310488 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1bb40372e0 con 0x7f1bbc187670 2021-04-09T18:20:19.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.704 7f1bc103b700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1b9c018930 0x7f1b9c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:19.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.704 7f1bc103b700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1b9c018930 0x7f1b9c01ae10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:19.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.727 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bbc1829e0 con 0x7f1bbc187670 2021-04-09T18:20:19.758 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.731 7f1bba7fc700 1 -- 172.21.15.120:0/4230310488 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1bb400bd90 con 0x7f1bbc187670 2021-04-09T18:20:19.906 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.909 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f1bbc1829e0 con 0x7f1b9c018930 2021-04-09T18:20:19.909 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.912 7f1bba7fc700 1 -- 172.21.15.120:0/4230310488 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+77233 (crc 0 0 0) 0x7f1bb0006a30 con 0x7f1b9c018930 2021-04-09T18:20:19.913 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2021-04-09T18:20:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:19.916 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1b9c018930 msgr2=0x7f1b9c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1b9c018930 0x7f1b9c01ae10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc187670 msgr2=0x7f1bbc0a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:19.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc187670 0x7f1bbc0a4a30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1bb400b840 tx=0x7f1bb400bc50).stop 2021-04-09T18:20:19.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 shutdown_connections 2021-04-09T18:20:19.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bbc0b5710 0x7f1bbc1838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1b9c018930 0x7f1b9c01ae10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1bbc0a5050 0x7f1bbc0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 --2- 172.21.15.120:0/4230310488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc187670 0x7f1bbc0a4a30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:19.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 >> 172.21.15.120:0/4230310488 conn(0x7f1bbc18dc90 msgr2=0x7f1bbc08fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 shutdown_connections 2021-04-09T18:20:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:19.918 7f1bc3a20700 1 -- 172.21.15.120:0/4230310488 wait complete. 2021-04-09T18:20:19.925 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2021-04-09 18:20:18.746599","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8390528,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584192,"statfs":{"total":773094113280,"available":764502212608,"internally_reserved":8589934592,"allocated":1900544,"data_stored":664916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002391"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671990","last_change":"2021-04-09 18:19:48.659214","last_active":"2021-04-09 18:19:54.671990","last_peered":"2021-04-09 18:19:54.671990","last_clean":"2021-04-09 18:19:54.671990","last_became_active":"2021-04-09 18:19:48.658812","last_became_peered":"2021-04-09 18:19:48.658812","last_unstale":"2021-04-09 18:19:54.671990","last_undegraded":"2021-04-09 18:19:54.671990","last_fullsized":"2021-04-09 18:19:54.671990","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734141","last_change":"2021-04-09 18:19:51.674918","last_active":"2021-04-09 18:20:03.734141","last_peered":"2021-04-09 18:20:03.734141","last_clean":"2021-04-09 18:20:03.734141","last_became_active":"2021-04-09 18:19:51.674416","last_became_peered":"2021-04-09 18:19:51.674416","last_unstale":"2021-04-09 18:20:03.734141","last_undegraded":"2021-04-09 18:20:03.734141","last_fullsized":"2021-04-09 18:20:03.734141","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687668","last_change":"2021-04-09 18:19:54.682596","last_active":"2021-04-09 18:19:54.687668","last_peered":"2021-04-09 18:19:54.687668","last_clean":"2021-04-09 18:19:54.687668","last_became_active":"2021-04-09 18:19:54.682305","last_became_peered":"2021-04-09 18:19:54.682305","last_unstale":"2021-04-09 18:19:54.687668","last_undegraded":"2021-04-09 18:19:54.687668","last_fullsized":"2021-04-09 18:19:54.687668","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671958","last_change":"2021-04-09 18:19:48.659288","last_active":"2021-04-09 18:19:54.671958","last_peered":"2021-04-09 18:19:54.671958","last_clean":"2021-04-09 18:19:54.671958","last_became_active":"2021-04-09 18:19:48.658917","last_became_peered":"2021-04-09 18:19:48.658917","last_unstale":"2021-04-09 18:19:54.671958","last_undegraded":"2021-04-09 18:19:54.671958","last_fullsized":"2021-04-09 18:19:54.671958","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"22'6","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735716","last_change":"2021-04-09 18:19:51.675020","last_active":"2021-04-09 18:20:03.735716","last_peered":"2021-04-09 18:20:03.735716","last_clean":"2021-04-09 18:20:03.735716","last_became_active":"2021-04-09 18:19:51.674681","last_became_peered":"2021-04-09 18:19:51.674681","last_unstale":"2021-04-09 18:20:03.735716","last_undegraded":"2021-04-09 18:20:03.735716","last_fullsized":"2021-04-09 18:20:03.735716","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688301","last_change":"2021-04-09 18:19:54.681265","last_active":"2021-04-09 18:19:54.688301","last_peered":"2021-04-09 18:19:54.688301","last_clean":"2021-04-09 18:19:54.688301","last_became_active":"2021-04-09 18:19:54.680726","last_became_peered":"2021-04-09 18:19:54.680726","last_unstale":"2021-04-09 18:19:54.688301","last_undegraded":"2021-04-09 18:19:54.688301","last_fullsized":"2021-04-09 18:19:54.688301","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685391","last_change":"2021-04-09 18:19:54.680273","last_active":"2021-04-09 18:19:54.685391","last_peered":"2021-04-09 18:19:54.685391","last_clean":"2021-04-09 18:19:54.685391","last_became_active":"2021-04-09 18:19:54.679793","last_became_peered":"2021-04-09 18:19:54.679793","last_unstale":"2021-04-09 18:19:54.685391","last_undegraded":"2021-04-09 18:19:54.685391","last_fullsized":"2021-04-09 18:19:54.685391","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672282","last_change":"2021-04-09 18:19:48.670446","last_active":"2021-04-09 18:19:54.672282","last_peered":"2021-04-09 18:19:54.672282","last_clean":"2021-04-09 18:19:54.672282","last_became_active":"2021-04-09 18:19:48.670077","last_became_peered":"2021-04-09 18:19:48.670077","last_unstale":"2021-04-09 18:19:54.672282","last_undegraded":"2021-04-09 18:19:54.672282","last_fullsized":"2021-04-09 18:19:54.672282","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'4","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.732754","last_change":"2021-04-09 18:19:51.668684","last_active":"2021-04-09 18:20:03.732754","last_peered":"2021-04-09 18:20:03.732754","last_clean":"2021-04-09 18:20:03.732754","last_became_active":"2021-04-09 18:19:51.668425","last_became_peered":"2021-04-09 18:19:51.668425","last_unstale":"2021-04-09 18:20:03.732754","last_undegraded":"2021-04-09 18:20:03.732754","last_fullsized":"2021-04-09 18:20:03.732754","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685459","last_change":"2021-04-09 18:19:54.678757","last_active":"2021-04-09 18:19:54.685459","last_peered":"2021-04-09 18:19:54.685459","last_clean":"2021-04-09 18:19:54.685459","last_became_active":"2021-04-09 18:19:54.678420","last_became_peered":"2021-04-09 18:19:54.678420","last_unstale":"2021-04-09 18:19:54.685459","last_undegraded":"2021-04-09 18:19:54.685459","last_fullsized":"2021-04-09 18:19:54.685459","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672124","last_change":"2021-04-09 18:19:48.660463","last_active":"2021-04-09 18:19:54.672124","last_peered":"2021-04-09 18:19:54.672124","last_clean":"2021-04-09 18:19:54.672124","last_became_active":"2021-04-09 18:19:48.660038","last_became_peered":"2021-04-09 18:19:48.660038","last_unstale":"2021-04-09 18:19:54.672124","last_undegraded":"2021-04-09 18:19:54.672124","last_fullsized":"2021-04-09 18:19:54.672124","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735889","last_change":"2021-04-09 18:19:51.670965","last_active":"2021-04-09 18:20:03.735889","last_peered":"2021-04-09 18:20:03.735889","last_clean":"2021-04-09 18:20:03.735889","last_became_active":"2021-04-09 18:19:51.670767","last_became_peered":"2021-04-09 18:19:51.670767","last_unstale":"2021-04-09 18:20:03.735889","last_undegraded":"2021-04-09 18:20:03.735889","last_fullsized":"2021-04-09 18:20:03.735889","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674910","last_change":"2021-04-09 18:19:48.668518","last_active":"2021-04-09 18:19:54.674910","last_peered":"2021-04-09 18:19:54.674910","last_clean":"2021-04-09 18:19:54.674910","last_became_active":"2021-04-09 18:19:48.668225","last_became_peered":"2021-04-09 18:19:48.668225","last_unstale":"2021-04-09 18:19:54.674910","last_undegraded":"2021-04-09 18:19:54.674910","last_fullsized":"2021-04-09 18:19:54.674910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'5","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734821","last_change":"2021-04-09 18:19:51.675432","last_active":"2021-04-09 18:20:03.734821","last_peered":"2021-04-09 18:20:03.734821","last_clean":"2021-04-09 18:20:03.734821","last_became_active":"2021-04-09 18:19:51.675161","last_became_peered":"2021-04-09 18:19:51.675161","last_unstale":"2021-04-09 18:20:03.734821","last_undegraded":"2021-04-09 18:20:03.734821","last_fullsized":"2021-04-09 18:20:03.734821","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685526","last_change":"2021-04-09 18:19:54.680136","last_active":"2021-04-09 18:19:54.685526","last_peered":"2021-04-09 18:19:54.685526","last_clean":"2021-04-09 18:19:54.685526","last_became_active":"2021-04-09 18:19:54.679654","last_became_peered":"2021-04-09 18:19:54.679654","last_unstale":"2021-04-09 18:19:54.685526","last_undegraded":"2021-04-09 18:19:54.685526","last_fullsized":"2021-04-09 18:19:54.685526","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674829","last_change":"2021-04-09 18:19:48.659172","last_active":"2021-04-09 18:19:54.674829","last_peered":"2021-04-09 18:19:54.674829","last_clean":"2021-04-09 18:19:54.674829","last_became_active":"2021-04-09 18:19:48.658788","last_became_peered":"2021-04-09 18:19:48.658788","last_unstale":"2021-04-09 18:19:54.674829","last_undegraded":"2021-04-09 18:19:54.674829","last_fullsized":"2021-04-09 18:19:54.674829","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:19:55.096291","last_change":"2021-04-09 18:19:51.675238","last_active":"2021-04-09 18:19:55.096291","last_peered":"2021-04-09 18:19:55.096291","last_clean":"2021-04-09 18:19:55.096291","last_became_active":"2021-04-09 18:19:51.674810","last_became_peered":"2021-04-09 18:19:51.674810","last_unstale":"2021-04-09 18:19:55.096291","last_undegraded":"2021-04-09 18:19:55.096291","last_fullsized":"2021-04-09 18:19:55.096291","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687598","last_change":"2021-04-09 18:19:54.680226","last_active":"2021-04-09 18:19:54.687598","last_peered":"2021-04-09 18:19:54.687598","last_clean":"2021-04-09 18:19:54.687598","last_became_active":"2021-04-09 18:19:54.679836","last_became_peered":"2021-04-09 18:19:54.679836","last_unstale":"2021-04-09 18:19:54.687598","last_undegraded":"2021-04-09 18:19:54.687598","last_fullsized":"2021-04-09 18:19:54.687598","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.676168","last_change":"2021-04-09 18:19:51.679961","last_active":"2021-04-09 18:19:54.676168","last_peered":"2021-04-09 18:19:54.676168","last_clean":"2021-04-09 18:19:54.676168","last_became_active":"2021-04-09 18:19:51.679689","last_became_peered":"2021-04-09 18:19:51.679689","last_unstale":"2021-04-09 18:19:54.676168","last_undegraded":"2021-04-09 18:19:54.676168","last_fullsized":"2021-04-09 18:19:54.676168","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674925","last_change":"2021-04-09 18:19:48.668812","last_active":"2021-04-09 18:19:54.674925","last_peered":"2021-04-09 18:19:54.674925","last_clean":"2021-04-09 18:19:54.674925","last_became_active":"2021-04-09 18:19:48.668474","last_became_peered":"2021-04-09 18:19:48.668474","last_unstale":"2021-04-09 18:19:54.674925","last_undegraded":"2021-04-09 18:19:54.674925","last_fullsized":"2021-04-09 18:19:54.674925","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688310","last_change":"2021-04-09 18:19:54.681340","last_active":"2021-04-09 18:19:54.688310","last_peered":"2021-04-09 18:19:54.688310","last_clean":"2021-04-09 18:19:54.688310","last_became_active":"2021-04-09 18:19:54.680877","last_became_peered":"2021-04-09 18:19:54.680877","last_unstale":"2021-04-09 18:19:54.688310","last_undegraded":"2021-04-09 18:19:54.688310","last_fullsized":"2021-04-09 18:19:54.688310","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735473","last_change":"2021-04-09 18:19:51.675129","last_active":"2021-04-09 18:20:03.735473","last_peered":"2021-04-09 18:20:03.735473","last_clean":"2021-04-09 18:20:03.735473","last_became_active":"2021-04-09 18:19:51.674771","last_became_peered":"2021-04-09 18:19:51.674771","last_unstale":"2021-04-09 18:20:03.735473","last_undegraded":"2021-04-09 18:20:03.735473","last_fullsized":"2021-04-09 18:20:03.735473","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672077","last_change":"2021-04-09 18:19:48.660437","last_active":"2021-04-09 18:19:54.672077","last_peered":"2021-04-09 18:19:54.672077","last_clean":"2021-04-09 18:19:54.672077","last_became_active":"2021-04-09 18:19:48.660180","last_became_peered":"2021-04-09 18:19:48.660180","last_unstale":"2021-04-09 18:19:54.672077","last_undegraded":"2021-04-09 18:19:54.672077","last_fullsized":"2021-04-09 18:19:54.672077","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685605","last_change":"2021-04-09 18:19:54.679817","last_active":"2021-04-09 18:19:54.685605","last_peered":"2021-04-09 18:19:54.685605","last_clean":"2021-04-09 18:19:54.685605","last_became_active":"2021-04-09 18:19:54.679420","last_became_peered":"2021-04-09 18:19:54.679420","last_unstale":"2021-04-09 18:19:54.685605","last_undegraded":"2021-04-09 18:19:54.685605","last_fullsized":"2021-04-09 18:19:54.685605","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":83269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":83109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":84229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":84069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]}]}} 2021-04-09T18:20:19.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:20:20.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.070 7f3d31c29700 1 Processor -- start 2021-04-09T18:20:20.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.070 7f3d31c29700 1 -- start start 2021-04-09T18:20:20.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d31c29700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3d2c0d7160 0x7f3d2c0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d31c29700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3d2c0d6190 0x7f3d2c0d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d31c29700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0d6be0 con 0x7f3d2c0d55a0 2021-04-09T18:20:20.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d31c29700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0d80f0 con 0x7f3d2c0d6190 2021-04-09T18:20:20.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d31c29700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c1a2ac0 con 0x7f3d2c0d7160 2021-04-09T18:20:20.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d2bfff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3d2c0d6190 0x7f3d2c0d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d2bfff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3d2c0d6190 0x7f3d2c0d6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53232/0 (socket says 172.21.15.120:53232) 2021-04-09T18:20:20.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d2bfff700 1 -- 172.21.15.120:0/901618769 learned_addr learned my addr 172.21.15.120:0/901618769 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:20.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d2b7fe700 1 --2- 172.21.15.120:0/901618769 >> v2:172.21.15.134:3300/0 conn(0x7f3d2c0d7160 0x7f3d2c0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d2bfff700 1 -- 172.21.15.120:0/901618769 >> v2:172.21.15.134:3300/0 conn(0x7f3d2c0d7160 msgr2=0x7f3d2c0d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:20.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d2bfff700 1 --2- 172.21.15.120:0/901618769 >> v2:172.21.15.134:3300/0 conn(0x7f3d2c0d7160 0x7f3d2c0d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d2bfff700 1 -- 172.21.15.120:0/901618769 >> v1:172.21.15.134:6789/0 conn(0x7f3d2c0d55a0 legacy=0x7f3d2c0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d2bfff700 1 -- 172.21.15.120:0/901618769 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c1ac1f0 con 0x7f3d2c0d6190 2021-04-09T18:20:20.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.071 7f3d2bfff700 1 --2- 172.21.15.120:0/901618769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c0d6190 0x7f3d2c0d6590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f3d24006b80 tx=0x7f3d24009b90).ready entity=mon.0 client_cookie=324febc970c2fba7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d2a7fc700 1 -- 172.21.15.120:0/901618769 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3d240022e0 con 0x7f3d2c0d6190 2021-04-09T18:20:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d2a7fc700 1 -- 172.21.15.120:0/901618769 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d24002620 con 0x7f3d2c0d6190 2021-04-09T18:20:20.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d2a7fc700 1 -- 172.21.15.120:0/901618769 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3d24002b00 con 0x7f3d2c0d6190 2021-04-09T18:20:20.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d31c29700 1 -- 172.21.15.120:0/901618769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c0d6190 msgr2=0x7f3d2c0d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d31c29700 1 --2- 172.21.15.120:0/901618769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c0d6190 0x7f3d2c0d6590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f3d24006b80 tx=0x7f3d24009b90).stop 2021-04-09T18:20:20.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d31c29700 1 -- 172.21.15.120:0/901618769 shutdown_connections 2021-04-09T18:20:20.127 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d31c29700 1 --2- 172.21.15.120:0/901618769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c0d6190 0x7f3d2c0d6590 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d31c29700 1 --2- 172.21.15.120:0/901618769 >> v2:172.21.15.134:3300/0 conn(0x7f3d2c0d7160 0x7f3d2c0d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d31c29700 1 -- 172.21.15.120:0/901618769 >> 172.21.15.120:0/901618769 conn(0x7f3d2c0d1590 msgr2=0x7f3d2c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:20.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d31c29700 1 -- 172.21.15.120:0/901618769 shutdown_connections 2021-04-09T18:20:20.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.072 7f3d31c29700 1 -- 172.21.15.120:0/901618769 wait complete. 2021-04-09T18:20:20.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.091 7f3d31c29700 1 Processor -- start 2021-04-09T18:20:20.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.091 7f3d31c29700 1 -- start start 2021-04-09T18:20:20.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d31c29700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c1971c0 0x7f3d2c193ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d31c29700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c18ad80 0x7f3d2c18b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d31c29700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d2c18bd70 0x7f3d2c18c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d31c29700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b0e80 con 0x7f3d2c1971c0 2021-04-09T18:20:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d31c29700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b1070 con 0x7f3d2c18ad80 2021-04-09T18:20:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d31c29700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b1290 con 0x7f3d2c18bd70 2021-04-09T18:20:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2b7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c1971c0 0x7f3d2c193ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2b7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c1971c0 0x7f3d2c193ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53236/0 (socket says 172.21.15.120:53236) 2021-04-09T18:20:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2b7fe700 1 -- 172.21.15.120:0/291361344 learned_addr learned my addr 172.21.15.120:0/291361344 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2affd700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c18ad80 0x7f3d2c18b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2bfff700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d2c18bd70 0x7f3d2c18c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2b7fe700 1 -- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d2c18bd70 msgr2=0x7f3d2c18c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2b7fe700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d2c18bd70 0x7f3d2c18c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2b7fe700 1 -- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c18ad80 msgr2=0x7f3d2c18b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2b7fe700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c18ad80 0x7f3d2c18b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2b7fe700 1 -- 172.21.15.120:0/291361344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0b14b0 con 0x7f3d2c1971c0 2021-04-09T18:20:20.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d2b7fe700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c1971c0 0x7f3d2c193ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3d1c00b930 tx=0x7f3d1c00bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:20.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d13fff700 1 -- 172.21.15.120:0/291361344 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3d1c00c2f0 con 0x7f3d2c1971c0 2021-04-09T18:20:20.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d13fff700 1 -- 172.21.15.120:0/291361344 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c00c5f0 con 0x7f3d2c1971c0 2021-04-09T18:20:20.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d31c29700 1 -- 172.21.15.120:0/291361344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c0b14b0 con 0x7f3d2c1971c0 2021-04-09T18:20:20.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d13fff700 1 -- 172.21.15.120:0/291361344 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3d1c00ca40 con 0x7f3d2c1971c0 2021-04-09T18:20:20.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.092 7f3d31c29700 1 -- 172.21.15.120:0/291361344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c0b14b0 con 0x7f3d2c1971c0 2021-04-09T18:20:20.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.093 7f3d13fff700 1 -- 172.21.15.120:0/291361344 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3d1c001010 con 0x7f3d2c1971c0 2021-04-09T18:20:20.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.093 7f3d13fff700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3d0c018930 0x7f3d0c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.093 7f3d13fff700 1 -- 172.21.15.120:0/291361344 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f3d1c032f50 con 0x7f3d2c1971c0 2021-04-09T18:20:20.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.093 7f3d2affd700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3d0c018930 0x7f3d0c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.094 7f3d2affd700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3d0c018930 0x7f3d0c01ae10 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:20.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.117 7f3d31c29700 1 -- 172.21.15.120:0/291361344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c182a20 con 0x7f3d2c1971c0 2021-04-09T18:20:20.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.120 7f3d13fff700 1 -- 172.21.15.120:0/291361344 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3d1c00be10 con 0x7f3d2c1971c0 2021-04-09T18:20:20.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.298 7f3d31c29700 1 -- 172.21.15.120:0/291361344 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f3d2c182a20 con 0x7f3d0c018930 2021-04-09T18:20:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.301 7f3d13fff700 1 -- 172.21.15.120:0/291361344 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+77233 (crc 0 0 0) 0x7f3d20006a90 con 0x7f3d0c018930 2021-04-09T18:20:20.302 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2021-04-09T18:20:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 -- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3d0c018930 msgr2=0x7f3d0c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3d0c018930 0x7f3d0c01ae10 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 -- 172.21.15.120:0/291361344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c1971c0 msgr2=0x7f3d2c193ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.310 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c1971c0 0x7f3d2c193ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3d1c00b930 tx=0x7f3d1c00bcd0).stop 2021-04-09T18:20:20.310 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 -- 172.21.15.120:0/291361344 shutdown_connections 2021-04-09T18:20:20.311 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3d0c018930 0x7f3d0c01ae10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.311 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d2c18bd70 0x7f3d2c18c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.311 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d2c18ad80 0x7f3d2c18b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 --2- 172.21.15.120:0/291361344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d2c1971c0 0x7f3d2c193ca0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 -- 172.21.15.120:0/291361344 >> 172.21.15.120:0/291361344 conn(0x7f3d2c18dcd0 msgr2=0x7f3d2c187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 -- 172.21.15.120:0/291361344 shutdown_connections 2021-04-09T18:20:20.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.307 7f3d31c29700 1 -- 172.21.15.120:0/291361344 wait complete. 2021-04-09T18:20:20.318 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2021-04-09 18:20:18.746599","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8390528,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584192,"statfs":{"total":773094113280,"available":764502212608,"internally_reserved":8589934592,"allocated":1900544,"data_stored":664916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002391"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671990","last_change":"2021-04-09 18:19:48.659214","last_active":"2021-04-09 18:19:54.671990","last_peered":"2021-04-09 18:19:54.671990","last_clean":"2021-04-09 18:19:54.671990","last_became_active":"2021-04-09 18:19:48.658812","last_became_peered":"2021-04-09 18:19:48.658812","last_unstale":"2021-04-09 18:19:54.671990","last_undegraded":"2021-04-09 18:19:54.671990","last_fullsized":"2021-04-09 18:19:54.671990","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734141","last_change":"2021-04-09 18:19:51.674918","last_active":"2021-04-09 18:20:03.734141","last_peered":"2021-04-09 18:20:03.734141","last_clean":"2021-04-09 18:20:03.734141","last_became_active":"2021-04-09 18:19:51.674416","last_became_peered":"2021-04-09 18:19:51.674416","last_unstale":"2021-04-09 18:20:03.734141","last_undegraded":"2021-04-09 18:20:03.734141","last_fullsized":"2021-04-09 18:20:03.734141","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687668","last_change":"2021-04-09 18:19:54.682596","last_active":"2021-04-09 18:19:54.687668","last_peered":"2021-04-09 18:19:54.687668","last_clean":"2021-04-09 18:19:54.687668","last_became_active":"2021-04-09 18:19:54.682305","last_became_peered":"2021-04-09 18:19:54.682305","last_unstale":"2021-04-09 18:19:54.687668","last_undegraded":"2021-04-09 18:19:54.687668","last_fullsized":"2021-04-09 18:19:54.687668","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671958","last_change":"2021-04-09 18:19:48.659288","last_active":"2021-04-09 18:19:54.671958","last_peered":"2021-04-09 18:19:54.671958","last_clean":"2021-04-09 18:19:54.671958","last_became_active":"2021-04-09 18:19:48.658917","last_became_peered":"2021-04-09 18:19:48.658917","last_unstale":"2021-04-09 18:19:54.671958","last_undegraded":"2021-04-09 18:19:54.671958","last_fullsized":"2021-04-09 18:19:54.671958","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"22'6","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735716","last_change":"2021-04-09 18:19:51.675020","last_active":"2021-04-09 18:20:03.735716","last_peered":"2021-04-09 18:20:03.735716","last_clean":"2021-04-09 18:20:03.735716","last_became_active":"2021-04-09 18:19:51.674681","last_became_peered":"2021-04-09 18:19:51.674681","last_unstale":"2021-04-09 18:20:03.735716","last_undegraded":"2021-04-09 18:20:03.735716","last_fullsized":"2021-04-09 18:20:03.735716","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688301","last_change":"2021-04-09 18:19:54.681265","last_active":"2021-04-09 18:19:54.688301","last_peered":"2021-04-09 18:19:54.688301","last_clean":"2021-04-09 18:19:54.688301","last_became_active":"2021-04-09 18:19:54.680726","last_became_peered":"2021-04-09 18:19:54.680726","last_unstale":"2021-04-09 18:19:54.688301","last_undegraded":"2021-04-09 18:19:54.688301","last_fullsized":"2021-04-09 18:19:54.688301","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685391","last_change":"2021-04-09 18:19:54.680273","last_active":"2021-04-09 18:19:54.685391","last_peered":"2021-04-09 18:19:54.685391","last_clean":"2021-04-09 18:19:54.685391","last_became_active":"2021-04-09 18:19:54.679793","last_became_peered":"2021-04-09 18:19:54.679793","last_unstale":"2021-04-09 18:19:54.685391","last_undegraded":"2021-04-09 18:19:54.685391","last_fullsized":"2021-04-09 18:19:54.685391","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672282","last_change":"2021-04-09 18:19:48.670446","last_active":"2021-04-09 18:19:54.672282","last_peered":"2021-04-09 18:19:54.672282","last_clean":"2021-04-09 18:19:54.672282","last_became_active":"2021-04-09 18:19:48.670077","last_became_peered":"2021-04-09 18:19:48.670077","last_unstale":"2021-04-09 18:19:54.672282","last_undegraded":"2021-04-09 18:19:54.672282","last_fullsized":"2021-04-09 18:19:54.672282","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'4","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.732754","last_change":"2021-04-09 18:19:51.668684","last_active":"2021-04-09 18:20:03.732754","last_peered":"2021-04-09 18:20:03.732754","last_clean":"2021-04-09 18:20:03.732754","last_became_active":"2021-04-09 18:19:51.668425","last_became_peered":"2021-04-09 18:19:51.668425","last_unstale":"2021-04-09 18:20:03.732754","last_undegraded":"2021-04-09 18:20:03.732754","last_fullsized":"2021-04-09 18:20:03.732754","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685459","last_change":"2021-04-09 18:19:54.678757","last_active":"2021-04-09 18:19:54.685459","last_peered":"2021-04-09 18:19:54.685459","last_clean":"2021-04-09 18:19:54.685459","last_became_active":"2021-04-09 18:19:54.678420","last_became_peered":"2021-04-09 18:19:54.678420","last_unstale":"2021-04-09 18:19:54.685459","last_undegraded":"2021-04-09 18:19:54.685459","last_fullsized":"2021-04-09 18:19:54.685459","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672124","last_change":"2021-04-09 18:19:48.660463","last_active":"2021-04-09 18:19:54.672124","last_peered":"2021-04-09 18:19:54.672124","last_clean":"2021-04-09 18:19:54.672124","last_became_active":"2021-04-09 18:19:48.660038","last_became_peered":"2021-04-09 18:19:48.660038","last_unstale":"2021-04-09 18:19:54.672124","last_undegraded":"2021-04-09 18:19:54.672124","last_fullsized":"2021-04-09 18:19:54.672124","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735889","last_change":"2021-04-09 18:19:51.670965","last_active":"2021-04-09 18:20:03.735889","last_peered":"2021-04-09 18:20:03.735889","last_clean":"2021-04-09 18:20:03.735889","last_became_active":"2021-04-09 18:19:51.670767","last_became_peered":"2021-04-09 18:19:51.670767","last_unstale":"2021-04-09 18:20:03.735889","last_undegraded":"2021-04-09 18:20:03.735889","last_fullsized":"2021-04-09 18:20:03.735889","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674910","last_change":"2021-04-09 18:19:48.668518","last_active":"2021-04-09 18:19:54.674910","last_peered":"2021-04-09 18:19:54.674910","last_clean":"2021-04-09 18:19:54.674910","last_became_active":"2021-04-09 18:19:48.668225","last_became_peered":"2021-04-09 18:19:48.668225","last_unstale":"2021-04-09 18:19:54.674910","last_undegraded":"2021-04-09 18:19:54.674910","last_fullsized":"2021-04-09 18:19:54.674910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'5","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734821","last_change":"2021-04-09 18:19:51.675432","last_active":"2021-04-09 18:20:03.734821","last_peered":"2021-04-09 18:20:03.734821","last_clean":"2021-04-09 18:20:03.734821","last_became_active":"2021-04-09 18:19:51.675161","last_became_peered":"2021-04-09 18:19:51.675161","last_unstale":"2021-04-09 18:20:03.734821","last_undegraded":"2021-04-09 18:20:03.734821","last_fullsized":"2021-04-09 18:20:03.734821","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685526","last_change":"2021-04-09 18:19:54.680136","last_active":"2021-04-09 18:19:54.685526","last_peered":"2021-04-09 18:19:54.685526","last_clean":"2021-04-09 18:19:54.685526","last_became_active":"2021-04-09 18:19:54.679654","last_became_peered":"2021-04-09 18:19:54.679654","last_unstale":"2021-04-09 18:19:54.685526","last_undegraded":"2021-04-09 18:19:54.685526","last_fullsized":"2021-04-09 18:19:54.685526","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674829","last_change":"2021-04-09 18:19:48.659172","last_active":"2021-04-09 18:19:54.674829","last_peered":"2021-04-09 18:19:54.674829","last_clean":"2021-04-09 18:19:54.674829","last_became_active":"2021-04-09 18:19:48.658788","last_became_peered":"2021-04-09 18:19:48.658788","last_unstale":"2021-04-09 18:19:54.674829","last_undegraded":"2021-04-09 18:19:54.674829","last_fullsized":"2021-04-09 18:19:54.674829","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:19:55.096291","last_change":"2021-04-09 18:19:51.675238","last_active":"2021-04-09 18:19:55.096291","last_peered":"2021-04-09 18:19:55.096291","last_clean":"2021-04-09 18:19:55.096291","last_became_active":"2021-04-09 18:19:51.674810","last_became_peered":"2021-04-09 18:19:51.674810","last_unstale":"2021-04-09 18:19:55.096291","last_undegraded":"2021-04-09 18:19:55.096291","last_fullsized":"2021-04-09 18:19:55.096291","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687598","last_change":"2021-04-09 18:19:54.680226","last_active":"2021-04-09 18:19:54.687598","last_peered":"2021-04-09 18:19:54.687598","last_clean":"2021-04-09 18:19:54.687598","last_became_active":"2021-04-09 18:19:54.679836","last_became_peered":"2021-04-09 18:19:54.679836","last_unstale":"2021-04-09 18:19:54.687598","last_undegraded":"2021-04-09 18:19:54.687598","last_fullsized":"2021-04-09 18:19:54.687598","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.676168","last_change":"2021-04-09 18:19:51.679961","last_active":"2021-04-09 18:19:54.676168","last_peered":"2021-04-09 18:19:54.676168","last_clean":"2021-04-09 18:19:54.676168","last_became_active":"2021-04-09 18:19:51.679689","last_became_peered":"2021-04-09 18:19:51.679689","last_unstale":"2021-04-09 18:19:54.676168","last_undegraded":"2021-04-09 18:19:54.676168","last_fullsized":"2021-04-09 18:19:54.676168","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674925","last_change":"2021-04-09 18:19:48.668812","last_active":"2021-04-09 18:19:54.674925","last_peered":"2021-04-09 18:19:54.674925","last_clean":"2021-04-09 18:19:54.674925","last_became_active":"2021-04-09 18:19:48.668474","last_became_peered":"2021-04-09 18:19:48.668474","last_unstale":"2021-04-09 18:19:54.674925","last_undegraded":"2021-04-09 18:19:54.674925","last_fullsized":"2021-04-09 18:19:54.674925","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688310","last_change":"2021-04-09 18:19:54.681340","last_active":"2021-04-09 18:19:54.688310","last_peered":"2021-04-09 18:19:54.688310","last_clean":"2021-04-09 18:19:54.688310","last_became_active":"2021-04-09 18:19:54.680877","last_became_peered":"2021-04-09 18:19:54.680877","last_unstale":"2021-04-09 18:19:54.688310","last_undegraded":"2021-04-09 18:19:54.688310","last_fullsized":"2021-04-09 18:19:54.688310","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735473","last_change":"2021-04-09 18:19:51.675129","last_active":"2021-04-09 18:20:03.735473","last_peered":"2021-04-09 18:20:03.735473","last_clean":"2021-04-09 18:20:03.735473","last_became_active":"2021-04-09 18:19:51.674771","last_became_peered":"2021-04-09 18:19:51.674771","last_unstale":"2021-04-09 18:20:03.735473","last_undegraded":"2021-04-09 18:20:03.735473","last_fullsized":"2021-04-09 18:20:03.735473","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672077","last_change":"2021-04-09 18:19:48.660437","last_active":"2021-04-09 18:19:54.672077","last_peered":"2021-04-09 18:19:54.672077","last_clean":"2021-04-09 18:19:54.672077","last_became_active":"2021-04-09 18:19:48.660180","last_became_peered":"2021-04-09 18:19:48.660180","last_unstale":"2021-04-09 18:19:54.672077","last_undegraded":"2021-04-09 18:19:54.672077","last_fullsized":"2021-04-09 18:19:54.672077","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685605","last_change":"2021-04-09 18:19:54.679817","last_active":"2021-04-09 18:19:54.685605","last_peered":"2021-04-09 18:19:54.685605","last_clean":"2021-04-09 18:19:54.685605","last_became_active":"2021-04-09 18:19:54.679420","last_became_peered":"2021-04-09 18:19:54.679420","last_unstale":"2021-04-09 18:19:54.685605","last_undegraded":"2021-04-09 18:19:54.685605","last_fullsized":"2021-04-09 18:19:54.685605","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":83269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":83109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":84229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":84069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]}]}} 2021-04-09T18:20:20.328 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json-pretty 2021-04-09T18:20:20.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.478 7f6720fc0700 1 Processor -- start 2021-04-09T18:20:20.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.478 7f6720fc0700 1 -- start start 2021-04-09T18:20:20.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.479 7f6720fc0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f671c0ff080 0x7f671c0ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.479 7f6720fc0700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671c0ffc90 con 0x7f671c1a9160 2021-04-09T18:20:20.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.479 7f6720fc0700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671c0d2040 con 0x7f671c07e700 2021-04-09T18:20:20.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.479 7f6720fc0700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671c0d80e0 con 0x7f671c0ff080 2021-04-09T18:20:20.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.479 7f671a59c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f671c0ff080 0x7f671c0ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.479 7f671a59c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f671c0ff080 0x7f671c0ff480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53248/0 (socket says 172.21.15.120:53248) 2021-04-09T18:20:20.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.479 7f671b59e700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f671c1a9160 0x7f671c1ab570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48158/0 (socket says 172.21.15.120:48158) 2021-04-09T18:20:20.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.479 7f671a59c700 1 -- 172.21.15.120:0/1988954059 learned_addr learned my addr 172.21.15.120:0/1988954059 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:20.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f671a59c700 1 -- 172.21.15.120:0/1988954059 >> v1:172.21.15.134:6789/0 conn(0x7f671c07e700 legacy=0x7f671c100210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f671a59c700 1 -- 172.21.15.120:0/1988954059 >> v1:172.21.15.120:6789/0 conn(0x7f671c1a9160 legacy=0x7f671c1ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f671a59c700 1 -- 172.21.15.120:0/1988954059 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c07eb00 con 0x7f671c0ff080 2021-04-09T18:20:20.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f6719d9b700 1 -- 172.21.15.120:0/1988954059 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522087660 0 0) 0x7f670c000fe0 con 0x7f671c07e700 2021-04-09T18:20:20.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f671a59c700 1 --2- 172.21.15.120:0/1988954059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0ff080 0x7f671c0ff480 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f6710006700 tx=0x7f6710009b80).ready entity=mon.0 client_cookie=d0a093ae7a02b15 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:20.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f6719d9b700 1 -- 172.21.15.120:0/1988954059 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f671000c0c0 con 0x7f671c0ff080 2021-04-09T18:20:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f6719d9b700 1 -- 172.21.15.120:0/1988954059 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671000c440 con 0x7f671c0ff080 2021-04-09T18:20:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f6719d9b700 1 -- 172.21.15.120:0/1988954059 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f671000c920 con 0x7f671c0ff080 2021-04-09T18:20:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f6720fc0700 1 -- 172.21.15.120:0/1988954059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0ff080 msgr2=0x7f671c0ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.480 7f6720fc0700 1 --2- 172.21.15.120:0/1988954059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0ff080 0x7f671c0ff480 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f6710006700 tx=0x7f6710009b80).stop 2021-04-09T18:20:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.481 7f6720fc0700 1 -- 172.21.15.120:0/1988954059 shutdown_connections 2021-04-09T18:20:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.481 7f6720fc0700 1 --2- 172.21.15.120:0/1988954059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0ff080 0x7f671c0ff480 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.481 7f6720fc0700 1 -- 172.21.15.120:0/1988954059 >> 172.21.15.120:0/1988954059 conn(0x7f671c0f0050 msgr2=0x7f671c0d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:20.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.481 7f6720fc0700 1 -- 172.21.15.120:0/1988954059 shutdown_connections 2021-04-09T18:20:20.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.481 7f6720fc0700 1 -- 172.21.15.120:0/1988954059 wait complete. 2021-04-09T18:20:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.499 7f6720fc0700 1 Processor -- start 2021-04-09T18:20:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.499 7f6720fc0700 1 -- start start 2021-04-09T18:20:20.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f6720fc0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f671c189170 0x7f671c192330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f6720fc0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0b0790 0x7f671c0b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f6720fc0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671c0b11b0 0x7f671c197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f6720fc0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c19a710 con 0x7f671c0b0790 2021-04-09T18:20:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f6720fc0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c192950 con 0x7f671c189170 2021-04-09T18:20:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f6720fc0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c197b80 con 0x7f671c0b11b0 2021-04-09T18:20:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671a59c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0b0790 0x7f671c0b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671a59c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0b0790 0x7f671c0b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53254/0 (socket says 172.21.15.120:53254) 2021-04-09T18:20:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671a59c700 1 -- 172.21.15.120:0/2679488995 learned_addr learned my addr 172.21.15.120:0/2679488995 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:20.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671ad9d700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f671c189170 0x7f671c192330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671b59e700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671c0b11b0 0x7f671c197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671a59c700 1 -- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671c0b11b0 msgr2=0x7f671c197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671a59c700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671c0b11b0 0x7f671c197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671a59c700 1 -- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f671c189170 msgr2=0x7f671c192330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:20.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671a59c700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f671c189170 0x7f671c192330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:20.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671a59c700 1 -- 172.21.15.120:0/2679488995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c197da0 con 0x7f671c0b0790 2021-04-09T18:20:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f671a59c700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0b0790 0x7f671c0b0b90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f671000b580 tx=0x7f671000b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.500 7f670b7fe700 1 -- 172.21.15.120:0/2679488995 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f671000bd10 con 0x7f671c0b0790 2021-04-09T18:20:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.501 7f670b7fe700 1 -- 172.21.15.120:0/2679488995 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710000c90 con 0x7f671c0b0790 2021-04-09T18:20:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.501 7f670b7fe700 1 -- 172.21.15.120:0/2679488995 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6710002220 con 0x7f671c0b0790 2021-04-09T18:20:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.501 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671c197da0 con 0x7f671c0b0790 2021-04-09T18:20:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.501 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671c197da0 con 0x7f671c0b0790 2021-04-09T18:20:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.501 7f670b7fe700 1 -- 172.21.15.120:0/2679488995 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6710009f90 con 0x7f671c0b0790 2021-04-09T18:20:20.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.501 7f670b7fe700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f67000188c0 0x7f670001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:20.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.501 7f670b7fe700 1 -- 172.21.15.120:0/2679488995 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f6710032980 con 0x7f671c0b0790 2021-04-09T18:20:20.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.502 7f671ad9d700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f67000188c0 0x7f670001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:20.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.502 7f671ad9d700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f67000188c0 0x7f670001adc0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:20.600 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.525 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671c17f740 con 0x7f671c0b0790 2021-04-09T18:20:20.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.528 7f670b7fe700 1 -- 172.21.15.120:0/2679488995 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f67100091e0 con 0x7f671c0b0790 2021-04-09T18:20:20.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:20:20.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:20:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.705 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f671c0ccbb0 con 0x7f671c0b0790 2021-04-09T18:20:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.708 7f670b7fe700 1 -- 172.21.15.120:0/2679488995 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+211751 (secure 0 0 0) 0x7f6710009f90 con 0x7f671c0b0790 2021-04-09T18:20:20.709 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:20.710 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2021-04-09T18:20:20.710 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "dcbe2161-e5ca-44be-8661-d46578834d60", 2021-04-09T18:20:20.711 INFO:teuthology.orchestra.run.smithi120.stdout: "health": { 2021-04-09T18:20:20.711 INFO:teuthology.orchestra.run.smithi120.stdout: "checks": {}, 2021-04-09T18:20:20.712 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "HEALTH_OK" 2021-04-09T18:20:20.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.713 INFO:teuthology.orchestra.run.smithi120.stdout: "election_epoch": 4, 2021-04-09T18:20:20.713 INFO:teuthology.orchestra.run.smithi120.stdout: "quorum": [ 2021-04-09T18:20:20.713 INFO:teuthology.orchestra.run.smithi120.stdout: 0, 2021-04-09T18:20:20.714 INFO:teuthology.orchestra.run.smithi120.stdout: 1, 2021-04-09T18:20:20.714 INFO:teuthology.orchestra.run.smithi120.stdout: 2 2021-04-09T18:20:20.715 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:20.715 INFO:teuthology.orchestra.run.smithi120.stdout: "quorum_names": [ 2021-04-09T18:20:20.716 INFO:teuthology.orchestra.run.smithi120.stdout: "a", 2021-04-09T18:20:20.717 INFO:teuthology.orchestra.run.smithi120.stdout: "b", 2021-04-09T18:20:20.717 INFO:teuthology.orchestra.run.smithi120.stdout: "c" 2021-04-09T18:20:20.718 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:20.718 INFO:teuthology.orchestra.run.smithi120.stdout: "quorum_age": 49, 2021-04-09T18:20:20.719 INFO:teuthology.orchestra.run.smithi120.stdout: "monmap": { 2021-04-09T18:20:20.719 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 1, 2021-04-09T18:20:20.720 INFO:teuthology.orchestra.run.smithi120.stdout: "min_mon_release_name": "14", 2021-04-09T18:20:20.720 INFO:teuthology.orchestra.run.smithi120.stdout: "num_mons": 3 2021-04-09T18:20:20.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.721 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap": { 2021-04-09T18:20:20.721 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap": { 2021-04-09T18:20:20.722 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 22, 2021-04-09T18:20:20.722 INFO:teuthology.orchestra.run.smithi120.stdout: "num_osds": 8, 2021-04-09T18:20:20.722 INFO:teuthology.orchestra.run.smithi120.stdout: "num_up_osds": 8, 2021-04-09T18:20:20.723 INFO:teuthology.orchestra.run.smithi120.stdout: "num_in_osds": 8, 2021-04-09T18:20:20.723 INFO:teuthology.orchestra.run.smithi120.stdout: "num_remapped_pgs": 0 2021-04-09T18:20:20.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:20.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.724 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap": { 2021-04-09T18:20:20.725 INFO:teuthology.orchestra.run.smithi120.stdout: "pgs_by_state": [ 2021-04-09T18:20:20.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:20.725 INFO:teuthology.orchestra.run.smithi120.stdout: "state_name": "active+clean", 2021-04-09T18:20:20.726 INFO:teuthology.orchestra.run.smithi120.stdout: "count": 24 2021-04-09T18:20:20.726 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:20.736 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:20.737 INFO:teuthology.orchestra.run.smithi120.stdout: "num_pgs": 24, 2021-04-09T18:20:20.737 INFO:teuthology.orchestra.run.smithi120.stdout: "num_pools": 3, 2021-04-09T18:20:20.738 INFO:teuthology.orchestra.run.smithi120.stdout: "num_objects": 22, 2021-04-09T18:20:20.738 INFO:teuthology.orchestra.run.smithi120.stdout: "data_bytes": 2286, 2021-04-09T18:20:20.738 INFO:teuthology.orchestra.run.smithi120.stdout: "bytes_used": 8591900672, 2021-04-09T18:20:20.739 INFO:teuthology.orchestra.run.smithi120.stdout: "bytes_avail": 764502212608, 2021-04-09T18:20:20.761 INFO:teuthology.orchestra.run.smithi120.stdout: "bytes_total": 773094113280, 2021-04-09T18:20:20.762 INFO:teuthology.orchestra.run.smithi120.stdout: "write_bytes_sec": 0, 2021-04-09T18:20:20.762 INFO:teuthology.orchestra.run.smithi120.stdout: "read_op_per_sec": 0, 2021-04-09T18:20:20.763 INFO:teuthology.orchestra.run.smithi120.stdout: "write_op_per_sec": 0 2021-04-09T18:20:20.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.764 INFO:teuthology.orchestra.run.smithi120.stdout: "fsmap": { 2021-04-09T18:20:20.764 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 7, 2021-04-09T18:20:20.765 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1, 2021-04-09T18:20:20.765 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2021-04-09T18:20:20.765 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2021-04-09T18:20:20.766 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 1, 2021-04-09T18:20:20.766 INFO:teuthology.orchestra.run.smithi120.stdout: "by_rank": [ 2021-04-09T18:20:20.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:20.767 INFO:teuthology.orchestra.run.smithi120.stdout: "filesystem_id": 1, 2021-04-09T18:20:20.768 INFO:teuthology.orchestra.run.smithi120.stdout: "rank": 0, 2021-04-09T18:20:20.768 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "b", 2021-04-09T18:20:20.790 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "up:active", 2021-04-09T18:20:20.791 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 4292 2021-04-09T18:20:20.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:20.792 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:20.792 INFO:teuthology.orchestra.run.smithi120.stdout: "up:standby": 1 2021-04-09T18:20:20.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.793 INFO:teuthology.orchestra.run.smithi120.stdout: "mgrmap": { 2021-04-09T18:20:20.794 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 3, 2021-04-09T18:20:20.794 INFO:teuthology.orchestra.run.smithi120.stdout: "active_gid": 4106, 2021-04-09T18:20:20.794 INFO:teuthology.orchestra.run.smithi120.stdout: "active_name": "x", 2021-04-09T18:20:20.795 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addrs": { 2021-04-09T18:20:20.795 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2021-04-09T18:20:20.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:20.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2021-04-09T18:20:20.796 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.134:6800", 2021-04-09T18:20:20.797 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 23529 2021-04-09T18:20:20.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:20.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2021-04-09T18:20:20.798 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.134:6801", 2021-04-09T18:20:20.799 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 23529 2021-04-09T18:20:20.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:20.799 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2021-04-09T18:20:20.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.801 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addr": "172.21.15.134:6801/23529", 2021-04-09T18:20:20.801 INFO:teuthology.orchestra.run.smithi120.stdout: "active_change": "2021-04-09 18:19:32.736784", 2021-04-09T18:20:20.801 INFO:teuthology.orchestra.run.smithi120.stdout: "available": true, 2021-04-09T18:20:20.802 INFO:teuthology.orchestra.run.smithi120.stdout: "standbys": [ 2021-04-09T18:20:20.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:20.803 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 4104, 2021-04-09T18:20:20.803 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "y", 2021-04-09T18:20:20.803 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2021-04-09T18:20:20.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:20.804 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2021-04-09T18:20:20.805 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:20.805 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:20.805 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:20.806 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:20.806 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:20.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:20.807 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:20.808 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:20.809 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.809 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.809 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.810 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2021-04-09T18:20:20.810 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.812 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.812 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2021-04-09T18:20:20.813 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2021-04-09T18:20:20.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:20.813 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:20.814 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:20.815 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.815 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.816 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.816 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2021-04-09T18:20:20.816 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.817 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.818 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2021-04-09T18:20:20.818 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2021-04-09T18:20:20.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:20.822 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:20.823 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2021-04-09T18:20:20.824 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.824 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.824 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.825 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2021-04-09T18:20:20.825 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.826 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.827 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2021-04-09T18:20:20.827 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2021-04-09T18:20:20.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:20.828 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:20.829 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:20.829 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.830 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.830 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.831 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2021-04-09T18:20:20.842 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.855 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.855 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2021-04-09T18:20:20.856 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2021-04-09T18:20:20.856 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:20.856 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:20.860 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:20.860 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.860 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.861 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.861 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2021-04-09T18:20:20.861 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.862 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.865 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2021-04-09T18:20:20.866 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2021-04-09T18:20:20.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:20.868 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:20.868 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2021-04-09T18:20:20.868 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.869 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.869 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.869 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2021-04-09T18:20:20.869 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.874 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.877 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.878 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2021-04-09T18:20:20.878 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2021-04-09T18:20:20.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:20.889 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:20.898 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:20.900 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.900 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.901 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.901 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2021-04-09T18:20:20.901 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.903 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.904 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2021-04-09T18:20:20.904 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2021-04-09T18:20:20.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:20.905 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:20.906 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:20.906 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.906 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.907 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.907 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2021-04-09T18:20:20.907 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.921 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.922 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2021-04-09T18:20:20.922 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2021-04-09T18:20:20.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:20.933 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:20.934 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:20.934 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.935 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.935 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.941 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2021-04-09T18:20:20.941 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.942 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.943 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:20.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:20.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:20.945 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ansible", 2021-04-09T18:20:20.945 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:20.945 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:20.946 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:20.946 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:20.951 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:20.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:20.953 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:20.954 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:20.954 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.955 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.955 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.956 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:20.956 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.962 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.963 INFO:teuthology.orchestra.run.smithi120.stdout: "server_url": { 2021-04-09T18:20:20.967 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_url", 2021-04-09T18:20:20.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:20.969 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:20.970 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:20.970 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.971 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.971 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.971 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:20.978 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.980 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:20.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:20.980 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:20.983 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:20.984 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:20.989 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:20.990 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:20.990 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:20.990 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:20.991 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:20.991 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:20.992 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:20.992 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:20.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:20.993 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.001 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_server": { 2021-04-09T18:20:21.001 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_server", 2021-04-09T18:20:21.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.002 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.003 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.003 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.008 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.008 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.008 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.009 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.010 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2021-04-09T18:20:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2021-04-09T18:20:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2021-04-09T18:20:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2021-04-09T18:20:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2021-04-09T18:20:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2021-04-09T18:20:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2021-04-09T18:20:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2021-04-09T18:20:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2021-04-09T18:20:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2021-04-09T18:20:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-04-09T18:20:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2021-04-09T18:20:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2021-04-09T18:20:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2021-04-09T18:20:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2021-04-09T18:20:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-04-09T18:20:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2021-04-09T18:20:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2021-04-09T18:20:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2021-04-09T18:20:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-04-09T18:20:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-04-09T18:20:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2021-04-09T18:20:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2021-04-09T18:20:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2021-04-09T18:20:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2021-04-09T18:20:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2021-04-09T18:20:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2021-04-09T18:20:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-04-09T18:20:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2021-04-09T18:20:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2021-04-09T18:20:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2400", 2021-04-09T18:20:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.089 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.090 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.090 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2021-04-09T18:20:21.091 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:21.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.092 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.092 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2021-04-09T18:20:21.093 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2021-04-09T18:20:21.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:21.094 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.095 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2021-04-09T18:20:21.095 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:21.096 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:21.096 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.096 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-04-09T18:20:21.097 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:21.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.098 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.099 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2021-04-09T18:20:21.099 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2021-04-09T18:20:21.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:21.100 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.101 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:21.102 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.102 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.103 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.103 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-04-09T18:20:21.103 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.104 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.104 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.105 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2021-04-09T18:20:21.123 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2021-04-09T18:20:21.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.124 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.125 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "none", 2021-04-09T18:20:21.125 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.126 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.126 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:21.126 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2021-04-09T18:20:21.129 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2021-04-09T18:20:21.129 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap" 2021-04-09T18:20:21.130 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:21.130 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2021-04-09T18:20:21.131 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.131 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.132 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2021-04-09T18:20:21.133 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2021-04-09T18:20:21.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.133 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.134 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.134 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.135 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.135 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.135 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-04-09T18:20:21.136 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.137 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.137 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:21.138 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:21.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:21.138 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.139 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.157 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:21.158 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.158 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.158 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.164 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-04-09T18:20:21.165 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.184 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.184 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2021-04-09T18:20:21.185 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2021-04-09T18:20:21.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:21.186 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.198 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.199 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:21.199 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:21.200 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.200 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.200 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2021-04-09T18:20:21.207 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-04-09T18:20:21.208 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.208 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.209 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_iterations": { 2021-04-09T18:20:21.210 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_iterations", 2021-04-09T18:20:21.210 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:21.210 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.211 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.211 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2021-04-09T18:20:21.212 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.212 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.212 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.213 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimization iterations", 2021-04-09T18:20:21.213 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.214 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.214 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.215 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.216 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.218 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2021-04-09T18:20:21.219 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.219 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.219 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:21.220 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2021-04-09T18:20:21.220 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2021-04-09T18:20:21.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:21.221 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.221 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.221 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2021-04-09T18:20:21.239 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.240 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.240 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.241 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2021-04-09T18:20:21.244 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.244 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.245 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.245 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2021-04-09T18:20:21.246 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2021-04-09T18:20:21.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:21.246 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.247 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2021-04-09T18:20:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2021-04-09T18:20:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2021-04-09T18:20:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2021-04-09T18:20:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2021-04-09T18:20:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.302 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2021-04-09T18:20:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2021-04-09T18:20:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-04-09T18:20:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-04-09T18:20:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2021-04-09T18:20:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2021-04-09T18:20:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.354 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.355 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.355 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.355 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.356 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.356 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.357 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.357 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.357 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.359 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_cephfs": { 2021-04-09T18:20:21.359 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-04-09T18:20:21.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.360 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.361 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.361 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.362 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.362 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_iscsi": { 2021-04-09T18:20:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-04-09T18:20:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_mirroring": { 2021-04-09T18:20:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-04-09T18:20:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rbd": { 2021-04-09T18:20:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-04-09T18:20:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rgw": { 2021-04-09T18:20:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-04-09T18:20:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-04-09T18:20:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-04-09T18:20:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2021-04-09T18:20:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2021-04-09T18:20:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-04-09T18:20:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-04-09T18:20:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2021-04-09T18:20:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2021-04-09T18:20:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2021-04-09T18:20:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2021-04-09T18:20:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-04-09T18:20:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-04-09T18:20:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-04-09T18:20:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-04-09T18:20:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-04-09T18:20:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-04-09T18:20:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2021-04-09T18:20:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2021-04-09T18:20:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2021-04-09T18:20:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-04-09T18:20:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2021-04-09T18:20:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2021-04-09T18:20:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2021-04-09T18:20:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-04-09T18:20:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-04-09T18:20:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_HOST": { 2021-04-09T18:20:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_HOST", 2021-04-09T18:20:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_PORT": { 2021-04-09T18:20:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_PORT", 2021-04-09T18:20:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "80", 2021-04-09T18:20:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SCHEME": { 2021-04-09T18:20:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SCHEME", 2021-04-09T18:20:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "http", 2021-04-09T18:20:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.532 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2021-04-09T18:20:21.533 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2021-04-09T18:20:21.533 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.534 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.534 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.535 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.535 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.536 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.536 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.536 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.537 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.537 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.538 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2021-04-09T18:20:21.538 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2021-04-09T18:20:21.539 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.539 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.539 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.540 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.540 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.541 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.541 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.541 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.542 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.542 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.555 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_USER_ID": { 2021-04-09T18:20:21.555 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_USER_ID", 2021-04-09T18:20:21.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.556 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.557 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.557 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.558 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.558 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.563 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.563 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.564 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.564 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.565 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2021-04-09T18:20:21.566 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2021-04-09T18:20:21.566 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.566 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.574 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.575 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.575 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.576 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.576 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.577 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.577 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.578 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2021-04-09T18:20:21.579 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2021-04-09T18:20:21.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.579 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.580 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.581 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:21.581 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.582 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.582 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.582 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2021-04-09T18:20:21.583 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.584 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.595 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2021-04-09T18:20:21.595 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2021-04-09T18:20:21.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:21.596 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.597 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.597 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2021-04-09T18:20:21.600 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.600 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.601 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.601 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.601 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.602 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.602 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.603 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:21.604 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:21.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.604 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.605 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.606 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.606 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.606 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.607 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.607 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.608 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.609 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:21.609 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:21.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.610 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.611 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.618 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.618 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.619 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.619 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.619 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.622 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.623 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:21.623 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:21.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.624 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.624 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2021-04-09T18:20:21.624 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.625 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.625 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.625 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.625 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.626 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.626 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:21.627 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:21.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:21.627 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.628 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2021-04-09T18:20:21.628 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.628 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.628 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.629 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.629 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.630 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.631 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:21.634 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:21.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.636 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.637 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.637 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.638 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.638 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.639 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.639 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.639 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.640 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.640 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2021-04-09T18:20:21.640 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2021-04-09T18:20:21.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:21.641 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.641 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.641 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2021-04-09T18:20:21.642 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.643 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.644 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.644 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.645 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.645 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.645 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.646 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2021-04-09T18:20:21.646 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2021-04-09T18:20:21.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.646 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.647 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2021-04-09T18:20:21.648 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.648 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.648 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:21.649 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2021-04-09T18:20:21.649 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2021-04-09T18:20:21.650 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:21.650 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.650 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.650 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.651 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2021-04-09T18:20:21.651 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2021-04-09T18:20:21.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:21.652 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.652 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2021-04-09T18:20:21.652 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2021-04-09T18:20:21.655 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2021-04-09T18:20:21.655 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.655 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.655 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.656 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.656 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.656 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2021-04-09T18:20:21.657 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2021-04-09T18:20:21.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.657 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.657 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.657 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.658 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.658 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.658 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.661 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.661 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.661 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.662 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:21.662 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:21.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.662 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.665 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.665 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.666 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.666 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.666 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.666 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.667 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.667 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.668 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "deepsea", 2021-04-09T18:20:21.668 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.669 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.669 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:21.669 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_eauth": { 2021-04-09T18:20:21.669 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_eauth", 2021-04-09T18:20:21.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.670 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.670 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.670 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "sharedsecret", 2021-04-09T18:20:21.670 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.671 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.671 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.671 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.671 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.672 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.672 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_password": { 2021-04-09T18:20:21.672 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_password", 2021-04-09T18:20:21.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.673 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.673 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.674 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.674 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.674 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.675 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.676 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.676 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.677 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_url": { 2021-04-09T18:20:21.677 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_url", 2021-04-09T18:20:21.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.677 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.678 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.678 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.678 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.679 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.679 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.679 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.680 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.680 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_username": { 2021-04-09T18:20:21.680 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_username", 2021-04-09T18:20:21.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.681 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.681 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.681 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.682 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.682 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.682 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.682 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.683 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.683 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.684 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2021-04-09T18:20:21.684 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.684 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.686 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:21.687 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2021-04-09T18:20:21.687 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2021-04-09T18:20:21.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.688 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.689 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.689 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:21.689 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.690 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.690 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.691 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2021-04-09T18:20:21.691 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.692 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.693 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2021-04-09T18:20:21.693 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2021-04-09T18:20:21.694 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:21.694 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.694 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.695 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2021-04-09T18:20:21.696 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.696 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.697 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.697 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-04-09T18:20:21.698 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.699 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.700 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.701 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2021-04-09T18:20:21.701 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2021-04-09T18:20:21.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.702 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.703 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2021-04-09T18:20:21.703 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.704 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.704 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.704 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2021-04-09T18:20:21.705 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.706 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.707 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2021-04-09T18:20:21.708 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2021-04-09T18:20:21.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:21.708 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.709 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.709 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2021-04-09T18:20:21.710 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.710 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.710 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.711 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2021-04-09T18:20:21.711 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.712 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.713 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2021-04-09T18:20:21.713 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2021-04-09T18:20:21.714 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:21.714 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.715 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:21.716 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.716 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.716 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.717 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2021-04-09T18:20:21.717 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.718 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.718 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.719 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2021-04-09T18:20:21.720 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2021-04-09T18:20:21.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:21.720 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.721 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.721 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:21.727 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.728 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.729 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.729 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-04-09T18:20:21.730 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.730 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.730 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.731 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:21.732 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:21.732 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:21.733 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.733 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.734 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:21.734 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.734 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.735 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.735 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2021-04-09T18:20:21.736 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.736 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.736 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.737 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2021-04-09T18:20:21.741 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2021-04-09T18:20:21.741 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:21.742 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.742 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.743 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2021-04-09T18:20:21.743 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.744 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.744 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.744 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-04-09T18:20:21.745 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.746 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cloud", 2021-04-09T18:20:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_cert_context": { 2021-04-09T18:20:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cert_context", 2021-04-09T18:20:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_default_authority": { 2021-04-09T18:20:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_default_authority", 2021-04-09T18:20:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_password": { 2021-04-09T18:20:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_password", 2021-04-09T18:20:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_port": { 2021-04-09T18:20:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_port", 2021-04-09T18:20:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31400", 2021-04-09T18:20:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_retrieve_prediction_interval": { 2021-04-09T18:20:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-04-09T18:20:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_server": { 2021-04-09T18:20:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_server", 2021-04-09T18:20:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_ssl_target_name_override": { 2021-04-09T18:20:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_ssl_target_name_override", 2021-04-09T18:20:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_metrics_interval": { 2021-04-09T18:20:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_metrics_interval", 2021-04-09T18:20:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_smart_interval": { 2021-04-09T18:20:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_smart_interval", 2021-04-09T18:20:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_user": { 2021-04-09T18:20:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_user", 2021-04-09T18:20:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2021-04-09T18:20:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2021-04-09T18:20:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2021-04-09T18:20:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2021-04-09T18:20:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2021-04-09T18:20:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2021-04-09T18:20:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2021-04-09T18:20:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2021-04-09T18:20:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2021-04-09T18:20:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2021-04-09T18:20:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2021-04-09T18:20:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2021-04-09T18:20:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2021-04-09T18:20:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2021-04-09T18:20:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2021-04-09T18:20:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2021-04-09T18:20:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2021-04-09T18:20:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2021-04-09T18:20:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2021-04-09T18:20:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2021-04-09T18:20:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2021-04-09T18:20:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2021-04-09T18:20:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2021-04-09T18:20:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2021-04-09T18:20:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2021-04-09T18:20:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.980 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.980 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:21.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.982 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2021-04-09T18:20:21.982 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.982 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.983 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:21.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:21.985 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2021-04-09T18:20:21.985 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:21.985 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:21.986 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:21.986 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2021-04-09T18:20:21.987 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2021-04-09T18:20:21.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:21.988 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.989 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2021-04-09T18:20:21.990 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.991 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.991 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:21.992 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2021-04-09T18:20:21.992 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:21.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:21.993 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:21.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:21.994 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2021-04-09T18:20:21.994 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2021-04-09T18:20:21.994 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:21.995 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:21.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:21.996 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:21.997 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:21.997 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:21.998 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.005 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2021-04-09T18:20:22.005 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.006 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.007 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2021-04-09T18:20:22.008 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2021-04-09T18:20:22.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.008 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.009 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2021-04-09T18:20:22.009 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.010 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.010 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.011 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2021-04-09T18:20:22.011 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.011 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.012 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.013 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2021-04-09T18:20:22.014 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2021-04-09T18:20:22.030 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.031 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.032 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2021-04-09T18:20:22.032 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.033 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.033 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.041 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2021-04-09T18:20:22.041 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.042 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.042 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.042 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2021-04-09T18:20:22.043 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2021-04-09T18:20:22.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.043 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.043 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.044 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.044 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.045 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.045 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2021-04-09T18:20:22.045 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.045 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.046 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2021-04-09T18:20:22.046 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2021-04-09T18:20:22.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.047 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.047 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2021-04-09T18:20:22.047 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.047 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.048 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.048 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2021-04-09T18:20:22.048 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.048 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.049 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.050 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator_cli", 2021-04-09T18:20:22.050 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.050 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.050 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.050 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2021-04-09T18:20:22.051 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2021-04-09T18:20:22.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.056 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.057 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.057 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.058 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.058 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.058 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.059 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.059 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.060 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.062 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2021-04-09T18:20:22.063 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.063 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.063 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.064 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:22.064 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:22.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.065 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.069 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.069 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:22.069 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.070 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.070 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.070 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.071 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.073 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.076 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2021-04-09T18:20:22.077 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.077 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.078 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.079 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:22.079 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:22.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.080 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.080 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.081 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.081 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.081 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.082 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.083 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.083 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.084 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.085 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2021-04-09T18:20:22.085 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2021-04-09T18:20:22.086 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.086 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.088 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2021-04-09T18:20:22.088 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.089 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.090 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.090 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2021-04-09T18:20:22.090 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.091 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.092 INFO:teuthology.orchestra.run.smithi120.stdout: "persist_interval": { 2021-04-09T18:20:22.092 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "persist_interval", 2021-04-09T18:20:22.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:22.094 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.095 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:22.095 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.095 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.096 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.096 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to persist completed events", 2021-04-09T18:20:22.097 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.098 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.101 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2021-04-09T18:20:22.101 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.102 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.102 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.102 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2021-04-09T18:20:22.103 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2021-04-09T18:20:22.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.104 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.105 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.105 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.106 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.106 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.107 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.107 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.109 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.109 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2021-04-09T18:20:22.112 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-04-09T18:20:22.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.112 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.113 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2021-04-09T18:20:22.114 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.114 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.115 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.115 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.116 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.116 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.117 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2021-04-09T18:20:22.118 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2021-04-09T18:20:22.118 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.119 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.120 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.121 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.122 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.122 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.123 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.123 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.124 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.128 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:22.128 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:22.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.130 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.131 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.136 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.136 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.137 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.137 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.138 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.139 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.142 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.143 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:22.144 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:22.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.145 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.145 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.145 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.151 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.151 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.152 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.152 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.153 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.154 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.154 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.155 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2021-04-09T18:20:22.155 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2021-04-09T18:20:22.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.156 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2021-04-09T18:20:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2021-04-09T18:20:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2021-04-09T18:20:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2021-04-09T18:20:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2021-04-09T18:20:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2021-04-09T18:20:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.296 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2021-04-09T18:20:22.296 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2021-04-09T18:20:22.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.297 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.308 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2021-04-09T18:20:22.308 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.315 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.316 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.316 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.317 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.317 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.317 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.318 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2021-04-09T18:20:22.319 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2021-04-09T18:20:22.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.320 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.321 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.322 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2021-04-09T18:20:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2021-04-09T18:20:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2021-04-09T18:20:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2021-04-09T18:20:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2021-04-09T18:20:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2021-04-09T18:20:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2021-04-09T18:20:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2021-04-09T18:20:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2021-04-09T18:20:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2021-04-09T18:20:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2021-04-09T18:20:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2021-04-09T18:20:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2021-04-09T18:20:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2021-04-09T18:20:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2021-04-09T18:20:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2021-04-09T18:20:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh", 2021-04-09T18:20:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_cache_timeout_min": { 2021-04-09T18:20:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_cache_timeout_min", 2021-04-09T18:20:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2021-04-09T18:20:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2021-04-09T18:20:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2021-04-09T18:20:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2021-04-09T18:20:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2021-04-09T18:20:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2021-04-09T18:20:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-04-09T18:20:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2021-04-09T18:20:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2021-04-09T18:20:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2021-04-09T18:20:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2021-04-09T18:20:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2021-04-09T18:20:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2021-04-09T18:20:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2021-04-09T18:20:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2021-04-09T18:20:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2021-04-09T18:20:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2021-04-09T18:20:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2021-04-09T18:20:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2021-04-09T18:20:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2021-04-09T18:20:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.536 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2021-04-09T18:20:22.536 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2021-04-09T18:20:22.536 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.537 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.537 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.537 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:22.537 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.538 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.538 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.538 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.538 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.539 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.539 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2021-04-09T18:20:22.539 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2021-04-09T18:20:22.540 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.540 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.552 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-04-09T18:20:22.552 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.552 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.552 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.552 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.553 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.553 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.553 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.554 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:22.554 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:22.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.554 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.555 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:22.555 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.555 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.555 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.556 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.556 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2021-04-09T18:20:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2021-04-09T18:20:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2021-04-09T18:20:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2021-04-09T18:20:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2021-04-09T18:20:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2021-04-09T18:20:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2021-04-09T18:20:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2021-04-09T18:20:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2021-04-09T18:20:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2021-04-09T18:20:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2021-04-09T18:20:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.616 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.616 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.616 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.616 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2021-04-09T18:20:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2021-04-09T18:20:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-04-09T18:20:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2021-04-09T18:20:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2021-04-09T18:20:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.638 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2021-04-09T18:20:22.638 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2021-04-09T18:20:22.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.639 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.640 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2021-04-09T18:20:22.641 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.641 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.642 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.642 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2021-04-09T18:20:22.642 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.643 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.645 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2021-04-09T18:20:22.646 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.646 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.647 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.647 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2021-04-09T18:20:22.647 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2021-04-09T18:20:22.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.660 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.661 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.661 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.661 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.662 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.663 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.663 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.664 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.665 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:22.665 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:22.665 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:22.666 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.666 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.667 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:22.667 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.668 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.668 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.668 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.669 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.681 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.682 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2021-04-09T18:20:22.683 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2021-04-09T18:20:22.683 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.684 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.684 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.685 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:22.685 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.685 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.686 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.686 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.686 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.687 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.688 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2021-04-09T18:20:22.688 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2021-04-09T18:20:22.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.689 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.689 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.689 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2021-04-09T18:20:22.689 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.690 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.690 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.690 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.690 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.702 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.702 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2021-04-09T18:20:22.702 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2021-04-09T18:20:22.703 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.703 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.703 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.703 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-04-09T18:20:22.704 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.704 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.704 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.705 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.705 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.705 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.706 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2021-04-09T18:20:22.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.707 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:22.707 INFO:teuthology.orchestra.run.smithi120.stdout: "modules": [ 2021-04-09T18:20:22.707 INFO:teuthology.orchestra.run.smithi120.stdout: "iostat", 2021-04-09T18:20:22.707 INFO:teuthology.orchestra.run.smithi120.stdout: "restful" 2021-04-09T18:20:22.707 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:22.708 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2021-04-09T18:20:22.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.708 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2021-04-09T18:20:22.708 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.709 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.709 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.709 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:22.709 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:22.709 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:22.710 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.710 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.711 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:22.711 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.723 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.723 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.724 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2021-04-09T18:20:22.725 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.726 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.727 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2021-04-09T18:20:22.727 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2021-04-09T18:20:22.728 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.728 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.728 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.729 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.729 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.730 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.730 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.730 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2021-04-09T18:20:22.731 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.731 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.732 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.733 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2021-04-09T18:20:22.745 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2021-04-09T18:20:22.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.745 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.746 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2021-04-09T18:20:22.748 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.748 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.749 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.749 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2021-04-09T18:20:22.750 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.750 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.751 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.752 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2021-04-09T18:20:22.753 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2021-04-09T18:20:22.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.754 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.766 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.767 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.767 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.768 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.769 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.770 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2021-04-09T18:20:22.770 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.771 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.771 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.772 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2021-04-09T18:20:22.772 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2021-04-09T18:20:22.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.773 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.773 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.773 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.774 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.774 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.774 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.775 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2021-04-09T18:20:22.775 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.797 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.798 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2021-04-09T18:20:22.798 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2021-04-09T18:20:22.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.799 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.799 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.799 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2021-04-09T18:20:22.800 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.808 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.808 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.809 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2021-04-09T18:20:22.809 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.809 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.810 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2021-04-09T18:20:22.810 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2021-04-09T18:20:22.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.811 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.812 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.812 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.812 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.813 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.813 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2021-04-09T18:20:22.813 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.813 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.814 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.814 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2021-04-09T18:20:22.814 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2021-04-09T18:20:22.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.815 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.815 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.816 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.816 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.816 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.816 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2021-04-09T18:20:22.817 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.817 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.817 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2021-04-09T18:20:22.818 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2021-04-09T18:20:22.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.819 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.819 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.819 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.819 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.820 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.820 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.820 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2021-04-09T18:20:22.820 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.821 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.823 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ansible", 2021-04-09T18:20:22.823 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.823 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.823 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.823 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:22.824 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:22.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.824 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.825 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.825 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.826 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.826 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.826 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.826 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.827 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.827 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.827 INFO:teuthology.orchestra.run.smithi120.stdout: "server_url": { 2021-04-09T18:20:22.828 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_url", 2021-04-09T18:20:22.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.828 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.829 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.829 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.829 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.830 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.830 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.830 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.830 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.831 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.831 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:22.834 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:22.835 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.835 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.835 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.836 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.836 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.836 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.836 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.837 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.837 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.838 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_server": { 2021-04-09T18:20:22.838 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_server", 2021-04-09T18:20:22.838 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.838 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.839 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.839 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.839 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.839 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.840 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.840 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.840 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.840 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.841 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.842 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2021-04-09T18:20:22.842 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.843 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.843 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.843 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2021-04-09T18:20:22.843 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2021-04-09T18:20:22.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.844 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.847 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:22.847 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.847 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.848 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.848 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2021-04-09T18:20:22.848 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.849 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.849 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2021-04-09T18:20:22.849 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2021-04-09T18:20:22.849 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.850 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.850 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2021-04-09T18:20:22.851 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.851 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.851 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.851 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2021-04-09T18:20:22.852 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:22.852 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.852 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.853 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2021-04-09T18:20:22.853 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2021-04-09T18:20:22.853 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:22.854 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.854 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:22.854 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:22.855 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:22.855 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.855 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-04-09T18:20:22.855 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:22.856 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.856 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.856 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2021-04-09T18:20:22.857 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2021-04-09T18:20:22.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:22.858 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.858 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.858 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2021-04-09T18:20:22.858 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:22.859 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2021-04-09T18:20:22.859 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.859 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-04-09T18:20:22.860 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.860 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.860 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.861 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2021-04-09T18:20:22.861 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2021-04-09T18:20:22.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.861 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.862 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.862 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2021-04-09T18:20:22.862 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.862 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.863 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.864 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-04-09T18:20:22.864 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-04-09T18:20:22.864 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.864 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.865 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2021-04-09T18:20:22.865 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2021-04-09T18:20:22.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:22.866 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.866 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2021-04-09T18:20:22.866 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2021-04-09T18:20:22.867 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2021-04-09T18:20:22.867 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.867 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2021-04-09T18:20:22.868 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-04-09T18:20:22.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.868 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.869 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2021-04-09T18:20:22.869 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2021-04-09T18:20:22.869 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.869 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.870 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2400", 2021-04-09T18:20:22.870 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.870 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.870 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.871 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2021-04-09T18:20:22.871 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:22.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.872 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.872 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2021-04-09T18:20:22.872 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2021-04-09T18:20:22.873 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:22.873 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.873 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.874 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2021-04-09T18:20:22.874 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:22.874 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:22.875 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.875 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-04-09T18:20:22.875 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:22.875 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.876 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.876 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2021-04-09T18:20:22.876 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2021-04-09T18:20:22.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:22.877 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.877 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:22.877 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.878 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.878 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.879 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-04-09T18:20:22.879 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.879 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.879 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.880 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2021-04-09T18:20:22.880 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2021-04-09T18:20:22.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.880 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.881 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "none", 2021-04-09T18:20:22.881 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.881 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.882 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:22.882 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2021-04-09T18:20:22.882 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2021-04-09T18:20:22.882 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap" 2021-04-09T18:20:22.883 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:22.883 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2021-04-09T18:20:22.883 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.883 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.885 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2021-04-09T18:20:22.885 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2021-04-09T18:20:22.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.885 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.886 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.886 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.886 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.886 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.887 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-04-09T18:20:22.887 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.887 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.888 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:22.889 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:22.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:22.889 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.889 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:22.890 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.890 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.890 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.891 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-04-09T18:20:22.891 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.891 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.892 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2021-04-09T18:20:22.892 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2021-04-09T18:20:22.892 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:22.892 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.893 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:22.893 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:22.893 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.893 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.894 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2021-04-09T18:20:22.894 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-04-09T18:20:22.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.895 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.895 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_iterations": { 2021-04-09T18:20:22.895 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_iterations", 2021-04-09T18:20:22.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:22.896 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.896 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2021-04-09T18:20:22.897 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.897 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.897 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.897 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimization iterations", 2021-04-09T18:20:22.897 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.898 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.900 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2021-04-09T18:20:22.900 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.900 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.900 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.900 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2021-04-09T18:20:22.901 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2021-04-09T18:20:22.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:22.901 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.902 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2021-04-09T18:20:22.902 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.902 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.902 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.902 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2021-04-09T18:20:22.903 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.903 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.903 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.904 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2021-04-09T18:20:22.904 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2021-04-09T18:20:22.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:22.904 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:22.906 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2021-04-09T18:20:22.906 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.906 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.906 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.907 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2021-04-09T18:20:22.907 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.907 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:22.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:22.908 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2021-04-09T18:20:22.909 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:22.909 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:22.910 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:22.911 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2021-04-09T18:20:22.911 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2021-04-09T18:20:22.911 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.911 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.911 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.912 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.912 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.912 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.912 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.913 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.913 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.913 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.914 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2021-04-09T18:20:22.914 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2021-04-09T18:20:22.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.915 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.916 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:22.916 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.917 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.917 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.917 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.917 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.918 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.918 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-04-09T18:20:22.919 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-04-09T18:20:22.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.919 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.920 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.920 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.921 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.921 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.921 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.921 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.922 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.922 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2021-04-09T18:20:22.922 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2021-04-09T18:20:22.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.923 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.923 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.924 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.924 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.924 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.924 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.925 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.925 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.926 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_cephfs": { 2021-04-09T18:20:22.927 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-04-09T18:20:22.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.927 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.928 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.928 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.928 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.928 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.929 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.929 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.929 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.930 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_iscsi": { 2021-04-09T18:20:22.930 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-04-09T18:20:22.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.931 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.931 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.932 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.932 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.932 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.932 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.932 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.933 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.933 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_mirroring": { 2021-04-09T18:20:22.933 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-04-09T18:20:22.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.934 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.934 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.934 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.935 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.935 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.935 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.935 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.936 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.937 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rbd": { 2021-04-09T18:20:22.937 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-04-09T18:20:22.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.937 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.938 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.938 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.938 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.938 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.939 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.939 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.939 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.940 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rgw": { 2021-04-09T18:20:22.940 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-04-09T18:20:22.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.941 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.941 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.942 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.942 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.942 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.942 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.943 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.943 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.944 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-04-09T18:20:22.944 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-04-09T18:20:22.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.944 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.945 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.945 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.945 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.945 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.946 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.946 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.946 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2021-04-09T18:20:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2021-04-09T18:20:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-04-09T18:20:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-04-09T18:20:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2021-04-09T18:20:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2021-04-09T18:20:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2021-04-09T18:20:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2021-04-09T18:20:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-04-09T18:20:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-04-09T18:20:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-04-09T18:20:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-04-09T18:20:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-04-09T18:20:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-04-09T18:20:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2021-04-09T18:20:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2021-04-09T18:20:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2021-04-09T18:20:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-04-09T18:20:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2021-04-09T18:20:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2021-04-09T18:20:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2021-04-09T18:20:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-04-09T18:20:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-04-09T18:20:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_HOST": { 2021-04-09T18:20:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_HOST", 2021-04-09T18:20:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_PORT": { 2021-04-09T18:20:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_PORT", 2021-04-09T18:20:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "80", 2021-04-09T18:20:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SCHEME": { 2021-04-09T18:20:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SCHEME", 2021-04-09T18:20:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "http", 2021-04-09T18:20:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2021-04-09T18:20:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2021-04-09T18:20:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2021-04-09T18:20:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2021-04-09T18:20:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_USER_ID": { 2021-04-09T18:20:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_USER_ID", 2021-04-09T18:20:23.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.106 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.107 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.108 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.108 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.108 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.109 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.109 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.110 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.111 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2021-04-09T18:20:23.123 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2021-04-09T18:20:23.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.124 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.124 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.125 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.125 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.125 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.126 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.127 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.127 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.127 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.128 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2021-04-09T18:20:23.129 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2021-04-09T18:20:23.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:23.129 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.130 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:23.131 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.131 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.131 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.132 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2021-04-09T18:20:23.132 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.144 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.145 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2021-04-09T18:20:23.145 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2021-04-09T18:20:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2021-04-09T18:20:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2021-04-09T18:20:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2021-04-09T18:20:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2021-04-09T18:20:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2021-04-09T18:20:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2021-04-09T18:20:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2021-04-09T18:20:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2021-04-09T18:20:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2021-04-09T18:20:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2021-04-09T18:20:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2021-04-09T18:20:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2021-04-09T18:20:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2021-04-09T18:20:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2021-04-09T18:20:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2021-04-09T18:20:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2021-04-09T18:20:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2021-04-09T18:20:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2021-04-09T18:20:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.201 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.201 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.201 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.201 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.202 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.202 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.202 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.202 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.203 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.203 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:23.204 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:23.204 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.204 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.204 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.204 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.205 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.205 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.205 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.205 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.206 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.206 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.207 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "deepsea", 2021-04-09T18:20:23.208 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.209 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.210 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.210 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_eauth": { 2021-04-09T18:20:23.211 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_eauth", 2021-04-09T18:20:23.211 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.211 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.211 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.211 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "sharedsecret", 2021-04-09T18:20:23.212 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.212 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.212 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.212 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.213 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.213 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.214 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_password": { 2021-04-09T18:20:23.214 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_password", 2021-04-09T18:20:23.214 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.214 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.214 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.215 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.215 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.215 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.215 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.216 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.216 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.216 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.216 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.217 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_url": { 2021-04-09T18:20:23.217 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_url", 2021-04-09T18:20:23.217 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.217 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.218 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.218 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.219 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.219 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.219 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.219 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.220 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.221 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_username": { 2021-04-09T18:20:23.221 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_username", 2021-04-09T18:20:23.221 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.222 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.222 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.222 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.222 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.223 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.223 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.223 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.223 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.223 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.224 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.225 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2021-04-09T18:20:23.225 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.225 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.225 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.226 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2021-04-09T18:20:23.226 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2021-04-09T18:20:23.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:23.226 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.227 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:23.227 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.227 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.228 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.228 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2021-04-09T18:20:23.228 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.229 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.230 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2021-04-09T18:20:23.230 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2021-04-09T18:20:23.230 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:23.230 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.231 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.231 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2021-04-09T18:20:23.232 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.232 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.232 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.232 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-04-09T18:20:23.233 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.233 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.233 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.233 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2021-04-09T18:20:23.234 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2021-04-09T18:20:23.234 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.234 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.234 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.235 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2021-04-09T18:20:23.235 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.235 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.235 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.236 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2021-04-09T18:20:23.236 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.236 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.236 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.237 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2021-04-09T18:20:23.237 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2021-04-09T18:20:23.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:23.237 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.238 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.238 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2021-04-09T18:20:23.238 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.238 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.239 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.239 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2021-04-09T18:20:23.250 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.251 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.251 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2021-04-09T18:20:23.251 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2021-04-09T18:20:23.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:23.252 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.253 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:23.253 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.253 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.253 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.254 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2021-04-09T18:20:23.254 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.254 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.255 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2021-04-09T18:20:23.255 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2021-04-09T18:20:23.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:23.255 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.256 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:23.256 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.256 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.257 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.257 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-04-09T18:20:23.257 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.258 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.258 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:23.258 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:23.259 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:23.259 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.259 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.259 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:23.260 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.260 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.271 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.271 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2021-04-09T18:20:23.272 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.272 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.273 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2021-04-09T18:20:23.273 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2021-04-09T18:20:23.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:23.274 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.274 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2021-04-09T18:20:23.275 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.275 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.275 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.275 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-04-09T18:20:23.276 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.276 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.277 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cloud", 2021-04-09T18:20:23.277 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.278 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.278 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.278 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_cert_context": { 2021-04-09T18:20:23.279 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cert_context", 2021-04-09T18:20:23.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.279 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.280 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.280 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.280 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.281 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.303 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.303 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.305 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.305 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_default_authority": { 2021-04-09T18:20:23.306 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_default_authority", 2021-04-09T18:20:23.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.306 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.309 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:23.309 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.310 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.311 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.311 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.312 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.312 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.326 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_password": { 2021-04-09T18:20:23.327 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_password", 2021-04-09T18:20:23.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.327 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.335 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.336 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.337 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.337 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.337 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.338 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.338 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.339 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.339 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_port": { 2021-04-09T18:20:23.340 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_port", 2021-04-09T18:20:23.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.341 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.341 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31400", 2021-04-09T18:20:23.342 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.342 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.343 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.357 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.358 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.359 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.359 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_retrieve_prediction_interval": { 2021-04-09T18:20:23.360 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-04-09T18:20:23.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.360 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.361 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:23.361 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.362 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.368 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.369 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.369 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.370 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.370 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_server": { 2021-04-09T18:20:23.371 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_server", 2021-04-09T18:20:23.383 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.385 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.386 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.386 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.386 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.387 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.387 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.387 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.388 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.388 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.388 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.389 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_ssl_target_name_override": { 2021-04-09T18:20:23.389 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_ssl_target_name_override", 2021-04-09T18:20:23.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.416 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.416 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:23.417 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.417 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.417 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.418 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.418 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.419 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.420 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_metrics_interval": { 2021-04-09T18:20:23.420 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_metrics_interval", 2021-04-09T18:20:23.420 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.421 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.421 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.421 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:23.422 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.422 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.422 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.423 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.423 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.424 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.424 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_smart_interval": { 2021-04-09T18:20:23.447 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_smart_interval", 2021-04-09T18:20:23.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.448 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.449 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:23.449 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.450 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.450 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.450 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.451 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.451 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.463 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_user": { 2021-04-09T18:20:23.464 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_user", 2021-04-09T18:20:23.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.464 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.465 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.465 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.466 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.466 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.466 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.467 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.467 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.493 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.493 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.504 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:23.504 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:23.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.505 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.505 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:23.506 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.506 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.507 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.507 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.507 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.508 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.510 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2021-04-09T18:20:23.510 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.527 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.528 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.528 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2021-04-09T18:20:23.528 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2021-04-09T18:20:23.529 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.529 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.530 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:23.531 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.531 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.532 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.532 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.532 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.533 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.533 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.543 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:23.543 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:23.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.544 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.547 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:23.547 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.548 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.548 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.548 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.549 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.550 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.552 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2021-04-09T18:20:23.552 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2021-04-09T18:20:23.553 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2021-04-09T18:20:23.553 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.553 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2021-04-09T18:20:23.554 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2021-04-09T18:20:23.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.554 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.561 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.562 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2021-04-09T18:20:23.562 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.562 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.563 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.564 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.564 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.564 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.565 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.566 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2021-04-09T18:20:23.566 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2021-04-09T18:20:23.566 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.567 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.568 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2021-04-09T18:20:23.568 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.569 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.570 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.571 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.571 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.571 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.572 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.573 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2021-04-09T18:20:23.573 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2021-04-09T18:20:23.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.574 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.575 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:23.575 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.576 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.576 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.576 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.577 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.577 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.578 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:23.578 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:23.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.579 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.582 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.582 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2021-04-09T18:20:23.582 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.583 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.583 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.584 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.584 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.584 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.585 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.586 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:23.586 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:23.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.587 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.588 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:23.588 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.588 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.589 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.589 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.590 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.592 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.593 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2021-04-09T18:20:23.593 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2021-04-09T18:20:23.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.594 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.595 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2021-04-09T18:20:23.595 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.596 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.596 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.596 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2021-04-09T18:20:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2021-04-09T18:20:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2021-04-09T18:20:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2021-04-09T18:20:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2021-04-09T18:20:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2021-04-09T18:20:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2021-04-09T18:20:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2021-04-09T18:20:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2021-04-09T18:20:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2021-04-09T18:20:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2021-04-09T18:20:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2021-04-09T18:20:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2021-04-09T18:20:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2021-04-09T18:20:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2021-04-09T18:20:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2021-04-09T18:20:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2021-04-09T18:20:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2021-04-09T18:20:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2021-04-09T18:20:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2021-04-09T18:20:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2021-04-09T18:20:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2021-04-09T18:20:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2021-04-09T18:20:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2021-04-09T18:20:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2021-04-09T18:20:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2021-04-09T18:20:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2021-04-09T18:20:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2021-04-09T18:20:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2021-04-09T18:20:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2021-04-09T18:20:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2021-04-09T18:20:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator_cli", 2021-04-09T18:20:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2021-04-09T18:20:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2021-04-09T18:20:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2021-04-09T18:20:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2021-04-09T18:20:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.800 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:23.802 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.803 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.803 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.803 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.804 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.804 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.804 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.816 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2021-04-09T18:20:23.817 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2021-04-09T18:20:23.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.818 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.818 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2021-04-09T18:20:23.819 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.819 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.820 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.820 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2021-04-09T18:20:23.821 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.821 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.822 INFO:teuthology.orchestra.run.smithi120.stdout: "persist_interval": { 2021-04-09T18:20:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "persist_interval", 2021-04-09T18:20:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.826 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to persist completed events", 2021-04-09T18:20:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2021-04-09T18:20:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2021-04-09T18:20:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2021-04-09T18:20:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.838 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.839 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2021-04-09T18:20:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-04-09T18:20:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2021-04-09T18:20:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.843 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.843 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.844 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2021-04-09T18:20:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2021-04-09T18:20:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.856 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.856 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:23.858 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:23.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.860 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.861 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.861 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.862 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.862 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.863 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.863 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.864 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.864 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.865 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2021-04-09T18:20:23.865 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2021-04-09T18:20:23.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.866 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.867 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.867 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.868 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.868 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.869 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.870 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.871 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.873 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2021-04-09T18:20:23.874 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.874 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.874 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:23.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.876 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2021-04-09T18:20:23.876 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.876 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.877 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.877 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:23.877 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:23.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.878 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.879 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.879 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.881 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.881 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.882 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.882 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.883 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.883 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.883 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:23.884 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:23.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.884 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.885 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.885 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.885 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.885 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.886 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.886 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.886 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.887 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:23.887 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:23.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.887 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.888 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.888 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.888 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.888 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.889 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.889 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.889 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.892 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2021-04-09T18:20:23.892 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.892 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.892 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:23.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.893 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2021-04-09T18:20:23.893 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.894 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.894 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.894 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2021-04-09T18:20:23.894 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2021-04-09T18:20:23.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.895 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.895 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.895 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.896 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.896 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.896 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.896 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.897 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.897 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2021-04-09T18:20:23.898 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2021-04-09T18:20:23.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.898 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.899 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2021-04-09T18:20:23.899 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.899 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.899 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.899 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.900 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.900 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.902 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2021-04-09T18:20:23.902 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2021-04-09T18:20:23.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.903 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.903 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.903 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.904 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.904 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.904 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.904 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.905 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.905 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2021-04-09T18:20:23.905 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2021-04-09T18:20:23.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:23.906 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.906 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.906 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.907 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.907 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.907 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.907 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.907 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.908 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.908 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.908 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2021-04-09T18:20:23.908 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2021-04-09T18:20:23.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:23.909 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.909 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.910 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.910 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.910 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.910 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.910 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.911 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.911 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2021-04-09T18:20:23.914 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2021-04-09T18:20:23.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.915 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.915 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.916 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.916 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.916 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.916 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.916 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.917 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.917 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2021-04-09T18:20:23.918 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2021-04-09T18:20:23.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:23.918 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.918 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.919 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.919 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.919 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.919 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.920 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.920 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.921 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2021-04-09T18:20:23.921 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2021-04-09T18:20:23.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:23.921 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.921 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.922 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:23.922 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.923 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.923 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.923 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.923 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.924 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.943 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2021-04-09T18:20:23.943 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2021-04-09T18:20:23.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.944 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.944 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.945 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.945 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.945 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.945 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.946 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.946 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.947 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2021-04-09T18:20:23.947 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2021-04-09T18:20:23.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.947 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.948 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.948 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.948 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.948 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.949 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.949 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.949 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.950 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2021-04-09T18:20:23.950 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2021-04-09T18:20:23.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.950 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.951 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.951 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.951 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.952 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.952 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.959 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.960 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.961 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh", 2021-04-09T18:20:23.961 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.961 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.962 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.962 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_cache_timeout_min": { 2021-04-09T18:20:23.962 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_cache_timeout_min", 2021-04-09T18:20:23.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.963 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.963 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.965 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.966 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.966 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.966 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.967 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.967 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.968 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2021-04-09T18:20:23.968 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2021-04-09T18:20:23.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.969 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.971 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:23.971 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.971 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.972 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.972 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.972 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.973 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.976 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2021-04-09T18:20:23.977 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.977 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.977 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:23.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.978 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2021-04-09T18:20:23.979 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.979 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:23.980 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:23.980 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2021-04-09T18:20:23.980 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2021-04-09T18:20:23.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:23.981 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.982 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-04-09T18:20:23.982 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.983 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.983 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.983 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.984 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.984 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.986 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.987 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:23.987 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:23.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:23.988 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:23.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:23.989 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2021-04-09T18:20:23.990 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:23.990 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:23.990 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:23.991 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:23.991 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:23.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:23.992 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:23.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:23.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:23.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:23.994 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2021-04-09T18:20:23.995 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:23.995 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:24.001 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:24.001 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2021-04-09T18:20:24.002 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2021-04-09T18:20:24.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:24.003 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.005 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:24.006 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.006 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.006 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.007 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2021-04-09T18:20:24.007 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.008 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.032 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2021-04-09T18:20:24.033 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2021-04-09T18:20:24.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:24.033 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.034 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:24.035 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.035 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.036 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.036 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.048 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.048 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.049 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.049 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2021-04-09T18:20:24.049 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2021-04-09T18:20:24.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:24.050 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.050 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:24.050 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.051 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.051 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.051 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.051 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.052 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.052 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2021-04-09T18:20:24.052 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2021-04-09T18:20:24.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:24.053 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.053 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:24.053 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.054 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.054 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.054 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.054 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.055 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.055 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2021-04-09T18:20:24.055 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2021-04-09T18:20:24.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:24.056 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.056 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:24.056 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.057 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.057 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2021-04-09T18:20:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2021-04-09T18:20:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2021-04-09T18:20:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2021-04-09T18:20:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-04-09T18:20:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2021-04-09T18:20:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2021-04-09T18:20:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2021-04-09T18:20:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2021-04-09T18:20:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2021-04-09T18:20:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2021-04-09T18:20:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2021-04-09T18:20:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2021-04-09T18:20:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2021-04-09T18:20:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2021-04-09T18:20:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2021-04-09T18:20:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2021-04-09T18:20:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2021-04-09T18:20:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-04-09T18:20:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2021-04-09T18:20:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2021-04-09T18:20:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2021-04-09T18:20:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2021-04-09T18:20:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2021-04-09T18:20:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2021-04-09T18:20:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2021-04-09T18:20:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:24.225 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:24.225 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:24.226 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2021-04-09T18:20:24.226 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2021-04-09T18:20:24.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:24.227 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.228 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.229 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:24.229 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.229 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.230 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.230 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.230 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.231 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.231 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.233 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:24.234 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:24.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:24.236 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.236 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.237 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:24.237 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.238 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.238 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.240 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.241 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.241 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.244 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.245 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2021-04-09T18:20:24.245 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2021-04-09T18:20:24.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:24.246 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.247 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:24.248 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.248 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.249 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.249 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.249 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.251 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.252 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2021-04-09T18:20:24.252 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2021-04-09T18:20:24.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:24.272 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.273 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2021-04-09T18:20:24.276 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.277 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.281 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.283 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.284 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.285 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.294 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2021-04-09T18:20:24.294 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2021-04-09T18:20:24.298 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:24.298 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:24.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:24.299 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-04-09T18:20:24.299 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:24.300 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:24.300 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:24.300 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:24.312 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:24.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:24.312 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:24.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:24.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:24.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:24.319 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:24.320 INFO:teuthology.orchestra.run.smithi120.stdout: "services": {}, 2021-04-09T18:20:24.321 INFO:teuthology.orchestra.run.smithi120.stdout: "always_on_modules": { 2021-04-09T18:20:24.321 INFO:teuthology.orchestra.run.smithi120.stdout: "nautilus": [ 2021-04-09T18:20:24.322 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2021-04-09T18:20:24.322 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2021-04-09T18:20:24.323 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2021-04-09T18:20:24.323 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator_cli", 2021-04-09T18:20:24.323 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2021-04-09T18:20:24.324 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2021-04-09T18:20:24.327 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2021-04-09T18:20:24.327 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2021-04-09T18:20:24.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2021-04-09T18:20:24.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:24.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.329 INFO:teuthology.orchestra.run.smithi120.stdout: "servicemap": { 2021-04-09T18:20:24.330 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 1, 2021-04-09T18:20:24.330 INFO:teuthology.orchestra.run.smithi120.stdout: "modified": "0.000000", 2021-04-09T18:20:24.331 INFO:teuthology.orchestra.run.smithi120.stdout: "services": {} 2021-04-09T18:20:24.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:24.332 INFO:teuthology.orchestra.run.smithi120.stdout: "progress_events": {} 2021-04-09T18:20:24.332 INFO:teuthology.orchestra.run.smithi120.stdout:} 2021-04-09T18:20:24.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f67000188c0 msgr2=0x7f670001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f67000188c0 0x7f670001adc0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0b0790 msgr2=0x7f671c0b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0b0790 0x7f671c0b0b90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f671000b580 tx=0x7f671000b920).stop 2021-04-09T18:20:24.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 shutdown_connections 2021-04-09T18:20:24.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f67000188c0 0x7f670001adc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671c0b11b0 0x7f671c197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671c0b0790 0x7f671c0b0b90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 --2- 172.21.15.120:0/2679488995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f671c189170 0x7f671c192330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 >> 172.21.15.120:0/2679488995 conn(0x7f671c18a9b0 msgr2=0x7f671c08be60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 shutdown_connections 2021-04-09T18:20:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:20.715 7f6720fc0700 1 -- 172.21.15.120:0/2679488995 wait complete. 2021-04-09T18:20:24.385 INFO:tasks.mds_thrash.ceph_manager:{'fsid': 'dcbe2161-e5ca-44be-8661-d46578834d60', 'health': {'checks': {}, 'status': 'HEALTH_OK'}, 'election_epoch': 4, 'quorum': [0, 1, 2], 'quorum_names': ['a', 'b', 'c'], 'quorum_age': 49, 'monmap': {'epoch': 1, 'min_mon_release_name': '14', 'num_mons': 3}, 'osdmap': {'osdmap': {'epoch': 22, 'num_osds': 8, 'num_up_osds': 8, 'num_in_osds': 8, 'num_remapped_pgs': 0}}, 'pgmap': {'pgs_by_state': [{'state_name': 'active+clean', 'count': 24}], 'num_pgs': 24, 'num_pools': 3, 'num_objects': 22, 'data_bytes': 2286, 'bytes_used': 8591900672, 'bytes_avail': 764502212608, 'bytes_total': 773094113280, 'write_bytes_sec': 0, 'read_op_per_sec': 0, 'write_op_per_sec': 0}, 'fsmap': {'epoch': 7, 'id': 1, 'up': 1, 'in': 1, 'max': 1, 'by_rank': [{'filesystem_id': 1, 'rank': 0, 'name': 'b', 'status': 'up:active', 'gid': 4292}], 'up:standby': 1}, 'mgrmap': {'epoch': 3, 'active_gid': 4106, 'active_name': 'x', 'active_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 23529}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 23529}]}, 'active_addr': '172.21.15.134:6801/23529', 'active_change': '2021-04-09 18:19:32.736784', 'available': True, 'standbys': [{'gid': 4104, 'name': 'y', 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}]}], 'modules': ['iostat', 'restful'], 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}], 'services': {}, 'always_on_modules': {'nautilus': ['balancer', 'crash', 'devicehealth', 'orchestrator_cli', 'progress', 'rbd_support', 'status', 'volumes']}}, 'servicemap': {'epoch': 1, 'modified': '0.000000', 'services': {}}, 'progress_events': {}} 2021-04-09T18:20:24.404 INFO:tasks.mds_thrash.ceph_manager:clean! 2021-04-09T18:20:24.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:20:24.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.561 7fe5567a1700 1 Processor -- start 2021-04-09T18:20:24.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.561 7fe5567a1700 1 -- start start 2021-04-09T18:20:24.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.561 7fe5567a1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5500d7160 0x7fe5500e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.561 7fe5567a1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5500d7560 0x7fe5500d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.561 7fe5567a1700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5500d6be0 con 0x7fe5500d5bc0 2021-04-09T18:20:24.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.561 7fe5567a1700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5500d80f0 con 0x7fe5500d7560 2021-04-09T18:20:24.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe5567a1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5500e7f00 con 0x7fe5500d7160 2021-04-09T18:20:24.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe547fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5500d7560 0x7fe5500d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:24.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54ffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5500d7160 0x7fe5500e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:24.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe554dbe700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe5500d5bc0 0x7fe5500d5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:42990/0 (socket says 172.21.15.120:42990) 2021-04-09T18:20:24.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe554dbe700 1 -- 172.21.15.120:0/2653526987 learned_addr learned my addr 172.21.15.120:0/2653526987 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:24.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54ffff700 1 -- 172.21.15.120:0/2653526987 >> v2:172.21.15.134:3300/0 conn(0x7fe5500d7560 msgr2=0x7fe5500d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:24.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54ffff700 1 --2- 172.21.15.120:0/2653526987 >> v2:172.21.15.134:3300/0 conn(0x7fe5500d7560 0x7fe5500d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54ffff700 1 -- 172.21.15.120:0/2653526987 >> v1:172.21.15.134:6789/0 conn(0x7fe5500d5bc0 legacy=0x7fe5500d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54ffff700 1 -- 172.21.15.120:0/2653526987 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5501a2ac0 con 0x7fe5500d7160 2021-04-09T18:20:24.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54f7fe700 1 -- 172.21.15.120:0/2653526987 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400891938 0 0) 0x7fe548001440 con 0x7fe5500d5bc0 2021-04-09T18:20:24.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe547fff700 1 --2- 172.21.15.120:0/2653526987 >> v2:172.21.15.134:3300/0 conn(0x7fe5500d7560 0x7fe5500d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:24.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54ffff700 1 --2- 172.21.15.120:0/2653526987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5500d7160 0x7fe5500e78e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe540006650 tx=0x7fe540009a80).ready entity=mon.2 client_cookie=4c4d61cca76b3f7a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:24.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54f7fe700 1 -- 172.21.15.120:0/2653526987 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5400009b0 con 0x7fe5500d7160 2021-04-09T18:20:24.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54f7fe700 1 -- 172.21.15.120:0/2653526987 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54000c0c0 con 0x7fe5500d7160 2021-04-09T18:20:24.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.562 7fe54f7fe700 1 -- 172.21.15.120:0/2653526987 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe54000c510 con 0x7fe5500d7160 2021-04-09T18:20:24.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.563 7fe5567a1700 1 -- 172.21.15.120:0/2653526987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5500d7160 msgr2=0x7fe5500e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.563 7fe5567a1700 1 --2- 172.21.15.120:0/2653526987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5500d7160 0x7fe5500e78e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe540006650 tx=0x7fe540009a80).stop 2021-04-09T18:20:24.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.563 7fe5567a1700 1 -- 172.21.15.120:0/2653526987 shutdown_connections 2021-04-09T18:20:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.563 7fe5567a1700 1 --2- 172.21.15.120:0/2653526987 >> v2:172.21.15.134:3300/0 conn(0x7fe5500d7560 0x7fe5500d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.563 7fe5567a1700 1 --2- 172.21.15.120:0/2653526987 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5500d7160 0x7fe5500e78e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.563 7fe5567a1700 1 -- 172.21.15.120:0/2653526987 >> 172.21.15.120:0/2653526987 conn(0x7fe5500d1590 msgr2=0x7fe5500d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:24.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.563 7fe5567a1700 1 -- 172.21.15.120:0/2653526987 shutdown_connections 2021-04-09T18:20:24.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.563 7fe5567a1700 1 -- 172.21.15.120:0/2653526987 wait complete. 2021-04-09T18:20:24.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.582 7fe5567a1700 1 Processor -- start 2021-04-09T18:20:24.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.582 7fe5567a1700 1 -- start start 2021-04-09T18:20:24.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.582 7fe5567a1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5501971c0 0x7fe550193ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe5567a1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe55018ad80 0x7fe55018b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe5567a1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe55018bd70 0x7fe55018c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe5567a1700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5500b0e80 con 0x7fe5501971c0 2021-04-09T18:20:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe5567a1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5500b1070 con 0x7fe55018ad80 2021-04-09T18:20:24.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe5567a1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5500b1290 con 0x7fe55018bd70 2021-04-09T18:20:24.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5501971c0 0x7fe550193ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:24.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5501971c0 0x7fe550193ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53264/0 (socket says 172.21.15.120:53264) 2021-04-09T18:20:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54ffff700 1 -- 172.21.15.120:0/3599426323 learned_addr learned my addr 172.21.15.120:0/3599426323 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe554dbe700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe55018bd70 0x7fe55018c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe547fff700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe55018ad80 0x7fe55018b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54ffff700 1 -- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe55018bd70 msgr2=0x7fe55018c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54ffff700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe55018bd70 0x7fe55018c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54ffff700 1 -- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe55018ad80 msgr2=0x7fe55018b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54ffff700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe55018ad80 0x7fe55018b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54ffff700 1 -- 172.21.15.120:0/3599426323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500b14b0 con 0x7fe5501971c0 2021-04-09T18:20:24.635 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54ffff700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5501971c0 0x7fe550193ca0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fe540009650 tx=0x7fe54000b8e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:24.635 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54d7fa700 1 -- 172.21.15.120:0/3599426323 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5400093a0 con 0x7fe5501971c0 2021-04-09T18:20:24.635 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54d7fa700 1 -- 172.21.15.120:0/3599426323 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe540006070 con 0x7fe5501971c0 2021-04-09T18:20:24.639 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe54d7fa700 1 -- 172.21.15.120:0/3599426323 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5400052e0 con 0x7fe5501971c0 2021-04-09T18:20:24.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5500b14b0 con 0x7fe5501971c0 2021-04-09T18:20:24.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.583 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5500b14b0 con 0x7fe5501971c0 2021-04-09T18:20:24.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.584 7fe54d7fa700 1 -- 172.21.15.120:0/3599426323 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe540009300 con 0x7fe5501971c0 2021-04-09T18:20:24.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.584 7fe54d7fa700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe5340188c0 0x7fe53401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.584 7fe54d7fa700 1 -- 172.21.15.120:0/3599426323 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fe540032b70 con 0x7fe5501971c0 2021-04-09T18:20:24.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.584 7fe547fff700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe5340188c0 0x7fe53401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:24.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.584 7fe547fff700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe5340188c0 0x7fe53401adc0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:24.646 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.607 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe550182a20 con 0x7fe5501971c0 2021-04-09T18:20:24.646 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.611 7fe54d7fa700 1 -- 172.21.15.120:0/3599426323 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe540006030 con 0x7fe5501971c0 2021-04-09T18:20:24.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.789 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fe550182a20 con 0x7fe5340188c0 2021-04-09T18:20:24.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.792 7fe54d7fa700 1 -- 172.21.15.120:0/3599426323 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+77178 (crc 0 0 0) 0x7fe538006a30 con 0x7fe5340188c0 2021-04-09T18:20:24.791 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2021-04-09T18:20:24.793 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:24.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.794 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe5340188c0 msgr2=0x7fe53401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe5340188c0 0x7fe53401adc0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5501971c0 msgr2=0x7fe550193ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5501971c0 0x7fe550193ca0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fe540009650 tx=0x7fe54000b8e0).stop 2021-04-09T18:20:24.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 shutdown_connections 2021-04-09T18:20:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe5340188c0 0x7fe53401adc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe55018bd70 0x7fe55018c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe55018ad80 0x7fe55018b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 --2- 172.21.15.120:0/3599426323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5501971c0 0x7fe550193ca0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 >> 172.21.15.120:0/3599426323 conn(0x7fe55018dcd0 msgr2=0x7fe550187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:24.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 shutdown_connections 2021-04-09T18:20:24.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.795 7fe5567a1700 1 -- 172.21.15.120:0/3599426323 wait complete. 2021-04-09T18:20:24.803 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2021-04-09 18:20:24.747592","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8390528,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584192,"statfs":{"total":773094113280,"available":764502212608,"internally_reserved":8589934592,"allocated":1900544,"data_stored":664916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002289"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671990","last_change":"2021-04-09 18:19:48.659214","last_active":"2021-04-09 18:19:54.671990","last_peered":"2021-04-09 18:19:54.671990","last_clean":"2021-04-09 18:19:54.671990","last_became_active":"2021-04-09 18:19:48.658812","last_became_peered":"2021-04-09 18:19:48.658812","last_unstale":"2021-04-09 18:19:54.671990","last_undegraded":"2021-04-09 18:19:54.671990","last_fullsized":"2021-04-09 18:19:54.671990","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734141","last_change":"2021-04-09 18:19:51.674918","last_active":"2021-04-09 18:20:03.734141","last_peered":"2021-04-09 18:20:03.734141","last_clean":"2021-04-09 18:20:03.734141","last_became_active":"2021-04-09 18:19:51.674416","last_became_peered":"2021-04-09 18:19:51.674416","last_unstale":"2021-04-09 18:20:03.734141","last_undegraded":"2021-04-09 18:20:03.734141","last_fullsized":"2021-04-09 18:20:03.734141","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687668","last_change":"2021-04-09 18:19:54.682596","last_active":"2021-04-09 18:19:54.687668","last_peered":"2021-04-09 18:19:54.687668","last_clean":"2021-04-09 18:19:54.687668","last_became_active":"2021-04-09 18:19:54.682305","last_became_peered":"2021-04-09 18:19:54.682305","last_unstale":"2021-04-09 18:19:54.687668","last_undegraded":"2021-04-09 18:19:54.687668","last_fullsized":"2021-04-09 18:19:54.687668","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.671958","last_change":"2021-04-09 18:19:48.659288","last_active":"2021-04-09 18:19:54.671958","last_peered":"2021-04-09 18:19:54.671958","last_clean":"2021-04-09 18:19:54.671958","last_became_active":"2021-04-09 18:19:48.658917","last_became_peered":"2021-04-09 18:19:48.658917","last_unstale":"2021-04-09 18:19:54.671958","last_undegraded":"2021-04-09 18:19:54.671958","last_fullsized":"2021-04-09 18:19:54.671958","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"22'6","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735716","last_change":"2021-04-09 18:19:51.675020","last_active":"2021-04-09 18:20:03.735716","last_peered":"2021-04-09 18:20:03.735716","last_clean":"2021-04-09 18:20:03.735716","last_became_active":"2021-04-09 18:19:51.674681","last_became_peered":"2021-04-09 18:19:51.674681","last_unstale":"2021-04-09 18:20:03.735716","last_undegraded":"2021-04-09 18:20:03.735716","last_fullsized":"2021-04-09 18:20:03.735716","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688301","last_change":"2021-04-09 18:19:54.681265","last_active":"2021-04-09 18:19:54.688301","last_peered":"2021-04-09 18:19:54.688301","last_clean":"2021-04-09 18:19:54.688301","last_became_active":"2021-04-09 18:19:54.680726","last_became_peered":"2021-04-09 18:19:54.680726","last_unstale":"2021-04-09 18:19:54.688301","last_undegraded":"2021-04-09 18:19:54.688301","last_fullsized":"2021-04-09 18:19:54.688301","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685391","last_change":"2021-04-09 18:19:54.680273","last_active":"2021-04-09 18:19:54.685391","last_peered":"2021-04-09 18:19:54.685391","last_clean":"2021-04-09 18:19:54.685391","last_became_active":"2021-04-09 18:19:54.679793","last_became_peered":"2021-04-09 18:19:54.679793","last_unstale":"2021-04-09 18:19:54.685391","last_undegraded":"2021-04-09 18:19:54.685391","last_fullsized":"2021-04-09 18:19:54.685391","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672282","last_change":"2021-04-09 18:19:48.670446","last_active":"2021-04-09 18:19:54.672282","last_peered":"2021-04-09 18:19:54.672282","last_clean":"2021-04-09 18:19:54.672282","last_became_active":"2021-04-09 18:19:48.670077","last_became_peered":"2021-04-09 18:19:48.670077","last_unstale":"2021-04-09 18:19:54.672282","last_undegraded":"2021-04-09 18:19:54.672282","last_fullsized":"2021-04-09 18:19:54.672282","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'4","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.732754","last_change":"2021-04-09 18:19:51.668684","last_active":"2021-04-09 18:20:03.732754","last_peered":"2021-04-09 18:20:03.732754","last_clean":"2021-04-09 18:20:03.732754","last_became_active":"2021-04-09 18:19:51.668425","last_became_peered":"2021-04-09 18:19:51.668425","last_unstale":"2021-04-09 18:20:03.732754","last_undegraded":"2021-04-09 18:20:03.732754","last_fullsized":"2021-04-09 18:20:03.732754","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685459","last_change":"2021-04-09 18:19:54.678757","last_active":"2021-04-09 18:19:54.685459","last_peered":"2021-04-09 18:19:54.685459","last_clean":"2021-04-09 18:19:54.685459","last_became_active":"2021-04-09 18:19:54.678420","last_became_peered":"2021-04-09 18:19:54.678420","last_unstale":"2021-04-09 18:19:54.685459","last_undegraded":"2021-04-09 18:19:54.685459","last_fullsized":"2021-04-09 18:19:54.685459","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672124","last_change":"2021-04-09 18:19:48.660463","last_active":"2021-04-09 18:19:54.672124","last_peered":"2021-04-09 18:19:54.672124","last_clean":"2021-04-09 18:19:54.672124","last_became_active":"2021-04-09 18:19:48.660038","last_became_peered":"2021-04-09 18:19:48.660038","last_unstale":"2021-04-09 18:19:54.672124","last_undegraded":"2021-04-09 18:19:54.672124","last_fullsized":"2021-04-09 18:19:54.672124","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735889","last_change":"2021-04-09 18:19:51.670965","last_active":"2021-04-09 18:20:03.735889","last_peered":"2021-04-09 18:20:03.735889","last_clean":"2021-04-09 18:20:03.735889","last_became_active":"2021-04-09 18:19:51.670767","last_became_peered":"2021-04-09 18:19:51.670767","last_unstale":"2021-04-09 18:20:03.735889","last_undegraded":"2021-04-09 18:20:03.735889","last_fullsized":"2021-04-09 18:20:03.735889","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674910","last_change":"2021-04-09 18:19:48.668518","last_active":"2021-04-09 18:19:54.674910","last_peered":"2021-04-09 18:19:54.674910","last_clean":"2021-04-09 18:19:54.674910","last_became_active":"2021-04-09 18:19:48.668225","last_became_peered":"2021-04-09 18:19:48.668225","last_unstale":"2021-04-09 18:19:54.674910","last_undegraded":"2021-04-09 18:19:54.674910","last_fullsized":"2021-04-09 18:19:54.674910","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'5","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.734821","last_change":"2021-04-09 18:19:51.675432","last_active":"2021-04-09 18:20:03.734821","last_peered":"2021-04-09 18:20:03.734821","last_clean":"2021-04-09 18:20:03.734821","last_became_active":"2021-04-09 18:19:51.675161","last_became_peered":"2021-04-09 18:19:51.675161","last_unstale":"2021-04-09 18:20:03.734821","last_undegraded":"2021-04-09 18:20:03.734821","last_fullsized":"2021-04-09 18:20:03.734821","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685526","last_change":"2021-04-09 18:19:54.680136","last_active":"2021-04-09 18:19:54.685526","last_peered":"2021-04-09 18:19:54.685526","last_clean":"2021-04-09 18:19:54.685526","last_became_active":"2021-04-09 18:19:54.679654","last_became_peered":"2021-04-09 18:19:54.679654","last_unstale":"2021-04-09 18:19:54.685526","last_undegraded":"2021-04-09 18:19:54.685526","last_fullsized":"2021-04-09 18:19:54.685526","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674829","last_change":"2021-04-09 18:19:48.659172","last_active":"2021-04-09 18:19:54.674829","last_peered":"2021-04-09 18:19:54.674829","last_clean":"2021-04-09 18:19:54.674829","last_became_active":"2021-04-09 18:19:48.658788","last_became_peered":"2021-04-09 18:19:48.658788","last_unstale":"2021-04-09 18:19:54.674829","last_undegraded":"2021-04-09 18:19:54.674829","last_fullsized":"2021-04-09 18:19:54.674829","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:19:55.096291","last_change":"2021-04-09 18:19:51.675238","last_active":"2021-04-09 18:19:55.096291","last_peered":"2021-04-09 18:19:55.096291","last_clean":"2021-04-09 18:19:55.096291","last_became_active":"2021-04-09 18:19:51.674810","last_became_peered":"2021-04-09 18:19:51.674810","last_unstale":"2021-04-09 18:19:55.096291","last_undegraded":"2021-04-09 18:19:55.096291","last_fullsized":"2021-04-09 18:19:55.096291","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.687598","last_change":"2021-04-09 18:19:54.680226","last_active":"2021-04-09 18:19:54.687598","last_peered":"2021-04-09 18:19:54.687598","last_clean":"2021-04-09 18:19:54.687598","last_became_active":"2021-04-09 18:19:54.679836","last_became_peered":"2021-04-09 18:19:54.679836","last_unstale":"2021-04-09 18:19:54.687598","last_undegraded":"2021-04-09 18:19:54.687598","last_fullsized":"2021-04-09 18:19:54.687598","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.676168","last_change":"2021-04-09 18:19:51.679961","last_active":"2021-04-09 18:19:54.676168","last_peered":"2021-04-09 18:19:54.676168","last_clean":"2021-04-09 18:19:54.676168","last_became_active":"2021-04-09 18:19:51.679689","last_became_peered":"2021-04-09 18:19:51.679689","last_unstale":"2021-04-09 18:19:54.676168","last_undegraded":"2021-04-09 18:19:54.676168","last_fullsized":"2021-04-09 18:19:54.676168","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.674925","last_change":"2021-04-09 18:19:48.668812","last_active":"2021-04-09 18:19:54.674925","last_peered":"2021-04-09 18:19:54.674925","last_clean":"2021-04-09 18:19:54.674925","last_became_active":"2021-04-09 18:19:48.668474","last_became_peered":"2021-04-09 18:19:48.668474","last_unstale":"2021-04-09 18:19:54.674925","last_undegraded":"2021-04-09 18:19:54.674925","last_fullsized":"2021-04-09 18:19:54.674925","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.688310","last_change":"2021-04-09 18:19:54.681340","last_active":"2021-04-09 18:19:54.688310","last_peered":"2021-04-09 18:19:54.688310","last_clean":"2021-04-09 18:19:54.688310","last_became_active":"2021-04-09 18:19:54.680877","last_became_peered":"2021-04-09 18:19:54.680877","last_unstale":"2021-04-09 18:19:54.688310","last_undegraded":"2021-04-09 18:19:54.688310","last_fullsized":"2021-04-09 18:19:54.688310","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'8","reported_seq":"20","reported_epoch":"22","state":"active+clean","last_fresh":"2021-04-09 18:20:03.735473","last_change":"2021-04-09 18:19:51.675129","last_active":"2021-04-09 18:20:03.735473","last_peered":"2021-04-09 18:20:03.735473","last_clean":"2021-04-09 18:20:03.735473","last_became_active":"2021-04-09 18:19:51.674771","last_became_peered":"2021-04-09 18:19:51.674771","last_unstale":"2021-04-09 18:20:03.735473","last_undegraded":"2021-04-09 18:20:03.735473","last_fullsized":"2021-04-09 18:20:03.735473","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.672077","last_change":"2021-04-09 18:19:48.660437","last_active":"2021-04-09 18:19:54.672077","last_peered":"2021-04-09 18:19:54.672077","last_clean":"2021-04-09 18:19:54.672077","last_became_active":"2021-04-09 18:19:48.660180","last_became_peered":"2021-04-09 18:19:48.660180","last_unstale":"2021-04-09 18:19:54.672077","last_undegraded":"2021-04-09 18:19:54.672077","last_fullsized":"2021-04-09 18:19:54.672077","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2021-04-09 18:19:54.685605","last_change":"2021-04-09 18:19:54.679817","last_active":"2021-04-09 18:19:54.685605","last_peered":"2021-04-09 18:19:54.685605","last_clean":"2021-04-09 18:19:54.685605","last_became_active":"2021-04-09 18:19:54.679420","last_became_peered":"2021-04-09 18:19:54.679420","last_unstale":"2021-04-09 18:19:54.685605","last_undegraded":"2021-04-09 18:19:54.685605","last_fullsized":"2021-04-09 18:19:54.685605","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":83269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":83109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":84229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":84069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":82577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":82543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]}]}} 2021-04-09T18:20:24.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json-pretty 2021-04-09T18:20:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f468c9c5700 1 Processor -- start 2021-04-09T18:20:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f468c9c5700 1 -- start start 2021-04-09T18:20:24.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f468c9c5700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f46880ff080 0x7f46880ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f468c9c5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881a9160 0x7f46881ab570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f468c9c5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46880ffc90 con 0x7f468807e700 2021-04-09T18:20:24.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f468c9c5700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46880d80e0 con 0x7f46880ff080 2021-04-09T18:20:24.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f468c9c5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880d2040 con 0x7f46881a9160 2021-04-09T18:20:24.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f4685e1b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f46880ff080 0x7f46880ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:24.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f4685e1b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f46880ff080 0x7f46880ff480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53276/0 (socket says 172.21.15.120:53276) 2021-04-09T18:20:24.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.954 7f4685e1b700 1 -- 172.21.15.120:0/3192978649 learned_addr learned my addr 172.21.15.120:0/3192978649 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:24.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f4686e1d700 1 --2- 172.21.15.120:0/3192978649 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881a9160 0x7f46881ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:24.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f4685e1b700 1 -- 172.21.15.120:0/3192978649 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881a9160 msgr2=0x7f46881ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:24.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f4685e1b700 1 --2- 172.21.15.120:0/3192978649 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881a9160 0x7f46881ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f4685e1b700 1 -- 172.21.15.120:0/3192978649 >> v1:172.21.15.134:6789/0 conn(0x7f468807e700 legacy=0x7f4688100210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f468561a700 1 -- 172.21.15.120:0/3192978649 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565401724 0 0) 0x7f4680000c60 con 0x7f468807e700 2021-04-09T18:20:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f4685e1b700 1 -- 172.21.15.120:0/3192978649 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468807eb00 con 0x7f46880ff080 2021-04-09T18:20:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f4686e1d700 1 --2- 172.21.15.120:0/3192978649 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881a9160 0x7f46881ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:24.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f4685e1b700 1 --2- 172.21.15.120:0/3192978649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46880ff080 0x7f46880ff480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f4670006a80 tx=0x7f4670009f00).ready entity=mon.0 client_cookie=e36b151788c2dab4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:24.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f468561a700 1 -- 172.21.15.120:0/3192978649 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f467000b5c0 con 0x7f46880ff080 2021-04-09T18:20:24.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f468561a700 1 -- 172.21.15.120:0/3192978649 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467000b8c0 con 0x7f46880ff080 2021-04-09T18:20:24.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f468561a700 1 -- 172.21.15.120:0/3192978649 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f467000bda0 con 0x7f46880ff080 2021-04-09T18:20:24.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f468c9c5700 1 -- 172.21.15.120:0/3192978649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46880ff080 msgr2=0x7f46880ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:24.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.955 7f468c9c5700 1 --2- 172.21.15.120:0/3192978649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46880ff080 0x7f46880ff480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f4670006a80 tx=0x7f4670009f00).stop 2021-04-09T18:20:24.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.956 7f468c9c5700 1 -- 172.21.15.120:0/3192978649 shutdown_connections 2021-04-09T18:20:24.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.956 7f468c9c5700 1 --2- 172.21.15.120:0/3192978649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46880ff080 0x7f46880ff480 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.956 7f468c9c5700 1 --2- 172.21.15.120:0/3192978649 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881a9160 0x7f46881ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:24.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.956 7f468c9c5700 1 -- 172.21.15.120:0/3192978649 >> 172.21.15.120:0/3192978649 conn(0x7f46880f0050 msgr2=0x7f46880d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:24.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.956 7f468c9c5700 1 -- 172.21.15.120:0/3192978649 shutdown_connections 2021-04-09T18:20:24.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.956 7f468c9c5700 1 -- 172.21.15.120:0/3192978649 wait complete. 2021-04-09T18:20:24.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468c9c5700 1 Processor -- start 2021-04-09T18:20:24.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468c9c5700 1 -- start start 2021-04-09T18:20:24.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468c9c5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f468819b5c0 0x7f4688184dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468c9c5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881853f0 0x7f46881857f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:24.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468c9c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4688185e10 0x7f4688186640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:25.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468c9c5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4688188460 con 0x7f468819b5c0 2021-04-09T18:20:25.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468c9c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468819b9c0 con 0x7f4688185e10 2021-04-09T18:20:25.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468c9c5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46881889e0 con 0x7f46881853f0 2021-04-09T18:20:25.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468661c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f468819b5c0 0x7f4688184dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:25.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468661c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f468819b5c0 0x7f4688184dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53278/0 (socket says 172.21.15.120:53278) 2021-04-09T18:20:25.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.975 7f468661c700 1 -- 172.21.15.120:0/2889371873 learned_addr learned my addr 172.21.15.120:0/2889371873 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:25.005 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f4685e1b700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881853f0 0x7f46881857f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:25.005 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f4686e1d700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4688185e10 0x7f4688186640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:25.006 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f468661c700 1 -- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881853f0 msgr2=0x7f46881857f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:25.006 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f468661c700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881853f0 0x7f46881857f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:25.007 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f468661c700 1 -- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4688185e10 msgr2=0x7f4688186640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:25.007 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f468661c700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4688185e10 0x7f4688186640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:25.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f468661c700 1 -- 172.21.15.120:0/2889371873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4688186210 con 0x7f468819b5c0 2021-04-09T18:20:25.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f468661c700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f468819b5c0 0x7f4688184dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f4680006f20 tx=0x7f468000b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:25.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f467effd700 1 -- 172.21.15.120:0/2889371873 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f468000bd80 con 0x7f468819b5c0 2021-04-09T18:20:25.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f467effd700 1 -- 172.21.15.120:0/2889371873 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4680001080 con 0x7f468819b5c0 2021-04-09T18:20:25.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4688186210 con 0x7f468819b5c0 2021-04-09T18:20:25.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f467effd700 1 -- 172.21.15.120:0/2889371873 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4680001550 con 0x7f468819b5c0 2021-04-09T18:20:25.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.976 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4688186210 con 0x7f468819b5c0 2021-04-09T18:20:25.018 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.977 7f467effd700 1 -- 172.21.15.120:0/2889371873 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4680001260 con 0x7f468819b5c0 2021-04-09T18:20:25.018 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.977 7f467effd700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f466c018930 0x7f466c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:25.018 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.977 7f467effd700 1 -- 172.21.15.120:0/2889371873 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f4680032ba0 con 0x7f468819b5c0 2021-04-09T18:20:25.019 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.977 7f4685e1b700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f466c018930 0x7f466c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:25.019 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:24.977 7f4685e1b700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f466c018930 0x7f466c01ae10 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:25.021 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.000 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4688182ac0 con 0x7f468819b5c0 2021-04-09T18:20:25.021 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.004 7f467effd700 1 -- 172.21.15.120:0/2889371873 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4680006bf0 con 0x7f468819b5c0 2021-04-09T18:20:25.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.178 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4688182ac0 con 0x7f468819b5c0 2021-04-09T18:20:25.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.180 7f467effd700 1 -- 172.21.15.120:0/2889371873 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+211660 (secure 0 0 0) 0x7f4680001080 con 0x7f468819b5c0 2021-04-09T18:20:25.185 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:25.185 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2021-04-09T18:20:25.186 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "dcbe2161-e5ca-44be-8661-d46578834d60", 2021-04-09T18:20:25.186 INFO:teuthology.orchestra.run.smithi120.stdout: "health": { 2021-04-09T18:20:25.186 INFO:teuthology.orchestra.run.smithi120.stdout: "checks": {}, 2021-04-09T18:20:25.187 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "HEALTH_OK" 2021-04-09T18:20:25.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.188 INFO:teuthology.orchestra.run.smithi120.stdout: "election_epoch": 4, 2021-04-09T18:20:25.194 INFO:teuthology.orchestra.run.smithi120.stdout: "quorum": [ 2021-04-09T18:20:25.209 INFO:teuthology.orchestra.run.smithi120.stdout: 0, 2021-04-09T18:20:25.209 INFO:teuthology.orchestra.run.smithi120.stdout: 1, 2021-04-09T18:20:25.210 INFO:teuthology.orchestra.run.smithi120.stdout: 2 2021-04-09T18:20:25.210 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:25.211 INFO:teuthology.orchestra.run.smithi120.stdout: "quorum_names": [ 2021-04-09T18:20:25.211 INFO:teuthology.orchestra.run.smithi120.stdout: "a", 2021-04-09T18:20:25.211 INFO:teuthology.orchestra.run.smithi120.stdout: "b", 2021-04-09T18:20:25.212 INFO:teuthology.orchestra.run.smithi120.stdout: "c" 2021-04-09T18:20:25.220 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:25.221 INFO:teuthology.orchestra.run.smithi120.stdout: "quorum_age": 54, 2021-04-09T18:20:25.221 INFO:teuthology.orchestra.run.smithi120.stdout: "monmap": { 2021-04-09T18:20:25.221 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 1, 2021-04-09T18:20:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: "min_mon_release_name": "14", 2021-04-09T18:20:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: "num_mons": 3 2021-04-09T18:20:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap": { 2021-04-09T18:20:25.224 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap": { 2021-04-09T18:20:25.224 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 22, 2021-04-09T18:20:25.225 INFO:teuthology.orchestra.run.smithi120.stdout: "num_osds": 8, 2021-04-09T18:20:25.225 INFO:teuthology.orchestra.run.smithi120.stdout: "num_up_osds": 8, 2021-04-09T18:20:25.226 INFO:teuthology.orchestra.run.smithi120.stdout: "num_in_osds": 8, 2021-04-09T18:20:25.226 INFO:teuthology.orchestra.run.smithi120.stdout: "num_remapped_pgs": 0 2021-04-09T18:20:25.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.227 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap": { 2021-04-09T18:20:25.228 INFO:teuthology.orchestra.run.smithi120.stdout: "pgs_by_state": [ 2021-04-09T18:20:25.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.229 INFO:teuthology.orchestra.run.smithi120.stdout: "state_name": "active+clean", 2021-04-09T18:20:25.229 INFO:teuthology.orchestra.run.smithi120.stdout: "count": 24 2021-04-09T18:20:25.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.230 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:25.231 INFO:teuthology.orchestra.run.smithi120.stdout: "num_pgs": 24, 2021-04-09T18:20:25.231 INFO:teuthology.orchestra.run.smithi120.stdout: "num_pools": 3, 2021-04-09T18:20:25.232 INFO:teuthology.orchestra.run.smithi120.stdout: "num_objects": 22, 2021-04-09T18:20:25.232 INFO:teuthology.orchestra.run.smithi120.stdout: "data_bytes": 2286, 2021-04-09T18:20:25.233 INFO:teuthology.orchestra.run.smithi120.stdout: "bytes_used": 8591900672, 2021-04-09T18:20:25.233 INFO:teuthology.orchestra.run.smithi120.stdout: "bytes_avail": 764502212608, 2021-04-09T18:20:25.234 INFO:teuthology.orchestra.run.smithi120.stdout: "bytes_total": 773094113280 2021-04-09T18:20:25.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.235 INFO:teuthology.orchestra.run.smithi120.stdout: "fsmap": { 2021-04-09T18:20:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 7, 2021-04-09T18:20:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1, 2021-04-09T18:20:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2021-04-09T18:20:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2021-04-09T18:20:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 1, 2021-04-09T18:20:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "by_rank": [ 2021-04-09T18:20:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "filesystem_id": 1, 2021-04-09T18:20:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "rank": 0, 2021-04-09T18:20:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "b", 2021-04-09T18:20:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "up:active", 2021-04-09T18:20:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 4292 2021-04-09T18:20:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "up:standby": 1 2021-04-09T18:20:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "mgrmap": { 2021-04-09T18:20:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 3, 2021-04-09T18:20:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "active_gid": 4106, 2021-04-09T18:20:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: "active_name": "x", 2021-04-09T18:20:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addrs": { 2021-04-09T18:20:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2021-04-09T18:20:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2021-04-09T18:20:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.134:6800", 2021-04-09T18:20:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 23529 2021-04-09T18:20:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2021-04-09T18:20:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.134:6801", 2021-04-09T18:20:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 23529 2021-04-09T18:20:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2021-04-09T18:20:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addr": "172.21.15.134:6801/23529", 2021-04-09T18:20:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: "active_change": "2021-04-09 18:19:32.736784", 2021-04-09T18:20:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "available": true, 2021-04-09T18:20:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "standbys": [ 2021-04-09T18:20:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 4104, 2021-04-09T18:20:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "y", 2021-04-09T18:20:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2021-04-09T18:20:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2021-04-09T18:20:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2021-04-09T18:20:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2021-04-09T18:20:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2021-04-09T18:20:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2021-04-09T18:20:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2021-04-09T18:20:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2021-04-09T18:20:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2021-04-09T18:20:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2021-04-09T18:20:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2021-04-09T18:20:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2021-04-09T18:20:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2021-04-09T18:20:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2021-04-09T18:20:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2021-04-09T18:20:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2021-04-09T18:20:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2021-04-09T18:20:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2021-04-09T18:20:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2021-04-09T18:20:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2021-04-09T18:20:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2021-04-09T18:20:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2021-04-09T18:20:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2021-04-09T18:20:25.352 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2021-04-09T18:20:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2021-04-09T18:20:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2021-04-09T18:20:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2021-04-09T18:20:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2021-04-09T18:20:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.409 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2021-04-09T18:20:25.411 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.411 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.411 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.413 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ansible", 2021-04-09T18:20:25.414 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:25.414 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:25.415 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:25.415 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:25.416 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:25.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.416 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.417 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.417 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.418 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.418 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.418 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.419 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.419 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.421 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.422 INFO:teuthology.orchestra.run.smithi120.stdout: "server_url": { 2021-04-09T18:20:25.423 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_url", 2021-04-09T18:20:25.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.424 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.425 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.425 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.425 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.426 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.426 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_server": { 2021-04-09T18:20:25.443 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_server", 2021-04-09T18:20:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2021-04-09T18:20:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2021-04-09T18:20:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2021-04-09T18:20:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2021-04-09T18:20:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2021-04-09T18:20:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2021-04-09T18:20:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.461 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2021-04-09T18:20:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2021-04-09T18:20:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2021-04-09T18:20:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2021-04-09T18:20:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:25.495 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.496 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:25.496 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:25.497 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:25.498 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.498 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-04-09T18:20:25.499 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:25.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.499 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.500 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2021-04-09T18:20:25.501 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2021-04-09T18:20:25.501 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:25.501 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.502 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2021-04-09T18:20:25.503 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:25.503 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2021-04-09T18:20:25.503 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.504 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-04-09T18:20:25.504 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.548 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.549 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2021-04-09T18:20:25.553 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2021-04-09T18:20:25.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.554 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2021-04-09T18:20:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-04-09T18:20:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-04-09T18:20:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2021-04-09T18:20:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2021-04-09T18:20:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2021-04-09T18:20:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2021-04-09T18:20:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2021-04-09T18:20:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2021-04-09T18:20:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-04-09T18:20:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2021-04-09T18:20:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2021-04-09T18:20:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2400", 2021-04-09T18:20:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2021-04-09T18:20:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2021-04-09T18:20:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2021-04-09T18:20:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2021-04-09T18:20:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-04-09T18:20:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2021-04-09T18:20:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2021-04-09T18:20:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-04-09T18:20:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2021-04-09T18:20:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2021-04-09T18:20:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "none", 2021-04-09T18:20:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.662 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.662 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2021-04-09T18:20:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2021-04-09T18:20:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap" 2021-04-09T18:20:25.664 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:25.664 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2021-04-09T18:20:25.669 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.669 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.669 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2021-04-09T18:20:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2021-04-09T18:20:25.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.673 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.687 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.687 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.688 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.688 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.689 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-04-09T18:20:25.702 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.703 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.709 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:25.710 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:25.710 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:25.711 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.712 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:25.713 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.713 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.713 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.714 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-04-09T18:20:25.714 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.715 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.715 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.716 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2021-04-09T18:20:25.716 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2021-04-09T18:20:25.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:25.717 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.718 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:25.718 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:25.718 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.719 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.719 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2021-04-09T18:20:25.719 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-04-09T18:20:25.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.720 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.721 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_iterations": { 2021-04-09T18:20:25.721 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_iterations", 2021-04-09T18:20:25.722 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:25.723 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.724 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2021-04-09T18:20:25.724 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.724 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.725 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.725 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimization iterations", 2021-04-09T18:20:25.726 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.726 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.726 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.728 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2021-04-09T18:20:25.729 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:25.729 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:25.729 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:25.730 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2021-04-09T18:20:25.730 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2021-04-09T18:20:25.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:25.731 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.731 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2021-04-09T18:20:25.732 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.732 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.733 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.734 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2021-04-09T18:20:25.734 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.735 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.735 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2021-04-09T18:20:25.736 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2021-04-09T18:20:25.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:25.737 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.737 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:25.737 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2021-04-09T18:20:25.738 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.738 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.738 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.739 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2021-04-09T18:20:25.739 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.740 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:25.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:25.742 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2021-04-09T18:20:25.743 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:25.743 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:25.744 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:25.744 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2021-04-09T18:20:25.745 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2021-04-09T18:20:25.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.746 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.747 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.747 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.747 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.748 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.748 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.749 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.749 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.749 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.750 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2021-04-09T18:20:25.751 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2021-04-09T18:20:25.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.751 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.752 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.752 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:25.752 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.753 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.753 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.753 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.754 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.754 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.755 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.755 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-04-09T18:20:25.756 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-04-09T18:20:25.756 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.757 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.757 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.757 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.758 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.758 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.758 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.759 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.759 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.759 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.760 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2021-04-09T18:20:25.761 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2021-04-09T18:20:25.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.761 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.762 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.762 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.763 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.763 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.764 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.765 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.765 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.766 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.767 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_cephfs": { 2021-04-09T18:20:25.767 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-04-09T18:20:25.768 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.768 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.768 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.769 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.769 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.770 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.770 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.771 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.771 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.771 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.772 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.772 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_iscsi": { 2021-04-09T18:20:25.773 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-04-09T18:20:25.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.774 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.774 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.774 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.775 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.775 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.776 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.776 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.777 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.777 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.778 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_mirroring": { 2021-04-09T18:20:25.779 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-04-09T18:20:25.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.779 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.780 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.781 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.781 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.782 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.782 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.782 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.783 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.784 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rbd": { 2021-04-09T18:20:25.784 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-04-09T18:20:25.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.785 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.785 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.786 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.787 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.787 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.787 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.788 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.788 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.789 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.789 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rgw": { 2021-04-09T18:20:25.790 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-04-09T18:20:25.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.790 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.791 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.792 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.792 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.792 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.793 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.793 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.794 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.798 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-04-09T18:20:25.798 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-04-09T18:20:25.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.799 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.799 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.800 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.800 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.801 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.801 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.801 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.802 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.803 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.803 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2021-04-09T18:20:25.804 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2021-04-09T18:20:25.804 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.804 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.805 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:25.805 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.806 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.806 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.806 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.807 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.808 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.809 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-04-09T18:20:25.810 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-04-09T18:20:25.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.812 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.812 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.812 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.813 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.813 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.813 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.814 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.814 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.815 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.816 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2021-04-09T18:20:25.816 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2021-04-09T18:20:25.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.817 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.818 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.819 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.819 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.820 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.820 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.820 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.821 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.822 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2021-04-09T18:20:25.822 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2021-04-09T18:20:25.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.823 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.824 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:25.824 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.824 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.825 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.825 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.826 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-04-09T18:20:25.828 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-04-09T18:20:25.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.829 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.830 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.830 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.830 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.831 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.831 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.833 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.833 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-04-09T18:20:25.834 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-04-09T18:20:25.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.834 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.835 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:25.836 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.836 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.836 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.836 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.836 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.837 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.837 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-04-09T18:20:25.837 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-04-09T18:20:25.838 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.838 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.838 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.838 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.850 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.850 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.850 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.850 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.851 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.851 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.852 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2021-04-09T18:20:25.852 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2021-04-09T18:20:25.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.852 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.853 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.853 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.853 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.853 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.854 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.854 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.854 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.855 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2021-04-09T18:20:25.855 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-04-09T18:20:25.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:25.855 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.856 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.856 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2021-04-09T18:20:25.856 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.856 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.856 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.857 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.857 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.858 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.858 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.859 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2021-04-09T18:20:25.864 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2021-04-09T18:20:25.864 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.865 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.865 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.866 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.866 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.867 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.867 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-04-09T18:20:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-04-09T18:20:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_HOST": { 2021-04-09T18:20:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_HOST", 2021-04-09T18:20:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_PORT": { 2021-04-09T18:20:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_PORT", 2021-04-09T18:20:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "80", 2021-04-09T18:20:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SCHEME": { 2021-04-09T18:20:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SCHEME", 2021-04-09T18:20:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "http", 2021-04-09T18:20:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2021-04-09T18:20:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2021-04-09T18:20:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2021-04-09T18:20:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2021-04-09T18:20:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_USER_ID": { 2021-04-09T18:20:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_USER_ID", 2021-04-09T18:20:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2021-04-09T18:20:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2021-04-09T18:20:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2021-04-09T18:20:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2021-04-09T18:20:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:25.995 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:25.996 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2021-04-09T18:20:25.996 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:25.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:25.997 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:25.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:25.998 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2021-04-09T18:20:25.999 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2021-04-09T18:20:25.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:25.999 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.000 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2021-04-09T18:20:26.001 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.001 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.002 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.002 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.002 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.003 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.004 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:26.004 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:26.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.005 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.006 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.007 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.007 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.019 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.019 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.020 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.020 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.021 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:26.022 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:26.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.022 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.023 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.024 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.024 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.024 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.025 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.025 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.026 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.028 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:26.029 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:26.030 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.030 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.031 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2021-04-09T18:20:26.032 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.032 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.033 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.033 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.034 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.034 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.035 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:26.036 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:26.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.037 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.037 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2021-04-09T18:20:26.038 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.038 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.039 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.039 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.040 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.041 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.042 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:26.042 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:26.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.043 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.043 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:26.043 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.044 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.044 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.044 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.044 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.045 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.045 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2021-04-09T18:20:26.045 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2021-04-09T18:20:26.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.046 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.046 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2021-04-09T18:20:26.046 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.047 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.047 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.047 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.047 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.048 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.048 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.048 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2021-04-09T18:20:26.048 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2021-04-09T18:20:26.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.049 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.049 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2021-04-09T18:20:26.049 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.050 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.050 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:26.051 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2021-04-09T18:20:26.051 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2021-04-09T18:20:26.051 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:26.051 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.051 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.052 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.052 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2021-04-09T18:20:26.053 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2021-04-09T18:20:26.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.053 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.053 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2021-04-09T18:20:26.054 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2021-04-09T18:20:26.054 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2021-04-09T18:20:26.054 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.054 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.055 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.055 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.056 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2021-04-09T18:20:26.056 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2021-04-09T18:20:26.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.056 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.057 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.057 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.057 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.057 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.057 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.058 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.058 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.058 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.059 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:26.059 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:26.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.060 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.060 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.061 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.061 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.061 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.061 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.062 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.062 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.063 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "deepsea", 2021-04-09T18:20:26.064 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.064 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.064 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.064 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_eauth": { 2021-04-09T18:20:26.064 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_eauth", 2021-04-09T18:20:26.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.065 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.065 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "sharedsecret", 2021-04-09T18:20:26.066 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.066 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.066 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.066 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.066 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.067 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.067 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_password": { 2021-04-09T18:20:26.068 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_password", 2021-04-09T18:20:26.068 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.068 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.068 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.068 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.069 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.069 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.069 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.069 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.070 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.070 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.070 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.070 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_url": { 2021-04-09T18:20:26.071 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_url", 2021-04-09T18:20:26.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.071 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.072 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.072 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.072 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.073 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.073 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.073 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.073 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.074 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_username": { 2021-04-09T18:20:26.074 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_username", 2021-04-09T18:20:26.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.075 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.075 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.075 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.075 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.075 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.076 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.076 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.076 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.076 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.077 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.078 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2021-04-09T18:20:26.078 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.078 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.078 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.078 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2021-04-09T18:20:26.079 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2021-04-09T18:20:26.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.079 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.080 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:26.080 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.080 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.080 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.082 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2021-04-09T18:20:26.083 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.083 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2021-04-09T18:20:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2021-04-09T18:20:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2021-04-09T18:20:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-04-09T18:20:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2021-04-09T18:20:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2021-04-09T18:20:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2021-04-09T18:20:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2021-04-09T18:20:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2021-04-09T18:20:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2021-04-09T18:20:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2021-04-09T18:20:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2021-04-09T18:20:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2021-04-09T18:20:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2021-04-09T18:20:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2021-04-09T18:20:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2021-04-09T18:20:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2021-04-09T18:20:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-04-09T18:20:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2021-04-09T18:20:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2021-04-09T18:20:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2021-04-09T18:20:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2021-04-09T18:20:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-04-09T18:20:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cloud", 2021-04-09T18:20:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_cert_context": { 2021-04-09T18:20:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cert_context", 2021-04-09T18:20:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_default_authority": { 2021-04-09T18:20:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_default_authority", 2021-04-09T18:20:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_password": { 2021-04-09T18:20:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_password", 2021-04-09T18:20:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_port": { 2021-04-09T18:20:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_port", 2021-04-09T18:20:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31400", 2021-04-09T18:20:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_retrieve_prediction_interval": { 2021-04-09T18:20:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-04-09T18:20:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_server": { 2021-04-09T18:20:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_server", 2021-04-09T18:20:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_ssl_target_name_override": { 2021-04-09T18:20:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_ssl_target_name_override", 2021-04-09T18:20:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_metrics_interval": { 2021-04-09T18:20:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_metrics_interval", 2021-04-09T18:20:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_smart_interval": { 2021-04-09T18:20:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_smart_interval", 2021-04-09T18:20:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_user": { 2021-04-09T18:20:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_user", 2021-04-09T18:20:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2021-04-09T18:20:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2021-04-09T18:20:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2021-04-09T18:20:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2021-04-09T18:20:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2021-04-09T18:20:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2021-04-09T18:20:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2021-04-09T18:20:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2021-04-09T18:20:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2021-04-09T18:20:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2021-04-09T18:20:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2021-04-09T18:20:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2021-04-09T18:20:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2021-04-09T18:20:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2021-04-09T18:20:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2021-04-09T18:20:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2021-04-09T18:20:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2021-04-09T18:20:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2021-04-09T18:20:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2021-04-09T18:20:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.196 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.197 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.197 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.197 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.198 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.198 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2021-04-09T18:20:26.198 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2021-04-09T18:20:26.198 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.199 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.199 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:26.200 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.200 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.200 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.200 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.200 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.201 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.201 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.201 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:26.202 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:26.202 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.202 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.202 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.203 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:26.203 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.203 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.203 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.203 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2021-04-09T18:20:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2021-04-09T18:20:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2021-04-09T18:20:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.211 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2021-04-09T18:20:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2021-04-09T18:20:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2021-04-09T18:20:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2021-04-09T18:20:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2021-04-09T18:20:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2021-04-09T18:20:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2021-04-09T18:20:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2021-04-09T18:20:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2021-04-09T18:20:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2021-04-09T18:20:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2021-04-09T18:20:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2021-04-09T18:20:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2021-04-09T18:20:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2021-04-09T18:20:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2021-04-09T18:20:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2021-04-09T18:20:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2021-04-09T18:20:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2021-04-09T18:20:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2021-04-09T18:20:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2021-04-09T18:20:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2021-04-09T18:20:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2021-04-09T18:20:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2021-04-09T18:20:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2021-04-09T18:20:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2021-04-09T18:20:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator_cli", 2021-04-09T18:20:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2021-04-09T18:20:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2021-04-09T18:20:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2021-04-09T18:20:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.314 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2021-04-09T18:20:26.314 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.314 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.314 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.315 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:26.315 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:26.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.315 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.316 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:26.316 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.316 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.317 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.317 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.317 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.317 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.318 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.318 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2021-04-09T18:20:26.318 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2021-04-09T18:20:26.319 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.319 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.319 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.319 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2021-04-09T18:20:26.320 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.320 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.320 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.320 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2021-04-09T18:20:26.321 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.321 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.322 INFO:teuthology.orchestra.run.smithi120.stdout: "persist_interval": { 2021-04-09T18:20:26.322 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "persist_interval", 2021-04-09T18:20:26.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.334 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.334 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:26.334 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.335 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.335 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.335 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to persist completed events", 2021-04-09T18:20:26.335 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.336 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.337 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2021-04-09T18:20:26.337 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.338 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.338 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.338 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2021-04-09T18:20:26.338 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2021-04-09T18:20:26.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.355 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.356 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.356 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.356 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.356 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.357 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.357 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.357 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.357 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.358 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2021-04-09T18:20:26.358 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-04-09T18:20:26.358 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.363 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.364 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2021-04-09T18:20:26.364 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.364 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.364 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.365 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.365 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.370 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.370 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2021-04-09T18:20:26.370 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2021-04-09T18:20:26.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.371 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.371 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.372 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.372 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.372 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.372 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.373 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.373 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.373 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.374 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:26.374 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:26.374 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.374 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.375 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.375 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.375 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.375 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.375 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.376 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.376 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.376 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.376 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.377 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:26.377 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:26.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.387 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.387 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.388 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.388 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.388 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.388 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.389 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.389 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.389 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.389 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.390 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2021-04-09T18:20:26.390 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2021-04-09T18:20:26.390 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.390 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.391 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.391 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.391 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.391 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.391 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.392 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.392 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.392 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.406 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2021-04-09T18:20:26.406 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.407 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.407 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:26.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.408 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2021-04-09T18:20:26.408 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.408 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.409 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.409 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:26.409 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:26.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.409 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.410 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.410 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.411 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.412 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.412 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.412 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.412 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.412 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.413 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:26.413 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:26.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.413 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.414 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.414 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.414 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.414 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.415 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.415 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.415 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.415 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.416 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.423 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:26.424 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:26.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.424 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.424 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.425 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.425 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.425 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.425 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.426 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.437 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.438 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2021-04-09T18:20:26.439 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.439 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.439 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:26.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.440 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2021-04-09T18:20:26.440 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.440 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.440 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.441 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2021-04-09T18:20:26.441 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2021-04-09T18:20:26.441 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.441 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.442 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.442 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.442 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.442 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.442 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.443 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.443 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.444 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2021-04-09T18:20:26.444 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2021-04-09T18:20:26.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.444 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.445 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2021-04-09T18:20:26.445 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.445 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.445 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.446 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.446 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.446 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.447 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2021-04-09T18:20:26.447 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2021-04-09T18:20:26.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.458 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.459 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.459 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.459 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.460 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.460 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.460 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.461 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.461 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2021-04-09T18:20:26.461 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2021-04-09T18:20:26.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.462 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.462 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.462 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.462 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.463 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.463 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.463 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.463 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.464 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.464 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2021-04-09T18:20:26.464 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2021-04-09T18:20:26.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.466 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.466 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.466 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.466 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.467 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.467 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2021-04-09T18:20:26.467 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2021-04-09T18:20:26.468 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.468 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.468 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.476 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.476 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.476 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.477 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.477 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.477 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.478 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.478 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2021-04-09T18:20:26.478 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2021-04-09T18:20:26.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.479 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.480 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.480 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.480 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.480 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.480 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.481 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.481 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.482 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.482 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2021-04-09T18:20:26.483 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2021-04-09T18:20:26.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.484 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.484 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.484 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:26.485 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.485 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.485 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.486 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.486 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.487 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.487 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.488 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2021-04-09T18:20:26.488 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2021-04-09T18:20:26.489 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.500 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.501 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.501 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.501 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.501 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.502 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.502 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.502 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.503 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.504 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2021-04-09T18:20:26.504 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2021-04-09T18:20:26.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.505 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.505 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.506 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.506 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.506 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.507 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.507 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.508 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.509 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2021-04-09T18:20:26.509 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2021-04-09T18:20:26.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.510 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.520 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.520 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.521 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.521 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.522 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.522 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.523 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.523 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.524 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.526 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh", 2021-04-09T18:20:26.526 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.526 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.527 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.527 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_cache_timeout_min": { 2021-04-09T18:20:26.528 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_cache_timeout_min", 2021-04-09T18:20:26.528 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.528 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.529 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.529 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.530 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.530 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.530 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.531 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2021-04-09T18:20:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2021-04-09T18:20:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2021-04-09T18:20:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2021-04-09T18:20:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2021-04-09T18:20:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2021-04-09T18:20:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-04-09T18:20:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2021-04-09T18:20:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2021-04-09T18:20:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2021-04-09T18:20:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2021-04-09T18:20:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2021-04-09T18:20:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.603 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2021-04-09T18:20:26.603 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2021-04-09T18:20:26.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.604 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.605 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:26.605 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.606 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.606 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.607 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.607 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.608 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.609 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2021-04-09T18:20:26.610 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2021-04-09T18:20:26.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.611 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.613 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:26.614 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.614 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.614 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.615 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.615 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.616 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.616 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.617 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2021-04-09T18:20:26.617 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2021-04-09T18:20:26.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.618 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.619 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:26.620 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.620 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.620 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.621 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.621 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.621 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.623 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.625 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2021-04-09T18:20:26.625 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2021-04-09T18:20:26.625 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.626 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.627 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:26.627 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.627 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.628 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.628 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.629 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.629 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.629 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.630 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2021-04-09T18:20:26.631 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2021-04-09T18:20:26.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.632 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.635 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.635 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:26.636 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.636 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.636 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.636 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.637 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.637 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.638 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2021-04-09T18:20:26.638 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2021-04-09T18:20:26.638 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.638 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.638 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.639 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-04-09T18:20:26.639 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.639 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.639 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.640 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.640 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.640 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.641 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:26.641 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:26.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.641 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.642 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:26.642 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.642 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.642 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.643 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.643 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.643 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.645 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:26.645 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:26.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.646 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.646 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2021-04-09T18:20:26.646 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2021-04-09T18:20:26.647 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.647 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.647 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.647 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.648 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.648 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.648 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2021-04-09T18:20:26.648 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2021-04-09T18:20:26.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.649 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.649 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2021-04-09T18:20:26.649 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.650 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.650 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.650 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.650 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.651 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.651 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2021-04-09T18:20:26.651 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2021-04-09T18:20:26.652 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.652 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.652 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:26.652 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.653 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.653 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.653 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.653 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.654 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.655 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2021-04-09T18:20:26.656 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2021-04-09T18:20:26.656 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.656 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.656 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.657 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:26.657 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.657 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.658 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.658 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2021-04-09T18:20:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2021-04-09T18:20:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2021-04-09T18:20:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2021-04-09T18:20:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-04-09T18:20:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2021-04-09T18:20:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2021-04-09T18:20:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2021-04-09T18:20:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2021-04-09T18:20:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2021-04-09T18:20:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2021-04-09T18:20:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2021-04-09T18:20:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2021-04-09T18:20:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2021-04-09T18:20:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2021-04-09T18:20:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2021-04-09T18:20:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2021-04-09T18:20:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2021-04-09T18:20:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2021-04-09T18:20:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2021-04-09T18:20:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2021-04-09T18:20:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-04-09T18:20:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2021-04-09T18:20:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "modules": [ 2021-04-09T18:20:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "iostat", 2021-04-09T18:20:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: "restful" 2021-04-09T18:20:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2021-04-09T18:20:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2021-04-09T18:20:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:26.753 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.753 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.753 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.754 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2021-04-09T18:20:26.779 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2021-04-09T18:20:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2021-04-09T18:20:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2021-04-09T18:20:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2021-04-09T18:20:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2021-04-09T18:20:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2021-04-09T18:20:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2021-04-09T18:20:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2021-04-09T18:20:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2021-04-09T18:20:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2021-04-09T18:20:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2021-04-09T18:20:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2021-04-09T18:20:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2021-04-09T18:20:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2021-04-09T18:20:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2021-04-09T18:20:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2021-04-09T18:20:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2021-04-09T18:20:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2021-04-09T18:20:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2021-04-09T18:20:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2021-04-09T18:20:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2021-04-09T18:20:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2021-04-09T18:20:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2021-04-09T18:20:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2021-04-09T18:20:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2021-04-09T18:20:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2021-04-09T18:20:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ansible", 2021-04-09T18:20:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "server_url": { 2021-04-09T18:20:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_url", 2021-04-09T18:20:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_server": { 2021-04-09T18:20:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_server", 2021-04-09T18:20:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2021-04-09T18:20:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2021-04-09T18:20:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2021-04-09T18:20:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2021-04-09T18:20:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2021-04-09T18:20:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2021-04-09T18:20:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2021-04-09T18:20:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2021-04-09T18:20:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2021-04-09T18:20:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2021-04-09T18:20:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-04-09T18:20:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2021-04-09T18:20:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2021-04-09T18:20:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2021-04-09T18:20:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2021-04-09T18:20:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-04-09T18:20:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2021-04-09T18:20:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2021-04-09T18:20:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2021-04-09T18:20:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-04-09T18:20:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-04-09T18:20:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2021-04-09T18:20:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2021-04-09T18:20:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2021-04-09T18:20:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2021-04-09T18:20:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2021-04-09T18:20:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2021-04-09T18:20:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-04-09T18:20:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2021-04-09T18:20:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2021-04-09T18:20:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2400", 2021-04-09T18:20:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2021-04-09T18:20:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-04-09T18:20:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2021-04-09T18:20:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2021-04-09T18:20:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2021-04-09T18:20:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2021-04-09T18:20:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "7", 2021-04-09T18:20:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-04-09T18:20:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-04-09T18:20:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2021-04-09T18:20:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2021-04-09T18:20:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2021-04-09T18:20:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-04-09T18:20:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2021-04-09T18:20:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2021-04-09T18:20:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "none", 2021-04-09T18:20:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2021-04-09T18:20:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2021-04-09T18:20:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap" 2021-04-09T18:20:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2021-04-09T18:20:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2021-04-09T18:20:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2021-04-09T18:20:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-04-09T18:20:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-04-09T18:20:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2021-04-09T18:20:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2021-04-09T18:20:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2021-04-09T18:20:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2021-04-09T18:20:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-04-09T18:20:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_iterations": { 2021-04-09T18:20:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_iterations", 2021-04-09T18:20:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2021-04-09T18:20:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2021-04-09T18:20:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimization iterations", 2021-04-09T18:20:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2021-04-09T18:20:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2021-04-09T18:20:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2021-04-09T18:20:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:27.040 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.040 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2021-04-09T18:20:27.040 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.041 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.041 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.041 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2021-04-09T18:20:27.041 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.041 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.042 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.042 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2021-04-09T18:20:27.042 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2021-04-09T18:20:27.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:27.043 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.043 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2021-04-09T18:20:27.045 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.045 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.045 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.045 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2021-04-09T18:20:27.045 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.046 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.047 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2021-04-09T18:20:27.047 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.048 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.048 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.048 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2021-04-09T18:20:27.048 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2021-04-09T18:20:27.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.049 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.049 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.053 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.053 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.053 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.054 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.054 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.055 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.055 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2021-04-09T18:20:27.056 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2021-04-09T18:20:27.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.056 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.057 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:27.057 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.057 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.057 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.058 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.058 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.058 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.058 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.059 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-04-09T18:20:27.059 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-04-09T18:20:27.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.059 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.060 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.060 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.060 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.060 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.061 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.061 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.062 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.062 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2021-04-09T18:20:27.062 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2021-04-09T18:20:27.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.063 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.063 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.063 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.064 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.064 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.064 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.065 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.065 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.066 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_cephfs": { 2021-04-09T18:20:27.066 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-04-09T18:20:27.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.066 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.067 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.067 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.067 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.068 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.068 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.068 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.068 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.069 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_iscsi": { 2021-04-09T18:20:27.069 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-04-09T18:20:27.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.070 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.070 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.070 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.070 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.071 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.071 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.071 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.072 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.072 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_mirroring": { 2021-04-09T18:20:27.072 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-04-09T18:20:27.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.073 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.073 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.073 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.073 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.074 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.074 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.074 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.074 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.086 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.087 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rbd": { 2021-04-09T18:20:27.087 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-04-09T18:20:27.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.087 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.088 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.088 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.088 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.089 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.089 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.089 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.089 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.090 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_rgw": { 2021-04-09T18:20:27.090 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-04-09T18:20:27.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.090 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.091 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.091 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.091 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.092 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.092 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.092 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.092 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.093 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-04-09T18:20:27.093 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-04-09T18:20:27.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.094 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.094 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.094 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.094 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.095 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.095 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.097 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.097 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.098 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2021-04-09T18:20:27.098 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2021-04-09T18:20:27.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.098 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.099 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:27.099 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.099 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.100 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.100 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.100 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.100 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.101 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-04-09T18:20:27.101 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-04-09T18:20:27.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.101 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.102 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.102 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.102 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.103 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.103 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.103 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.103 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.103 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.104 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2021-04-09T18:20:27.104 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2021-04-09T18:20:27.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.105 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.105 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.105 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.106 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.106 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.106 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.106 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.107 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.108 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2021-04-09T18:20:27.108 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2021-04-09T18:20:27.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.108 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.109 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:27.109 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.109 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.110 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.110 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.110 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.111 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.111 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-04-09T18:20:27.111 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-04-09T18:20:27.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.112 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.112 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.112 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.113 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.113 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.113 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.113 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.114 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.114 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-04-09T18:20:27.114 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-04-09T18:20:27.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.115 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.116 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.116 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:27.116 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.116 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.117 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.118 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.118 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.118 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.119 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-04-09T18:20:27.119 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-04-09T18:20:27.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.119 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.120 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.120 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.120 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.121 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.121 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.121 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.121 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.122 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2021-04-09T18:20:27.122 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2021-04-09T18:20:27.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.123 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.123 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.123 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.124 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.124 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.124 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.124 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.125 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.125 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2021-04-09T18:20:27.125 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-04-09T18:20:27.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.126 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.126 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2021-04-09T18:20:27.126 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.127 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.127 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.138 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.138 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.139 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.139 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.139 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2021-04-09T18:20:27.140 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2021-04-09T18:20:27.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.140 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.140 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.141 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.141 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.141 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.141 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.141 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.142 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.142 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.143 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-04-09T18:20:27.143 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-04-09T18:20:27.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.143 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2021-04-09T18:20:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_HOST": { 2021-04-09T18:20:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_HOST", 2021-04-09T18:20:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_PORT": { 2021-04-09T18:20:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_PORT", 2021-04-09T18:20:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "80", 2021-04-09T18:20:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SCHEME": { 2021-04-09T18:20:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SCHEME", 2021-04-09T18:20:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "http", 2021-04-09T18:20:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2021-04-09T18:20:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2021-04-09T18:20:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2021-04-09T18:20:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2021-04-09T18:20:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_USER_ID": { 2021-04-09T18:20:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_USER_ID", 2021-04-09T18:20:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2021-04-09T18:20:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2021-04-09T18:20:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2021-04-09T18:20:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2021-04-09T18:20:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2021-04-09T18:20:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2021-04-09T18:20:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2021-04-09T18:20:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2021-04-09T18:20:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2021-04-09T18:20:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2021-04-09T18:20:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2021-04-09T18:20:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2021-04-09T18:20:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2021-04-09T18:20:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2021-04-09T18:20:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2021-04-09T18:20:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2021-04-09T18:20:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2021-04-09T18:20:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2021-04-09T18:20:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2021-04-09T18:20:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2021-04-09T18:20:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2021-04-09T18:20:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2021-04-09T18:20:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2021-04-09T18:20:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2021-04-09T18:20:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2021-04-09T18:20:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2021-04-09T18:20:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "deepsea", 2021-04-09T18:20:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_eauth": { 2021-04-09T18:20:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_eauth", 2021-04-09T18:20:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "sharedsecret", 2021-04-09T18:20:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_password": { 2021-04-09T18:20:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_password", 2021-04-09T18:20:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_url": { 2021-04-09T18:20:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_url", 2021-04-09T18:20:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "salt_api_username": { 2021-04-09T18:20:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "salt_api_username", 2021-04-09T18:20:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2021-04-09T18:20:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2021-04-09T18:20:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2021-04-09T18:20:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2021-04-09T18:20:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2021-04-09T18:20:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2021-04-09T18:20:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.388 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2021-04-09T18:20:27.388 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.389 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.389 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.389 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-04-09T18:20:27.389 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.390 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.390 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.391 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2021-04-09T18:20:27.391 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2021-04-09T18:20:27.391 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.391 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.392 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2021-04-09T18:20:27.392 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.392 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.393 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.393 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2021-04-09T18:20:27.393 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.393 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.394 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2021-04-09T18:20:27.394 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2021-04-09T18:20:27.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:27.395 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.395 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2021-04-09T18:20:27.395 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.396 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.396 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.396 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2021-04-09T18:20:27.396 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.396 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.397 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.397 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2021-04-09T18:20:27.397 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2021-04-09T18:20:27.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:27.398 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.398 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:27.398 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.399 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.399 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.399 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2021-04-09T18:20:27.399 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.400 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.410 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2021-04-09T18:20:27.412 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2021-04-09T18:20:27.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.412 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.413 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.413 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.413 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.413 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.414 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-04-09T18:20:27.414 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.414 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.414 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.415 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:27.415 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:27.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:27.415 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.416 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:27.416 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.432 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.433 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.433 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2021-04-09T18:20:27.433 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.434 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.435 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2021-04-09T18:20:27.436 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2021-04-09T18:20:27.436 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:27.453 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.455 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2021-04-09T18:20:27.455 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.456 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.456 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.456 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-04-09T18:20:27.457 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.457 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.459 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cloud", 2021-04-09T18:20:27.460 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.460 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.460 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.461 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_cert_context": { 2021-04-09T18:20:27.461 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_cert_context", 2021-04-09T18:20:27.462 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.469 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.469 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.469 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.469 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.469 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.470 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.470 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.470 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.471 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.471 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_default_authority": { 2021-04-09T18:20:27.471 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_default_authority", 2021-04-09T18:20:27.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.472 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.472 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:27.472 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.473 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.473 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.473 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.473 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.473 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.474 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.487 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_password": { 2021-04-09T18:20:27.487 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_password", 2021-04-09T18:20:27.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.488 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.488 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.489 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.489 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.489 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.490 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.490 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.494 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.494 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.506 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_port": { 2021-04-09T18:20:27.507 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_port", 2021-04-09T18:20:27.508 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.508 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.509 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.509 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31400", 2021-04-09T18:20:27.510 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.510 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.510 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.511 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.511 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.512 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.513 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_retrieve_prediction_interval": { 2021-04-09T18:20:27.513 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-04-09T18:20:27.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.514 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.515 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.515 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:27.515 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.525 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.526 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.528 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.530 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.530 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.531 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.532 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_server": { 2021-04-09T18:20:27.532 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_server", 2021-04-09T18:20:27.533 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.533 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.533 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.534 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.534 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.534 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.535 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.539 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.540 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.540 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.540 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.541 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_ssl_target_name_override": { 2021-04-09T18:20:27.542 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_ssl_target_name_override", 2021-04-09T18:20:27.542 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.543 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.543 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.543 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "localhost", 2021-04-09T18:20:27.544 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.544 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.545 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.545 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.546 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.546 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.547 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_metrics_interval": { 2021-04-09T18:20:27.548 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_metrics_interval", 2021-04-09T18:20:27.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.565 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.566 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.566 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:27.566 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.567 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.568 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.568 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.576 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.576 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.577 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.578 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_upload_smart_interval": { 2021-04-09T18:20:27.578 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_upload_smart_interval", 2021-04-09T18:20:27.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.579 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.580 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.580 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "43200", 2021-04-09T18:20:27.580 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.580 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.580 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.581 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.581 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.581 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.581 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.582 INFO:teuthology.orchestra.run.smithi120.stdout: "diskprediction_user": { 2021-04-09T18:20:27.582 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_user", 2021-04-09T18:20:27.582 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.582 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.583 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.583 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.583 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.584 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.584 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.584 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.584 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.584 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.585 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:27.587 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:27.588 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.588 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.588 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.588 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:27.589 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.589 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.589 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.589 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.589 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.590 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.591 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2021-04-09T18:20:27.592 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.592 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.592 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.592 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2021-04-09T18:20:27.592 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2021-04-09T18:20:27.593 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.593 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.593 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.593 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2021-04-09T18:20:27.594 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.594 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.594 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.594 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.595 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.597 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.598 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:27.598 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:27.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.598 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.599 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2021-04-09T18:20:27.599 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.599 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.599 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.600 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.600 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.600 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.601 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2021-04-09T18:20:27.602 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2021-04-09T18:20:27.602 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2021-04-09T18:20:27.602 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.602 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2021-04-09T18:20:27.602 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2021-04-09T18:20:27.603 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.603 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.603 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.603 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2021-04-09T18:20:27.604 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.604 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.605 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.605 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.605 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.606 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.607 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.608 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2021-04-09T18:20:27.608 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2021-04-09T18:20:27.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.609 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.610 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2021-04-09T18:20:27.610 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.611 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.611 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.611 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.612 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.612 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.613 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.613 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2021-04-09T18:20:27.614 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2021-04-09T18:20:27.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.614 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.615 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.615 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:27.615 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.616 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.616 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.618 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.618 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.619 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.620 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:27.620 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:27.620 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.621 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.621 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.622 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2021-04-09T18:20:27.622 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.622 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.623 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.623 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.624 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.625 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.625 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2021-04-09T18:20:27.626 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2021-04-09T18:20:27.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.627 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.639 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:27.640 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.640 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.640 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.641 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.641 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.641 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.642 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.643 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2021-04-09T18:20:27.643 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2021-04-09T18:20:27.644 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.644 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.645 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2021-04-09T18:20:27.645 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.646 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.646 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.646 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.647 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.648 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.661 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2021-04-09T18:20:27.661 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2021-04-09T18:20:27.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.662 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.663 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2021-04-09T18:20:27.663 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.664 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.664 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.664 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.665 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.665 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.666 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.667 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2021-04-09T18:20:27.667 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2021-04-09T18:20:27.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.673 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.674 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:27.675 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.676 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.676 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.677 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.677 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.678 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.678 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.679 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2021-04-09T18:20:27.679 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2021-04-09T18:20:27.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.692 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.693 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.693 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:27.694 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.694 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.694 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.695 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.695 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.695 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.696 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.697 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2021-04-09T18:20:27.697 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2021-04-09T18:20:27.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.698 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.699 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2021-04-09T18:20:27.699 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.699 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.700 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.700 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.700 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.716 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2021-04-09T18:20:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2021-04-09T18:20:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2021-04-09T18:20:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2021-04-09T18:20:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2021-04-09T18:20:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2021-04-09T18:20:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2021-04-09T18:20:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2021-04-09T18:20:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2021-04-09T18:20:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2021-04-09T18:20:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2021-04-09T18:20:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2021-04-09T18:20:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2021-04-09T18:20:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2021-04-09T18:20:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2021-04-09T18:20:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2021-04-09T18:20:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2021-04-09T18:20:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2021-04-09T18:20:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2021-04-09T18:20:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2021-04-09T18:20:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.788 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.790 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.791 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.791 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.792 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.792 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2021-04-09T18:20:27.793 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.793 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.794 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2021-04-09T18:20:27.795 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2021-04-09T18:20:27.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.795 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.796 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2021-04-09T18:20:27.797 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2021-04-09T18:20:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator_cli", 2021-04-09T18:20:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2021-04-09T18:20:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2021-04-09T18:20:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2021-04-09T18:20:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2021-04-09T18:20:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2021-04-09T18:20:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2021-04-09T18:20:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2021-04-09T18:20:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2021-04-09T18:20:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2021-04-09T18:20:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2021-04-09T18:20:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: "persist_interval": { 2021-04-09T18:20:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "persist_interval", 2021-04-09T18:20:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2021-04-09T18:20:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2021-04-09T18:20:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.879 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.879 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.879 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to persist completed events", 2021-04-09T18:20:27.879 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.879 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2021-04-09T18:20:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2021-04-09T18:20:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2021-04-09T18:20:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2021-04-09T18:20:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-04-09T18:20:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2021-04-09T18:20:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2021-04-09T18:20:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2021-04-09T18:20:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2021-04-09T18:20:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2021-04-09T18:20:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2021-04-09T18:20:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2021-04-09T18:20:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2021-04-09T18:20:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2021-04-09T18:20:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2021-04-09T18:20:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2021-04-09T18:20:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2021-04-09T18:20:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2021-04-09T18:20:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2021-04-09T18:20:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2021-04-09T18:20:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2021-04-09T18:20:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2021-04-09T18:20:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2021-04-09T18:20:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2021-04-09T18:20:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2021-04-09T18:20:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2021-04-09T18:20:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2021-04-09T18:20:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2021-04-09T18:20:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2021-04-09T18:20:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2021-04-09T18:20:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2021-04-09T18:20:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2021-04-09T18:20:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2021-04-09T18:20:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2021-04-09T18:20:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.057 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2021-04-09T18:20:28.058 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2021-04-09T18:20:28.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:28.058 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.058 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.059 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.059 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.059 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.060 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2021-04-09T18:20:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2021-04-09T18:20:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2021-04-09T18:20:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2021-04-09T18:20:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2021-04-09T18:20:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2021-04-09T18:20:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.079 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2021-04-09T18:20:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2021-04-09T18:20:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh", 2021-04-09T18:20:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_cache_timeout_min": { 2021-04-09T18:20:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_cache_timeout_min", 2021-04-09T18:20:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2021-04-09T18:20:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2021-04-09T18:20:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2021-04-09T18:20:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2021-04-09T18:20:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2021-04-09T18:20:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2021-04-09T18:20:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-04-09T18:20:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2021-04-09T18:20:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2021-04-09T18:20:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2021-04-09T18:20:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2021-04-09T18:20:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:28.173 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.174 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:28.174 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.176 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.176 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.176 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2021-04-09T18:20:28.177 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.178 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.178 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2021-04-09T18:20:28.179 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2021-04-09T18:20:28.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:28.180 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.192 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.192 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:28.193 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.193 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.193 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.194 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.194 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.195 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.197 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2021-04-09T18:20:28.197 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2021-04-09T18:20:28.198 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:28.198 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.199 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2021-04-09T18:20:28.202 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.203 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.203 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.204 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.204 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.205 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.206 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2021-04-09T18:20:28.213 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2021-04-09T18:20:28.214 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:28.214 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.215 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.215 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:28.215 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.216 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.216 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.223 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.224 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.224 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.225 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.226 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2021-04-09T18:20:28.226 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2021-04-09T18:20:28.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.227 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.234 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.235 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:28.235 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.236 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.236 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.237 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.237 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.237 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.238 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.241 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2021-04-09T18:20:28.242 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2021-04-09T18:20:28.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.243 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.243 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.243 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:28.244 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.261 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.261 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.261 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.263 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.263 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.264 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2021-04-09T18:20:28.264 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2021-04-09T18:20:28.265 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.265 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.265 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.266 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-04-09T18:20:28.266 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.267 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.267 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.268 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.268 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.268 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.269 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.270 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2021-04-09T18:20:28.278 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2021-04-09T18:20:28.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:28.279 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.280 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:28.282 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.282 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.283 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.283 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.284 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.284 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.285 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:28.285 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:28.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:28.285 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.286 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2021-04-09T18:20:28.286 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2021-04-09T18:20:28.286 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.287 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.287 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.287 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.287 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.288 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2021-04-09T18:20:28.288 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2021-04-09T18:20:28.288 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:28.288 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.289 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2021-04-09T18:20:28.289 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.289 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.290 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.290 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.290 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.290 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.291 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2021-04-09T18:20:28.292 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2021-04-09T18:20:28.292 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2021-04-09T18:20:28.292 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.293 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2021-04-09T18:20:28.293 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.293 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.294 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.294 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.294 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.295 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.295 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2021-04-09T18:20:28.296 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2021-04-09T18:20:28.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.296 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.296 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.296 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:28.297 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.297 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.297 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.298 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.298 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.302 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.303 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.303 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2021-04-09T18:20:28.304 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2021-04-09T18:20:28.304 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.304 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.307 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:28.307 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.308 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.308 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.308 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.309 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.309 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.310 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2021-04-09T18:20:28.310 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2021-04-09T18:20:28.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.311 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.311 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-04-09T18:20:28.311 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.311 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.312 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.312 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.331 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.331 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.331 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:28.335 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2021-04-09T18:20:28.335 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:28.335 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:28.335 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": {} 2021-04-09T18:20:28.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:28.336 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2021-04-09T18:20:28.336 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:28.336 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:28.337 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:28.337 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2021-04-09T18:20:28.337 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2021-04-09T18:20:28.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:28.338 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.338 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.338 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2021-04-09T18:20:28.338 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.339 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.339 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.339 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2021-04-09T18:20:28.339 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.340 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2021-04-09T18:20:28.366 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2021-04-09T18:20:28.366 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2021-04-09T18:20:28.366 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2021-04-09T18:20:28.367 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2021-04-09T18:20:28.367 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2021-04-09T18:20:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2021-04-09T18:20:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2021-04-09T18:20:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2021-04-09T18:20:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2021-04-09T18:20:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2021-04-09T18:20:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2021-04-09T18:20:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2021-04-09T18:20:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2021-04-09T18:20:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "None", 2021-04-09T18:20:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2021-04-09T18:20:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2021-04-09T18:20:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2021-04-09T18:20:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2021-04-09T18:20:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2021-04-09T18:20:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2021-04-09T18:20:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2021-04-09T18:20:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2021-04-09T18:20:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2021-04-09T18:20:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-04-09T18:20:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2021-04-09T18:20:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2021-04-09T18:20:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2021-04-09T18:20:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2021-04-09T18:20:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2021-04-09T18:20:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2021-04-09T18:20:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2021-04-09T18:20:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.468 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2021-04-09T18:20:28.469 INFO:teuthology.orchestra.run.smithi120.stdout: "services": {}, 2021-04-09T18:20:28.469 INFO:teuthology.orchestra.run.smithi120.stdout: "always_on_modules": { 2021-04-09T18:20:28.470 INFO:teuthology.orchestra.run.smithi120.stdout: "nautilus": [ 2021-04-09T18:20:28.470 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2021-04-09T18:20:28.470 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2021-04-09T18:20:28.471 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2021-04-09T18:20:28.471 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator_cli", 2021-04-09T18:20:28.472 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2021-04-09T18:20:28.472 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2021-04-09T18:20:28.472 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2021-04-09T18:20:28.472 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2021-04-09T18:20:28.472 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2021-04-09T18:20:28.473 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:28.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.473 INFO:teuthology.orchestra.run.smithi120.stdout: "servicemap": { 2021-04-09T18:20:28.474 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 1, 2021-04-09T18:20:28.474 INFO:teuthology.orchestra.run.smithi120.stdout: "modified": "0.000000", 2021-04-09T18:20:28.475 INFO:teuthology.orchestra.run.smithi120.stdout: "services": {} 2021-04-09T18:20:28.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:28.485 INFO:teuthology.orchestra.run.smithi120.stdout: "progress_events": {} 2021-04-09T18:20:28.485 INFO:teuthology.orchestra.run.smithi120.stdout:} 2021-04-09T18:20:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.183 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f466c018930 msgr2=0x7f466c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.183 7f468c9c5700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f466c018930 0x7f466c01ae10 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.183 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f468819b5c0 msgr2=0x7f4688184dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.183 7f468c9c5700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f468819b5c0 0x7f4688184dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f4680006f20 tx=0x7f468000b990).stop 2021-04-09T18:20:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.183 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 shutdown_connections 2021-04-09T18:20:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.183 7f468c9c5700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4688185e10 0x7f4688186640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.183 7f468c9c5700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f466c018930 0x7f466c01ae10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.183 7f468c9c5700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f46881853f0 0x7f46881857f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.183 7f468c9c5700 1 --2- 172.21.15.120:0/2889371873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f468819b5c0 0x7f4688184dd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.184 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 >> 172.21.15.120:0/2889371873 conn(0x7f468818dd30 msgr2=0x7f468809bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.184 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 shutdown_connections 2021-04-09T18:20:28.490 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:25.184 7f468c9c5700 1 -- 172.21.15.120:0/2889371873 wait complete. 2021-04-09T18:20:28.505 INFO:tasks.mds_thrash.ceph_manager:{'fsid': 'dcbe2161-e5ca-44be-8661-d46578834d60', 'health': {'checks': {}, 'status': 'HEALTH_OK'}, 'election_epoch': 4, 'quorum': [0, 1, 2], 'quorum_names': ['a', 'b', 'c'], 'quorum_age': 54, 'monmap': {'epoch': 1, 'min_mon_release_name': '14', 'num_mons': 3}, 'osdmap': {'osdmap': {'epoch': 22, 'num_osds': 8, 'num_up_osds': 8, 'num_in_osds': 8, 'num_remapped_pgs': 0}}, 'pgmap': {'pgs_by_state': [{'state_name': 'active+clean', 'count': 24}], 'num_pgs': 24, 'num_pools': 3, 'num_objects': 22, 'data_bytes': 2286, 'bytes_used': 8591900672, 'bytes_avail': 764502212608, 'bytes_total': 773094113280}, 'fsmap': {'epoch': 7, 'id': 1, 'up': 1, 'in': 1, 'max': 1, 'by_rank': [{'filesystem_id': 1, 'rank': 0, 'name': 'b', 'status': 'up:active', 'gid': 4292}], 'up:standby': 1}, 'mgrmap': {'epoch': 3, 'active_gid': 4106, 'active_name': 'x', 'active_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 23529}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 23529}]}, 'active_addr': '172.21.15.134:6801/23529', 'active_change': '2021-04-09 18:19:32.736784', 'available': True, 'standbys': [{'gid': 4104, 'name': 'y', 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}]}], 'modules': ['iostat', 'restful'], 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}], 'services': {}, 'always_on_modules': {'nautilus': ['balancer', 'crash', 'devicehealth', 'orchestrator_cli', 'progress', 'rbd_support', 'status', 'volumes']}}, 'servicemap': {'epoch': 1, 'modified': '0.000000', 'services': {}}, 'progress_events': {}} 2021-04-09T18:20:28.513 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:20:28.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.658 7f4aa32d6700 1 Processor -- start 2021-04-09T18:20:28.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.658 7f4aa32d6700 1 -- start start 2021-04-09T18:20:28.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.658 7f4aa32d6700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4a9c0d7560 0x7f4a9c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:28.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.658 7f4aa32d6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a9c0d63b0 0x7f4a9c1ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:28.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.658 7f4aa32d6700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9c0d7960 con 0x7f4a9c0d7160 2021-04-09T18:20:28.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.658 7f4aa32d6700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c0d80f0 con 0x7f4a9c0d7560 2021-04-09T18:20:28.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.658 7f4aa32d6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0d6be0 con 0x7f4a9c0d63b0 2021-04-09T18:20:28.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.658 7f4aa10f2700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f4a9c0d7160 0x7f4a9c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48198/0 (socket says 172.21.15.120:48198) 2021-04-09T18:20:28.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.658 7f4aa10f2700 1 -- 172.21.15.120:0/2123417771 learned_addr learned my addr 172.21.15.120:0/2123417771 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:28.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa18f3700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a9c0d63b0 0x7f4a9c1ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:28.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa08f1700 1 --2- 172.21.15.120:0/2123417771 >> v2:172.21.15.134:3300/0 conn(0x7f4a9c0d7560 0x7f4a9c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:28.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940984355 0 0) 0x7f4a98001060 con 0x7f4a9c0d7160 2021-04-09T18:20:28.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a88002fe0 con 0x7f4a9c0d7160 2021-04-09T18:20:28.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3521672770 0 0) 0x7f4a98001460 con 0x7f4a9c0d7160 2021-04-09T18:20:28.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a9c0d63b0 msgr2=0x7f4a9c1ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:28.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a9c0d63b0 0x7f4a9c1ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 >> v2:172.21.15.134:3300/0 conn(0x7f4a9c0d7560 msgr2=0x7f4a9c0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:28.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 --2- 172.21.15.120:0/2123417771 >> v2:172.21.15.134:3300/0 conn(0x7f4a9c0d7560 0x7f4a9c0d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c1a2ac0 con 0x7f4a9c0d7160 2021-04-09T18:20:28.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f4a98001980 con 0x7f4a9c0d7160 2021-04-09T18:20:28.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 >> v1:172.21.15.120:6789/0 conn(0x7f4a9c0d7160 legacy=0x7f4a9c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:28.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a88003a40 0x7f4a88005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a8804a780 0x7f4a8804cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa10f2700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a88003a40 0x7f4a88005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:28.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a8804d510 0x7f4a8804fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:28.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880502e0 con 0x7f4a88003a40 2021-04-09T18:20:28.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a88050500 con 0x7f4a8804d510 2021-04-09T18:20:28.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a88050720 con 0x7f4a8804a780 2021-04-09T18:20:28.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa08f1700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a8804a780 0x7f4a8804cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:28.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa18f3700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a8804d510 0x7f4a8804fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:28.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa10f2700 1 -- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a8804a780 msgr2=0x7f4a8804cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:28.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa10f2700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a8804a780 0x7f4a8804cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa10f2700 1 -- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a8804d510 msgr2=0x7f4a8804fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:28.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa10f2700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a8804d510 0x7f4a8804fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.659 7f4aa10f2700 1 -- 172.21.15.120:0/2123417771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a880509c0 con 0x7f4a88003a40 2021-04-09T18:20:28.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.660 7f4aa10f2700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a88003a40 0x7f4a88005ef0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f4a98007cf0 tx=0x7f4a9800a310).ready entity=mon.0 client_cookie=b9d1bb71898e0f1a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:28.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.660 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a980017c0 con 0x7f4a88003a40 2021-04-09T18:20:28.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.660 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a980070c0 con 0x7f4a88003a40 2021-04-09T18:20:28.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.660 7f4a93fff700 1 -- 172.21.15.120:0/2123417771 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a9800a910 con 0x7f4a88003a40 2021-04-09T18:20:28.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.660 7f4aa32d6700 1 -- 172.21.15.120:0/2123417771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a88003a40 msgr2=0x7f4a88005ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:28.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.660 7f4aa32d6700 1 --2- 172.21.15.120:0/2123417771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a88003a40 0x7f4a88005ef0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f4a98007cf0 tx=0x7f4a9800a310).stop 2021-04-09T18:20:28.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.660 7f4aa18f3700 1 -- 172.21.15.120:0/2123417771 reap_dead start 2021-04-09T18:20:28.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.660 7f4aa32d6700 1 -- 172.21.15.120:0/2123417771 shutdown_connections 2021-04-09T18:20:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.660 7f4aa32d6700 1 -- 172.21.15.120:0/2123417771 >> 172.21.15.120:0/2123417771 conn(0x7f4a9c0d1590 msgr2=0x7f4a9c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.661 7f4aa32d6700 1 -- 172.21.15.120:0/2123417771 shutdown_connections 2021-04-09T18:20:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.661 7f4aa32d6700 1 -- 172.21.15.120:0/2123417771 wait complete. 2021-04-09T18:20:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.679 7f4aa32d6700 1 Processor -- start 2021-04-09T18:20:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.679 7f4aa32d6700 1 -- start start 2021-04-09T18:20:28.772 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa32d6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a9c08a9b0 0x7f4a9c08b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:28.772 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa32d6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a9c0b1fe0 0x7f4a9c0b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:28.772 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa32d6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a9c183f10 0x7f4a9c184310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:28.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa32d6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c197600 con 0x7f4a9c183f10 2021-04-09T18:20:28.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa32d6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c08ae30 con 0x7f4a9c0b1fe0 2021-04-09T18:20:28.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa32d6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c08b990 con 0x7f4a9c08a9b0 2021-04-09T18:20:28.774 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa18f3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a9c183f10 0x7f4a9c184310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:28.774 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa18f3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a9c183f10 0x7f4a9c184310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53302/0 (socket says 172.21.15.120:53302) 2021-04-09T18:20:28.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa18f3700 1 -- 172.21.15.120:0/977236188 learned_addr learned my addr 172.21.15.120:0/977236188 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:28.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa08f1700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a9c0b1fe0 0x7f4a9c0b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:28.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa10f2700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a9c08a9b0 0x7f4a9c08b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:28.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa18f3700 1 -- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a9c08a9b0 msgr2=0x7f4a9c08b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:28.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa18f3700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a9c08a9b0 0x7f4a9c08b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa18f3700 1 -- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a9c0b1fe0 msgr2=0x7f4a9c0b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:28.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.680 7f4aa18f3700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a9c0b1fe0 0x7f4a9c0b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4aa18f3700 1 -- 172.21.15.120:0/977236188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c1971c0 con 0x7f4a9c183f10 2021-04-09T18:20:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4aa18f3700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a9c183f10 0x7f4a9c184310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4a94006f30 tx=0x7f4a9400b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4a91ffb700 1 -- 172.21.15.120:0/977236188 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a9400bd80 con 0x7f4a9c183f10 2021-04-09T18:20:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4a91ffb700 1 -- 172.21.15.120:0/977236188 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a94002030 con 0x7f4a9c183f10 2021-04-09T18:20:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4a91ffb700 1 -- 172.21.15.120:0/977236188 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4a94002510 con 0x7f4a9c183f10 2021-04-09T18:20:28.780 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9c1971c0 con 0x7f4a9c183f10 2021-04-09T18:20:28.780 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9c1971c0 con 0x7f4a9c183f10 2021-04-09T18:20:28.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4a91ffb700 1 -- 172.21.15.120:0/977236188 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4a94000a70 con 0x7f4a9c183f10 2021-04-09T18:20:28.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4a91ffb700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4a7c018930 0x7f4a7c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:28.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.681 7f4a91ffb700 1 -- 172.21.15.120:0/977236188 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f4a94032b50 con 0x7f4a9c183f10 2021-04-09T18:20:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.682 7f4aa10f2700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4a7c018930 0x7f4a7c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:28.785 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.682 7f4aa10f2700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4a7c018930 0x7f4a7c01ae10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.704 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9c182a20 con 0x7f4a9c183f10 2021-04-09T18:20:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.708 7f4a91ffb700 1 -- 172.21.15.120:0/977236188 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4a94032d60 con 0x7f4a9c183f10 2021-04-09T18:20:28.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.884 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a9c182a20 con 0x7f4a9c183f10 2021-04-09T18:20:28.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.885 7f4a91ffb700 1 -- 172.21.15.120:0/977236188 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7f4a9400bd80 con 0x7f4a9c183f10 2021-04-09T18:20:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:28.886 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:20:28.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4a7c018930 msgr2=0x7f4a7c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:28.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4a7c018930 0x7f4a7c01ae10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a9c183f10 msgr2=0x7f4a9c184310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:28.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a9c183f10 0x7f4a9c184310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4a94006f30 tx=0x7f4a9400b990).stop 2021-04-09T18:20:28.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 shutdown_connections 2021-04-09T18:20:28.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a9c183f10 0x7f4a9c184310 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a9c0b1fe0 0x7f4a9c0b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4a7c018930 0x7f4a7c01ae10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 --2- 172.21.15.120:0/977236188 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a9c08a9b0 0x7f4a9c08b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:28.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 >> 172.21.15.120:0/977236188 conn(0x7f4a9c18dcd0 msgr2=0x7f4a9c187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:28.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 shutdown_connections 2021-04-09T18:20:28.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:28.887 7f4aa32d6700 1 -- 172.21.15.120:0/977236188 wait complete. 2021-04-09T18:20:28.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:19:47.013532', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:19:50.254363', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:19:52.685224', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:20:28.895 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:20:29.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.055 7ff234051700 1 Processor -- start 2021-04-09T18:20:29.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.055 7ff234051700 1 -- start start 2021-04-09T18:20:29.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff234051700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff22c0d7580 0x7ff22c0d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff234051700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c0d63d0 0x7ff22c1ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff234051700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22c0d7980 con 0x7ff22c0d7180 2021-04-09T18:20:29.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff234051700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22c0d6c00 con 0x7ff22c0d7580 2021-04-09T18:20:29.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff234051700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c1a2ae0 con 0x7ff22c0d63d0 2021-04-09T18:20:29.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23266e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c0d63d0 0x7ff22c1ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23166c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff22c0d7580 0x7ff22c0d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23166c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff22c0d7580 0x7ff22c0d5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:42146/0 (socket says 172.21.15.120:42146) 2021-04-09T18:20:29.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23266e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c0d63d0 0x7ff22c1ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:39972/0 (socket says 172.21.15.120:39972) 2021-04-09T18:20:29.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23166c700 1 -- 172.21.15.120:0/3078144496 learned_addr learned my addr 172.21.15.120:0/3078144496 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:29.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff231e6d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff22c0d7180 0x7ff22c0d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:43034/0 (socket says 172.21.15.120:43034) 2021-04-09T18:20:29.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23166c700 1 -- 172.21.15.120:0/3078144496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c0d63d0 msgr2=0x7ff22c1ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:29.077 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23166c700 1 --2- 172.21.15.120:0/3078144496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c0d63d0 0x7ff22c1ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.077 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23166c700 1 -- 172.21.15.120:0/3078144496 >> v1:172.21.15.134:6789/0 conn(0x7ff22c0d7180 legacy=0x7ff22c0d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.077 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23166c700 1 -- 172.21.15.120:0/3078144496 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c0d67d0 con 0x7ff22c0d7580 2021-04-09T18:20:29.077 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff230e6b700 1 -- 172.21.15.120:0/3078144496 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251150747 0 0) 0x7ff228001440 con 0x7ff22c0d7180 2021-04-09T18:20:29.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.056 7ff23266e700 1 --2- 172.21.15.120:0/3078144496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c0d63d0 0x7ff22c1ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:29.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.057 7ff23166c700 1 --2- 172.21.15.120:0/3078144496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff22c0d7580 0x7ff22c0d5db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff21c006700 tx=0x7ff21c009b80).ready entity=mon.1 client_cookie=866a8b9be03f42de server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:29.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.057 7ff230e6b700 1 -- 172.21.15.120:0/3078144496 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff21c00c0c0 con 0x7ff22c0d7580 2021-04-09T18:20:29.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.057 7ff230e6b700 1 -- 172.21.15.120:0/3078144496 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c00c440 con 0x7ff22c0d7580 2021-04-09T18:20:29.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.057 7ff230e6b700 1 -- 172.21.15.120:0/3078144496 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff21c00c920 con 0x7ff22c0d7580 2021-04-09T18:20:29.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.057 7ff234051700 1 -- 172.21.15.120:0/3078144496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff22c0d7580 msgr2=0x7ff22c0d5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.057 7ff234051700 1 --2- 172.21.15.120:0/3078144496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff22c0d7580 0x7ff22c0d5db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff21c006700 tx=0x7ff21c009b80).stop 2021-04-09T18:20:29.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.058 7ff234051700 1 -- 172.21.15.120:0/3078144496 shutdown_connections 2021-04-09T18:20:29.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.058 7ff234051700 1 --2- 172.21.15.120:0/3078144496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff22c0d7580 0x7ff22c0d5db0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.058 7ff234051700 1 --2- 172.21.15.120:0/3078144496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c0d63d0 0x7ff22c1ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.058 7ff234051700 1 -- 172.21.15.120:0/3078144496 >> 172.21.15.120:0/3078144496 conn(0x7ff22c0d15b0 msgr2=0x7ff22c0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:29.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.058 7ff234051700 1 -- 172.21.15.120:0/3078144496 shutdown_connections 2021-04-09T18:20:29.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.058 7ff234051700 1 -- 172.21.15.120:0/3078144496 wait complete. 2021-04-09T18:20:29.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.076 7ff234051700 1 Processor -- start 2021-04-09T18:20:29.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.076 7ff234051700 1 -- start start 2021-04-09T18:20:29.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff234051700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff22c190610 0x7ff22c097c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff234051700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c190a10 0x7ff22c098240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff234051700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff22c098860 0x7ff22c098c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff234051700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c099280 con 0x7ff22c098860 2021-04-09T18:20:29.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff234051700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c18db90 con 0x7ff22c190610 2021-04-09T18:20:29.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff234051700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c0a8710 con 0x7ff22c190a10 2021-04-09T18:20:29.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23266e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff22c098860 0x7ff22c098c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23266e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff22c098860 0x7ff22c098c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53316/0 (socket says 172.21.15.120:53316) 2021-04-09T18:20:29.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23266e700 1 -- 172.21.15.120:0/850687429 learned_addr learned my addr 172.21.15.120:0/850687429 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:29.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23166c700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c190a10 0x7ff22c098240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff231e6d700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff22c190610 0x7ff22c097c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23266e700 1 -- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c190a10 msgr2=0x7ff22c098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23266e700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c190a10 0x7ff22c098240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23266e700 1 -- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff22c190610 msgr2=0x7ff22c097c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23266e700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff22c190610 0x7ff22c097c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23266e700 1 -- 172.21.15.120:0/850687429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c0afdd0 con 0x7ff22c098860 2021-04-09T18:20:29.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.077 7ff23266e700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff22c098860 0x7ff22c098c60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7ff22400b580 tx=0x7ff22400b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:29.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.078 7ff2227fc700 1 -- 172.21.15.120:0/850687429 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff22400bd10 con 0x7ff22c098860 2021-04-09T18:20:29.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.078 7ff2227fc700 1 -- 172.21.15.120:0/850687429 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224006720 con 0x7ff22c098860 2021-04-09T18:20:29.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.078 7ff2227fc700 1 -- 172.21.15.120:0/850687429 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff2240024d0 con 0x7ff22c098860 2021-04-09T18:20:29.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.078 7ff234051700 1 -- 172.21.15.120:0/850687429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c0afdd0 con 0x7ff22c098860 2021-04-09T18:20:29.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.078 7ff234051700 1 -- 172.21.15.120:0/850687429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c0afdd0 con 0x7ff22c098860 2021-04-09T18:20:29.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.079 7ff2227fc700 1 -- 172.21.15.120:0/850687429 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff224005330 con 0x7ff22c098860 2021-04-09T18:20:29.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.079 7ff2227fc700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff2140188c0 0x7ff21401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.079 7ff2227fc700 1 -- 172.21.15.120:0/850687429 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff224032900 con 0x7ff22c098860 2021-04-09T18:20:29.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.079 7ff231e6d700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff2140188c0 0x7ff21401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.080 7ff231e6d700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff2140188c0 0x7ff21401adc0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:29.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.102 7ff234051700 1 -- 172.21.15.120:0/850687429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c0d9890 con 0x7ff22c098860 2021-04-09T18:20:29.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.105 7ff2227fc700 1 -- 172.21.15.120:0/850687429 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff224005330 con 0x7ff22c098860 2021-04-09T18:20:29.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.274 7ff234051700 1 -- 172.21.15.120:0/850687429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7ff22c0d9890 con 0x7ff22c098860 2021-04-09T18:20:29.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.275 7ff2227fc700 1 -- 172.21.15.120:0/850687429 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff224000e70 con 0x7ff22c098860 2021-04-09T18:20:29.273 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:29.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 -- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff2140188c0 msgr2=0x7ff21401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff2140188c0 0x7ff21401adc0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 -- 172.21.15.120:0/850687429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff22c098860 msgr2=0x7ff22c098c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff22c098860 0x7ff22c098c60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7ff22400b580 tx=0x7ff22400b920).stop 2021-04-09T18:20:29.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 -- 172.21.15.120:0/850687429 shutdown_connections 2021-04-09T18:20:29.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff22c098860 0x7ff22c098c60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff2140188c0 0x7ff21401adc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff22c190a10 0x7ff22c098240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 --2- 172.21.15.120:0/850687429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff22c190610 0x7ff22c097c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 -- 172.21.15.120:0/850687429 >> 172.21.15.120:0/850687429 conn(0x7ff22c0e1870 msgr2=0x7ff22c0db8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:29.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 -- 172.21.15.120:0/850687429 shutdown_connections 2021-04-09T18:20:29.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.277 7ff234051700 1 -- 172.21.15.120:0/850687429 wait complete. 2021-04-09T18:20:29.290 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:20:29.477 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.444 7f6714fa9700 1 Processor -- start 2021-04-09T18:20:29.477 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.444 7f6714fa9700 1 -- start start 2021-04-09T18:20:29.478 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f6714fa9700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f67100d7180 0x7f67100d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.478 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f6714fa9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67100d61b0 0x7f67100d65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.479 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f6714fa9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67100d6c00 con 0x7f67100d55c0 2021-04-09T18:20:29.479 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f6714fa9700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100d8110 con 0x7f67100d7180 2021-04-09T18:20:29.480 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f6714fa9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67101a2ae0 con 0x7f67100d61b0 2021-04-09T18:20:29.480 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670ed9d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f67100d7180 0x7f67100d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.481 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670f59e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67100d61b0 0x7f67100d65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670ed9d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f67100d7180 0x7f67100d7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:42156/0 (socket says 172.21.15.120:42156) 2021-04-09T18:20:29.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670f59e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67100d61b0 0x7f67100d65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:39988/0 (socket says 172.21.15.120:39988) 2021-04-09T18:20:29.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670e59c700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f67100d55c0 0x7f67100d59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:43048/0 (socket says 172.21.15.120:43048) 2021-04-09T18:20:29.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670ed9d700 1 -- 172.21.15.120:0/1174185422 learned_addr learned my addr 172.21.15.120:0/1174185422 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:29.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670ed9d700 1 -- 172.21.15.120:0/1174185422 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67100d61b0 msgr2=0x7f67100d65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:29.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670ed9d700 1 --2- 172.21.15.120:0/1174185422 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67100d61b0 0x7f67100d65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670ed9d700 1 -- 172.21.15.120:0/1174185422 >> v1:172.21.15.134:6789/0 conn(0x7f67100d55c0 legacy=0x7f67100d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670ed9d700 1 -- 172.21.15.120:0/1174185422 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67101ac210 con 0x7f67100d7180 2021-04-09T18:20:29.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.445 7f670f59e700 1 --2- 172.21.15.120:0/1174185422 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67100d61b0 0x7f67100d65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:29.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.446 7f670ed9d700 1 --2- 172.21.15.120:0/1174185422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100d7180 0x7f67100d7580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f6700006700 tx=0x7f6700009b80).ready entity=mon.1 client_cookie=79087e68d52609bf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:29.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.446 7f670dd9b700 1 -- 172.21.15.120:0/1174185422 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f670000c0c0 con 0x7f67100d7180 2021-04-09T18:20:29.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.446 7f670dd9b700 1 -- 172.21.15.120:0/1174185422 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670000c3c0 con 0x7f67100d7180 2021-04-09T18:20:29.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.446 7f670dd9b700 1 -- 172.21.15.120:0/1174185422 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f670000c8a0 con 0x7f67100d7180 2021-04-09T18:20:29.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.446 7f6714fa9700 1 -- 172.21.15.120:0/1174185422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100d7180 msgr2=0x7f67100d7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.446 7f6714fa9700 1 --2- 172.21.15.120:0/1174185422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100d7180 0x7f67100d7580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f6700006700 tx=0x7f6700009b80).stop 2021-04-09T18:20:29.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.447 7f6714fa9700 1 -- 172.21.15.120:0/1174185422 shutdown_connections 2021-04-09T18:20:29.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.447 7f6714fa9700 1 --2- 172.21.15.120:0/1174185422 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67100d61b0 0x7f67100d65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.447 7f6714fa9700 1 --2- 172.21.15.120:0/1174185422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100d7180 0x7f67100d7580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.447 7f6714fa9700 1 -- 172.21.15.120:0/1174185422 >> 172.21.15.120:0/1174185422 conn(0x7f67100d15b0 msgr2=0x7f67100d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:29.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.447 7f6714fa9700 1 -- 172.21.15.120:0/1174185422 shutdown_connections 2021-04-09T18:20:29.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.447 7f6714fa9700 1 -- 172.21.15.120:0/1174185422 wait complete. 2021-04-09T18:20:29.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.465 7f6714fa9700 1 Processor -- start 2021-04-09T18:20:29.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.465 7f6714fa9700 1 -- start start 2021-04-09T18:20:29.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f6714fa9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671009b120 0x7f67100e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.594 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f6714fa9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100e40c0 0x7f67100b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f6714fa9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671009b520 0x7f67100b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f6714fa9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671009dce0 con 0x7f671009b120 2021-04-09T18:20:29.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f6714fa9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671009aba0 con 0x7f67100e40c0 2021-04-09T18:20:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f6714fa9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100b5c50 con 0x7f671009b520 2021-04-09T18:20:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670ed9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671009b120 0x7f67100e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670ed9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671009b120 0x7f67100e3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53330/0 (socket says 172.21.15.120:53330) 2021-04-09T18:20:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670ed9d700 1 -- 172.21.15.120:0/3903661002 learned_addr learned my addr 172.21.15.120:0/3903661002 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670e59c700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100e40c0 0x7f67100b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670f59e700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671009b520 0x7f67100b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670ed9d700 1 -- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671009b520 msgr2=0x7f67100b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670ed9d700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671009b520 0x7f67100b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670ed9d700 1 -- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100e40c0 msgr2=0x7f67100b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670ed9d700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100e40c0 0x7f67100b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670ed9d700 1 -- 172.21.15.120:0/3903661002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100b5e30 con 0x7f671009b120 2021-04-09T18:20:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670f59e700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671009b520 0x7f67100b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670e59c700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100e40c0 0x7f67100b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f670ed9d700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671009b120 0x7f67100e3aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f670000b5e0 tx=0x7f670000b980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.466 7f66ff7fe700 1 -- 172.21.15.120:0/3903661002 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f670000bd70 con 0x7f671009b120 2021-04-09T18:20:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.467 7f66ff7fe700 1 -- 172.21.15.120:0/3903661002 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700002030 con 0x7f671009b120 2021-04-09T18:20:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.467 7f66ff7fe700 1 -- 172.21.15.120:0/3903661002 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6700002550 con 0x7f671009b120 2021-04-09T18:20:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.467 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67100b5e30 con 0x7f671009b120 2021-04-09T18:20:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.467 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67100b5e30 con 0x7f671009b120 2021-04-09T18:20:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.467 7f66ff7fe700 1 -- 172.21.15.120:0/3903661002 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6700002210 con 0x7f671009b120 2021-04-09T18:20:29.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.467 7f66ff7fe700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f66f4018930 0x7f66f401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.467 7f66ff7fe700 1 -- 172.21.15.120:0/3903661002 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f6700032b20 con 0x7f671009b120 2021-04-09T18:20:29.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.468 7f670e59c700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f66f4018930 0x7f66f401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.468 7f670e59c700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f66f4018930 0x7f66f401adc0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:29.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.491 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67100e25b0 con 0x7f671009b120 2021-04-09T18:20:29.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.494 7f66ff7fe700 1 -- 172.21.15.120:0/3903661002 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6700002240 con 0x7f671009b120 2021-04-09T18:20:29.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.661 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f67100e25b0 con 0x7f671009b120 2021-04-09T18:20:29.669 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.662 7f66ff7fe700 1 -- 172.21.15.120:0/3903661002 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6700002030 con 0x7f671009b120 2021-04-09T18:20:29.670 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:29.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f66f4018930 msgr2=0x7f66f401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f66f4018930 0x7f66f401adc0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671009b120 msgr2=0x7f67100e3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671009b120 0x7f67100e3aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f670000b5e0 tx=0x7f670000b980).stop 2021-04-09T18:20:29.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 shutdown_connections 2021-04-09T18:20:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f66f4018930 0x7f66f401adc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f671009b520 0x7f67100b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67100e40c0 0x7f67100b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 --2- 172.21.15.120:0/3903661002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671009b120 0x7f67100e3aa0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.664 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 >> 172.21.15.120:0/3903661002 conn(0x7f67101822c0 msgr2=0x7f671009df50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:29.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.665 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 shutdown_connections 2021-04-09T18:20:29.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.665 7f6714fa9700 1 -- 172.21.15.120:0/3903661002 wait complete. 2021-04-09T18:20:29.700 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:20:29.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff476075700 1 Processor -- start 2021-04-09T18:20:29.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff476075700 1 -- start start 2021-04-09T18:20:29.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff476075700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff4700d7580 0x7ff4700d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff476075700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4700d63d0 0x7ff4701ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff476075700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4700d7980 con 0x7ff4700d7180 2021-04-09T18:20:29.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff476075700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4700d6c00 con 0x7ff4700d7580 2021-04-09T18:20:29.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff476075700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4701a2ae0 con 0x7ff4700d63d0 2021-04-09T18:20:29.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff46effd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff4700d7580 0x7ff4700d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff46effd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff4700d7580 0x7ff4700d5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53338/0 (socket says 172.21.15.120:53338) 2021-04-09T18:20:29.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff46effd700 1 -- 172.21.15.120:0/2496557445 learned_addr learned my addr 172.21.15.120:0/2496557445 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:29.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff46f7fe700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff4700d7180 0x7ff4700d55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48246/0 (socket says 172.21.15.120:48246) 2021-04-09T18:20:29.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.847 7ff46ffff700 1 --2- 172.21.15.120:0/2496557445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4700d63d0 0x7ff4701ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46effd700 1 -- 172.21.15.120:0/2496557445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4700d63d0 msgr2=0x7ff4701ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:29.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46effd700 1 --2- 172.21.15.120:0/2496557445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4700d63d0 0x7ff4701ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46effd700 1 -- 172.21.15.120:0/2496557445 >> v1:172.21.15.120:6789/0 conn(0x7ff4700d7180 legacy=0x7ff4700d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46effd700 1 -- 172.21.15.120:0/2496557445 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700d67d0 con 0x7ff4700d7580 2021-04-09T18:20:29.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46e7fc700 1 -- 172.21.15.120:0/2496557445 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474472630 0 0) 0x7ff460000ce0 con 0x7ff4700d7180 2021-04-09T18:20:29.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46ffff700 1 --2- 172.21.15.120:0/2496557445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4700d63d0 0x7ff4701ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:29.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46effd700 1 --2- 172.21.15.120:0/2496557445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700d7580 0x7ff4700d5db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff464006700 tx=0x7ff464009b80).ready entity=mon.0 client_cookie=288cb4cdb93218cb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:29.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46e7fc700 1 -- 172.21.15.120:0/2496557445 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff46400c0c0 con 0x7ff4700d7580 2021-04-09T18:20:29.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46e7fc700 1 -- 172.21.15.120:0/2496557445 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400c440 con 0x7ff4700d7580 2021-04-09T18:20:29.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff46e7fc700 1 -- 172.21.15.120:0/2496557445 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff46400c920 con 0x7ff4700d7580 2021-04-09T18:20:29.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff476075700 1 -- 172.21.15.120:0/2496557445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700d7580 msgr2=0x7ff4700d5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.848 7ff476075700 1 --2- 172.21.15.120:0/2496557445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700d7580 0x7ff4700d5db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff464006700 tx=0x7ff464009b80).stop 2021-04-09T18:20:29.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.849 7ff476075700 1 -- 172.21.15.120:0/2496557445 shutdown_connections 2021-04-09T18:20:29.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.849 7ff476075700 1 --2- 172.21.15.120:0/2496557445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700d7580 0x7ff4700d5db0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.849 7ff476075700 1 --2- 172.21.15.120:0/2496557445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4700d63d0 0x7ff4701ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.849 7ff476075700 1 -- 172.21.15.120:0/2496557445 >> 172.21.15.120:0/2496557445 conn(0x7ff4700d15b0 msgr2=0x7ff4700d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:29.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.849 7ff476075700 1 -- 172.21.15.120:0/2496557445 shutdown_connections 2021-04-09T18:20:29.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.849 7ff476075700 1 -- 172.21.15.120:0/2496557445 wait complete. 2021-04-09T18:20:29.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.867 7ff476075700 1 Processor -- start 2021-04-09T18:20:29.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff476075700 1 -- start start 2021-04-09T18:20:29.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff476075700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff47009b120 0x7ff4700e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff476075700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700e40c0 0x7ff4700b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff476075700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff47009b520 0x7ff4700b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.901 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff476075700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47009dce0 con 0x7ff4700e40c0 2021-04-09T18:20:29.901 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff476075700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47009aba0 con 0x7ff47009b120 2021-04-09T18:20:29.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff476075700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700b5c50 con 0x7ff47009b520 2021-04-09T18:20:29.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700e40c0 0x7ff4700b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700e40c0 0x7ff4700b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53342/0 (socket says 172.21.15.120:53342) 2021-04-09T18:20:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46effd700 1 -- 172.21.15.120:0/158918116 learned_addr learned my addr 172.21.15.120:0/158918116 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46f7fe700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff47009b120 0x7ff4700e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46ffff700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff47009b520 0x7ff4700b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46effd700 1 -- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff47009b520 msgr2=0x7ff4700b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46effd700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff47009b520 0x7ff4700b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46effd700 1 -- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff47009b120 msgr2=0x7ff4700e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:29.906 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46effd700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff47009b120 0x7ff4700e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:29.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46effd700 1 -- 172.21.15.120:0/158918116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700b5e30 con 0x7ff4700e40c0 2021-04-09T18:20:29.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46ffff700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff47009b520 0x7ff4700b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:20:29.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.868 7ff46f7fe700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff47009b120 0x7ff4700e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:20:29.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.869 7ff46effd700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700e40c0 0x7ff4700b5010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ff46400b650 tx=0x7ff46400b9f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:29.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.869 7ff457fff700 1 -- 172.21.15.120:0/158918116 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff46400bde0 con 0x7ff4700e40c0 2021-04-09T18:20:29.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.869 7ff457fff700 1 -- 172.21.15.120:0/158918116 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4640091e0 con 0x7ff4700e40c0 2021-04-09T18:20:29.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.869 7ff476075700 1 -- 172.21.15.120:0/158918116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4700b5e30 con 0x7ff4700e40c0 2021-04-09T18:20:29.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.869 7ff457fff700 1 -- 172.21.15.120:0/158918116 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4640022b0 con 0x7ff4700e40c0 2021-04-09T18:20:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.869 7ff476075700 1 -- 172.21.15.120:0/158918116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4700b5e30 con 0x7ff4700e40c0 2021-04-09T18:20:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.869 7ff457fff700 1 -- 172.21.15.120:0/158918116 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff464000c90 con 0x7ff4700e40c0 2021-04-09T18:20:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.869 7ff457fff700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff450018930 0x7ff45001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.869 7ff457fff700 1 -- 172.21.15.120:0/158918116 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff464032b80 con 0x7ff4700e40c0 2021-04-09T18:20:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.870 7ff46f7fe700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff450018930 0x7ff45001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.870 7ff46f7fe700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff450018930 0x7ff45001ae10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.893 7ff476075700 1 -- 172.21.15.120:0/158918116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4700e25b0 con 0x7ff4700e40c0 2021-04-09T18:20:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:29.897 7ff457fff700 1 -- 172.21.15.120:0/158918116 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff4640091e0 con 0x7ff4700e40c0 2021-04-09T18:20:30.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.065 7ff476075700 1 -- 172.21.15.120:0/158918116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7ff4700e25b0 con 0x7ff4700e40c0 2021-04-09T18:20:30.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.065 7ff457fff700 1 -- 172.21.15.120:0/158918116 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff46400bde0 con 0x7ff4700e40c0 2021-04-09T18:20:30.063 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:30.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.067 7ff476075700 1 -- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff450018930 msgr2=0x7ff45001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.067 7ff476075700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff450018930 0x7ff45001ae10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 -- 172.21.15.120:0/158918116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700e40c0 msgr2=0x7ff4700b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700e40c0 0x7ff4700b5010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ff46400b650 tx=0x7ff46400b9f0).stop 2021-04-09T18:20:30.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 -- 172.21.15.120:0/158918116 shutdown_connections 2021-04-09T18:20:30.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff450018930 0x7ff45001ae10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff47009b520 0x7ff4700b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4700e40c0 0x7ff4700b5010 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 --2- 172.21.15.120:0/158918116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff47009b120 0x7ff4700e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 -- 172.21.15.120:0/158918116 >> 172.21.15.120:0/158918116 conn(0x7ff4701822c0 msgr2=0x7ff47009df50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:30.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 -- 172.21.15.120:0/158918116 shutdown_connections 2021-04-09T18:20:30.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.068 7ff476075700 1 -- 172.21.15.120:0/158918116 wait complete. 2021-04-09T18:20:30.081 DEBUG:tasks.mds_thrash:Yielding 2021-04-09T18:20:30.081 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-04-09T18:20:30.168 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-04-09T18:20:30.169 INFO:tasks.ceph_fuse:config is None 2021-04-09T18:20:30.169 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2021-04-09T18:20:30.170 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-04-09T18:20:30.171 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:20:30.188 INFO:tasks.mds_thrash.fs.[None]:starting mds_do_thrash for fs None 2021-04-09T18:20:30.189 INFO:tasks.mds_thrash.fs.[None]:waiting for 13 secs before thrashing 2021-04-09T18:20:30.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.331 7fec61ec3700 1 Processor -- start 2021-04-09T18:20:30.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.331 7fec61ec3700 1 -- start start 2021-04-09T18:20:30.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec61ec3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec5c0d6580 0x7fec5c1ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec61ec3700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0d7960 con 0x7fec5c0d7160 2021-04-09T18:20:30.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec61ec3700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0d6980 con 0x7fec5c0d7560 2021-04-09T18:20:30.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec61ec3700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0d6be0 con 0x7fec5c0d6580 2021-04-09T18:20:30.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5b7fe700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fec5c0d7160 0x7fec5c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48260/0 (socket says 172.21.15.120:48260) 2021-04-09T18:20:30.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5b7fe700 1 -- 172.21.15.120:0/3462623198 learned_addr learned my addr 172.21.15.120:0/3462623198 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:30.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5bfff700 1 --2- 172.21.15.120:0/3462623198 >> v2:172.21.15.134:3300/0 conn(0x7fec5c0d6580 0x7fec5c1ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866079470 0 0) 0x7fec4c001060 con 0x7fec5c0d7160 2021-04-09T18:20:30.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec44002fe0 con 0x7fec5c0d7160 2021-04-09T18:20:30.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1091610880 0 0) 0x7fec4c001250 con 0x7fec5c0d7160 2021-04-09T18:20:30.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 >> v2:172.21.15.134:3300/0 conn(0x7fec5c0d6580 msgr2=0x7fec5c1ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:30.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 --2- 172.21.15.120:0/3462623198 >> v2:172.21.15.134:3300/0 conn(0x7fec5c0d6580 0x7fec5c1ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 >> v1:172.21.15.134:6789/0 conn(0x7fec5c0d7560 legacy=0x7fec5c0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c1a2ac0 con 0x7fec5c0d7160 2021-04-09T18:20:30.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7fec4c001980 con 0x7fec5c0d7160 2021-04-09T18:20:30.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 >> v1:172.21.15.120:6789/0 conn(0x7fec5c0d7160 legacy=0x7fec5c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec44003a40 0x7fec44005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec44006790 0x7fec44008c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec44009590 0x7fec4400bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4400c300 con 0x7fec44009590 2021-04-09T18:20:30.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4400c520 con 0x7fec44003a40 2021-04-09T18:20:30.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec44050750 con 0x7fec44006790 2021-04-09T18:20:30.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.332 7fec5bfff700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec44009590 0x7fec4400bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5b7fe700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec44003a40 0x7fec44005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5affd700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec44006790 0x7fec44008c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5bfff700 1 -- 172.21.15.120:0/3462623198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec44006790 msgr2=0x7fec44008c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:30.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5bfff700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec44006790 0x7fec44008c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5bfff700 1 -- 172.21.15.120:0/3462623198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec44003a40 msgr2=0x7fec44005ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:30.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5bfff700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec44003a40 0x7fec44005ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5bfff700 1 -- 172.21.15.120:0/3462623198 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec440509b0 con 0x7fec44009590 2021-04-09T18:20:30.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5affd700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec44006790 0x7fec44008c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:30.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5bfff700 1 -- 172.21.15.120:0/3462623198 reap_dead start 2021-04-09T18:20:30.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5bfff700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec44009590 0x7fec4400bab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fec5400c970 tx=0x7fec5400cd10).ready entity=mon.0 client_cookie=1dbf317aef969eb8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:30.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec54009310 con 0x7fec44009590 2021-04-09T18:20:30.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54009690 con 0x7fec44009590 2021-04-09T18:20:30.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec5a7fc700 1 -- 172.21.15.120:0/3462623198 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec54009b70 con 0x7fec44009590 2021-04-09T18:20:30.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec61ec3700 1 -- 172.21.15.120:0/3462623198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec44009590 msgr2=0x7fec4400bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.333 7fec61ec3700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec44009590 0x7fec4400bab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fec5400c970 tx=0x7fec5400cd10).stop 2021-04-09T18:20:30.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.334 7fec61ec3700 1 -- 172.21.15.120:0/3462623198 shutdown_connections 2021-04-09T18:20:30.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.334 7fec61ec3700 1 --2- 172.21.15.120:0/3462623198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec44009590 0x7fec4400bab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.334 7fec61ec3700 1 -- 172.21.15.120:0/3462623198 >> 172.21.15.120:0/3462623198 conn(0x7fec5c0d1590 msgr2=0x7fec5c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:30.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.334 7fec61ec3700 1 -- 172.21.15.120:0/3462623198 shutdown_connections 2021-04-09T18:20:30.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.334 7fec61ec3700 1 -- 172.21.15.120:0/3462623198 wait complete. 2021-04-09T18:20:30.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.352 7fec61ec3700 1 Processor -- start 2021-04-09T18:20:30.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec61ec3700 1 -- start start 2021-04-09T18:20:30.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec61ec3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec5c1853a0 0x7fec5c1869b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec61ec3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c1857a0 0x7fec5c19d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec61ec3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c19e000 0x7fec5c19e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec61ec3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c186fd0 con 0x7fec5c1857a0 2021-04-09T18:20:30.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec61ec3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c19ea20 con 0x7fec5c19e000 2021-04-09T18:20:30.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec61ec3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c19ec40 con 0x7fec5c1853a0 2021-04-09T18:20:30.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec5affd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c1857a0 0x7fec5c19d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec5affd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c1857a0 0x7fec5c19d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53362/0 (socket says 172.21.15.120:53362) 2021-04-09T18:20:30.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec5affd700 1 -- 172.21.15.120:0/1355393765 learned_addr learned my addr 172.21.15.120:0/1355393765 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:30.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec5b7fe700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec5c1853a0 0x7fec5c1869b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.353 7fec5bfff700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c19e000 0x7fec5c19e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec5affd700 1 -- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec5c1853a0 msgr2=0x7fec5c1869b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec5affd700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec5c1853a0 0x7fec5c1869b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec5affd700 1 -- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c19e000 msgr2=0x7fec5c19e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec5affd700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c19e000 0x7fec5c19e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec5affd700 1 -- 172.21.15.120:0/1355393765 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c183460 con 0x7fec5c1857a0 2021-04-09T18:20:30.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec5bfff700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c19e000 0x7fec5c19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:30.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec5affd700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c1857a0 0x7fec5c19d9e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fec50006f10 tx=0x7fec5000b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:30.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec43fff700 1 -- 172.21.15.120:0/1355393765 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec5000bd80 con 0x7fec5c1857a0 2021-04-09T18:20:30.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec43fff700 1 -- 172.21.15.120:0/1355393765 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec500063e0 con 0x7fec5c1857a0 2021-04-09T18:20:30.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec43fff700 1 -- 172.21.15.120:0/1355393765 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec50002030 con 0x7fec5c1857a0 2021-04-09T18:20:30.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c183460 con 0x7fec5c1857a0 2021-04-09T18:20:30.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c183460 con 0x7fec5c1857a0 2021-04-09T18:20:30.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.354 7fec43fff700 1 -- 172.21.15.120:0/1355393765 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fec500052e0 con 0x7fec5c1857a0 2021-04-09T18:20:30.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.355 7fec43fff700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec3c018930 0x7fec3c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.355 7fec43fff700 1 -- 172.21.15.120:0/1355393765 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fec50032b40 con 0x7fec5c1857a0 2021-04-09T18:20:30.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.355 7fec5b7fe700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec3c018930 0x7fec3c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.355 7fec5b7fe700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec3c018930 0x7fec3c01ae10 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:30.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.377 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c184e70 con 0x7fec5c1857a0 2021-04-09T18:20:30.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.381 7fec43fff700 1 -- 172.21.15.120:0/1355393765 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fec50006be0 con 0x7fec5c1857a0 2021-04-09T18:20:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.556 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec5c184e70 con 0x7fec5c1857a0 2021-04-09T18:20:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.557 7fec43fff700 1 -- 172.21.15.120:0/1355393765 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14350 (secure 0 0 0) 0x7fec5001f720 con 0x7fec5c1857a0 2021-04-09T18:20:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:30.555 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:19:55.049098","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:20:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec3c018930 msgr2=0x7fec3c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec3c018930 0x7fec3c01ae10 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c1857a0 msgr2=0x7fec5c19d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c1857a0 0x7fec5c19d9e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fec50006f10 tx=0x7fec5000b990).stop 2021-04-09T18:20:30.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 shutdown_connections 2021-04-09T18:20:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec5c19e000 0x7fec5c19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c1857a0 0x7fec5c19d9e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec3c018930 0x7fec3c01ae10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 --2- 172.21.15.120:0/1355393765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec5c1853a0 0x7fec5c1869b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 >> 172.21.15.120:0/1355393765 conn(0x7fec5c18dc90 msgr2=0x7fec5c08fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 shutdown_connections 2021-04-09T18:20:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.559 7fec61ec3700 1 -- 172.21.15.120:0/1355393765 wait complete. 2021-04-09T18:20:30.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-04-09 18:19:47.013532', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2021-04-09 18:19:50.254363', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2021-04-09 18:19:52.685224', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-04-09T18:20:30.567 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-04-09T18:20:30.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.713 7ffad01ab700 1 Processor -- start 2021-04-09T18:20:30.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7ffad01ab700 1 -- start start 2021-04-09T18:20:30.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7ffad01ab700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80d7580 0x7ffac80d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7ffad01ab700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ffac80d63d0 0x7ffac81ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7ffad01ab700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac80d7980 con 0x7ffac80d7180 2021-04-09T18:20:30.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7ffad01ab700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac80d6c00 con 0x7ffac80d63d0 2021-04-09T18:20:30.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7ffad01ab700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac81a2ae0 con 0x7ffac80d7580 2021-04-09T18:20:30.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7fface7c8700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ffac80d63d0 0x7ffac81ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7fface7c8700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ffac80d63d0 0x7ffac81ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53370/0 (socket says 172.21.15.120:53370) 2021-04-09T18:20:30.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7fface7c8700 1 -- 172.21.15.120:0/2829741033 learned_addr learned my addr 172.21.15.120:0/2829741033 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:30.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.714 7ffacd7c6700 1 --2- 172.21.15.120:0/2829741033 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80d7580 0x7ffac80d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7fface7c8700 1 -- 172.21.15.120:0/2829741033 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80d7580 msgr2=0x7ffac80d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:30.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7fface7c8700 1 --2- 172.21.15.120:0/2829741033 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80d7580 0x7ffac80d5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7fface7c8700 1 -- 172.21.15.120:0/2829741033 >> v1:172.21.15.134:6789/0 conn(0x7ffac80d7180 legacy=0x7ffac80d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:30.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7fface7c8700 1 -- 172.21.15.120:0/2829741033 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80d67d0 con 0x7ffac80d63d0 2021-04-09T18:20:30.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7fface7c8700 1 --2- 172.21.15.120:0/2829741033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac80d63d0 0x7ffac81ab200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ffac0006b80 tx=0x7ffac0009b90).ready entity=mon.0 client_cookie=8ac21a8fefb5b780 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:30.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7ffaccfc5700 1 -- 172.21.15.120:0/2829741033 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffac00022e0 con 0x7ffac80d63d0 2021-04-09T18:20:30.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7ffaccfc5700 1 -- 172.21.15.120:0/2829741033 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0002620 con 0x7ffac80d63d0 2021-04-09T18:20:30.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7ffaccfc5700 1 -- 172.21.15.120:0/2829741033 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffac0002b00 con 0x7ffac80d63d0 2021-04-09T18:20:30.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7ffad01ab700 1 -- 172.21.15.120:0/2829741033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac80d63d0 msgr2=0x7ffac81ab200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.715 7ffad01ab700 1 --2- 172.21.15.120:0/2829741033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac80d63d0 0x7ffac81ab200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ffac0006b80 tx=0x7ffac0009b90).stop 2021-04-09T18:20:30.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.716 7ffad01ab700 1 -- 172.21.15.120:0/2829741033 shutdown_connections 2021-04-09T18:20:30.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.716 7ffad01ab700 1 --2- 172.21.15.120:0/2829741033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac80d63d0 0x7ffac81ab200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.716 7ffad01ab700 1 --2- 172.21.15.120:0/2829741033 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80d7580 0x7ffac80d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.716 7ffad01ab700 1 -- 172.21.15.120:0/2829741033 >> 172.21.15.120:0/2829741033 conn(0x7ffac80d15b0 msgr2=0x7ffac80d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:30.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.716 7ffad01ab700 1 -- 172.21.15.120:0/2829741033 shutdown_connections 2021-04-09T18:20:30.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.716 7ffad01ab700 1 -- 172.21.15.120:0/2829741033 wait complete. 2021-04-09T18:20:30.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.734 7ffad01ab700 1 Processor -- start 2021-04-09T18:20:30.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.734 7ffad01ab700 1 -- start start 2021-04-09T18:20:30.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffad01ab700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac8097290 0x7ffac8097dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffad01ab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffac80daa00 0x7ffac80dae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffad01ab700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80b0ba0 0x7ffac80b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffad01ab700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8198710 con 0x7ffac8097290 2021-04-09T18:20:30.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffad01ab700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80db420 con 0x7ffac80daa00 2021-04-09T18:20:30.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffad01ab700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8185c10 con 0x7ffac80b0ba0 2021-04-09T18:20:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacdfc7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac8097290 0x7ffac8097dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacdfc7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac8097290 0x7ffac8097dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53376/0 (socket says 172.21.15.120:53376) 2021-04-09T18:20:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacdfc7700 1 -- 172.21.15.120:0/1458643691 learned_addr learned my addr 172.21.15.120:0/1458643691 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacd7c6700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffac80daa00 0x7ffac80dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7fface7c8700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80b0ba0 0x7ffac80b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacdfc7700 1 -- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80b0ba0 msgr2=0x7ffac80b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacdfc7700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80b0ba0 0x7ffac80b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacdfc7700 1 -- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffac80daa00 msgr2=0x7ffac80dae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacdfc7700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffac80daa00 0x7ffac80dae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacdfc7700 1 -- 172.21.15.120:0/1458643691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80a86f0 con 0x7ffac8097290 2021-04-09T18:20:30.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7fface7c8700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80b0ba0 0x7ffac80b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:30.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffacdfc7700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac8097290 0x7ffac8097dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ffac4009940 tx=0x7ffac400bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:30.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.735 7ffabe7fc700 1 -- 172.21.15.120:0/1458643691 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffac4000fe0 con 0x7ffac8097290 2021-04-09T18:20:30.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.736 7ffabe7fc700 1 -- 172.21.15.120:0/1458643691 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400c2f0 con 0x7ffac8097290 2021-04-09T18:20:30.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.736 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac80a86f0 con 0x7ffac8097290 2021-04-09T18:20:30.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.736 7ffabe7fc700 1 -- 172.21.15.120:0/1458643691 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffac400c7d0 con 0x7ffac8097290 2021-04-09T18:20:30.767 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.736 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac80a86f0 con 0x7ffac8097290 2021-04-09T18:20:30.767 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.736 7ffabe7fc700 1 -- 172.21.15.120:0/1458643691 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ffac4001230 con 0x7ffac8097290 2021-04-09T18:20:30.768 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.736 7ffabe7fc700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ffab0018930 0x7ffab001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:30.768 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.736 7ffabe7fc700 1 -- 172.21.15.120:0/1458643691 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ffac4032ef0 con 0x7ffac8097290 2021-04-09T18:20:30.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.736 7ffacd7c6700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ffab0018930 0x7ffab001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:30.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.737 7ffacd7c6700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ffab0018930 0x7ffab001ae10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:30.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.760 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac80db420 con 0x7ffac8097290 2021-04-09T18:20:30.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.763 7ffabe7fc700 1 -- 172.21.15.120:0/1458643691 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ffac400be30 con 0x7ffac8097290 2021-04-09T18:20:30.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.930 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7ffac80db420 con 0x7ffac8097290 2021-04-09T18:20:30.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.931 7ffabe7fc700 1 -- 172.21.15.120:0/1458643691 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffac4001230 con 0x7ffac8097290 2021-04-09T18:20:30.929 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:30.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ffab0018930 msgr2=0x7ffab001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ffab0018930 0x7ffab001ae10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac8097290 msgr2=0x7ffac8097dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:30.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac8097290 0x7ffac8097dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ffac4009940 tx=0x7ffac400bcf0).stop 2021-04-09T18:20:30.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 shutdown_connections 2021-04-09T18:20:30.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ffab0018930 0x7ffab001ae10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffac80b0ba0 0x7ffac80b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffac80daa00 0x7ffac80dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 --2- 172.21.15.120:0/1458643691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffac8097290 0x7ffac8097dc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:30.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 >> 172.21.15.120:0/1458643691 conn(0x7ffac80e4b80 msgr2=0x7ffac81806c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:30.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 shutdown_connections 2021-04-09T18:20:30.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:30.933 7ffad01ab700 1 -- 172.21.15.120:0/1458643691 wait complete. 2021-04-09T18:20:30.947 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-04-09T18:20:31.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.098 7f5773e00700 1 Processor -- start 2021-04-09T18:20:31.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.098 7f5773e00700 1 -- start start 2021-04-09T18:20:31.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f5773e00700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f576c0d7580 0x7f576c0d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f5773e00700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f576c0d63d0 0x7f576c1ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f5773e00700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576c0d7980 con 0x7f576c0d7180 2021-04-09T18:20:31.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f5773e00700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c0d8110 con 0x7f576c0d63d0 2021-04-09T18:20:31.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f5773e00700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c0d6c00 con 0x7f576c0d7580 2021-04-09T18:20:31.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f577241d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f576c0d63d0 0x7f576c1ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f577241d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f576c0d63d0 0x7f576c1ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53384/0 (socket says 172.21.15.120:53384) 2021-04-09T18:20:31.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f577241d700 1 -- 172.21.15.120:0/3031125055 learned_addr learned my addr 172.21.15.120:0/3031125055 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:31.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f577141b700 1 --2- 172.21.15.120:0/3031125055 >> v2:172.21.15.134:3300/0 conn(0x7f576c0d7580 0x7f576c0d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f577241d700 1 -- 172.21.15.120:0/3031125055 >> v2:172.21.15.134:3300/0 conn(0x7f576c0d7580 msgr2=0x7f576c0d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:31.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f577241d700 1 --2- 172.21.15.120:0/3031125055 >> v2:172.21.15.134:3300/0 conn(0x7f576c0d7580 0x7f576c0d5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f577241d700 1 -- 172.21.15.120:0/3031125055 >> v1:172.21.15.134:6789/0 conn(0x7f576c0d7180 legacy=0x7f576c0d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:31.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f577241d700 1 -- 172.21.15.120:0/3031125055 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c1a2ae0 con 0x7f576c0d63d0 2021-04-09T18:20:31.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.099 7f577241d700 1 --2- 172.21.15.120:0/3031125055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c0d63d0 0x7f576c1ab200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f5764006b80 tx=0x7f5764009b90).ready entity=mon.0 client_cookie=7c05b71646593777 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:31.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5770c1a700 1 -- 172.21.15.120:0/3031125055 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f57640022e0 con 0x7f576c0d63d0 2021-04-09T18:20:31.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5770c1a700 1 -- 172.21.15.120:0/3031125055 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764002620 con 0x7f576c0d63d0 2021-04-09T18:20:31.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5770c1a700 1 -- 172.21.15.120:0/3031125055 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5764002b00 con 0x7f576c0d63d0 2021-04-09T18:20:31.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5773e00700 1 -- 172.21.15.120:0/3031125055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c0d63d0 msgr2=0x7f576c1ab200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5773e00700 1 --2- 172.21.15.120:0/3031125055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c0d63d0 0x7f576c1ab200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f5764006b80 tx=0x7f5764009b90).stop 2021-04-09T18:20:31.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5773e00700 1 -- 172.21.15.120:0/3031125055 shutdown_connections 2021-04-09T18:20:31.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5773e00700 1 --2- 172.21.15.120:0/3031125055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c0d63d0 0x7f576c1ab200 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5773e00700 1 --2- 172.21.15.120:0/3031125055 >> v2:172.21.15.134:3300/0 conn(0x7f576c0d7580 0x7f576c0d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5773e00700 1 -- 172.21.15.120:0/3031125055 >> 172.21.15.120:0/3031125055 conn(0x7f576c0d15b0 msgr2=0x7f576c0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5773e00700 1 -- 172.21.15.120:0/3031125055 shutdown_connections 2021-04-09T18:20:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.100 7f5773e00700 1 -- 172.21.15.120:0/3031125055 wait complete. 2021-04-09T18:20:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.119 7f5773e00700 1 Processor -- start 2021-04-09T18:20:31.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.119 7f5773e00700 1 -- start start 2021-04-09T18:20:31.127 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f5773e00700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f576c190610 0x7f576c097c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f5773e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f576c190a10 0x7f576c098240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f5773e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c098860 0x7f576c098c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f5773e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c099280 con 0x7f576c098860 2021-04-09T18:20:31.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f5773e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c18db90 con 0x7f576c190a10 2021-04-09T18:20:31.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f5773e00700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c0a8710 con 0x7f576c190610 2021-04-09T18:20:31.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577241d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c098860 0x7f576c098c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577241d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c098860 0x7f576c098c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53392/0 (socket says 172.21.15.120:53392) 2021-04-09T18:20:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577241d700 1 -- 172.21.15.120:0/3890490748 learned_addr learned my addr 172.21.15.120:0/3890490748 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:31.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577141b700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f576c190a10 0x7f576c098240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f5771c1c700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f576c190610 0x7f576c097c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577241d700 1 -- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f576c190610 msgr2=0x7f576c097c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577241d700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f576c190610 0x7f576c097c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577241d700 1 -- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f576c190a10 msgr2=0x7f576c098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577241d700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f576c190a10 0x7f576c098240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577241d700 1 -- 172.21.15.120:0/3890490748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c0afdd0 con 0x7f576c098860 2021-04-09T18:20:31.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f5771c1c700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f576c190610 0x7f576c097c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:31.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.120 7f577241d700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c098860 0x7f576c098c60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f5764009640 tx=0x7f576400b960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:31.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.121 7f575e7fc700 1 -- 172.21.15.120:0/3890490748 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5764009100 con 0x7f576c098860 2021-04-09T18:20:31.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.121 7f575e7fc700 1 -- 172.21.15.120:0/3890490748 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576400bd50 con 0x7f576c098860 2021-04-09T18:20:31.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.121 7f5773e00700 1 -- 172.21.15.120:0/3890490748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576c0afdd0 con 0x7f576c098860 2021-04-09T18:20:31.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.121 7f575e7fc700 1 -- 172.21.15.120:0/3890490748 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5764006430 con 0x7f576c098860 2021-04-09T18:20:31.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.121 7f5773e00700 1 -- 172.21.15.120:0/3890490748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576c0afdd0 con 0x7f576c098860 2021-04-09T18:20:31.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.121 7f575e7fc700 1 -- 172.21.15.120:0/3890490748 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5764006240 con 0x7f576c098860 2021-04-09T18:20:31.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.121 7f575e7fc700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5754018930 0x7f575401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.121 7f575e7fc700 1 -- 172.21.15.120:0/3890490748 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5764032b40 con 0x7f576c098860 2021-04-09T18:20:31.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.122 7f5771c1c700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5754018930 0x7f575401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.122 7f5771c1c700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5754018930 0x7f575401ae10 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:31.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.145 7f5773e00700 1 -- 172.21.15.120:0/3890490748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c0d9890 con 0x7f576c098860 2021-04-09T18:20:31.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.148 7f575e7fc700 1 -- 172.21.15.120:0/3890490748 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5764006030 con 0x7f576c098860 2021-04-09T18:20:31.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.316 7f5773e00700 1 -- 172.21.15.120:0/3890490748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f576c0d9890 con 0x7f576c098860 2021-04-09T18:20:31.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.317 7f575e7fc700 1 -- 172.21.15.120:0/3890490748 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5764006240 con 0x7f576c098860 2021-04-09T18:20:31.315 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:31.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 -- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5754018930 msgr2=0x7f575401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5754018930 0x7f575401ae10 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 -- 172.21.15.120:0/3890490748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c098860 msgr2=0x7f576c098c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c098860 0x7f576c098c60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f5764009640 tx=0x7f576400b960).stop 2021-04-09T18:20:31.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 -- 172.21.15.120:0/3890490748 shutdown_connections 2021-04-09T18:20:31.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f576c098860 0x7f576c098c60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.320 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f576c190a10 0x7f576c098240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.320 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5754018930 0x7f575401ae10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.321 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 --2- 172.21.15.120:0/3890490748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f576c190610 0x7f576c097c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.321 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 -- 172.21.15.120:0/3890490748 >> 172.21.15.120:0/3890490748 conn(0x7f576c0e1870 msgr2=0x7f576c0db8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:31.322 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 -- 172.21.15.120:0/3890490748 shutdown_connections 2021-04-09T18:20:31.322 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.319 7f5773e00700 1 -- 172.21.15.120:0/3890490748 wait complete. 2021-04-09T18:20:31.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-04-09T18:20:31.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.475 7feec444d700 1 Processor -- start 2021-04-09T18:20:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.475 7feec444d700 1 -- start start 2021-04-09T18:20:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec444d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feebc0d7180 0x7feebc0d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec444d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0d55c0 0x7feebc0d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec444d700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feebc0d6c00 con 0x7feebc0d5fe0 2021-04-09T18:20:31.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec444d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc0d8110 con 0x7feebc0d7180 2021-04-09T18:20:31.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec444d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc1a2ae0 con 0x7feebc0d55c0 2021-04-09T18:20:31.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec2a6a700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7feebc0d5fe0 0x7feebc0d63e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48310/0 (socket says 172.21.15.120:48310) 2021-04-09T18:20:31.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec2a6a700 1 -- 172.21.15.120:0/3686517276 learned_addr learned my addr 172.21.15.120:0/3686517276 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:31.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec1a68700 1 --2- 172.21.15.120:0/3686517276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0d55c0 0x7feebc0d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec2269700 1 --2- 172.21.15.120:0/3686517276 >> v2:172.21.15.134:3300/0 conn(0x7feebc0d7180 0x7feebc0d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.476 7feec1267700 1 -- 172.21.15.120:0/3686517276 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642205662 0 0) 0x7feeb40009b0 con 0x7feebc0d5fe0 2021-04-09T18:20:31.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec1267700 1 -- 172.21.15.120:0/3686517276 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea8002fe0 con 0x7feebc0d5fe0 2021-04-09T18:20:31.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec2269700 1 -- 172.21.15.120:0/3686517276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0d55c0 msgr2=0x7feebc0d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:31.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec2269700 1 --2- 172.21.15.120:0/3686517276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0d55c0 0x7feebc0d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec2269700 1 -- 172.21.15.120:0/3686517276 >> v1:172.21.15.120:6789/0 conn(0x7feebc0d5fe0 legacy=0x7feebc0d63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec2269700 1 -- 172.21.15.120:0/3686517276 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc1ac210 con 0x7feebc0d7180 2021-04-09T18:20:31.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec1a68700 1 --2- 172.21.15.120:0/3686517276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0d55c0 0x7feebc0d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:31.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec2269700 1 --2- 172.21.15.120:0/3686517276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc0d7180 0x7feebc0d7580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7feeb80069d0 tx=0x7feeb8009e40).ready entity=mon.1 client_cookie=24150a69b269a74e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:31.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec1267700 1 -- 172.21.15.120:0/3686517276 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feeb800b510 con 0x7feebc0d7180 2021-04-09T18:20:31.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec1267700 1 -- 172.21.15.120:0/3686517276 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb800b890 con 0x7feebc0d7180 2021-04-09T18:20:31.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec1267700 1 -- 172.21.15.120:0/3686517276 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feeb800bd70 con 0x7feebc0d7180 2021-04-09T18:20:31.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec444d700 1 -- 172.21.15.120:0/3686517276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc0d7180 msgr2=0x7feebc0d7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.477 7feec444d700 1 --2- 172.21.15.120:0/3686517276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc0d7180 0x7feebc0d7580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7feeb80069d0 tx=0x7feeb8009e40).stop 2021-04-09T18:20:31.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.478 7feec444d700 1 -- 172.21.15.120:0/3686517276 shutdown_connections 2021-04-09T18:20:31.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.478 7feec444d700 1 --2- 172.21.15.120:0/3686517276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0d55c0 0x7feebc0d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.478 7feec444d700 1 --2- 172.21.15.120:0/3686517276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc0d7180 0x7feebc0d7580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.478 7feec444d700 1 -- 172.21.15.120:0/3686517276 >> 172.21.15.120:0/3686517276 conn(0x7feebc0d15b0 msgr2=0x7feebc0d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.478 7feec444d700 1 -- 172.21.15.120:0/3686517276 shutdown_connections 2021-04-09T18:20:31.547 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.478 7feec444d700 1 -- 172.21.15.120:0/3686517276 wait complete. 2021-04-09T18:20:31.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec444d700 1 Processor -- start 2021-04-09T18:20:31.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec444d700 1 -- start start 2021-04-09T18:20:31.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec444d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc1a1660 0x7feebc189e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec444d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc19dbd0 0x7feebc19dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec444d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0ac900 0x7feebc0acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec444d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc1a1ae0 con 0x7feebc19dbd0 2021-04-09T18:20:31.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec444d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc1898d0 con 0x7feebc1a1660 2021-04-09T18:20:31.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec444d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc19e5f0 con 0x7feebc0ac900 2021-04-09T18:20:31.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec1a68700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc19dbd0 0x7feebc19dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.497 7feec1a68700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc19dbd0 0x7feebc19dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53402/0 (socket says 172.21.15.120:53402) 2021-04-09T18:20:31.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec1a68700 1 -- 172.21.15.120:0/3957211642 learned_addr learned my addr 172.21.15.120:0/3957211642 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:31.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec2269700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc1a1660 0x7feebc189e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec2a6a700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0ac900 0x7feebc0acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec1a68700 1 -- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0ac900 msgr2=0x7feebc0acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec1a68700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0ac900 0x7feebc0acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec1a68700 1 -- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc1a1660 msgr2=0x7feebc189e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec1a68700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc1a1660 0x7feebc189e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec1a68700 1 -- 172.21.15.120:0/3957211642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc1895a0 con 0x7feebc19dbd0 2021-04-09T18:20:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec2269700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc1a1660 0x7feebc189e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec1a68700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc19dbd0 0x7feebc19dfd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7feeac00b580 tx=0x7feeac00b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feeb2ffd700 1 -- 172.21.15.120:0/3957211642 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feeac00bd10 con 0x7feebc19dbd0 2021-04-09T18:20:31.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feeb2ffd700 1 -- 172.21.15.120:0/3957211642 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac000c90 con 0x7feebc19dbd0 2021-04-09T18:20:31.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec444d700 1 -- 172.21.15.120:0/3957211642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc1895a0 con 0x7feebc19dbd0 2021-04-09T18:20:31.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feeb2ffd700 1 -- 172.21.15.120:0/3957211642 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feeac002220 con 0x7feebc19dbd0 2021-04-09T18:20:31.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.498 7feec444d700 1 -- 172.21.15.120:0/3957211642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc1895a0 con 0x7feebc19dbd0 2021-04-09T18:20:31.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.499 7feeb2ffd700 1 -- 172.21.15.120:0/3957211642 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7feeac00a000 con 0x7feebc19dbd0 2021-04-09T18:20:31.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.499 7feeb2ffd700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feea4018930 0x7feea401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.499 7feeb2ffd700 1 -- 172.21.15.120:0/3957211642 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7feeac032b30 con 0x7feebc19dbd0 2021-04-09T18:20:31.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.499 7feec2269700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feea4018930 0x7feea401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.499 7feec2269700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feea4018930 0x7feea401ae10 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:31.635 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.522 7feec444d700 1 -- 172.21.15.120:0/3957211642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc0d9ee0 con 0x7feebc19dbd0 2021-04-09T18:20:31.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.525 7feeb2ffd700 1 -- 172.21.15.120:0/3957211642 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7feeac032d40 con 0x7feebc19dbd0 2021-04-09T18:20:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.691 7feec444d700 1 -- 172.21.15.120:0/3957211642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7feebc0d9ee0 con 0x7feebc19dbd0 2021-04-09T18:20:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.692 7feeb2ffd700 1 -- 172.21.15.120:0/3957211642 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7feeac000c90 con 0x7feebc19dbd0 2021-04-09T18:20:31.690 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 8 2021-04-09T18:20:31.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 -- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feea4018930 msgr2=0x7feea401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feea4018930 0x7feea401ae10 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 -- 172.21.15.120:0/3957211642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc19dbd0 msgr2=0x7feebc19dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc19dbd0 0x7feebc19dfd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7feeac00b580 tx=0x7feeac00b920).stop 2021-04-09T18:20:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 -- 172.21.15.120:0/3957211642 shutdown_connections 2021-04-09T18:20:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feea4018930 0x7feea401ae10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feebc0ac900 0x7feebc0acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc19dbd0 0x7feebc19dfd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 --2- 172.21.15.120:0/3957211642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feebc1a1660 0x7feebc189e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.694 7feec444d700 1 -- 172.21.15.120:0/3957211642 >> 172.21.15.120:0/3957211642 conn(0x7feebc19f050 msgr2=0x7feebc0da420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.695 7feec444d700 1 -- 172.21.15.120:0/3957211642 shutdown_connections 2021-04-09T18:20:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.695 7feec444d700 1 -- 172.21.15.120:0/3957211642 wait complete. 2021-04-09T18:20:31.732 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-04-09T18:20:31.732 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:31.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.873 7f00c952e700 1 Processor -- start 2021-04-09T18:20:31.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.873 7f00c952e700 1 -- start start 2021-04-09T18:20:31.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c952e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c40d7160 0x7f00c40e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c952e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00c40d7560 0x7f00c40d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c952e700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40d6be0 con 0x7f00c40d5bc0 2021-04-09T18:20:31.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c952e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c40d80f0 con 0x7f00c40d7560 2021-04-09T18:20:31.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c952e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40e7f00 con 0x7f00c40d7160 2021-04-09T18:20:31.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c3ac0700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f00c40d5bc0 0x7f00c40d5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48324/0 (socket says 172.21.15.120:48324) 2021-04-09T18:20:31.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c3ac0700 1 -- 172.21.15.120:0/1839721005 learned_addr learned my addr 172.21.15.120:0/1839721005 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:31.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c32bf700 1 --2- 172.21.15.120:0/1839721005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c40d7160 0x7f00c40e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c2abe700 1 --2- 172.21.15.120:0/1839721005 >> v2:172.21.15.134:3300/0 conn(0x7f00c40d7560 0x7f00c40d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c22bd700 1 -- 172.21.15.120:0/1839721005 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943705473 0 0) 0x7f00bc0009b0 con 0x7f00c40d5bc0 2021-04-09T18:20:31.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c22bd700 1 -- 172.21.15.120:0/1839721005 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b0002fe0 con 0x7f00c40d5bc0 2021-04-09T18:20:31.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c32bf700 1 -- 172.21.15.120:0/1839721005 >> v2:172.21.15.134:3300/0 conn(0x7f00c40d7560 msgr2=0x7f00c40d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:31.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c32bf700 1 --2- 172.21.15.120:0/1839721005 >> v2:172.21.15.134:3300/0 conn(0x7f00c40d7560 0x7f00c40d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c32bf700 1 -- 172.21.15.120:0/1839721005 >> v1:172.21.15.120:6789/0 conn(0x7f00c40d5bc0 legacy=0x7f00c40d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c32bf700 1 -- 172.21.15.120:0/1839721005 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c41a2ac0 con 0x7f00c40d7160 2021-04-09T18:20:31.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c2abe700 1 --2- 172.21.15.120:0/1839721005 >> v2:172.21.15.134:3300/0 conn(0x7f00c40d7560 0x7f00c40d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:31.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.874 7f00c32bf700 1 --2- 172.21.15.120:0/1839721005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c40d7160 0x7f00c40e78e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f00ac0069d0 tx=0x7f00ac009e40).ready entity=mon.2 client_cookie=16b12838b6cb2468 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:31.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c22bd700 1 -- 172.21.15.120:0/1839721005 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00ac00b510 con 0x7f00c40d7160 2021-04-09T18:20:31.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c22bd700 1 -- 172.21.15.120:0/1839721005 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac00b890 con 0x7f00c40d7160 2021-04-09T18:20:31.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c22bd700 1 -- 172.21.15.120:0/1839721005 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00ac00bd70 con 0x7f00c40d7160 2021-04-09T18:20:31.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c952e700 1 -- 172.21.15.120:0/1839721005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c40d7160 msgr2=0x7f00c40e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:31.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c952e700 1 --2- 172.21.15.120:0/1839721005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c40d7160 0x7f00c40e78e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f00ac0069d0 tx=0x7f00ac009e40).stop 2021-04-09T18:20:31.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c952e700 1 -- 172.21.15.120:0/1839721005 shutdown_connections 2021-04-09T18:20:31.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c952e700 1 --2- 172.21.15.120:0/1839721005 >> v2:172.21.15.134:3300/0 conn(0x7f00c40d7560 0x7f00c40d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c952e700 1 --2- 172.21.15.120:0/1839721005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c40d7160 0x7f00c40e78e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c952e700 1 -- 172.21.15.120:0/1839721005 >> 172.21.15.120:0/1839721005 conn(0x7f00c40d1590 msgr2=0x7f00c40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c952e700 1 -- 172.21.15.120:0/1839721005 shutdown_connections 2021-04-09T18:20:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.875 7f00c952e700 1 -- 172.21.15.120:0/1839721005 wait complete. 2021-04-09T18:20:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.894 7f00c952e700 1 Processor -- start 2021-04-09T18:20:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.894 7f00c952e700 1 -- start start 2021-04-09T18:20:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c952e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00c4182d50 0x7f00c417edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c952e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c4183150 0x7f00c417f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c952e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00c417fa30 0x7f00c417fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c952e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c41827d0 con 0x7f00c4182d50 2021-04-09T18:20:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c952e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40a49f0 con 0x7f00c417fa30 2021-04-09T18:20:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c952e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40aef20 con 0x7f00c4183150 2021-04-09T18:20:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c32bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00c4182d50 0x7f00c417edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c32bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00c4182d50 0x7f00c417edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53420/0 (socket says 172.21.15.120:53420) 2021-04-09T18:20:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c32bf700 1 -- 172.21.15.120:0/3679968560 learned_addr learned my addr 172.21.15.120:0/3679968560 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c2abe700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c4183150 0x7f00c417f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c3ac0700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00c417fa30 0x7f00c417fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c32bf700 1 -- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c4183150 msgr2=0x7f00c417f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c32bf700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c4183150 0x7f00c417f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c32bf700 1 -- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00c417fa30 msgr2=0x7f00c417fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c32bf700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00c417fa30 0x7f00c417fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c32bf700 1 -- 172.21.15.120:0/3679968560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40af140 con 0x7f00c4182d50 2021-04-09T18:20:32.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c32bf700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00c4182d50 0x7f00c417edf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f00ac0099e0 tx=0x7f00ac00bd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:32.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00bbfff700 1 -- 172.21.15.120:0/3679968560 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00ac006240 con 0x7f00c4182d50 2021-04-09T18:20:32.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00bbfff700 1 -- 172.21.15.120:0/3679968560 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac00be60 con 0x7f00c4182d50 2021-04-09T18:20:32.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00bbfff700 1 -- 172.21.15.120:0/3679968560 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00ac005660 con 0x7f00c4182d50 2021-04-09T18:20:32.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c952e700 1 -- 172.21.15.120:0/3679968560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c40af140 con 0x7f00c4182d50 2021-04-09T18:20:32.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.895 7f00c952e700 1 -- 172.21.15.120:0/3679968560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c40af140 con 0x7f00c4182d50 2021-04-09T18:20:32.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.896 7f00bbfff700 1 -- 172.21.15.120:0/3679968560 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f00ac005660 con 0x7f00c4182d50 2021-04-09T18:20:32.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.896 7f00bbfff700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00a8018930 0x7f00a801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:32.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.896 7f00bbfff700 1 -- 172.21.15.120:0/3679968560 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f00ac032f40 con 0x7f00c4182d50 2021-04-09T18:20:32.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.896 7f00c2abe700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00a8018930 0x7f00a801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:32.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.896 7f00c2abe700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00a8018930 0x7f00a801adc0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:32.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.920 7f00c952e700 1 -- 172.21.15.120:0/3679968560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c40e4960 con 0x7f00c4182d50 2021-04-09T18:20:32.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:31.923 7f00bbfff700 1 -- 172.21.15.120:0/3679968560 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f00ac0064a0 con 0x7f00c4182d50 2021-04-09T18:20:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.104 7f00c952e700 1 -- 172.21.15.120:0/3679968560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00c40e4960 con 0x7f00c4182d50 2021-04-09T18:20:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.104 7f00bbfff700 1 -- 172.21.15.120:0/3679968560 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2104 (secure 0 0 0) 0x7f00ac005660 con 0x7f00c4182d50 2021-04-09T18:20:32.103 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2021-04-09T18:20:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:32.104 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:04.724179","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4292":{"gid":4292,"name":"b","rank":0,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1933604370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1933604370},{"type":"v1","addr":"172.21.15.134:6835","nonce":1933604370}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:32.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.106 7f00c952e700 1 -- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00a8018930 msgr2=0x7f00a801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:32.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.106 7f00c952e700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00a8018930 0x7f00a801adc0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:32.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.106 7f00c952e700 1 -- 172.21.15.120:0/3679968560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00c4182d50 msgr2=0x7f00c417edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:32.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.106 7f00c952e700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00c4182d50 0x7f00c417edf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f00ac0099e0 tx=0x7f00ac00bd20).stop 2021-04-09T18:20:32.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.106 7f00c952e700 1 -- 172.21.15.120:0/3679968560 shutdown_connections 2021-04-09T18:20:32.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.106 7f00c952e700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00c417fa30 0x7f00c417fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:32.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.106 7f00c952e700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00a8018930 0x7f00a801adc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:32.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.107 7f00c952e700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00c4183150 0x7f00c417f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:32.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.107 7f00c952e700 1 --2- 172.21.15.120:0/3679968560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00c4182d50 0x7f00c417edf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:32.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.107 7f00c952e700 1 -- 172.21.15.120:0/3679968560 >> 172.21.15.120:0/3679968560 conn(0x7f00c418b040 msgr2=0x7f00c417b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:32.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.107 7f00c952e700 1 -- 172.21.15.120:0/3679968560 shutdown_connections 2021-04-09T18:20:32.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:32.107 7f00c952e700 1 -- 172.21.15.120:0/3679968560 wait complete. 2021-04-09T18:20:32.315 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-04-09 18:19:55.049244', 'modified': '2021-04-09 18:20:04.724179', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4292}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4292': {'gid': 4292, 'name': 'b', 'rank': 0, 'incarnation': 6, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6835/1933604370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1933604370}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1933604370}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-04-09T18:20:32.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-04-09T18:20:32.317 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2021-04-09T18:20:32.444 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2021-04-09T18:20:32.445 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "dcbe2161-e5ca-44be-8661-d46578834d60", 2021-04-09T18:20:32.445 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2021-04-09T18:20:32.446 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 4292, 2021-04-09T18:20:32.446 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2021-04-09T18:20:32.446 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2021-04-09T18:20:32.447 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 28.723290986999999, 2021-04-09T18:20:32.447 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 7, 2021-04-09T18:20:32.448 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 22, 2021-04-09T18:20:32.448 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 22, 2021-04-09T18:20:32.449 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 33.712606579000003 2021-04-09T18:20:32.449 INFO:teuthology.orchestra.run.smithi134.stdout:} 2021-04-09T18:20:32.451 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "dcbe2161-e5ca-44be-8661-d46578834d60", "whoami": 0, "id": 4292, "want_state": "up:active", "state": "up:active", "rank_uptime": 28.723290986999999, "mdsmap_epoch": 7, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "uptime": 33.712606579000003 } 2021-04-09T18:20:32.452 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-04-09T18:20:32.452 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-04-09T18:20:32.452 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi120.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-04-09T18:20:32.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:20:32.453 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:20:32.497 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2021-04-09T18:20:32.621 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:20:32.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:20:32.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:20:32.679 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2021-04-09T18:20:32.724 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-04-09T18:20:32.725 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:20:32.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2021-04-09T18:20:32.824 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:20:32.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:20:32.877 INFO:teuthology.orchestra.run.smithi120.stderr:mount: /sys/fs/fuse/connections is already mounted or /sys/fs/fuse/connections busy 2021-04-09T18:20:32.878 INFO:teuthology.orchestra.run.smithi120.stderr: /sys/fs/fuse/connections is already mounted on /sys/fs/fuse/connections 2021-04-09T18:20:32.879 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:20:32.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:20:32.881 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2021-04-09T18:20:32.910 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:2021-04-09 18:20:32.911 7fe1b06b5f80 -1 init, newargv = 0x5612c86da700 newargc=9 2021-04-09T18:20:32.911 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:ceph-fuse[29622]: starting ceph client 2021-04-09T18:20:33.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:ceph-fuse[29622]: starting fuse 2021-04-09T18:20:34.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2021-04-09T18:20:34.092 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-04-09T18:20:34.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-04-09T18:20:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:mount: /sys/fs/fuse/connections is already mounted or /sys/fs/fuse/connections busy 2021-04-09T18:20:34.149 INFO:teuthology.orchestra.run.smithi120.stderr: /sys/fs/fuse/connections is already mounted on /sys/fs/fuse/connections 2021-04-09T18:20:34.150 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-04-09T18:20:34.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:20:34.153 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2021-04-09T18:20:34.196 INFO:teuthology.orchestra.run.smithi120.stdout:42 2021-04-09T18:20:34.197 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2021-04-09T18:20:34.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:20:34.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo python3 -c ' 2021-04-09T18:20:34.199 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2021-04-09T18:20:34.199 DEBUG:teuthology.orchestra.run.smithi120:> import re 2021-04-09T18:20:34.201 DEBUG:teuthology.orchestra.run.smithi120:> import os 2021-04-09T18:20:34.202 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2021-04-09T18:20:34.203 DEBUG:teuthology.orchestra.run.smithi120:> 2021-04-09T18:20:34.204 DEBUG:teuthology.orchestra.run.smithi120:> def find_socket(client_name): 2021-04-09T18:20:34.204 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-04-09T18:20:34.205 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2021-04-09T18:20:34.205 DEBUG:teuthology.orchestra.run.smithi120:> 2021-04-09T18:20:34.206 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2021-04-09T18:20:34.207 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2021-04-09T18:20:34.208 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2021-04-09T18:20:34.208 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2021-04-09T18:20:34.209 DEBUG:teuthology.orchestra.run.smithi120:> 2021-04-09T18:20:34.209 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2021-04-09T18:20:34.210 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-04-09T18:20:34.236 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2021-04-09T18:20:34.237 DEBUG:teuthology.orchestra.run.smithi120:> return f 2021-04-09T18:20:34.237 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-04-09T18:20:34.238 DEBUG:teuthology.orchestra.run.smithi120:> 2021-04-09T18:20:34.239 DEBUG:teuthology.orchestra.run.smithi120:> print(find_socket("client.0")) 2021-04-09T18:20:34.240 DEBUG:teuthology.orchestra.run.smithi120:> ' 2021-04-09T18:20:34.348 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.0.29622.asok 2021-04-09T18:20:34.353 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.29622.asok 2021-04-09T18:20:34.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:20:34.354 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.29622.asok status 2021-04-09T18:20:34.471 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2021-04-09T18:20:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2021-04-09T18:20:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "d23cd2d5f486487b0b80655c4e33344f0f97b82b", 2021-04-09T18:20:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 14.2.19-116-gd23cd2d5f48 (d23cd2d5f486487b0b80655c4e33344f0f97b82b) nautilus (stable)", 2021-04-09T18:20:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "0", 2021-04-09T18:20:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2021-04-09T18:20:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-04-09T18:20:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "29622", 2021-04-09T18:20:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2021-04-09T18:20:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2021-04-09T18:20:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2021-04-09T18:20:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4677, 2021-04-09T18:20:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2021-04-09T18:20:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2021-04-09T18:20:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2021-04-09T18:20:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 4677 2021-04-09T18:20:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2021-04-09T18:20:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2021-04-09T18:20:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2021-04-09T18:20:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2065428898 2021-04-09T18:20:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2021-04-09T18:20:34.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:34.491 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2021-04-09T18:20:34.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2021-04-09T18:20:34.496 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2021-04-09T18:20:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2065428898 2021-04-09T18:20:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2021-04-09T18:20:34.506 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.4677 172.21.15.120:0/2065428898", 2021-04-09T18:20:34.506 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "172.21.15.120:0/2065428898", 2021-04-09T18:20:34.507 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2021-04-09T18:20:34.507 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 7, 2021-04-09T18:20:34.508 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 22, 2021-04-09T18:20:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2021-04-09T18:20:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "blacklisted": false, 2021-04-09T18:20:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2021-04-09T18:20:34.529 INFO:teuthology.orchestra.run.smithi120.stdout:} 2021-04-09T18:20:34.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:20:34.564 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:20:34.565 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:20:34.608 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2021-04-09T18:20:34.609 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:20:34.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:20:34.610 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:20:34.702 INFO:teuthology.run_tasks:Running task workunit... 2021-04-09T18:20:34.747 INFO:tasks.workunit:Pulling workunits from ref d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:20:34.748 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-04-09T18:20:34.749 INFO:tasks.workunit:timeout=6h 2021-04-09T18:20:34.749 INFO:tasks.workunit:cleanup=True 2021-04-09T18:20:34.761 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.0 2021-04-09T18:20:34.807 INFO:teuthology.orchestra.run.smithi120.stdout: File: ‘/home/ubuntu/cephtest/mnt.0’ 2021-04-09T18:20:34.808 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2021-04-09T18:20:34.808 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 2ah/42d Inode: 1 Links: 2 2021-04-09T18:20:34.809 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2021-04-09T18:20:34.815 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:fusefs_t:s0 2021-04-09T18:20:34.815 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2021-04-09T18:20:34.816 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2021-04-09 18:20:03.725496499 +0000 2021-04-09T18:20:34.816 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2021-04-09 18:20:34.703354572 +0000 2021-04-09T18:20:34.816 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2021-04-09T18:20:34.817 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2021-04-09T18:20:34.818 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2021-04-09T18:20:34.909 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T18:20:34.957 INFO:tasks.workunit.client.0.smithi120.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-04-09T18:20:43.190 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:43.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.335 7f0e35956700 1 Processor -- start 2021-04-09T18:20:43.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.335 7f0e35956700 1 -- start start 2021-04-09T18:20:43.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e35956700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e300d7560 0x7f0e300d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e35956700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300d7960 con 0x7f0e300d63b0 2021-04-09T18:20:43.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e35956700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300d6be0 con 0x7f0e300d7160 2021-04-09T18:20:43.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e35956700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e300d80f0 con 0x7f0e300d7560 2021-04-09T18:20:43.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2ed73700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e300d7560 0x7f0e300d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2fd75700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0e300d63b0 0x7f0e301ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48360/0 (socket says 172.21.15.120:48360) 2021-04-09T18:20:43.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2fd75700 1 -- 172.21.15.120:0/3157629134 learned_addr learned my addr 172.21.15.120:0/3157629134 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:43.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2e572700 1 -- 172.21.15.120:0/3157629134 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329059717 0 0) 0x7f0e280009b0 con 0x7f0e300d63b0 2021-04-09T18:20:43.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2e572700 1 -- 172.21.15.120:0/3157629134 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e18002fe0 con 0x7f0e300d63b0 2021-04-09T18:20:43.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2f574700 1 -- 172.21.15.120:0/3157629134 >> v1:172.21.15.134:6789/0 conn(0x7f0e300d7160 legacy=0x7f0e300d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-04-09T18:20:43.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2f574700 1 -- 172.21.15.120:0/3157629134 >> v1:172.21.15.134:6789/0 conn(0x7f0e300d7160 legacy=0x7f0e300d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:20:43.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2f574700 1 --1- 172.21.15.120:0/3157629134 >> v1:172.21.15.134:6789/0 conn(0x7f0e300d7160 0x7f0e300d55a0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2021-04-09T18:20:43.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2ed73700 1 -- 172.21.15.120:0/3157629134 >> v1:172.21.15.134:6789/0 conn(0x7f0e300d7160 legacy=0x7f0e300d55a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-04-09T18:20:43.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.336 7f0e2ed73700 1 -- 172.21.15.120:0/3157629134 >> v1:172.21.15.120:6789/0 conn(0x7f0e300d63b0 legacy=0x7f0e301ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.337 7f0e2ed73700 1 -- 172.21.15.120:0/3157629134 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e301a2ac0 con 0x7f0e300d7560 2021-04-09T18:20:43.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.337 7f0e2ed73700 1 --2- 172.21.15.120:0/3157629134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e300d7560 0x7f0e300d5d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f0e240069d0 tx=0x7f0e24009e40).ready entity=mon.0 client_cookie=1bb36c16522d2012 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:43.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.337 7f0e2e572700 1 -- 172.21.15.120:0/3157629134 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e2400b510 con 0x7f0e300d7560 2021-04-09T18:20:43.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.337 7f0e2e572700 1 -- 172.21.15.120:0/3157629134 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2400b890 con 0x7f0e300d7560 2021-04-09T18:20:43.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.337 7f0e2e572700 1 -- 172.21.15.120:0/3157629134 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e2400bd70 con 0x7f0e300d7560 2021-04-09T18:20:43.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.337 7f0e35956700 1 -- 172.21.15.120:0/3157629134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e300d7560 msgr2=0x7f0e300d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.337 7f0e35956700 1 --2- 172.21.15.120:0/3157629134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e300d7560 0x7f0e300d5d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f0e240069d0 tx=0x7f0e24009e40).stop 2021-04-09T18:20:43.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.338 7f0e35956700 1 -- 172.21.15.120:0/3157629134 shutdown_connections 2021-04-09T18:20:43.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.338 7f0e35956700 1 --2- 172.21.15.120:0/3157629134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e300d7560 0x7f0e300d5d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.338 7f0e35956700 1 -- 172.21.15.120:0/3157629134 >> 172.21.15.120:0/3157629134 conn(0x7f0e300d1590 msgr2=0x7f0e300d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:43.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.338 7f0e35956700 1 -- 172.21.15.120:0/3157629134 shutdown_connections 2021-04-09T18:20:43.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.338 7f0e35956700 1 -- 172.21.15.120:0/3157629134 wait complete. 2021-04-09T18:20:43.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.356 7f0e35956700 1 Processor -- start 2021-04-09T18:20:43.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e35956700 1 -- start start 2021-04-09T18:20:43.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e35956700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3018e740 0x7f0e3019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e35956700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3018eb40 0x7f0e301a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e35956700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e301a0a50 0x7f0e301a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e35956700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e301a1470 con 0x7f0e3018e740 2021-04-09T18:20:43.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e35956700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3018e1c0 con 0x7f0e301a0a50 2021-04-09T18:20:43.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e35956700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3018c320 con 0x7f0e3018eb40 2021-04-09T18:20:43.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e2f574700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3018e740 0x7f0e3019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e2f574700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3018e740 0x7f0e3019fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53452/0 (socket says 172.21.15.120:53452) 2021-04-09T18:20:43.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e2f574700 1 -- 172.21.15.120:0/1840039592 learned_addr learned my addr 172.21.15.120:0/1840039592 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:43.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e2f574700 1 -- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3018eb40 msgr2=0x7f0e301a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e2fd75700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e301a0a50 0x7f0e301a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.357 7f0e2ed73700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3018eb40 0x7f0e301a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e2f574700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3018eb40 0x7f0e301a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e2f574700 1 -- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e301a0a50 msgr2=0x7f0e301a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e2f574700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e301a0a50 0x7f0e301a0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e2f574700 1 -- 172.21.15.120:0/1840039592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3018c540 con 0x7f0e3018e740 2021-04-09T18:20:43.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e2f574700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3018e740 0x7f0e3019fe10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f0e2000b580 tx=0x7f0e2000b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:43.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e17fff700 1 -- 172.21.15.120:0/1840039592 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e2000bd10 con 0x7f0e3018e740 2021-04-09T18:20:43.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e17fff700 1 -- 172.21.15.120:0/1840039592 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e200050d0 con 0x7f0e3018e740 2021-04-09T18:20:43.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e35956700 1 -- 172.21.15.120:0/1840039592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3018c540 con 0x7f0e3018e740 2021-04-09T18:20:43.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e17fff700 1 -- 172.21.15.120:0/1840039592 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e20006220 con 0x7f0e3018e740 2021-04-09T18:20:43.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e35956700 1 -- 172.21.15.120:0/1840039592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3018c540 con 0x7f0e3018e740 2021-04-09T18:20:43.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.358 7f0e17fff700 1 -- 172.21.15.120:0/1840039592 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0e20006030 con 0x7f0e3018e740 2021-04-09T18:20:43.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.359 7f0e17fff700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e10018930 0x7f0e1001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.359 7f0e17fff700 1 -- 172.21.15.120:0/1840039592 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0e20032ba0 con 0x7f0e3018e740 2021-04-09T18:20:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.359 7f0e2ed73700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e10018930 0x7f0e1001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.359 7f0e2ed73700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e10018930 0x7f0e1001ae10 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.381 7f0e35956700 1 -- 172.21.15.120:0/1840039592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e301a1470 con 0x7f0e3018e740 2021-04-09T18:20:43.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.384 7f0e17fff700 1 -- 172.21.15.120:0/1840039592 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0e20006030 con 0x7f0e3018e740 2021-04-09T18:20:43.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.571 7f0e35956700 1 -- 172.21.15.120:0/1840039592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e301a1470 con 0x7f0e3018e740 2021-04-09T18:20:43.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.572 7f0e17fff700 1 -- 172.21.15.120:0/1840039592 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2104 (secure 0 0 0) 0x7f0e200050b0 con 0x7f0e3018e740 2021-04-09T18:20:43.571 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2021-04-09T18:20:43.572 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:43.573 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:04.724179","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4292":{"gid":4292,"name":"b","rank":0,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1933604370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1933604370},{"type":"v1","addr":"172.21.15.134:6835","nonce":1933604370}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:43.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.574 7f0e35956700 1 -- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e10018930 msgr2=0x7f0e1001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.574 7f0e35956700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e10018930 0x7f0e1001ae10 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.574 7f0e35956700 1 -- 172.21.15.120:0/1840039592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3018e740 msgr2=0x7f0e3019fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.574 7f0e35956700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3018e740 0x7f0e3019fe10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f0e2000b580 tx=0x7f0e2000b920).stop 2021-04-09T18:20:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.575 7f0e35956700 1 -- 172.21.15.120:0/1840039592 shutdown_connections 2021-04-09T18:20:43.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.575 7f0e35956700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e301a0a50 0x7f0e301a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.575 7f0e35956700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e10018930 0x7f0e1001ae10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.575 7f0e35956700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3018eb40 0x7f0e301a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.575 7f0e35956700 1 --2- 172.21.15.120:0/1840039592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3018e740 0x7f0e3019fe10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.575 7f0e35956700 1 -- 172.21.15.120:0/1840039592 >> 172.21.15.120:0/1840039592 conn(0x7f0e30183d80 msgr2=0x7f0e30198a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:43.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.575 7f0e35956700 1 -- 172.21.15.120:0/1840039592 shutdown_connections 2021-04-09T18:20:43.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.575 7f0e35956700 1 -- 172.21.15.120:0/1840039592 wait complete. 2021-04-09T18:20:43.593 INFO:tasks.mds_thrash.fs.[None]:kill mds.b (rank=0) 2021-04-09T18:20:43.593 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:20:43.594 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:20:43.609 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:20:43.609 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:43.785 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.761 7f55a18f1700 1 Processor -- start 2021-04-09T18:20:43.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.761 7f55a18f1700 1 -- start start 2021-04-09T18:20:43.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.761 7f55a18f1700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f559c0d7160 0x7f559c0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.761 7f55a18f1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f559c0d55a0 0x7f559c0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.761 7f55a18f1700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c0d6be0 con 0x7f559c0d5fc0 2021-04-09T18:20:43.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.761 7f55a18f1700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c0d80f0 con 0x7f559c0d7160 2021-04-09T18:20:43.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.761 7f55a18f1700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c0d11f0 con 0x7f559c0d55a0 2021-04-09T18:20:43.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559b574700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f559c0d7160 0x7f559c0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559b574700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f559c0d7160 0x7f559c0d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53460/0 (socket says 172.21.15.120:53460) 2021-04-09T18:20:43.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559b574700 1 -- 172.21.15.120:0/4212666992 learned_addr learned my addr 172.21.15.120:0/4212666992 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:43.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f5593fff700 1 --2- 172.21.15.120:0/4212666992 >> v2:172.21.15.134:3300/0 conn(0x7f559c0d55a0 0x7f559c0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559b574700 1 -- 172.21.15.120:0/4212666992 >> v2:172.21.15.134:3300/0 conn(0x7f559c0d55a0 msgr2=0x7f559c0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559b574700 1 --2- 172.21.15.120:0/4212666992 >> v2:172.21.15.134:3300/0 conn(0x7f559c0d55a0 0x7f559c0d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559b574700 1 -- 172.21.15.120:0/4212666992 >> v1:172.21.15.134:6789/0 conn(0x7f559c0d5fc0 legacy=0x7f559c0d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559b574700 1 -- 172.21.15.120:0/4212666992 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c1a2ac0 con 0x7f559c0d7160 2021-04-09T18:20:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559b574700 1 --2- 172.21.15.120:0/4212666992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0d7160 0x7f559c0d7560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f558c006700 tx=0x7f558c009b80).ready entity=mon.0 client_cookie=5e6a49ee2e8fd1e3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:43.794 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559ad73700 1 -- 172.21.15.120:0/4212666992 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f558c00c0c0 con 0x7f559c0d7160 2021-04-09T18:20:43.794 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559ad73700 1 -- 172.21.15.120:0/4212666992 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c00c440 con 0x7f559c0d7160 2021-04-09T18:20:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f559ad73700 1 -- 172.21.15.120:0/4212666992 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f558c00c920 con 0x7f559c0d7160 2021-04-09T18:20:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f55a18f1700 1 -- 172.21.15.120:0/4212666992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0d7160 msgr2=0x7f559c0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.762 7f55a18f1700 1 --2- 172.21.15.120:0/4212666992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0d7160 0x7f559c0d7560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f558c006700 tx=0x7f558c009b80).stop 2021-04-09T18:20:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.763 7f55a18f1700 1 -- 172.21.15.120:0/4212666992 shutdown_connections 2021-04-09T18:20:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.763 7f55a18f1700 1 --2- 172.21.15.120:0/4212666992 >> v2:172.21.15.134:3300/0 conn(0x7f559c0d55a0 0x7f559c0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.763 7f55a18f1700 1 --2- 172.21.15.120:0/4212666992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0d7160 0x7f559c0d7560 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.763 7f55a18f1700 1 -- 172.21.15.120:0/4212666992 >> 172.21.15.120:0/4212666992 conn(0x7f559c0d1590 msgr2=0x7f559c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:43.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.763 7f55a18f1700 1 -- 172.21.15.120:0/4212666992 shutdown_connections 2021-04-09T18:20:43.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.763 7f55a18f1700 1 -- 172.21.15.120:0/4212666992 wait complete. 2021-04-09T18:20:43.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.782 7f55a18f1700 1 Processor -- start 2021-04-09T18:20:43.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.782 7f55a18f1700 1 -- start start 2021-04-09T18:20:43.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.782 7f55a18f1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f559c1986d0 0x7f559c094570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.782 7f55a18f1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0a86c0 0x7f559c0a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.782 7f55a18f1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f559c19ada0 0x7f559c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.782 7f55a18f1700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c19b7c0 con 0x7f559c0a86c0 2021-04-09T18:20:43.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.782 7f55a18f1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c094b90 con 0x7f559c19ada0 2021-04-09T18:20:43.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.782 7f55a18f1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c093c40 con 0x7f559c1986d0 2021-04-09T18:20:43.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5593fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0a86c0 0x7f559c0a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5593fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0a86c0 0x7f559c0a8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53468/0 (socket says 172.21.15.120:53468) 2021-04-09T18:20:43.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5593fff700 1 -- 172.21.15.120:0/154760406 learned_addr learned my addr 172.21.15.120:0/154760406 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:43.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f559b574700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f559c1986d0 0x7f559c094570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f559bd75700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f559c19ada0 0x7f559c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5593fff700 1 -- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f559c1986d0 msgr2=0x7f559c094570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5593fff700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f559c1986d0 0x7f559c094570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5593fff700 1 -- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f559c19ada0 msgr2=0x7f559c19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5593fff700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f559c19ada0 0x7f559c19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5593fff700 1 -- 172.21.15.120:0/154760406 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0b0430 con 0x7f559c0a86c0 2021-04-09T18:20:43.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f559bd75700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f559c19ada0 0x7f559c19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:43.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5593fff700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0a86c0 0x7f559c0a8ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f558400b580 tx=0x7f558400b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:43.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5598d6f700 1 -- 172.21.15.120:0/154760406 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5584006900 con 0x7f559c0a86c0 2021-04-09T18:20:43.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5598d6f700 1 -- 172.21.15.120:0/154760406 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558400bd10 con 0x7f559c0a86c0 2021-04-09T18:20:43.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f55a18f1700 1 -- 172.21.15.120:0/154760406 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c0b0430 con 0x7f559c0a86c0 2021-04-09T18:20:43.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f5598d6f700 1 -- 172.21.15.120:0/154760406 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5584002030 con 0x7f559c0a86c0 2021-04-09T18:20:43.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.783 7f55a18f1700 1 -- 172.21.15.120:0/154760406 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c0b0430 con 0x7f559c0a86c0 2021-04-09T18:20:43.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.784 7f5598d6f700 1 -- 172.21.15.120:0/154760406 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f55840068b0 con 0x7f559c0a86c0 2021-04-09T18:20:43.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.784 7f5598d6f700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5580018930 0x7f558001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:43.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.784 7f5598d6f700 1 -- 172.21.15.120:0/154760406 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5584032ce0 con 0x7f559c0a86c0 2021-04-09T18:20:43.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.784 7f559b574700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5580018930 0x7f558001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:43.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.784 7f559b574700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5580018930 0x7f558001ae10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:43.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.805 7f55a18f1700 1 -- 172.21.15.120:0/154760406 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c17a2e0 con 0x7f559c0a86c0 2021-04-09T18:20:43.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.809 7f5598d6f700 1 -- 172.21.15.120:0/154760406 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5584000940 con 0x7f559c0a86c0 2021-04-09T18:20:43.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.994 7f55a18f1700 1 -- 172.21.15.120:0/154760406 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f559c17a2e0 con 0x7f559c0a86c0 2021-04-09T18:20:43.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.994 7f5598d6f700 1 -- 172.21.15.120:0/154760406 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2104 (secure 0 0 0) 0x7f55840068b0 con 0x7f559c0a86c0 2021-04-09T18:20:43.994 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2021-04-09T18:20:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:43.995 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:04.724179","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4292":{"gid":4292,"name":"b","rank":0,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1933604370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1933604370},{"type":"v1","addr":"172.21.15.134:6835","nonce":1933604370}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:43.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 -- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5580018930 msgr2=0x7f558001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5580018930 0x7f558001ae10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 -- 172.21.15.120:0/154760406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0a86c0 msgr2=0x7f559c0a8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:43.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0a86c0 0x7f559c0a8ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f558400b580 tx=0x7f558400b920).stop 2021-04-09T18:20:43.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 -- 172.21.15.120:0/154760406 shutdown_connections 2021-04-09T18:20:43.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f559c19ada0 0x7f559c19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:43.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f559c0a86c0 0x7f559c0a8ac0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:44.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5580018930 0x7f558001ae10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:44.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 --2- 172.21.15.120:0/154760406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f559c1986d0 0x7f559c094570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:44.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 -- 172.21.15.120:0/154760406 >> 172.21.15.120:0/154760406 conn(0x7f559c185590 msgr2=0x7f559c19bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:44.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 -- 172.21.15.120:0/154760406 shutdown_connections 2021-04-09T18:20:44.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:43.997 7f55a18f1700 1 -- 172.21.15.120:0/154760406 wait complete. 2021-04-09T18:20:44.005 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:20:46.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:46.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.148 7f1f95d67700 1 Processor -- start 2021-04-09T18:20:46.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.148 7f1f95d67700 1 -- start start 2021-04-09T18:20:46.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f95d67700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1f900d7560 0x7f1f900d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:46.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f95d67700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1f900d63b0 0x7f1f901ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:46.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f95d67700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f900d7960 con 0x7f1f900d7160 2021-04-09T18:20:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f95d67700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f900d80f0 con 0x7f1f900d63b0 2021-04-09T18:20:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f95d67700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f900d6be0 con 0x7f1f900d7560 2021-04-09T18:20:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8ffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1f900d63b0 0x7f1f901ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:46.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8ffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1f900d63b0 0x7f1f901ab1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53482/0 (socket says 172.21.15.120:53482) 2021-04-09T18:20:46.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8ffff700 1 -- 172.21.15.120:0/3750127524 learned_addr learned my addr 172.21.15.120:0/3750127524 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:46.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8effd700 1 --2- 172.21.15.120:0/3750127524 >> v2:172.21.15.134:3300/0 conn(0x7f1f900d7560 0x7f1f900d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:46.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8ffff700 1 -- 172.21.15.120:0/3750127524 >> v2:172.21.15.134:3300/0 conn(0x7f1f900d7560 msgr2=0x7f1f900d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:46.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8ffff700 1 --2- 172.21.15.120:0/3750127524 >> v2:172.21.15.134:3300/0 conn(0x7f1f900d7560 0x7f1f900d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8ffff700 1 -- 172.21.15.120:0/3750127524 >> v1:172.21.15.134:6789/0 conn(0x7f1f900d7160 legacy=0x7f1f900d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:46.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8ffff700 1 -- 172.21.15.120:0/3750127524 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f901a2ac0 con 0x7f1f900d63b0 2021-04-09T18:20:46.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8effd700 1 --2- 172.21.15.120:0/3750127524 >> v2:172.21.15.134:3300/0 conn(0x7f1f900d7560 0x7f1f900d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:46.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8ffff700 1 --2- 172.21.15.120:0/3750127524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f900d63b0 0x7f1f901ab1e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f1f88006f00 tx=0x7f1f88009f10).ready entity=mon.0 client_cookie=98e7b236c32e1149 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:46.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8e7fc700 1 -- 172.21.15.120:0/3750127524 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f8800b3b0 con 0x7f1f900d63b0 2021-04-09T18:20:46.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8e7fc700 1 -- 172.21.15.120:0/3750127524 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800b730 con 0x7f1f900d63b0 2021-04-09T18:20:46.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f8e7fc700 1 -- 172.21.15.120:0/3750127524 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f8800bc10 con 0x7f1f900d63b0 2021-04-09T18:20:46.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f95d67700 1 -- 172.21.15.120:0/3750127524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f900d63b0 msgr2=0x7f1f901ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:46.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.149 7f1f95d67700 1 --2- 172.21.15.120:0/3750127524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f900d63b0 0x7f1f901ab1e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f1f88006f00 tx=0x7f1f88009f10).stop 2021-04-09T18:20:46.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.150 7f1f95d67700 1 -- 172.21.15.120:0/3750127524 shutdown_connections 2021-04-09T18:20:46.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.150 7f1f95d67700 1 --2- 172.21.15.120:0/3750127524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f900d63b0 0x7f1f901ab1e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.150 7f1f95d67700 1 --2- 172.21.15.120:0/3750127524 >> v2:172.21.15.134:3300/0 conn(0x7f1f900d7560 0x7f1f900d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.150 7f1f95d67700 1 -- 172.21.15.120:0/3750127524 >> 172.21.15.120:0/3750127524 conn(0x7f1f900d1590 msgr2=0x7f1f900d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:46.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.150 7f1f95d67700 1 -- 172.21.15.120:0/3750127524 shutdown_connections 2021-04-09T18:20:46.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.150 7f1f95d67700 1 -- 172.21.15.120:0/3750127524 wait complete. 2021-04-09T18:20:46.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f95d67700 1 Processor -- start 2021-04-09T18:20:46.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f95d67700 1 -- start start 2021-04-09T18:20:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f95d67700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f90094d00 0x7f1f9009b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f95d67700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f9017abc0 0x7f1f9017afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f95d67700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9017b5e0 0x7f1f90182150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f95d67700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9009b800 con 0x7f1f9017b5e0 2021-04-09T18:20:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f95d67700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9009bb50 con 0x7f1f9017abc0 2021-04-09T18:20:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f95d67700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90183d90 con 0x7f1f90094d00 2021-04-09T18:20:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f8ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9017b5e0 0x7f1f90182150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f8ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9017b5e0 0x7f1f90182150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53486/0 (socket says 172.21.15.120:53486) 2021-04-09T18:20:46.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.177 7f1f8ffff700 1 -- 172.21.15.120:0/2050411046 learned_addr learned my addr 172.21.15.120:0/2050411046 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:46.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f8effd700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f9017abc0 0x7f1f9017afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:46.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f8f7fe700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f90094d00 0x7f1f9009b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:46.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f8ffff700 1 -- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f90094d00 msgr2=0x7f1f9009b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:46.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f8ffff700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f90094d00 0x7f1f9009b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f8ffff700 1 -- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f9017abc0 msgr2=0x7f1f9017afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:46.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f8ffff700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f9017abc0 0x7f1f9017afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f8ffff700 1 -- 172.21.15.120:0/2050411046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9017b9e0 con 0x7f1f9017b5e0 2021-04-09T18:20:46.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f8ffff700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9017b5e0 0x7f1f90182150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f1f88009390 tx=0x7f1f8800bd40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:46.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f77fff700 1 -- 172.21.15.120:0/2050411046 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f88003030 con 0x7f1f9017b5e0 2021-04-09T18:20:46.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f77fff700 1 -- 172.21.15.120:0/2050411046 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f880068e0 con 0x7f1f9017b5e0 2021-04-09T18:20:46.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f77fff700 1 -- 172.21.15.120:0/2050411046 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f8800c570 con 0x7f1f9017b5e0 2021-04-09T18:20:46.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9017b9e0 con 0x7f1f9017b5e0 2021-04-09T18:20:46.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.178 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9017b9e0 con 0x7f1f9017b5e0 2021-04-09T18:20:46.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.179 7f1f77fff700 1 -- 172.21.15.120:0/2050411046 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1f88005820 con 0x7f1f9017b5e0 2021-04-09T18:20:46.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.179 7f1f77fff700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1f70018930 0x7f1f7001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:46.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.179 7f1f77fff700 1 -- 172.21.15.120:0/2050411046 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1f88032ec0 con 0x7f1f9017b5e0 2021-04-09T18:20:46.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.179 7f1f8f7fe700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1f70018930 0x7f1f7001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:46.326 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.179 7f1f8f7fe700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1f70018930 0x7f1f7001ae10 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:46.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.194 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f90179cb0 con 0x7f1f9017b5e0 2021-04-09T18:20:46.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.198 7f1f77fff700 1 -- 172.21.15.120:0/2050411046 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1f88006c80 con 0x7f1f9017b5e0 2021-04-09T18:20:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.381 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f90179cb0 con 0x7f1f9017b5e0 2021-04-09T18:20:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.382 7f1f77fff700 1 -- 172.21.15.120:0/2050411046 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2104 (secure 0 0 0) 0x7f1f880068e0 con 0x7f1f9017b5e0 2021-04-09T18:20:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2021-04-09T18:20:46.386 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:46.387 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:04.724179","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4292":{"gid":4292,"name":"b","rank":0,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1933604370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1933604370},{"type":"v1","addr":"172.21.15.134:6835","nonce":1933604370}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:46.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.384 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1f70018930 msgr2=0x7f1f7001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:46.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.384 7f1f95d67700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1f70018930 0x7f1f7001ae10 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.384 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9017b5e0 msgr2=0x7f1f90182150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:46.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.384 7f1f95d67700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9017b5e0 0x7f1f90182150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f1f88009390 tx=0x7f1f8800bd40).stop 2021-04-09T18:20:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.385 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 shutdown_connections 2021-04-09T18:20:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.385 7f1f95d67700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f9017b5e0 0x7f1f90182150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.385 7f1f95d67700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f9017abc0 0x7f1f9017afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.385 7f1f95d67700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1f70018930 0x7f1f7001ae10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.385 7f1f95d67700 1 --2- 172.21.15.120:0/2050411046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f90094d00 0x7f1f9009b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.385 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 >> 172.21.15.120:0/2050411046 conn(0x7f1f90184f60 msgr2=0x7f1f90094050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.385 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 shutdown_connections 2021-04-09T18:20:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:46.385 7f1f95d67700 1 -- 172.21.15.120:0/2050411046 wait complete. 2021-04-09T18:20:46.396 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:20:48.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.542 7f541f596700 1 Processor -- start 2021-04-09T18:20:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.542 7f541f596700 1 -- start start 2021-04-09T18:20:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541f596700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f54180d7560 0x7f54180d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541f596700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54180d63b0 0x7f54181ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:48.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541f596700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180d7960 con 0x7f54180d7160 2021-04-09T18:20:48.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541f596700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54180d80f0 con 0x7f54180d7560 2021-04-09T18:20:48.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541f596700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54180d6be0 con 0x7f54180d63b0 2021-04-09T18:20:48.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541cbb1700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f54180d7560 0x7f54180d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:48.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541d3b2700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f54180d7160 0x7f54180d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48406/0 (socket says 172.21.15.120:48406) 2021-04-09T18:20:48.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541d3b2700 1 -- 172.21.15.120:0/2346301471 learned_addr learned my addr 172.21.15.120:0/2346301471 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:48.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541dbb3700 1 --2- 172.21.15.120:0/2346301471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54180d63b0 0x7f54181ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:48.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541cbb1700 1 -- 172.21.15.120:0/2346301471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54180d63b0 msgr2=0x7f54181ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:48.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f541cbb1700 1 --2- 172.21.15.120:0/2346301471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54180d63b0 0x7f54181ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.544 7f541cbb1700 1 -- 172.21.15.120:0/2346301471 >> v1:172.21.15.120:6789/0 conn(0x7f54180d7160 legacy=0x7f54180d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:48.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.543 7f540ffff700 1 -- 172.21.15.120:0/2346301471 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379173877 0 0) 0x7f5414000ce0 con 0x7f54180d7160 2021-04-09T18:20:48.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.544 7f541cbb1700 1 -- 172.21.15.120:0/2346301471 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54181a2ac0 con 0x7f54180d7560 2021-04-09T18:20:48.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.544 7f541cbb1700 1 --2- 172.21.15.120:0/2346301471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54180d7560 0x7f54180d5d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f5408006650 tx=0x7f5408009a00).ready entity=mon.0 client_cookie=7aeb596b76cba1e7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:48.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.544 7f540ffff700 1 -- 172.21.15.120:0/2346301471 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5408009df0 con 0x7f54180d7560 2021-04-09T18:20:48.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.544 7f540ffff700 1 -- 172.21.15.120:0/2346301471 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080009b0 con 0x7f54180d7560 2021-04-09T18:20:48.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.544 7f540ffff700 1 -- 172.21.15.120:0/2346301471 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f540800c2b0 con 0x7f54180d7560 2021-04-09T18:20:48.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.544 7f541f596700 1 -- 172.21.15.120:0/2346301471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54180d7560 msgr2=0x7f54180d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:48.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.544 7f541f596700 1 --2- 172.21.15.120:0/2346301471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54180d7560 0x7f54180d5d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f5408006650 tx=0x7f5408009a00).stop 2021-04-09T18:20:48.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.545 7f541f596700 1 -- 172.21.15.120:0/2346301471 shutdown_connections 2021-04-09T18:20:48.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.545 7f541f596700 1 --2- 172.21.15.120:0/2346301471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54180d7560 0x7f54180d5d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.545 7f541f596700 1 --2- 172.21.15.120:0/2346301471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54180d63b0 0x7f54181ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.545 7f541f596700 1 -- 172.21.15.120:0/2346301471 >> 172.21.15.120:0/2346301471 conn(0x7f54180d1590 msgr2=0x7f54180d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.545 7f541f596700 1 -- 172.21.15.120:0/2346301471 shutdown_connections 2021-04-09T18:20:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.545 7f541f596700 1 -- 172.21.15.120:0/2346301471 wait complete. 2021-04-09T18:20:48.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.564 7f541f596700 1 Processor -- start 2021-04-09T18:20:48.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.564 7f541f596700 1 -- start start 2021-04-09T18:20:48.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541f596700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418187380 0x7f5418189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:48.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541f596700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5418187780 0x7f54180987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:48.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541f596700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5418189c50 0x7f54180b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:48.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541f596700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541818ce60 con 0x7f5418189c50 2021-04-09T18:20:48.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541f596700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5418098e10 con 0x7f5418187380 2021-04-09T18:20:48.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541f596700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5418099030 con 0x7f5418187780 2021-04-09T18:20:48.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541dbb3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5418189c50 0x7f54180b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:48.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541dbb3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5418189c50 0x7f54180b8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53500/0 (socket says 172.21.15.120:53500) 2021-04-09T18:20:48.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541dbb3700 1 -- 172.21.15.120:0/183707350 learned_addr learned my addr 172.21.15.120:0/183707350 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:48.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541d3b2700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418187380 0x7f5418189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:48.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541cbb1700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5418187780 0x7f54180987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:48.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541dbb3700 1 -- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5418187780 msgr2=0x7f54180987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:48.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541dbb3700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5418187780 0x7f54180987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541dbb3700 1 -- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418187380 msgr2=0x7f5418189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:48.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541dbb3700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418187380 0x7f5418189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541dbb3700 1 -- 172.21.15.120:0/183707350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180b8b30 con 0x7f5418189c50 2021-04-09T18:20:48.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541cbb1700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5418187780 0x7f54180987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:20:48.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541d3b2700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418187380 0x7f5418189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:20:48.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541dbb3700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5418189c50 0x7f54180b8510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f54100099a0 tx=0x7f541000bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:48.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f540dffb700 1 -- 172.21.15.120:0/183707350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f54100066f0 con 0x7f5418189c50 2021-04-09T18:20:48.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f540dffb700 1 -- 172.21.15.120:0/183707350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410003030 con 0x7f5418189c50 2021-04-09T18:20:48.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541f596700 1 -- 172.21.15.120:0/183707350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54180b8b30 con 0x7f5418189c50 2021-04-09T18:20:48.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f540dffb700 1 -- 172.21.15.120:0/183707350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5410001470 con 0x7f5418189c50 2021-04-09T18:20:48.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.565 7f541f596700 1 -- 172.21.15.120:0/183707350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54180b8b30 con 0x7f5418189c50 2021-04-09T18:20:48.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.566 7f540dffb700 1 -- 172.21.15.120:0/183707350 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f54100011f0 con 0x7f5418189c50 2021-04-09T18:20:48.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.566 7f540dffb700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f53f8018930 0x7f53f801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:48.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.566 7f540dffb700 1 -- 172.21.15.120:0/183707350 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5410032f00 con 0x7f5418189c50 2021-04-09T18:20:48.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.566 7f541d3b2700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f53f8018930 0x7f53f801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:48.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.567 7f541d3b2700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f53f8018930 0x7f53f801ae10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:48.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.588 7f541f596700 1 -- 172.21.15.120:0/183707350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5418189100 con 0x7f5418189c50 2021-04-09T18:20:48.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.591 7f540dffb700 1 -- 172.21.15.120:0/183707350 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f541000be30 con 0x7f5418189c50 2021-04-09T18:20:48.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.783 7f541f596700 1 -- 172.21.15.120:0/183707350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5418189100 con 0x7f5418189c50 2021-04-09T18:20:48.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.784 7f540dffb700 1 -- 172.21.15.120:0/183707350 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2104 (secure 0 0 0) 0x7f541001fae0 con 0x7f5418189c50 2021-04-09T18:20:48.783 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2021-04-09T18:20:48.784 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:48.785 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:04.724179","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4292":{"gid":4292,"name":"b","rank":0,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1933604370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1933604370},{"type":"v1","addr":"172.21.15.134:6835","nonce":1933604370}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:48.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.786 7f541f596700 1 -- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f53f8018930 msgr2=0x7f53f801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:48.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.786 7f541f596700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f53f8018930 0x7f53f801ae10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.786 7f541f596700 1 -- 172.21.15.120:0/183707350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5418189c50 msgr2=0x7f54180b8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:48.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.786 7f541f596700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5418189c50 0x7f54180b8510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f54100099a0 tx=0x7f541000bcf0).stop 2021-04-09T18:20:48.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.787 7f541f596700 1 -- 172.21.15.120:0/183707350 shutdown_connections 2021-04-09T18:20:48.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.787 7f541f596700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5418189c50 0x7f54180b8510 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.787 7f541f596700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f53f8018930 0x7f53f801ae10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.787 7f541f596700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5418187780 0x7f54180987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.787 7f541f596700 1 --2- 172.21.15.120:0/183707350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418187380 0x7f5418189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:48.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.787 7f541f596700 1 -- 172.21.15.120:0/183707350 >> 172.21.15.120:0/183707350 conn(0x7f541818dc90 msgr2=0x7f541808fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:48.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.787 7f541f596700 1 -- 172.21.15.120:0/183707350 shutdown_connections 2021-04-09T18:20:48.794 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:48.787 7f541f596700 1 -- 172.21.15.120:0/183707350 wait complete. 2021-04-09T18:20:48.796 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:20:50.797 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:50.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.940 7f06fb6c2700 1 Processor -- start 2021-04-09T18:20:50.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.940 7f06fb6c2700 1 -- start start 2021-04-09T18:20:50.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06fb6c2700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f06f40d7160 0x7f06f40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:50.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06fb6c2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40d6190 0x7f06f40d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:50.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06fb6c2700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f40d6be0 con 0x7f06f40d55a0 2021-04-09T18:20:50.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06fb6c2700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f40d80f0 con 0x7f06f40d7160 2021-04-09T18:20:50.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06fb6c2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40d11f0 con 0x7f06f40d6190 2021-04-09T18:20:50.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06f94de700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f06f40d7160 0x7f06f40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:50.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06f94de700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f06f40d7160 0x7f06f40d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53508/0 (socket says 172.21.15.120:53508) 2021-04-09T18:20:50.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06f94de700 1 -- 172.21.15.120:0/2467720429 learned_addr learned my addr 172.21.15.120:0/2467720429 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:50.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06f9cdf700 1 --2- 172.21.15.120:0/2467720429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40d6190 0x7f06f40d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:50.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06f94de700 1 -- 172.21.15.120:0/2467720429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40d6190 msgr2=0x7f06f40d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:50.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06f94de700 1 --2- 172.21.15.120:0/2467720429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40d6190 0x7f06f40d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:50.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06f94de700 1 -- 172.21.15.120:0/2467720429 >> v1:172.21.15.134:6789/0 conn(0x7f06f40d55a0 legacy=0x7f06f40d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:50.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06f94de700 1 -- 172.21.15.120:0/2467720429 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f41a2ac0 con 0x7f06f40d7160 2021-04-09T18:20:50.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06f94de700 1 --2- 172.21.15.120:0/2467720429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f40d7160 0x7f06f40d7560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f06f0006700 tx=0x7f06f0009b00).ready entity=mon.0 client_cookie=4f10c0926d63f98c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:50.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.941 7f06ebfff700 1 -- 172.21.15.120:0/2467720429 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06f000c0c0 con 0x7f06f40d7160 2021-04-09T18:20:50.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.942 7f06ebfff700 1 -- 172.21.15.120:0/2467720429 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f000c400 con 0x7f06f40d7160 2021-04-09T18:20:50.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.942 7f06ebfff700 1 -- 172.21.15.120:0/2467720429 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06f000c8e0 con 0x7f06f40d7160 2021-04-09T18:20:50.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.942 7f06fb6c2700 1 -- 172.21.15.120:0/2467720429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f40d7160 msgr2=0x7f06f40d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:50.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.942 7f06fb6c2700 1 --2- 172.21.15.120:0/2467720429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f40d7160 0x7f06f40d7560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f06f0006700 tx=0x7f06f0009b00).stop 2021-04-09T18:20:50.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.942 7f06fb6c2700 1 -- 172.21.15.120:0/2467720429 shutdown_connections 2021-04-09T18:20:50.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.942 7f06fb6c2700 1 --2- 172.21.15.120:0/2467720429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40d6190 0x7f06f40d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:50.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.942 7f06fb6c2700 1 --2- 172.21.15.120:0/2467720429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f40d7160 0x7f06f40d7560 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:50.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.942 7f06fb6c2700 1 -- 172.21.15.120:0/2467720429 >> 172.21.15.120:0/2467720429 conn(0x7f06f40d1590 msgr2=0x7f06f40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:50.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.943 7f06fb6c2700 1 -- 172.21.15.120:0/2467720429 shutdown_connections 2021-04-09T18:20:50.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.943 7f06fb6c2700 1 -- 172.21.15.120:0/2467720429 wait complete. 2021-04-09T18:20:50.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.962 7f06fb6c2700 1 Processor -- start 2021-04-09T18:20:50.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.962 7f06fb6c2700 1 -- start start 2021-04-09T18:20:50.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.962 7f06fb6c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4191390 0x7f06f408ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:50.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.962 7f06fb6c2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40b1f70 0x7f06f40b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:50.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.962 7f06fb6c2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f41838d0 0x7f06f4183cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:50.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.962 7f06fb6c2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f408b330 con 0x7f06f41838d0 2021-04-09T18:20:50.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06fb6c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f41842f0 con 0x7f06f4191390 2021-04-09T18:20:50.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06fb6c2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4184510 con 0x7f06f40b1f70 2021-04-09T18:20:50.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f9cdf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f41838d0 0x7f06f4183cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:50.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f9cdf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f41838d0 0x7f06f4183cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53518/0 (socket says 172.21.15.120:53518) 2021-04-09T18:20:50.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f94de700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4191390 0x7f06f408ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:50.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f9cdf700 1 -- 172.21.15.120:0/3334125907 learned_addr learned my addr 172.21.15.120:0/3334125907 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:50.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f8cdd700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40b1f70 0x7f06f40b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:50.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f94de700 1 -- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40b1f70 msgr2=0x7f06f40b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:50.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f94de700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40b1f70 0x7f06f40b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:50.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f94de700 1 -- 172.21.15.120:0/3334125907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f41838d0 msgr2=0x7f06f4183cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:50.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f94de700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f41838d0 0x7f06f4183cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:50.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f94de700 1 -- 172.21.15.120:0/3334125907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f40b9ca0 con 0x7f06f4191390 2021-04-09T18:20:50.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f9cdf700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f41838d0 0x7f06f4183cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:20:50.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06f94de700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4191390 0x7f06f408ad10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f06f0000bd0 tx=0x7f06f000b810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:50.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06e9ffb700 1 -- 172.21.15.120:0/3334125907 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06f0009090 con 0x7f06f4191390 2021-04-09T18:20:50.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06e9ffb700 1 -- 172.21.15.120:0/3334125907 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f0000da0 con 0x7f06f4191390 2021-04-09T18:20:50.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f40b9ca0 con 0x7f06f4191390 2021-04-09T18:20:50.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06e9ffb700 1 -- 172.21.15.120:0/3334125907 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06f0002030 con 0x7f06f4191390 2021-04-09T18:20:50.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.963 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f40b9ca0 con 0x7f06f4191390 2021-04-09T18:20:50.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.964 7f06e9ffb700 1 -- 172.21.15.120:0/3334125907 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f06f00052e0 con 0x7f06f4191390 2021-04-09T18:20:50.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.964 7f06e9ffb700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06d4018930 0x7f06d401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:50.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.964 7f06e9ffb700 1 -- 172.21.15.120:0/3334125907 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f06f0032a90 con 0x7f06f4191390 2021-04-09T18:20:50.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.964 7f06f8cdd700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06d4018930 0x7f06d401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:50.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.965 7f06f8cdd700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06d4018930 0x7f06d401ae10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:51.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.986 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f418cc10 con 0x7f06f4191390 2021-04-09T18:20:51.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:50.989 7f06e9ffb700 1 -- 172.21.15.120:0/3334125907 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f06f0006350 con 0x7f06f4191390 2021-04-09T18:20:51.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.217 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06f418cc10 con 0x7f06f4191390 2021-04-09T18:20:51.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.217 7f06e9ffb700 1 -- 172.21.15.120:0/3334125907 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2104 (secure 0 0 0) 0x7f06f0000c90 con 0x7f06f4191390 2021-04-09T18:20:51.217 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2021-04-09T18:20:51.218 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:51.218 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:04.724179","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4292":{"gid":4292,"name":"b","rank":0,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1933604370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1933604370},{"type":"v1","addr":"172.21.15.134:6835","nonce":1933604370}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:51.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.220 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06d4018930 msgr2=0x7f06d401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:51.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.220 7f06fb6c2700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06d4018930 0x7f06d401ae10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:51.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.220 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4191390 msgr2=0x7f06f408ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:51.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.220 7f06fb6c2700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4191390 0x7f06f408ad10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f06f0000bd0 tx=0x7f06f000b810).stop 2021-04-09T18:20:51.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.221 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 shutdown_connections 2021-04-09T18:20:51.232 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.221 7f06fb6c2700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f41838d0 0x7f06f4183cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:51.232 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.221 7f06fb6c2700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06d4018930 0x7f06d401ae10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:51.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.221 7f06fb6c2700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06f40b1f70 0x7f06f40b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:51.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.221 7f06fb6c2700 1 --2- 172.21.15.120:0/3334125907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06f4191390 0x7f06f408ad10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:51.235 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.221 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 >> 172.21.15.120:0/3334125907 conn(0x7f06f419a7e0 msgr2=0x7f06f4093af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:51.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.221 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 shutdown_connections 2021-04-09T18:20:51.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:51.221 7f06fb6c2700 1 -- 172.21.15.120:0/3334125907 wait complete. 2021-04-09T18:20:51.237 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:20:53.238 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:53.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff725e14700 1 Processor -- start 2021-04-09T18:20:53.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff725e14700 1 -- start start 2021-04-09T18:20:53.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff725e14700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff7200d7160 0x7ff7200d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:53.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff725e14700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7200d55a0 0x7ff7200d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:53.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff725e14700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7200d6be0 con 0x7ff7200d5fc0 2021-04-09T18:20:53.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff725e14700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7200d80f0 con 0x7ff7200d7160 2021-04-09T18:20:53.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff725e14700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7201a2ac0 con 0x7ff7200d55a0 2021-04-09T18:20:53.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff71f7fe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff7200d7160 0x7ff7200d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:53.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff71ffff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff7200d5fc0 0x7ff7200d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48438/0 (socket says 172.21.15.120:48438) 2021-04-09T18:20:53.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff71ffff700 1 -- 172.21.15.120:0/1641460618 learned_addr learned my addr 172.21.15.120:0/1641460618 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:53.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.381 7ff71f7fe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff7200d7160 0x7ff7200d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53522/0 (socket says 172.21.15.120:53522) 2021-04-09T18:20:53.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71effd700 1 --2- 172.21.15.120:0/1641460618 >> v2:172.21.15.134:3300/0 conn(0x7ff7200d55a0 0x7ff7200d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:53.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71f7fe700 1 -- 172.21.15.120:0/1641460618 >> v2:172.21.15.134:3300/0 conn(0x7ff7200d55a0 msgr2=0x7ff7200d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:53.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71f7fe700 1 --2- 172.21.15.120:0/1641460618 >> v2:172.21.15.134:3300/0 conn(0x7ff7200d55a0 0x7ff7200d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71f7fe700 1 -- 172.21.15.120:0/1641460618 >> v1:172.21.15.120:6789/0 conn(0x7ff7200d5fc0 legacy=0x7ff7200d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:53.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71e7fc700 1 -- 172.21.15.120:0/1641460618 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431842219 0 0) 0x7ff718000d30 con 0x7ff7200d5fc0 2021-04-09T18:20:53.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71f7fe700 1 -- 172.21.15.120:0/1641460618 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7201ac1f0 con 0x7ff7200d7160 2021-04-09T18:20:53.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71f7fe700 1 --2- 172.21.15.120:0/1641460618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7200d7160 0x7ff7200d7560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7ff710006650 tx=0x7ff710009a00).ready entity=mon.0 client_cookie=d80ff56e1f37a9e9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:53.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71e7fc700 1 -- 172.21.15.120:0/1641460618 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff710009df0 con 0x7ff7200d7160 2021-04-09T18:20:53.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71e7fc700 1 -- 172.21.15.120:0/1641460618 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7100009b0 con 0x7ff7200d7160 2021-04-09T18:20:53.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff71e7fc700 1 -- 172.21.15.120:0/1641460618 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff71000c2b0 con 0x7ff7200d7160 2021-04-09T18:20:53.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff725e14700 1 -- 172.21.15.120:0/1641460618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7200d7160 msgr2=0x7ff7200d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:53.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.382 7ff725e14700 1 --2- 172.21.15.120:0/1641460618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7200d7160 0x7ff7200d7560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7ff710006650 tx=0x7ff710009a00).stop 2021-04-09T18:20:53.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.383 7ff725e14700 1 -- 172.21.15.120:0/1641460618 shutdown_connections 2021-04-09T18:20:53.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.383 7ff725e14700 1 --2- 172.21.15.120:0/1641460618 >> v2:172.21.15.134:3300/0 conn(0x7ff7200d55a0 0x7ff7200d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.383 7ff725e14700 1 --2- 172.21.15.120:0/1641460618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7200d7160 0x7ff7200d7560 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.383 7ff725e14700 1 -- 172.21.15.120:0/1641460618 >> 172.21.15.120:0/1641460618 conn(0x7ff7200d1590 msgr2=0x7ff7200d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:53.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.383 7ff725e14700 1 -- 172.21.15.120:0/1641460618 shutdown_connections 2021-04-09T18:20:53.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.383 7ff725e14700 1 -- 172.21.15.120:0/1641460618 wait complete. 2021-04-09T18:20:53.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff725e14700 1 Processor -- start 2021-04-09T18:20:53.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff725e14700 1 -- start start 2021-04-09T18:20:53.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff725e14700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7201853a0 0x7ff7201869b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:53.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff725e14700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7201857a0 0x7ff72019d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:53.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff725e14700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff72019e000 0x7ff72019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:53.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff725e14700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff720186fd0 con 0x7ff7201857a0 2021-04-09T18:20:53.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff725e14700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72019ea20 con 0x7ff72019e000 2021-04-09T18:20:53.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff725e14700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72019ec40 con 0x7ff7201853a0 2021-04-09T18:20:53.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff71effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7201857a0 0x7ff72019d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:53.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff71effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7201857a0 0x7ff72019d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53530/0 (socket says 172.21.15.120:53530) 2021-04-09T18:20:53.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.404 7ff71effd700 1 -- 172.21.15.120:0/1241879357 learned_addr learned my addr 172.21.15.120:0/1241879357 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:53.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71ffff700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff72019e000 0x7ff72019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:53.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71f7fe700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7201853a0 0x7ff7201869b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:53.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71effd700 1 -- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7201853a0 msgr2=0x7ff7201869b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:53.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71effd700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7201853a0 0x7ff7201869b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71effd700 1 -- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff72019e000 msgr2=0x7ff72019e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:53.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71effd700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff72019e000 0x7ff72019e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71effd700 1 -- 172.21.15.120:0/1241879357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff720183460 con 0x7ff7201857a0 2021-04-09T18:20:53.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71f7fe700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7201853a0 0x7ff7201869b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:20:53.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71ffff700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff72019e000 0x7ff72019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:20:53.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff71effd700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7201857a0 0x7ff72019d9e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7ff714006f00 tx=0x7ff71400b940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:53.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff707fff700 1 -- 172.21.15.120:0/1241879357 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff71400bd30 con 0x7ff7201857a0 2021-04-09T18:20:53.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff707fff700 1 -- 172.21.15.120:0/1241879357 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff714002030 con 0x7ff7201857a0 2021-04-09T18:20:53.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff707fff700 1 -- 172.21.15.120:0/1241879357 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff714002590 con 0x7ff7201857a0 2021-04-09T18:20:53.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff725e14700 1 -- 172.21.15.120:0/1241879357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff720183460 con 0x7ff7201857a0 2021-04-09T18:20:53.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.405 7ff725e14700 1 -- 172.21.15.120:0/1241879357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff720183460 con 0x7ff7201857a0 2021-04-09T18:20:53.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.406 7ff707fff700 1 -- 172.21.15.120:0/1241879357 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff714002210 con 0x7ff7201857a0 2021-04-09T18:20:53.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.406 7ff707fff700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7000188c0 0x7ff70001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:53.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.406 7ff707fff700 1 -- 172.21.15.120:0/1241879357 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff7140329a0 con 0x7ff7201857a0 2021-04-09T18:20:53.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.406 7ff71f7fe700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7000188c0 0x7ff70001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:53.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.407 7ff71f7fe700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7000188c0 0x7ff70001adc0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:53.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.426 7ff725e14700 1 -- 172.21.15.120:0/1241879357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff720184e70 con 0x7ff7201857a0 2021-04-09T18:20:53.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.429 7ff707fff700 1 -- 172.21.15.120:0/1241879357 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff714002460 con 0x7ff7201857a0 2021-04-09T18:20:53.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.621 7ff725e14700 1 -- 172.21.15.120:0/1241879357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff720184e70 con 0x7ff7201857a0 2021-04-09T18:20:53.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.621 7ff707fff700 1 -- 172.21.15.120:0/1241879357 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2104 (secure 0 0 0) 0x7ff71402df30 con 0x7ff7201857a0 2021-04-09T18:20:53.620 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2021-04-09T18:20:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:53.621 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:04.724179","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4292":{"gid":4292,"name":"b","rank":0,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1933604370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1933604370},{"type":"v1","addr":"172.21.15.134:6835","nonce":1933604370}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:53.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 -- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7000188c0 msgr2=0x7ff70001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:53.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7000188c0 0x7ff70001adc0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 -- 172.21.15.120:0/1241879357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7201857a0 msgr2=0x7ff72019d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:53.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7201857a0 0x7ff72019d9e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7ff714006f00 tx=0x7ff71400b940).stop 2021-04-09T18:20:53.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 -- 172.21.15.120:0/1241879357 shutdown_connections 2021-04-09T18:20:53.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff72019e000 0x7ff72019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7201857a0 0x7ff72019d9e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7000188c0 0x7ff70001adc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 --2- 172.21.15.120:0/1241879357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7201853a0 0x7ff7201869b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:53.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 -- 172.21.15.120:0/1241879357 >> 172.21.15.120:0/1241879357 conn(0x7ff72018dc90 msgr2=0x7ff72008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:53.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 -- 172.21.15.120:0/1241879357 shutdown_connections 2021-04-09T18:20:53.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:53.624 7ff725e14700 1 -- 172.21.15.120:0/1241879357 wait complete. 2021-04-09T18:20:53.632 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:20:54.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:20:54.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:20:55.634 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.783 7f1977ca7700 1 Processor -- start 2021-04-09T18:20:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f1977ca7700 1 -- start start 2021-04-09T18:20:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f1977ca7700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f19700eac40 0x7f19700dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f1977ca7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f19700d6760 0x7f19700d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:55.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f1977ca7700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19700d61e0 con 0x7f19700d1b40 2021-04-09T18:20:55.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f1977ca7700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1970100d60 con 0x7f19700eac40 2021-04-09T18:20:55.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f1977ca7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19700eaa10 con 0x7f19700d6760 2021-04-09T18:20:55.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f1975ac3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f19700eac40 0x7f19700dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:55.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f1975ac3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f19700eac40 0x7f19700dc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53546/0 (socket says 172.21.15.120:53546) 2021-04-09T18:20:55.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f1975ac3700 1 -- 172.21.15.120:0/3572817011 learned_addr learned my addr 172.21.15.120:0/3572817011 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:55.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.784 7f19762c4700 1 --2- 172.21.15.120:0/3572817011 >> v2:172.21.15.134:3300/0 conn(0x7f19700d6760 0x7f19700d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:55.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1975ac3700 1 -- 172.21.15.120:0/3572817011 >> v2:172.21.15.134:3300/0 conn(0x7f19700d6760 msgr2=0x7f19700d6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:55.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1975ac3700 1 --2- 172.21.15.120:0/3572817011 >> v2:172.21.15.134:3300/0 conn(0x7f19700d6760 0x7f19700d6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:55.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1975ac3700 1 -- 172.21.15.120:0/3572817011 >> v1:172.21.15.134:6789/0 conn(0x7f19700d1b40 legacy=0x7f1970088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:55.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1975ac3700 1 -- 172.21.15.120:0/3572817011 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700f38e0 con 0x7f19700eac40 2021-04-09T18:20:55.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1975ac3700 1 --2- 172.21.15.120:0/3572817011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19700eac40 0x7f19700dc6b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f196c006a80 tx=0x7f196c009e80).ready entity=mon.0 client_cookie=acc39c3f0982259d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:55.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1974ac1700 1 -- 172.21.15.120:0/3572817011 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f196c00b510 con 0x7f19700eac40 2021-04-09T18:20:55.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1974ac1700 1 -- 172.21.15.120:0/3572817011 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c00b7d0 con 0x7f19700eac40 2021-04-09T18:20:55.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1974ac1700 1 -- 172.21.15.120:0/3572817011 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f196c00bcb0 con 0x7f19700eac40 2021-04-09T18:20:55.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1977ca7700 1 -- 172.21.15.120:0/3572817011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19700eac40 msgr2=0x7f19700dc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:55.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.785 7f1977ca7700 1 --2- 172.21.15.120:0/3572817011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19700eac40 0x7f19700dc6b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f196c006a80 tx=0x7f196c009e80).stop 2021-04-09T18:20:55.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.786 7f1977ca7700 1 -- 172.21.15.120:0/3572817011 shutdown_connections 2021-04-09T18:20:55.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.786 7f1977ca7700 1 --2- 172.21.15.120:0/3572817011 >> v2:172.21.15.134:3300/0 conn(0x7f19700d6760 0x7f19700d6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:55.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.786 7f1977ca7700 1 --2- 172.21.15.120:0/3572817011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19700eac40 0x7f19700dc6b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:55.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.786 7f1977ca7700 1 -- 172.21.15.120:0/3572817011 >> 172.21.15.120:0/3572817011 conn(0x7f19700e93c0 msgr2=0x7f1970100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:55.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.786 7f1977ca7700 1 -- 172.21.15.120:0/3572817011 shutdown_connections 2021-04-09T18:20:55.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.786 7f1977ca7700 1 -- 172.21.15.120:0/3572817011 wait complete. 2021-04-09T18:20:55.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.809 7f1977ca7700 1 Processor -- start 2021-04-09T18:20:55.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.809 7f1977ca7700 1 -- start start 2021-04-09T18:20:55.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1977ca7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f197008a070 0x7f1970097700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:55.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1977ca7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19700899f0 0x7f197018fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:55.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1977ca7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19700963e0 0x7f19700967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:55.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1977ca7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970097200 con 0x7f197008a070 2021-04-09T18:20:55.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1977ca7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970097d20 con 0x7f19700899f0 2021-04-09T18:20:55.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1977ca7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1970096e00 con 0x7f19700963e0 2021-04-09T18:20:55.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1975ac3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f197008a070 0x7f1970097700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:55.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1975ac3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f197008a070 0x7f1970097700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53552/0 (socket says 172.21.15.120:53552) 2021-04-09T18:20:55.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1975ac3700 1 -- 172.21.15.120:0/2591838047 learned_addr learned my addr 172.21.15.120:0/2591838047 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:55.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f19752c2700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19700899f0 0x7f197018fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:55.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f19762c4700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19700963e0 0x7f19700967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:55.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1975ac3700 1 -- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19700963e0 msgr2=0x7f19700967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:55.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1975ac3700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19700963e0 0x7f19700967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1975ac3700 1 -- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19700899f0 msgr2=0x7f197018fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1975ac3700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19700899f0 0x7f197018fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1975ac3700 1 -- 172.21.15.120:0/2591838047 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970190460 con 0x7f197008a070 2021-04-09T18:20:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f19762c4700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19700963e0 0x7f19700967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1975ac3700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f197008a070 0x7f1970097700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f196c00b970 tx=0x7f196c00bd10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f19667fc700 1 -- 172.21.15.120:0/2591838047 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f196c000d30 con 0x7f197008a070 2021-04-09T18:20:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f19667fc700 1 -- 172.21.15.120:0/2591838047 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c006020 con 0x7f197008a070 2021-04-09T18:20:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1970190460 con 0x7f197008a070 2021-04-09T18:20:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f19667fc700 1 -- 172.21.15.120:0/2591838047 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f196c0064b0 con 0x7f197008a070 2021-04-09T18:20:55.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.810 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1970190460 con 0x7f197008a070 2021-04-09T18:20:55.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.811 7f19667fc700 1 -- 172.21.15.120:0/2591838047 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f196c006200 con 0x7f197008a070 2021-04-09T18:20:55.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.811 7f19667fc700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1958018930 0x7f195801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:55.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.811 7f19667fc700 1 -- 172.21.15.120:0/2591838047 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f196c006200 con 0x7f197008a070 2021-04-09T18:20:55.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.812 7f19752c2700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1958018930 0x7f195801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:55.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.812 7f19752c2700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1958018930 0x7f195801ae10 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.827 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1970088500 con 0x7f197008a070 2021-04-09T18:20:55.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:55.830 7f19667fc700 1 -- 172.21.15.120:0/2591838047 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f196c006000 con 0x7f197008a070 2021-04-09T18:20:56.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.046 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19700ccba0 con 0x7f197008a070 2021-04-09T18:20:56.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.046 7f19667fc700 1 -- 172.21.15.120:0/2591838047 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+1767 (secure 0 0 0) 0x7f196c000d30 con 0x7f197008a070 2021-04-09T18:20:56.045 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2021-04-09T18:20:56.045 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:56.046 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:55.767393","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:56.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1958018930 msgr2=0x7f195801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:56.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1958018930 0x7f195801ae10 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f197008a070 msgr2=0x7f1970097700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:56.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f197008a070 0x7f1970097700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f196c00b970 tx=0x7f196c00bd10).stop 2021-04-09T18:20:56.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 shutdown_connections 2021-04-09T18:20:56.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1958018930 0x7f195801ae10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19700963e0 0x7f19700967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19700899f0 0x7f197018fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 --2- 172.21.15.120:0/2591838047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f197008a070 0x7f1970097700 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 >> 172.21.15.120:0/2591838047 conn(0x7f19700ab640 msgr2=0x7f197009fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:56.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 shutdown_connections 2021-04-09T18:20:56.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.049 7f1977ca7700 1 -- 172.21.15.120:0/2591838047 wait complete. 2021-04-09T18:20:56.058 INFO:tasks.mds_thrash.fs.[None]:mds.b down, removed from mdsmap 2021-04-09T18:20:56.058 INFO:tasks.mds_thrash.fs.[None]:waiting for mds cluster to stabilize... 2021-04-09T18:20:56.058 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:56.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.200 7fe78ca16700 1 Processor -- start 2021-04-09T18:20:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.200 7fe78ca16700 1 -- start start 2021-04-09T18:20:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.200 7fe78ca16700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7880d7160 0x7fe7880d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.200 7fe78ca16700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe7880d55a0 0x7fe7880d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.200 7fe78ca16700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7880d6be0 con 0x7fe7880d5fc0 2021-04-09T18:20:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.200 7fe78ca16700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7880d80f0 con 0x7fe7880d55a0 2021-04-09T18:20:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.200 7fe78ca16700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7881a2ac0 con 0x7fe7880d7160 2021-04-09T18:20:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe785e1b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe7880d55a0 0x7fe7880d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe786e1d700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe7880d5fc0 0x7fe7880d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48474/0 (socket says 172.21.15.120:48474) 2021-04-09T18:20:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe786e1d700 1 -- 172.21.15.120:0/160471014 learned_addr learned my addr 172.21.15.120:0/160471014 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:56.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe78661c700 1 --2- 172.21.15.120:0/160471014 >> v2:172.21.15.134:3300/0 conn(0x7fe7880d7160 0x7fe7880d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:56.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe785e1b700 1 -- 172.21.15.120:0/160471014 >> v2:172.21.15.134:3300/0 conn(0x7fe7880d7160 msgr2=0x7fe7880d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:56.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe785e1b700 1 --2- 172.21.15.120:0/160471014 >> v2:172.21.15.134:3300/0 conn(0x7fe7880d7160 0x7fe7880d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe785e1b700 1 -- 172.21.15.120:0/160471014 >> v1:172.21.15.120:6789/0 conn(0x7fe7880d5fc0 legacy=0x7fe7880d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:56.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe78561a700 1 -- 172.21.15.120:0/160471014 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279618483 0 0) 0x7fe7800009b0 con 0x7fe7880d5fc0 2021-04-09T18:20:56.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe785e1b700 1 -- 172.21.15.120:0/160471014 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7881ac1f0 con 0x7fe7880d55a0 2021-04-09T18:20:56.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe785e1b700 1 --2- 172.21.15.120:0/160471014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7880d55a0 0x7fe7880d59a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe7700069d0 tx=0x7fe770009dc0).ready entity=mon.0 client_cookie=fd03138ab5e79cd8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:56.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe78561a700 1 -- 172.21.15.120:0/160471014 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe77000b510 con 0x7fe7880d55a0 2021-04-09T18:20:56.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe78561a700 1 -- 172.21.15.120:0/160471014 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe770006ac0 con 0x7fe7880d55a0 2021-04-09T18:20:56.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe78561a700 1 -- 172.21.15.120:0/160471014 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe77000ba80 con 0x7fe7880d55a0 2021-04-09T18:20:56.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe78ca16700 1 -- 172.21.15.120:0/160471014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7880d55a0 msgr2=0x7fe7880d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:56.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.201 7fe78ca16700 1 --2- 172.21.15.120:0/160471014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7880d55a0 0x7fe7880d59a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe7700069d0 tx=0x7fe770009dc0).stop 2021-04-09T18:20:56.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.202 7fe78ca16700 1 -- 172.21.15.120:0/160471014 shutdown_connections 2021-04-09T18:20:56.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.202 7fe78ca16700 1 --2- 172.21.15.120:0/160471014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7880d55a0 0x7fe7880d59a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.202 7fe78ca16700 1 --2- 172.21.15.120:0/160471014 >> v2:172.21.15.134:3300/0 conn(0x7fe7880d7160 0x7fe7880d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.202 7fe78ca16700 1 -- 172.21.15.120:0/160471014 >> 172.21.15.120:0/160471014 conn(0x7fe7880d1590 msgr2=0x7fe7880d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:56.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.202 7fe78ca16700 1 -- 172.21.15.120:0/160471014 shutdown_connections 2021-04-09T18:20:56.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.202 7fe78ca16700 1 -- 172.21.15.120:0/160471014 wait complete. 2021-04-09T18:20:56.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.222 7fe78ca16700 1 Processor -- start 2021-04-09T18:20:56.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.222 7fe78ca16700 1 -- start start 2021-04-09T18:20:56.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.222 7fe78ca16700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe78817b4b0 0x7fe7881a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.222 7fe78ca16700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7881a1760 0x7fe78819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.222 7fe78ca16700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe78817b8b0 0x7fe78819ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.222 7fe78ca16700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7881a0c40 con 0x7fe7881a1760 2021-04-09T18:20:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.222 7fe78ca16700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78817be20 con 0x7fe78817b8b0 2021-04-09T18:20:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.222 7fe78ca16700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7881a0550 con 0x7fe78817b4b0 2021-04-09T18:20:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe785e1b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7881a1760 0x7fe78819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe785e1b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7881a1760 0x7fe78819f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53568/0 (socket says 172.21.15.120:53568) 2021-04-09T18:20:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe785e1b700 1 -- 172.21.15.120:0/1032571066 learned_addr learned my addr 172.21.15.120:0/1032571066 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:56.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe78661c700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe78817b4b0 0x7fe7881a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:56.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe786e1d700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe78817b8b0 0x7fe78819ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:56.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe785e1b700 1 -- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe78817b4b0 msgr2=0x7fe7881a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:56.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe785e1b700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe78817b4b0 0x7fe7881a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe785e1b700 1 -- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe78817b8b0 msgr2=0x7fe78819ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:56.235 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe785e1b700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe78817b8b0 0x7fe78819ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe785e1b700 1 -- 172.21.15.120:0/1032571066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7881a0770 con 0x7fe7881a1760 2021-04-09T18:20:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe785e1b700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7881a1760 0x7fe78819f910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fe77000b930 tx=0x7fe77000bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe77effd700 1 -- 172.21.15.120:0/1032571066 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe770006030 con 0x7fe7881a1760 2021-04-09T18:20:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe77effd700 1 -- 172.21.15.120:0/1032571066 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7700063b0 con 0x7fe7881a1760 2021-04-09T18:20:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe77effd700 1 -- 172.21.15.120:0/1032571066 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe770005660 con 0x7fe7881a1760 2021-04-09T18:20:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7881a0770 con 0x7fe7881a1760 2021-04-09T18:20:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.223 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7881a0770 con 0x7fe7881a1760 2021-04-09T18:20:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.224 7fe77effd700 1 -- 172.21.15.120:0/1032571066 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe770006ce0 con 0x7fe7881a1760 2021-04-09T18:20:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.224 7fe77effd700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe760018930 0x7fe76001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.224 7fe77effd700 1 -- 172.21.15.120:0/1032571066 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fe7700330e0 con 0x7fe7881a1760 2021-04-09T18:20:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.224 7fe78661c700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe760018930 0x7fe76001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.225 7fe78661c700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe760018930 0x7fe76001ae10 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.246 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78817a2b0 con 0x7fe7881a1760 2021-04-09T18:20:56.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.249 7fe77effd700 1 -- 172.21.15.120:0/1032571066 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe77000be10 con 0x7fe7881a1760 2021-04-09T18:20:56.450 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.452 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe78817a2b0 con 0x7fe7881a1760 2021-04-09T18:20:56.450 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.452 7fe77effd700 1 -- 172.21.15.120:0/1032571066 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+1767 (secure 0 0 0) 0x7fe770006ce0 con 0x7fe7881a1760 2021-04-09T18:20:56.451 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2021-04-09T18:20:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:56.452 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:55.767393","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:56.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe760018930 msgr2=0x7fe76001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:56.460 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe760018930 0x7fe76001ae10 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.466 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7881a1760 msgr2=0x7fe78819f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:56.467 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7881a1760 0x7fe78819f910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fe77000b930 tx=0x7fe77000bcd0).stop 2021-04-09T18:20:56.467 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 shutdown_connections 2021-04-09T18:20:56.468 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe78817b8b0 0x7fe78819ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.468 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7881a1760 0x7fe78819f910 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.468 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe760018930 0x7fe76001ae10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.469 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 --2- 172.21.15.120:0/1032571066 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe78817b4b0 0x7fe7881a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:56.469 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 >> 172.21.15.120:0/1032571066 conn(0x7fe788185580 msgr2=0x7fe788188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:56.470 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 shutdown_connections 2021-04-09T18:20:56.470 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:56.455 7fe78ca16700 1 -- 172.21.15.120:0/1032571066 wait complete. 2021-04-09T18:20:56.473 INFO:tasks.mds_thrash.fs.[None]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 8, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-04-09 18:19:55.049244", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 8, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4329": { "addr": "172.21.15.120:6833/2249625664", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 2249625664, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 2249625664, "type": "v1" } ] }, "export_targets": [], "features": 4611087854035861503, "flags": 0, "gid": 4329, "incarnation": 8, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 23, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "-1 (unspecified)", "modified": "2021-04-09 18:20:55.767393", "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4329 } } } ], "standbys": [] } 2021-04-09T18:20:58.474 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:20:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.631 7f9d4afd7700 1 Processor -- start 2021-04-09T18:20:58.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.631 7f9d4afd7700 1 -- start start 2021-04-09T18:20:58.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d4afd7700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9d440d7160 0x7f9d440d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:58.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d4afd7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9d440d6190 0x7f9d440d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:58.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d4afd7700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d440d6be0 con 0x7f9d440d55a0 2021-04-09T18:20:58.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d4afd7700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d440d80f0 con 0x7f9d440d7160 2021-04-09T18:20:58.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d4afd7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d441a2ac0 con 0x7f9d440d6190 2021-04-09T18:20:58.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d48df3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9d440d7160 0x7f9d440d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:58.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d43fff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9d440d55a0 0x7f9d440d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48496/0 (socket says 172.21.15.120:48496) 2021-04-09T18:20:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d43fff700 1 -- 172.21.15.120:0/806755976 learned_addr learned my addr 172.21.15.120:0/806755976 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:20:58.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d495f4700 1 --2- 172.21.15.120:0/806755976 >> v2:172.21.15.134:3300/0 conn(0x7f9d440d6190 0x7f9d440d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:58.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d48df3700 1 -- 172.21.15.120:0/806755976 >> v2:172.21.15.134:3300/0 conn(0x7f9d440d6190 msgr2=0x7f9d440d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:20:58.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d48df3700 1 --2- 172.21.15.120:0/806755976 >> v2:172.21.15.134:3300/0 conn(0x7f9d440d6190 0x7f9d440d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d48df3700 1 -- 172.21.15.120:0/806755976 >> v1:172.21.15.120:6789/0 conn(0x7f9d440d55a0 legacy=0x7f9d440d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d48df3700 1 -- 172.21.15.120:0/806755976 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d441ac1f0 con 0x7f9d440d7160 2021-04-09T18:20:58.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d437fe700 1 -- 172.21.15.120:0/806755976 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304223102 0 0) 0x7f9d34001060 con 0x7f9d440d55a0 2021-04-09T18:20:58.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d495f4700 1 --2- 172.21.15.120:0/806755976 >> v2:172.21.15.134:3300/0 conn(0x7f9d440d6190 0x7f9d440d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:20:58.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d48df3700 1 --2- 172.21.15.120:0/806755976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440d7160 0x7f9d440d7560 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9d2c006650 tx=0x7f9d2c009a80).ready entity=mon.0 client_cookie=9a595c5658175e5f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d437fe700 1 -- 172.21.15.120:0/806755976 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d2c0009b0 con 0x7f9d440d7160 2021-04-09T18:20:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d437fe700 1 -- 172.21.15.120:0/806755976 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c00c0c0 con 0x7f9d440d7160 2021-04-09T18:20:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d437fe700 1 -- 172.21.15.120:0/806755976 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d2c00c510 con 0x7f9d440d7160 2021-04-09T18:20:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d4afd7700 1 -- 172.21.15.120:0/806755976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440d7160 msgr2=0x7f9d440d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.632 7f9d4afd7700 1 --2- 172.21.15.120:0/806755976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440d7160 0x7f9d440d7560 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9d2c006650 tx=0x7f9d2c009a80).stop 2021-04-09T18:20:58.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.633 7f9d4afd7700 1 -- 172.21.15.120:0/806755976 shutdown_connections 2021-04-09T18:20:58.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.633 7f9d4afd7700 1 --2- 172.21.15.120:0/806755976 >> v2:172.21.15.134:3300/0 conn(0x7f9d440d6190 0x7f9d440d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.633 7f9d4afd7700 1 --2- 172.21.15.120:0/806755976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440d7160 0x7f9d440d7560 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.633 7f9d4afd7700 1 -- 172.21.15.120:0/806755976 >> 172.21.15.120:0/806755976 conn(0x7f9d440d1590 msgr2=0x7f9d440d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:58.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.633 7f9d4afd7700 1 -- 172.21.15.120:0/806755976 shutdown_connections 2021-04-09T18:20:58.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.633 7f9d4afd7700 1 -- 172.21.15.120:0/806755976 wait complete. 2021-04-09T18:20:58.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.657 7f9d4afd7700 1 Processor -- start 2021-04-09T18:20:58.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.657 7f9d4afd7700 1 -- start start 2021-04-09T18:20:58.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.657 7f9d4afd7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d4419a350 0x7f9d44195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:58.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.657 7f9d4afd7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d44090700 0x7f9d440b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:58.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.657 7f9d4afd7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440b55a0 0x7f9d44183940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:58.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.657 7f9d4afd7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44195470 con 0x7f9d440b55a0 2021-04-09T18:20:58.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.657 7f9d4afd7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44195fd0 con 0x7f9d44090700 2021-04-09T18:20:58.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.657 7f9d4afd7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44195040 con 0x7f9d4419a350 2021-04-09T18:20:58.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.657 7f9d495f4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440b55a0 0x7f9d44183940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:58.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d495f4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440b55a0 0x7f9d44183940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53594/0 (socket says 172.21.15.120:53594) 2021-04-09T18:20:58.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d495f4700 1 -- 172.21.15.120:0/3593393429 learned_addr learned my addr 172.21.15.120:0/3593393429 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:20:58.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d43fff700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d44090700 0x7f9d440b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:58.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d48df3700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d4419a350 0x7f9d44195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:58.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d495f4700 1 -- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d4419a350 msgr2=0x7f9d44195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:58.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d495f4700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d4419a350 0x7f9d44195970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d495f4700 1 -- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d44090700 msgr2=0x7f9d440b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:58.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d495f4700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d44090700 0x7f9d440b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d495f4700 1 -- 172.21.15.120:0/3593393429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440b59a0 con 0x7f9d440b55a0 2021-04-09T18:20:58.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d43fff700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d44090700 0x7f9d440b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:20:58.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d495f4700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440b55a0 0x7f9d44183940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f9d3c00b580 tx=0x7f9d3c00b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:58.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d417fa700 1 -- 172.21.15.120:0/3593393429 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d3c00bd10 con 0x7f9d440b55a0 2021-04-09T18:20:58.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d417fa700 1 -- 172.21.15.120:0/3593393429 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c006410 con 0x7f9d440b55a0 2021-04-09T18:20:58.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d417fa700 1 -- 172.21.15.120:0/3593393429 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d3c002220 con 0x7f9d440b55a0 2021-04-09T18:20:58.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d440b59a0 con 0x7f9d440b55a0 2021-04-09T18:20:58.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.658 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d440b59a0 con 0x7f9d440b55a0 2021-04-09T18:20:58.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.659 7f9d417fa700 1 -- 172.21.15.120:0/3593393429 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9d3c00a030 con 0x7f9d440b55a0 2021-04-09T18:20:58.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.659 7f9d417fa700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d28018930 0x7f9d2801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:20:58.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.659 7f9d417fa700 1 -- 172.21.15.120:0/3593393429 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f9d3c032ba0 con 0x7f9d440b55a0 2021-04-09T18:20:58.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.659 7f9d48df3700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d28018930 0x7f9d2801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:20:58.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.660 7f9d48df3700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d28018930 0x7f9d2801ae10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:20:58.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.673 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d44182a30 con 0x7f9d440b55a0 2021-04-09T18:20:58.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.676 7f9d417fa700 1 -- 172.21.15.120:0/3593393429 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9d3c006ba0 con 0x7f9d440b55a0 2021-04-09T18:20:58.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.864 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d44182a30 con 0x7f9d440b55a0 2021-04-09T18:20:58.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.865 7f9d417fa700 1 -- 172.21.15.120:0/3593393429 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f9d3c00a030 con 0x7f9d440b55a0 2021-04-09T18:20:58.864 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 11 2021-04-09T18:20:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:20:58.866 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:20:58.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d28018930 msgr2=0x7f9d2801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:58.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d28018930 0x7f9d2801ae10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440b55a0 msgr2=0x7f9d44183940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:20:58.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440b55a0 0x7f9d44183940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f9d3c00b580 tx=0x7f9d3c00b920).stop 2021-04-09T18:20:58.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 shutdown_connections 2021-04-09T18:20:58.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d440b55a0 0x7f9d44183940 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d44090700 0x7f9d440b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9d28018930 0x7f9d2801ae10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 --2- 172.21.15.120:0/3593393429 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d4419a350 0x7f9d44195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:20:58.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.867 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 >> 172.21.15.120:0/3593393429 conn(0x7f9d4418dcc0 msgr2=0x7f9d44186a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:20:58.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.868 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 shutdown_connections 2021-04-09T18:20:58.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:20:58.868 7f9d4afd7700 1 -- 172.21.15.120:0/3593393429 wait complete. 2021-04-09T18:20:58.876 INFO:tasks.mds_thrash.fs.[None]:mds.a has gained rank=0, replacing gid=4292 2021-04-09T18:20:58.876 INFO:tasks.mds_thrash.fs.[None]:waiting for 8 secs before reviving mds.b 2021-04-09T18:21:06.877 INFO:tasks.mds_thrash.fs.[None]:reviving mds.b 2021-04-09T18:21:06.877 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:21:06.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:21:06.882 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:21:06.882 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:21:07.017 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2021-04-09T18:21:07.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.028 7f7547850700 1 Processor -- start 2021-04-09T18:21:07.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.028 7f7547850700 1 -- start start 2021-04-09T18:21:07.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7547850700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f75400d7560 0x7f75400d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:07.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7547850700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75400d7960 con 0x7f75400d7160 2021-04-09T18:21:07.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7547850700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75400d6be0 con 0x7f75400d63b0 2021-04-09T18:21:07.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7547850700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75400d80f0 con 0x7f75400d7560 2021-04-09T18:21:07.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f754566c700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f75400d7160 0x7f75400d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48520/0 (socket says 172.21.15.120:48520) 2021-04-09T18:21:07.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f754566c700 1 -- 172.21.15.120:0/3797807345 learned_addr learned my addr 172.21.15.120:0/3797807345 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:21:07.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7544e6b700 1 --2- 172.21.15.120:0/3797807345 >> v2:172.21.15.120:3300/0 conn(0x7f75400d7560 0x7f75400d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:07.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7537fff700 1 -- 172.21.15.120:0/3797807345 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176074859 0 0) 0x7f753c000ce0 con 0x7f75400d7160 2021-04-09T18:21:07.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7537fff700 1 -- 172.21.15.120:0/3797807345 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f752c002fe0 con 0x7f75400d7160 2021-04-09T18:21:07.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7544e6b700 1 -- 172.21.15.120:0/3797807345 >> v1:172.21.15.134:6789/0 conn(0x7f75400d63b0 legacy=0x7f75401ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:07.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7544e6b700 1 -- 172.21.15.120:0/3797807345 >> v1:172.21.15.120:6789/0 conn(0x7f75400d7160 legacy=0x7f75400d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:07.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.029 7f7544e6b700 1 -- 172.21.15.120:0/3797807345 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75401a2af0 con 0x7f75400d7560 2021-04-09T18:21:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.030 7f7544e6b700 1 --2- 172.21.15.120:0/3797807345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75400d7560 0x7f75400d5d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7530006650 tx=0x7f7530009a80).ready entity=mon.0 client_cookie=a39c2dc5b694009a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:21:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.030 7f7537fff700 1 -- 172.21.15.120:0/3797807345 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f75300009b0 con 0x7f75400d7560 2021-04-09T18:21:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.030 7f7537fff700 1 -- 172.21.15.120:0/3797807345 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000c0c0 con 0x7f75400d7560 2021-04-09T18:21:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.030 7f7537fff700 1 -- 172.21.15.120:0/3797807345 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f753000c510 con 0x7f75400d7560 2021-04-09T18:21:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.030 7f7547850700 1 -- 172.21.15.120:0/3797807345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75400d7560 msgr2=0x7f75400d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.030 7f7547850700 1 --2- 172.21.15.120:0/3797807345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75400d7560 0x7f75400d5d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7530006650 tx=0x7f7530009a80).stop 2021-04-09T18:21:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.030 7f7547850700 1 -- 172.21.15.120:0/3797807345 shutdown_connections 2021-04-09T18:21:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.030 7f7547850700 1 --2- 172.21.15.120:0/3797807345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75400d7560 0x7f75400d5d90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.030 7f7547850700 1 -- 172.21.15.120:0/3797807345 >> 172.21.15.120:0/3797807345 conn(0x7f75400d1590 msgr2=0x7f75400d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:21:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.031 7f7547850700 1 -- 172.21.15.120:0/3797807345 shutdown_connections 2021-04-09T18:21:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.031 7f7547850700 1 -- 172.21.15.120:0/3797807345 wait complete. 2021-04-09T18:21:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.050 7f7547850700 1 Processor -- start 2021-04-09T18:21:07.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.050 7f7547850700 1 -- start start 2021-04-09T18:21:07.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.050 7f7547850700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7540187e20 0x7f75400b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:07.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7547850700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75400b2500 0x7f754008f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:07.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7547850700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f754008f9c0 0x7f754008fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:07.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7547850700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75401878a0 con 0x7f754008f9c0 2021-04-09T18:21:07.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7547850700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75401884a0 con 0x7f75400b2500 2021-04-09T18:21:07.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7547850700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754009d4b0 con 0x7f7540187e20 2021-04-09T18:21:07.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7545e6d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f754008f9c0 0x7f754008fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:07.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7545e6d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f754008f9c0 0x7f754008fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53618/0 (socket says 172.21.15.120:53618) 2021-04-09T18:21:07.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7545e6d700 1 -- 172.21.15.120:0/3287727518 learned_addr learned my addr 172.21.15.120:0/3287727518 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:21:07.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f754566c700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7540187e20 0x7f75400b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:07.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7544e6b700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75400b2500 0x7f754008f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:07.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7545e6d700 1 -- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7540187e20 msgr2=0x7f75400b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:07.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7545e6d700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7540187e20 0x7f75400b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:07.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7545e6d700 1 -- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75400b2500 msgr2=0x7f754008f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:07.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7545e6d700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75400b2500 0x7f754008f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:07.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7545e6d700 1 -- 172.21.15.120:0/3287727518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75400903e0 con 0x7f754008f9c0 2021-04-09T18:21:07.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7545e6d700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f754008f9c0 0x7f754008fdc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7538009940 tx=0x7f753800bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:21:07.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7535ffb700 1 -- 172.21.15.120:0/3287727518 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7538000f40 con 0x7f754008f9c0 2021-04-09T18:21:07.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7535ffb700 1 -- 172.21.15.120:0/3287727518 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753800c2f0 con 0x7f754008f9c0 2021-04-09T18:21:07.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7535ffb700 1 -- 172.21.15.120:0/3287727518 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f753800c7d0 con 0x7f754008f9c0 2021-04-09T18:21:07.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7547850700 1 -- 172.21.15.120:0/3287727518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75400903e0 con 0x7f754008f9c0 2021-04-09T18:21:07.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.051 7f7547850700 1 -- 172.21.15.120:0/3287727518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75400903e0 con 0x7f754008f9c0 2021-04-09T18:21:07.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.053 7f7535ffb700 1 -- 172.21.15.120:0/3287727518 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7538001220 con 0x7f754008f9c0 2021-04-09T18:21:07.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.053 7f7535ffb700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75200188c0 0x7f752001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:07.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.053 7f7535ffb700 1 -- 172.21.15.120:0/3287727518 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f7538032d00 con 0x7f754008f9c0 2021-04-09T18:21:07.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.053 7f754566c700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75200188c0 0x7f752001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:07.080 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.053 7f754566c700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75200188c0 0x7f752001adc0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:21:07.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.071 7f7547850700 1 -- 172.21.15.120:0/3287727518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7540090970 con 0x7f754008f9c0 2021-04-09T18:21:07.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.075 7f7535ffb700 1 -- 172.21.15.120:0/3287727518 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f753800be30 con 0x7f754008f9c0 2021-04-09T18:21:07.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.262 7f7547850700 1 -- 172.21.15.120:0/3287727518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7540090970 con 0x7f754008f9c0 2021-04-09T18:21:07.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.262 7f7535ffb700 1 -- 172.21.15.120:0/3287727518 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f7538001220 con 0x7f754008f9c0 2021-04-09T18:21:07.261 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 11 2021-04-09T18:21:07.261 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:21:07.262 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:21:07.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 -- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75200188c0 msgr2=0x7f752001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:07.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75200188c0 0x7f752001adc0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:07.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 -- 172.21.15.120:0/3287727518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f754008f9c0 msgr2=0x7f754008fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:07.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f754008f9c0 0x7f754008fdc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7538009940 tx=0x7f753800bcf0).stop 2021-04-09T18:21:07.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 -- 172.21.15.120:0/3287727518 shutdown_connections 2021-04-09T18:21:07.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f754008f9c0 0x7f754008fdc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:07.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75400b2500 0x7f754008f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:07.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f75200188c0 0x7f752001adc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:07.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 --2- 172.21.15.120:0/3287727518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7540187e20 0x7f75400b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:07.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 -- 172.21.15.120:0/3287727518 >> 172.21.15.120:0/3287727518 conn(0x7f754018a9d0 msgr2=0x7f754008cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:21:07.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 -- 172.21.15.120:0/3287727518 shutdown_connections 2021-04-09T18:21:07.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:07.265 7f7547850700 1 -- 172.21.15.120:0/3287727518 wait complete. 2021-04-09T18:21:07.273 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-04-09T18:21:09.274 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:21:09.453 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.417 7f97a346e700 1 Processor -- start 2021-04-09T18:21:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.417 7f97a346e700 1 -- start start 2021-04-09T18:21:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a346e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f979c0d7160 0x7f979c0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:09.454 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a346e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f979c0e70a0 0x7f979c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a346e700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c0d6be0 con 0x7f979c0d7560 2021-04-09T18:21:09.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a346e700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c0d80f0 con 0x7f979c0e70a0 2021-04-09T18:21:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a346e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0e7f00 con 0x7f979c0d7160 2021-04-09T18:21:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a1a8b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f979c0e70a0 0x7f979c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a0a89700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f979c0d7560 0x7f979c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:48538/0 (socket says 172.21.15.120:48538) 2021-04-09T18:21:09.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a0a89700 1 -- 172.21.15.120:0/1371940612 learned_addr learned my addr 172.21.15.120:0/1371940612 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:21:09.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a128a700 1 --2- 172.21.15.120:0/1371940612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f979c0d7160 0x7f979c0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:09.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a1a8b700 1 -- 172.21.15.120:0/1371940612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f979c0d7160 msgr2=0x7f979c0e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:21:09.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a1a8b700 1 --2- 172.21.15.120:0/1371940612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f979c0d7160 0x7f979c0e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:09.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a1a8b700 1 -- 172.21.15.120:0/1371940612 >> v1:172.21.15.120:6789/0 conn(0x7f979c0d7560 legacy=0x7f979c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:09.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f978ffff700 1 -- 172.21.15.120:0/1371940612 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135140559 0 0) 0x7f9790000ce0 con 0x7f979c0d7560 2021-04-09T18:21:09.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.418 7f97a1a8b700 1 -- 172.21.15.120:0/1371940612 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c1a2ac0 con 0x7f979c0e70a0 2021-04-09T18:21:09.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.419 7f97a1a8b700 1 --2- 172.21.15.120:0/1371940612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c0e70a0 0x7f979c0d5d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9794006e30 tx=0x7f9794009de0).ready entity=mon.0 client_cookie=979edcfa1f023555 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:21:09.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.419 7f978ffff700 1 -- 172.21.15.120:0/1371940612 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f979400b300 con 0x7f979c0e70a0 2021-04-09T18:21:09.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.419 7f978ffff700 1 -- 172.21.15.120:0/1371940612 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979400b680 con 0x7f979c0e70a0 2021-04-09T18:21:09.460 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.419 7f978ffff700 1 -- 172.21.15.120:0/1371940612 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f979400bb60 con 0x7f979c0e70a0 2021-04-09T18:21:09.469 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.419 7f97a346e700 1 -- 172.21.15.120:0/1371940612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c0e70a0 msgr2=0x7f979c0d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:09.469 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.419 7f97a346e700 1 --2- 172.21.15.120:0/1371940612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c0e70a0 0x7f979c0d5d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9794006e30 tx=0x7f9794009de0).stop 2021-04-09T18:21:09.469 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.420 7f97a346e700 1 -- 172.21.15.120:0/1371940612 shutdown_connections 2021-04-09T18:21:09.471 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.420 7f97a346e700 1 --2- 172.21.15.120:0/1371940612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c0e70a0 0x7f979c0d5d90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:09.472 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.420 7f97a346e700 1 --2- 172.21.15.120:0/1371940612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f979c0d7160 0x7f979c0e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:09.472 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.420 7f97a346e700 1 -- 172.21.15.120:0/1371940612 >> 172.21.15.120:0/1371940612 conn(0x7f979c0d1590 msgr2=0x7f979c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:21:09.472 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.420 7f97a346e700 1 -- 172.21.15.120:0/1371940612 shutdown_connections 2021-04-09T18:21:09.473 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.420 7f97a346e700 1 -- 172.21.15.120:0/1371940612 wait complete. 2021-04-09T18:21:09.473 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a346e700 1 Processor -- start 2021-04-09T18:21:09.473 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a346e700 1 -- start start 2021-04-09T18:21:09.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a346e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f979c08f270 0x7f979c0b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:09.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a346e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c094730 0x7f979c094b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:09.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a346e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f979c08fbc0 0x7f979c08ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:09.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a346e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c08f970 con 0x7f979c094730 2021-04-09T18:21:09.476 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a346e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0b14f0 con 0x7f979c08fbc0 2021-04-09T18:21:09.476 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a346e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0b1710 con 0x7f979c08f270 2021-04-09T18:21:09.477 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a0a89700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c094730 0x7f979c094b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:09.478 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a0a89700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c094730 0x7f979c094b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53630/0 (socket says 172.21.15.120:53630) 2021-04-09T18:21:09.478 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.439 7f97a0a89700 1 -- 172.21.15.120:0/2973587245 learned_addr learned my addr 172.21.15.120:0/2973587245 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:21:09.478 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f97a0a89700 1 -- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f979c08f270 msgr2=0x7f979c0b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:09.480 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f97a0a89700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f979c08f270 0x7f979c0b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:21:09.480 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f97a0a89700 1 -- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f979c08fbc0 msgr2=0x7f979c08ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:09.481 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f97a0a89700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f979c08fbc0 0x7f979c08ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:21:09.482 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f97a0a89700 1 -- 172.21.15.120:0/2973587245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c090650 con 0x7f979c094730 2021-04-09T18:21:09.482 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f97a0a89700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c094730 0x7f979c094b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f979000b530 tx=0x7f979000b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:21:09.483 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f978dffb700 1 -- 172.21.15.120:0/2973587245 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9790006020 con 0x7f979c094730 2021-04-09T18:21:09.483 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f978dffb700 1 -- 172.21.15.120:0/2973587245 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97900063a0 con 0x7f979c094730 2021-04-09T18:21:09.483 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f978dffb700 1 -- 172.21.15.120:0/2973587245 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9790004590 con 0x7f979c094730 2021-04-09T18:21:09.484 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f97a346e700 1 -- 172.21.15.120:0/2973587245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c090650 con 0x7f979c094730 2021-04-09T18:21:09.484 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.440 7f97a346e700 1 -- 172.21.15.120:0/2973587245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c090650 con 0x7f979c094730 2021-04-09T18:21:09.485 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.441 7f978dffb700 1 -- 172.21.15.120:0/2973587245 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f979000bcc0 con 0x7f979c094730 2021-04-09T18:21:09.485 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.441 7f978dffb700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f977c018930 0x7f977c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:09.485 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.441 7f978dffb700 1 -- 172.21.15.120:0/2973587245 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f9790034e20 con 0x7f979c094730 2021-04-09T18:21:09.485 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.441 7f97a128a700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f977c018930 0x7f977c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:09.486 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.441 7f97a128a700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f977c018930 0x7f977c01ae10 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:21:09.486 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.463 7f97a346e700 1 -- 172.21.15.120:0/2973587245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c182a30 con 0x7f979c094730 2021-04-09T18:21:09.487 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.466 7f978dffb700 1 -- 172.21.15.120:0/2973587245 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9790006b90 con 0x7f979c094730 2021-04-09T18:21:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.651 7f97a346e700 1 -- 172.21.15.120:0/2973587245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f979c182a30 con 0x7f979c094730 2021-04-09T18:21:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.651 7f978dffb700 1 -- 172.21.15.120:0/2973587245 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f9790006380 con 0x7f979c094730 2021-04-09T18:21:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 11 2021-04-09T18:21:09.652 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:21:09.652 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:21:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 -- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f977c018930 msgr2=0x7f977c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f977c018930 0x7f977c01ae10 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:09.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 -- 172.21.15.120:0/2973587245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c094730 msgr2=0x7f979c094b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:09.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c094730 0x7f979c094b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f979000b530 tx=0x7f979000b8d0).stop 2021-04-09T18:21:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 -- 172.21.15.120:0/2973587245 shutdown_connections 2021-04-09T18:21:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f979c08fbc0 0x7f979c08ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:21:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f979c094730 0x7f979c094b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f977c018930 0x7f977c01ae10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 --2- 172.21.15.120:0/2973587245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f979c08f270 0x7f979c0b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:21:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 -- 172.21.15.120:0/2973587245 >> 172.21.15.120:0/2973587245 conn(0x7f979c18dcc0 msgr2=0x7f979c186a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:21:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 -- 172.21.15.120:0/2973587245 shutdown_connections 2021-04-09T18:21:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:09.654 7f97a346e700 1 -- 172.21.15.120:0/2973587245 wait complete. 2021-04-09T18:21:09.662 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-04-09T18:21:11.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:21:11.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.806 7f4e4d590700 1 Processor -- start 2021-04-09T18:21:11.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.806 7f4e4d590700 1 -- start start 2021-04-09T18:21:11.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.807 7f4e4d590700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e480d7160 0x7f4e480e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:11.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.807 7f4e4d590700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4e480e70a0 0x7f4e480d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:11.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.807 7f4e4d590700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e480d6be0 con 0x7f4e480d7560 2021-04-09T18:21:11.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.807 7f4e4d590700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e480d80f0 con 0x7f4e480e70a0 2021-04-09T18:21:11.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.807 7f4e4d590700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480e7f00 con 0x7f4e480d7160 2021-04-09T18:21:11.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.807 7f4e47ac0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4e480e70a0 0x7f4e480d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:11.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.807 7f4e47ac0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4e480e70a0 0x7f4e480d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53640/0 (socket says 172.21.15.120:53640) 2021-04-09T18:21:11.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.807 7f4e47ac0700 1 -- 172.21.15.120:0/1763749250 learned_addr learned my addr 172.21.15.120:0/1763749250 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:21:11.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e472bf700 1 --2- 172.21.15.120:0/1763749250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e480d7160 0x7f4e480e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:11.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e47ac0700 1 -- 172.21.15.120:0/1763749250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e480d7160 msgr2=0x7f4e480e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:21:11.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e47ac0700 1 --2- 172.21.15.120:0/1763749250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e480d7160 0x7f4e480e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:11.840 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e47ac0700 1 -- 172.21.15.120:0/1763749250 >> v1:172.21.15.134:6789/0 conn(0x7f4e480d7560 legacy=0x7f4e480d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:21:11.840 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e47ac0700 1 -- 172.21.15.120:0/1763749250 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e481a2ac0 con 0x7f4e480e70a0 2021-04-09T18:21:11.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e472bf700 1 --2- 172.21.15.120:0/1763749250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e480d7160 0x7f4e480e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:21:11.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e47ac0700 1 --2- 172.21.15.120:0/1763749250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480e70a0 0x7f4e480d5d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f4e40006f00 tx=0x7f4e40009f10).ready entity=mon.0 client_cookie=96a54c8221f251f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:21:11.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e46abe700 1 -- 172.21.15.120:0/1763749250 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e4000b3b0 con 0x7f4e480e70a0 2021-04-09T18:21:11.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e46abe700 1 -- 172.21.15.120:0/1763749250 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4000b730 con 0x7f4e480e70a0 2021-04-09T18:21:11.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e46abe700 1 -- 172.21.15.120:0/1763749250 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e4000bc10 con 0x7f4e480e70a0 2021-04-09T18:21:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e4d590700 1 -- 172.21.15.120:0/1763749250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480e70a0 msgr2=0x7f4e480d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.808 7f4e4d590700 1 --2- 172.21.15.120:0/1763749250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480e70a0 0x7f4e480d5d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f4e40006f00 tx=0x7f4e40009f10).stop 2021-04-09T18:21:11.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.809 7f4e4d590700 1 -- 172.21.15.120:0/1763749250 shutdown_connections 2021-04-09T18:21:11.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.809 7f4e4d590700 1 --2- 172.21.15.120:0/1763749250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480e70a0 0x7f4e480d5d90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:11.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.809 7f4e4d590700 1 --2- 172.21.15.120:0/1763749250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e480d7160 0x7f4e480e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.809 7f4e4d590700 1 -- 172.21.15.120:0/1763749250 >> 172.21.15.120:0/1763749250 conn(0x7f4e480d1590 msgr2=0x7f4e480d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:21:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.809 7f4e4d590700 1 -- 172.21.15.120:0/1763749250 shutdown_connections 2021-04-09T18:21:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.809 7f4e4d590700 1 -- 172.21.15.120:0/1763749250 wait complete. 2021-04-09T18:21:11.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.831 7f4e4d590700 1 Processor -- start 2021-04-09T18:21:11.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e4d590700 1 -- start start 2021-04-09T18:21:11.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e4d590700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480aad60 0x7f4e480ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:11.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e4d590700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4817dd10 0x7f4e4817e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:11.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e4d590700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e48090bd0 0x7f4e48090fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:11.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e4d590700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48091710 con 0x7f4e480aad60 2021-04-09T18:21:11.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e4d590700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48091930 con 0x7f4e4817dd10 2021-04-09T18:21:11.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e4d590700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48091b50 con 0x7f4e48090bd0 2021-04-09T18:21:11.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e472bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480aad60 0x7f4e480ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:11.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e472bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480aad60 0x7f4e480ab160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53646/0 (socket says 172.21.15.120:53646) 2021-04-09T18:21:11.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e472bf700 1 -- 172.21.15.120:0/3734524968 learned_addr learned my addr 172.21.15.120:0/3734524968 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:21:11.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e47ac0700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e48090bd0 0x7f4e48090fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:11.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.832 7f4e3eabe700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4817dd10 0x7f4e4817e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:11.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e472bf700 1 -- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e48090bd0 msgr2=0x7f4e48090fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:11.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e472bf700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e48090bd0 0x7f4e48090fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:11.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e472bf700 1 -- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4817dd10 msgr2=0x7f4e4817e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:11.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e472bf700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4817dd10 0x7f4e4817e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:11.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e472bf700 1 -- 172.21.15.120:0/3734524968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48091d70 con 0x7f4e480aad60 2021-04-09T18:21:11.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e3eabe700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4817dd10 0x7f4e4817e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:21:11.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e472bf700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480aad60 0x7f4e480ab160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f4e3800b580 tx=0x7f4e3800b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:21:11.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e44aba700 1 -- 172.21.15.120:0/3734524968 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e3800bd10 con 0x7f4e480aad60 2021-04-09T18:21:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e44aba700 1 -- 172.21.15.120:0/3734524968 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e38000c90 con 0x7f4e480aad60 2021-04-09T18:21:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e48091d70 con 0x7f4e480aad60 2021-04-09T18:21:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e44aba700 1 -- 172.21.15.120:0/3734524968 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4e38002220 con 0x7f4e480aad60 2021-04-09T18:21:11.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e48091d70 con 0x7f4e480aad60 2021-04-09T18:21:11.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.833 7f4e44aba700 1 -- 172.21.15.120:0/3734524968 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4e3800a000 con 0x7f4e480aad60 2021-04-09T18:21:11.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.834 7f4e44aba700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4e2c018930 0x7f4e2c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:21:11.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.834 7f4e44aba700 1 -- 172.21.15.120:0/3734524968 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f4e38032bb0 con 0x7f4e480aad60 2021-04-09T18:21:11.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.834 7f4e3eabe700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4e2c018930 0x7f4e2c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:21:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.834 7f4e3eabe700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4e2c018930 0x7f4e2c01ae10 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:21:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.852 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e480e4cf0 con 0x7f4e480aad60 2021-04-09T18:21:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:11.855 7f4e44aba700 1 -- 172.21.15.120:0/3734524968 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4e38006bb0 con 0x7f4e480aad60 2021-04-09T18:21:12.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.041 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e480d6be0 con 0x7f4e480aad60 2021-04-09T18:21:12.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.042 7f4e44aba700 1 -- 172.21.15.120:0/3734524968 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2109 (secure 0 0 0) 0x7f4e38000c90 con 0x7f4e480aad60 2021-04-09T18:21:12.041 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2021-04-09T18:21:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:21:12.042 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:21:12.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4e2c018930 msgr2=0x7f4e2c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:12.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4e2c018930 0x7f4e2c01ae10 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:12.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480aad60 msgr2=0x7f4e480ab160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:21:12.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480aad60 0x7f4e480ab160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f4e3800b580 tx=0x7f4e3800b920).stop 2021-04-09T18:21:12.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 shutdown_connections 2021-04-09T18:21:12.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4e2c018930 0x7f4e2c01ae10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:12.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e48090bd0 0x7f4e48090fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:12.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4817dd10 0x7f4e4817e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:12.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 --2- 172.21.15.120:0/3734524968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e480aad60 0x7f4e480ab160 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:21:12.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 >> 172.21.15.120:0/3734524968 conn(0x7f4e4817a3a0 msgr2=0x7f4e4818a510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:21:12.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 shutdown_connections 2021-04-09T18:21:12.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:21:12.045 7f4e4d590700 1 -- 172.21.15.120:0/3734524968 wait complete. 2021-04-09T18:21:12.052 INFO:tasks.mds_thrash.fs.[None]:mds.b reported in up:standby state 2021-04-09T18:21:12.053 INFO:tasks.mds_thrash.fs.[None]:waiting for 101 secs before thrashing 2021-04-09T18:21:24.459 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:21:24.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:21:35.813 INFO:tasks.workunit.client.0.smithi120.stderr:Note: checking out 'd23cd2d5f486487b0b80655c4e33344f0f97b82b'. 2021-04-09T18:21:35.814 INFO:tasks.workunit.client.0.smithi120.stderr: 2021-04-09T18:21:35.814 INFO:tasks.workunit.client.0.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-04-09T18:21:35.814 INFO:tasks.workunit.client.0.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2021-04-09T18:21:35.815 INFO:tasks.workunit.client.0.smithi120.stderr:state without impacting any branches by performing another checkout. 2021-04-09T18:21:35.815 INFO:tasks.workunit.client.0.smithi120.stderr: 2021-04-09T18:21:35.815 INFO:tasks.workunit.client.0.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2021-04-09T18:21:35.815 INFO:tasks.workunit.client.0.smithi120.stderr:do so (now or later) by using -b with the checkout command again. Example: 2021-04-09T18:21:35.816 INFO:tasks.workunit.client.0.smithi120.stderr: 2021-04-09T18:21:35.816 INFO:tasks.workunit.client.0.smithi120.stderr: git checkout -b new_branch_name 2021-04-09T18:21:35.816 INFO:tasks.workunit.client.0.smithi120.stderr: 2021-04-09T18:21:35.816 INFO:tasks.workunit.client.0.smithi120.stderr:HEAD is now at d23cd2d... Merge branch 'wip-50026-nautilus' of https://github.com/smithfarm/ceph into wip-yuri2-testing-2021-04-09-0846-nautilus 2021-04-09T18:21:35.818 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-04-09T18:21:35.865 INFO:tasks.workunit.client.0.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-04-09T18:21:35.868 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-04-09T18:21:35.868 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-04-09T18:21:36.186 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-04-09T18:21:36.243 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-04-09T18:21:36.274 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-04-09T18:21:36.275 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-04-09T18:21:36.276 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-04-09T18:21:36.306 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-04-09T18:21:36.354 DEBUG:teuthology.orchestra.remote:smithi120:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2021-04-09T18:21:36.406 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2021-04-09T18:21:36.406 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2021-04-09T18:21:36.406 DEBUG:teuthology.orchestra.run.smithi120:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d23cd2d5f486487b0b80655c4e33344f0f97b82b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2021-04-09T18:21:36.460 INFO:tasks.workunit.client.0.smithi120.stderr:+ mkdir -p fsstress 2021-04-09T18:21:36.463 INFO:tasks.workunit.client.0.smithi120.stderr:+ pushd fsstress 2021-04-09T18:21:36.464 INFO:tasks.workunit.client.0.smithi120.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2021-04-09T18:21:36.465 INFO:tasks.workunit.client.0.smithi120.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2021-04-09T18:21:37.747 INFO:tasks.workunit.client.0.smithi120.stderr:+ tar xzf ltp-full.tgz 2021-04-09T18:21:54.571 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:21:54.577 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:22:24.661 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:22:24.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:22:53.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:22:53.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.233 7f0af8107700 1 Processor -- start 2021-04-09T18:22:53.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.233 7f0af8107700 1 -- start start 2021-04-09T18:22:53.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.234 7f0af8107700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af00d7560 0x7f0af00d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.234 7f0af8107700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00d7960 con 0x7f0af00d63b0 2021-04-09T18:22:53.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.234 7f0af8107700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00d6be0 con 0x7f0af00d7160 2021-04-09T18:22:53.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.234 7f0af8107700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af01a2ac0 con 0x7f0af00d7560 2021-04-09T18:22:53.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.234 7f0af6724700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0af00d63b0 0x7f0af01ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49282/0 (socket says 172.21.15.120:49282) 2021-04-09T18:22:53.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.234 7f0af6724700 1 -- 172.21.15.120:0/2164028273 learned_addr learned my addr 172.21.15.120:0/2164028273 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:22:53.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.234 7f0af5722700 1 --2- 172.21.15.120:0/2164028273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af00d7560 0x7f0af00d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af4f21700 1 -- 172.21.15.120:0/2164028273 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352852609 0 0) 0x7f0ae8000d30 con 0x7f0af00d63b0 2021-04-09T18:22:53.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af4f21700 1 -- 172.21.15.120:0/2164028273 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0adc002fe0 con 0x7f0af00d63b0 2021-04-09T18:22:53.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af4f21700 1 -- 172.21.15.120:0/2164028273 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139642022 0 0) 0x7f0ae0000c60 con 0x7f0af00d7160 2021-04-09T18:22:53.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af4f21700 1 -- 172.21.15.120:0/2164028273 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0adc0042c0 con 0x7f0af00d7160 2021-04-09T18:22:53.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af5722700 1 -- 172.21.15.120:0/2164028273 >> v1:172.21.15.134:6789/0 conn(0x7f0af00d7160 legacy=0x7f0af00d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af5722700 1 -- 172.21.15.120:0/2164028273 >> v1:172.21.15.120:6789/0 conn(0x7f0af00d63b0 legacy=0x7f0af01ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af5722700 1 -- 172.21.15.120:0/2164028273 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af01a2cb0 con 0x7f0af00d7560 2021-04-09T18:22:53.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af5722700 1 --2- 172.21.15.120:0/2164028273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af00d7560 0x7f0af00d5d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0aec006650 tx=0x7f0aec009a80).ready entity=mon.2 client_cookie=d6311a1f0a92d628 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:53.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af4f21700 1 -- 172.21.15.120:0/2164028273 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0aec0009b0 con 0x7f0af00d7560 2021-04-09T18:22:53.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af4f21700 1 -- 172.21.15.120:0/2164028273 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec00c0c0 con 0x7f0af00d7560 2021-04-09T18:22:53.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af4f21700 1 -- 172.21.15.120:0/2164028273 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0aec00c510 con 0x7f0af00d7560 2021-04-09T18:22:53.258 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af8107700 1 -- 172.21.15.120:0/2164028273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af00d7560 msgr2=0x7f0af00d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.235 7f0af8107700 1 --2- 172.21.15.120:0/2164028273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af00d7560 0x7f0af00d5d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0aec006650 tx=0x7f0aec009a80).stop 2021-04-09T18:22:53.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.236 7f0af8107700 1 -- 172.21.15.120:0/2164028273 shutdown_connections 2021-04-09T18:22:53.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.236 7f0af8107700 1 --2- 172.21.15.120:0/2164028273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af00d7560 0x7f0af00d5d90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.236 7f0af8107700 1 -- 172.21.15.120:0/2164028273 >> 172.21.15.120:0/2164028273 conn(0x7f0af00d1590 msgr2=0x7f0af00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:22:53.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.236 7f0af8107700 1 -- 172.21.15.120:0/2164028273 shutdown_connections 2021-04-09T18:22:53.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.236 7f0af8107700 1 -- 172.21.15.120:0/2164028273 wait complete. 2021-04-09T18:22:53.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.259 7f0af8107700 1 Processor -- start 2021-04-09T18:22:53.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.259 7f0af8107700 1 -- start start 2021-04-09T18:22:53.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.259 7f0af8107700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00910f0 0x7f0af00914f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.259 7f0af8107700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af01a1180 0x7f0af01a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.259 7f0af8107700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0af017a3e0 0x7f0af017a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.259 7f0af8107700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0090bf0 con 0x7f0af017a3e0 2021-04-09T18:22:53.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.259 7f0af8107700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00aa870 con 0x7f0af00910f0 2021-04-09T18:22:53.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.259 7f0af8107700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af017ae00 con 0x7f0af01a1180 2021-04-09T18:22:53.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5f23700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00910f0 0x7f0af00914f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5722700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af01a1180 0x7f0af01a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5f23700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00910f0 0x7f0af00914f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:43210/0 (socket says 172.21.15.120:43210) 2021-04-09T18:22:53.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5722700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af01a1180 0x7f0af01a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:41040/0 (socket says 172.21.15.120:41040) 2021-04-09T18:22:53.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5f23700 1 -- 172.21.15.120:0/4135397220 learned_addr learned my addr 172.21.15.120:0/4135397220 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:22:53.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5f23700 1 -- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af01a1180 msgr2=0x7f0af01a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5f23700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af01a1180 0x7f0af01a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5f23700 1 -- 172.21.15.120:0/4135397220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0af017a3e0 msgr2=0x7f0af017a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-04-09T18:22:53.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5f23700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0af017a3e0 0x7f0af017a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:22:53.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5f23700 1 -- 172.21.15.120:0/4135397220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af017b020 con 0x7f0af00910f0 2021-04-09T18:22:53.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5722700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af01a1180 0x7f0af01a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:22:53.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af5f23700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00910f0 0x7f0af00914f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0ae0006f20 tx=0x7f0ae000b990).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:53.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0ae67fc700 1 -- 172.21.15.120:0/4135397220 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ae000bd80 con 0x7f0af00910f0 2021-04-09T18:22:53.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0ae67fc700 1 -- 172.21.15.120:0/4135397220 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0000e20 con 0x7f0af00910f0 2021-04-09T18:22:53.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0af8107700 1 -- 172.21.15.120:0/4135397220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af017b020 con 0x7f0af00910f0 2021-04-09T18:22:53.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.260 7f0ae67fc700 1 -- 172.21.15.120:0/4135397220 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ae00022b0 con 0x7f0af00910f0 2021-04-09T18:22:53.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.261 7f0af8107700 1 -- 172.21.15.120:0/4135397220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af017b020 con 0x7f0af00910f0 2021-04-09T18:22:53.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.261 7f0ae67fc700 1 -- 172.21.15.120:0/4135397220 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0ae0005300 con 0x7f0af00910f0 2021-04-09T18:22:53.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.261 7f0ae67fc700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0ad8018930 0x7f0ad801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.262 7f0ae67fc700 1 -- 172.21.15.120:0/4135397220 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f0ae0032f50 con 0x7f0af00910f0 2021-04-09T18:22:53.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.262 7f0af5722700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0ad8018930 0x7f0ad801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.262 7f0af5722700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0ad8018930 0x7f0ad801ae10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:53.271 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.276 7f0af8107700 1 -- 172.21.15.120:0/4135397220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af017b2c0 con 0x7f0af00910f0 2021-04-09T18:22:53.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.280 7f0ae67fc700 1 -- 172.21.15.120:0/4135397220 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0ae0000b80 con 0x7f0af00910f0 2021-04-09T18:22:53.487 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.491 7f0af8107700 1 -- 172.21.15.120:0/4135397220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0af017b2c0 con 0x7f0af00910f0 2021-04-09T18:22:53.488 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.492 7f0ae67fc700 1 -- 172.21.15.120:0/4135397220 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2109 (secure 0 0 0) 0x7f0ae000bd80 con 0x7f0af00910f0 2021-04-09T18:22:53.488 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2021-04-09T18:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:22:53.491 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 -- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0ad8018930 msgr2=0x7f0ad801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.491 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0ad8018930 0x7f0ad801ae10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 -- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00910f0 msgr2=0x7f0af00914f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00910f0 0x7f0af00914f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0ae0006f20 tx=0x7f0ae000b990).stop 2021-04-09T18:22:53.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 -- 172.21.15.120:0/4135397220 shutdown_connections 2021-04-09T18:22:53.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0af017a3e0 0x7f0af017a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:22:53.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0ad8018930 0x7f0ad801ae10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0af01a1180 0x7f0af01a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 --2- 172.21.15.120:0/4135397220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00910f0 0x7f0af00914f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 -- 172.21.15.120:0/4135397220 >> 172.21.15.120:0/4135397220 conn(0x7f0af0184180 msgr2=0x7f0af019c290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:22:53.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 -- 172.21.15.120:0/4135397220 shutdown_connections 2021-04-09T18:22:53.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.494 7f0af8107700 1 -- 172.21.15.120:0/4135397220 wait complete. 2021-04-09T18:22:53.500 INFO:tasks.mds_thrash.fs.[None]:kill mds.a (rank=0) 2021-04-09T18:22:53.500 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:22:53.500 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:22:53.510 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:22:53.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:22:53.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.691 7fedaa7ce700 1 Processor -- start 2021-04-09T18:22:53.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.691 7fedaa7ce700 1 -- start start 2021-04-09T18:22:53.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.691 7fedaa7ce700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feda40d7560 0x7feda40d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.691 7fedaa7ce700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda40d63b0 0x7feda41ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.691 7fedaa7ce700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda40d7960 con 0x7feda40d7160 2021-04-09T18:22:53.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7fedaa7ce700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda40d80f0 con 0x7feda40d7560 2021-04-09T18:22:53.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7fedaa7ce700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40d6be0 con 0x7feda40d63b0 2021-04-09T18:22:53.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7fed9bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feda40d7560 0x7feda40d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7feda3fff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7feda40d7160 0x7feda40d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:44120/0 (socket says 172.21.15.120:44120) 2021-04-09T18:22:53.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7feda8deb700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda40d63b0 0x7feda41ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7feda3fff700 1 -- 172.21.15.120:0/611762849 learned_addr learned my addr 172.21.15.120:0/611762849 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:22:53.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7fed9bfff700 1 -- 172.21.15.120:0/611762849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda40d63b0 msgr2=0x7feda41ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:22:53.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7fed9bfff700 1 --2- 172.21.15.120:0/611762849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda40d63b0 0x7feda41ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7fed9bfff700 1 -- 172.21.15.120:0/611762849 >> v1:172.21.15.134:6789/0 conn(0x7feda40d7160 legacy=0x7feda40d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7feda37fe700 1 -- 172.21.15.120:0/611762849 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672055950 0 0) 0x7fed940010c0 con 0x7feda40d7160 2021-04-09T18:22:53.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7fed9bfff700 1 -- 172.21.15.120:0/611762849 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda41a2ac0 con 0x7feda40d7560 2021-04-09T18:22:53.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7fed9bfff700 1 --2- 172.21.15.120:0/611762849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda40d7560 0x7feda40d5d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fed8c006650 tx=0x7fed8c009a00).ready entity=mon.1 client_cookie=25c59d3f8a979ce6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:53.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7feda37fe700 1 -- 172.21.15.120:0/611762849 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed8c009df0 con 0x7feda40d7560 2021-04-09T18:22:53.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7feda37fe700 1 -- 172.21.15.120:0/611762849 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c0009b0 con 0x7feda40d7560 2021-04-09T18:22:53.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.692 7feda37fe700 1 -- 172.21.15.120:0/611762849 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed8c00c2b0 con 0x7feda40d7560 2021-04-09T18:22:53.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.693 7fedaa7ce700 1 -- 172.21.15.120:0/611762849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda40d7560 msgr2=0x7feda40d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.693 7fedaa7ce700 1 --2- 172.21.15.120:0/611762849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda40d7560 0x7feda40d5d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fed8c006650 tx=0x7fed8c009a00).stop 2021-04-09T18:22:53.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.693 7fedaa7ce700 1 -- 172.21.15.120:0/611762849 shutdown_connections 2021-04-09T18:22:53.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.693 7fedaa7ce700 1 --2- 172.21.15.120:0/611762849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda40d7560 0x7feda40d5d90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.693 7fedaa7ce700 1 --2- 172.21.15.120:0/611762849 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda40d63b0 0x7feda41ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.693 7fedaa7ce700 1 -- 172.21.15.120:0/611762849 >> 172.21.15.120:0/611762849 conn(0x7feda40d1590 msgr2=0x7feda40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:22:53.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.693 7fedaa7ce700 1 -- 172.21.15.120:0/611762849 shutdown_connections 2021-04-09T18:22:53.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.693 7fedaa7ce700 1 -- 172.21.15.120:0/611762849 wait complete. 2021-04-09T18:22:53.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.712 7fedaa7ce700 1 Processor -- start 2021-04-09T18:22:53.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.712 7fedaa7ce700 1 -- start start 2021-04-09T18:22:53.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.712 7fedaa7ce700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda4099110 0x7feda4188560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.712 7fedaa7ce700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feda417b820 0x7feda417aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.712 7fedaa7ce700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda4099ae0 0x7feda4099ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.712 7fedaa7ce700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda417b550 con 0x7feda417b820 2021-04-09T18:22:53.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.712 7fedaa7ce700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda4099590 con 0x7feda4099ae0 2021-04-09T18:22:53.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.712 7fedaa7ce700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40b2ad0 con 0x7feda4099110 2021-04-09T18:22:53.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.712 7fed9bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feda417b820 0x7feda417aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fed9bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feda417b820 0x7feda417aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54402/0 (socket says 172.21.15.120:54402) 2021-04-09T18:22:53.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fed9bfff700 1 -- 172.21.15.120:0/3967626055 learned_addr learned my addr 172.21.15.120:0/3967626055 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:22:53.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda3fff700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda4099110 0x7feda4188560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda8deb700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda4099ae0 0x7feda4099ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda8deb700 1 -- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda4099ae0 msgr2=0x7feda4099ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2021-04-09T18:22:53.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda8deb700 1 -- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda4099ae0 msgr2=0x7feda4099ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:22:53.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda8deb700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda4099ae0 0x7feda4099ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:22:53.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda8deb700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda4099ae0 0x7feda4099ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:22:53.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fed9bfff700 1 -- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda4099110 msgr2=0x7feda4188560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fed9bfff700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda4099110 0x7feda4188560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fed9bfff700 1 -- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda4099ae0 msgr2=0x7feda4099ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-04-09T18:22:53.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fed9bfff700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda4099ae0 0x7feda4099ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fed9bfff700 1 -- 172.21.15.120:0/3967626055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40b2cf0 con 0x7feda417b820 2021-04-09T18:22:53.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda3fff700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda4099110 0x7feda4188560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:22:53.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fed9bfff700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feda417b820 0x7feda417aeb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fed8c0096a0 tx=0x7fed8c00b9b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:53.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda17fa700 1 -- 172.21.15.120:0/3967626055 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed8c0093a0 con 0x7feda417b820 2021-04-09T18:22:53.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda40b2cf0 con 0x7feda417b820 2021-04-09T18:22:53.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda17fa700 1 -- 172.21.15.120:0/3967626055 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c000940 con 0x7feda417b820 2021-04-09T18:22:53.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7feda17fa700 1 -- 172.21.15.120:0/3967626055 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed8c0067f0 con 0x7feda417b820 2021-04-09T18:22:53.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.713 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda40b2cf0 con 0x7feda417b820 2021-04-09T18:22:53.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.714 7feda17fa700 1 -- 172.21.15.120:0/3967626055 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fed8c0052e0 con 0x7feda417b820 2021-04-09T18:22:53.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.714 7feda17fa700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fed88018930 0x7fed8801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:53.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.714 7feda17fa700 1 -- 172.21.15.120:0/3967626055 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fed8c032bc0 con 0x7feda417b820 2021-04-09T18:22:53.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.714 7feda3fff700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fed88018930 0x7fed8801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:53.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.714 7feda3fff700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fed88018930 0x7fed8801adc0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:53.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.737 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda4179cb0 con 0x7feda417b820 2021-04-09T18:22:53.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.741 7feda17fa700 1 -- 172.21.15.120:0/3967626055 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fed8c000940 con 0x7feda417b820 2021-04-09T18:22:53.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.923 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feda4179cb0 con 0x7feda417b820 2021-04-09T18:22:53.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.924 7feda17fa700 1 -- 172.21.15.120:0/3967626055 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2109 (secure 0 0 0) 0x7fed8c000940 con 0x7feda417b820 2021-04-09T18:22:53.920 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2021-04-09T18:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:22:53.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fed88018930 msgr2=0x7fed8801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fed88018930 0x7fed8801adc0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feda417b820 msgr2=0x7feda417aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:53.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feda417b820 0x7feda417aeb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fed8c0096a0 tx=0x7fed8c00b9b0).stop 2021-04-09T18:22:53.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 shutdown_connections 2021-04-09T18:22:53.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feda4099ae0 0x7feda4099ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feda417b820 0x7feda417aeb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fed88018930 0x7fed8801adc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 --2- 172.21.15.120:0/3967626055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feda4099110 0x7feda4188560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:53.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 >> 172.21.15.120:0/3967626055 conn(0x7feda4184f60 msgr2=0x7feda4094050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:22:53.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 shutdown_connections 2021-04-09T18:22:53.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:53.926 7fedaa7ce700 1 -- 172.21.15.120:0/3967626055 wait complete. 2021-04-09T18:22:53.932 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:22:54.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:22:54.812 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:22:55.934 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:22:56.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.084 7f97207bf700 1 Processor -- start 2021-04-09T18:22:56.107 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.084 7f97207bf700 1 -- start start 2021-04-09T18:22:56.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.085 7f97207bf700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f97180d7160 0x7f97180d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:56.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.085 7f97207bf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180d6190 0x7f97180d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:56.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.085 7f97207bf700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97180d6be0 con 0x7f97180d55a0 2021-04-09T18:22:56.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.085 7f97207bf700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97180d80f0 con 0x7f97180d7160 2021-04-09T18:22:56.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.085 7f97207bf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97181a2ac0 con 0x7f97180d6190 2021-04-09T18:22:56.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.085 7f971e5db700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f97180d7160 0x7f97180d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.085 7f971e5db700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f97180d7160 0x7f97180d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54412/0 (socket says 172.21.15.120:54412) 2021-04-09T18:22:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.085 7f971e5db700 1 -- 172.21.15.120:0/3039914261 learned_addr learned my addr 172.21.15.120:0/3039914261 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:22:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.085 7f971eddc700 1 --2- 172.21.15.120:0/3039914261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180d6190 0x7f97180d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f971e5db700 1 -- 172.21.15.120:0/3039914261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180d6190 msgr2=0x7f97180d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:22:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f971e5db700 1 --2- 172.21.15.120:0/3039914261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180d6190 0x7f97180d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f971e5db700 1 -- 172.21.15.120:0/3039914261 >> v1:172.21.15.134:6789/0 conn(0x7f97180d55a0 legacy=0x7f97180d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f971e5db700 1 -- 172.21.15.120:0/3039914261 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97181a2cb0 con 0x7f97180d7160 2021-04-09T18:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f971eddc700 1 --2- 172.21.15.120:0/3039914261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180d6190 0x7f97180d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f971e5db700 1 --2- 172.21.15.120:0/3039914261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97180d7160 0x7f97180d7560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f9708006700 tx=0x7f9708009b80).ready entity=mon.0 client_cookie=4cdb355a63ac1118 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f971d5d9700 1 -- 172.21.15.120:0/3039914261 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f970800c0c0 con 0x7f97180d7160 2021-04-09T18:22:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f971d5d9700 1 -- 172.21.15.120:0/3039914261 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970800c440 con 0x7f97180d7160 2021-04-09T18:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f971d5d9700 1 -- 172.21.15.120:0/3039914261 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f970800c920 con 0x7f97180d7160 2021-04-09T18:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f97207bf700 1 -- 172.21.15.120:0/3039914261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97180d7160 msgr2=0x7f97180d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.086 7f97207bf700 1 --2- 172.21.15.120:0/3039914261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97180d7160 0x7f97180d7560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f9708006700 tx=0x7f9708009b80).stop 2021-04-09T18:22:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.087 7f97207bf700 1 -- 172.21.15.120:0/3039914261 shutdown_connections 2021-04-09T18:22:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.087 7f97207bf700 1 --2- 172.21.15.120:0/3039914261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180d6190 0x7f97180d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.087 7f97207bf700 1 --2- 172.21.15.120:0/3039914261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97180d7160 0x7f97180d7560 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.087 7f97207bf700 1 -- 172.21.15.120:0/3039914261 >> 172.21.15.120:0/3039914261 conn(0x7f97180d1590 msgr2=0x7f97180d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.087 7f97207bf700 1 -- 172.21.15.120:0/3039914261 shutdown_connections 2021-04-09T18:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.087 7f97207bf700 1 -- 172.21.15.120:0/3039914261 wait complete. 2021-04-09T18:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f97207bf700 1 Processor -- start 2021-04-09T18:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f97207bf700 1 -- start start 2021-04-09T18:22:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f97207bf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f971817bac0 0x7f9718095bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f97207bf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180aba60 0x7f97180abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f97207bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97181a0c30 0x7f97181a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f97207bf700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971817bec0 con 0x7f97181a0c30 2021-04-09T18:22:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f97207bf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718095640 con 0x7f971817bac0 2021-04-09T18:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f97207bf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97180961e0 con 0x7f97180aba60 2021-04-09T18:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f971eddc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97181a0c30 0x7f97181a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f971eddc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97181a0c30 0x7f97181a1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54422/0 (socket says 172.21.15.120:54422) 2021-04-09T18:22:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f971eddc700 1 -- 172.21.15.120:0/2745665545 learned_addr learned my addr 172.21.15.120:0/2745665545 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:22:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f971e5db700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f971817bac0 0x7f9718095bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.106 7f971ddda700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180aba60 0x7f97180abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f971eddc700 1 -- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180aba60 msgr2=0x7f97180abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f971eddc700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180aba60 0x7f97180abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f971eddc700 1 -- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f971817bac0 msgr2=0x7f9718095bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f971eddc700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f971817bac0 0x7f9718095bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f971eddc700 1 -- 172.21.15.120:0/2745665545 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97181a1650 con 0x7f97181a0c30 2021-04-09T18:22:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f971eddc700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97181a0c30 0x7f97181a1030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f9710009980 tx=0x7f971000bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f9716ffd700 1 -- 172.21.15.120:0/2745665545 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f971000c2f0 con 0x7f97181a0c30 2021-04-09T18:22:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f9716ffd700 1 -- 172.21.15.120:0/2745665545 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710006790 con 0x7f97181a0c30 2021-04-09T18:22:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f97207bf700 1 -- 172.21.15.120:0/2745665545 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97181a1650 con 0x7f97181a0c30 2021-04-09T18:22:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f9716ffd700 1 -- 172.21.15.120:0/2745665545 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f971000c7e0 con 0x7f97181a0c30 2021-04-09T18:22:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f97207bf700 1 -- 172.21.15.120:0/2745665545 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97181a1650 con 0x7f97181a0c30 2021-04-09T18:22:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.107 7f9716ffd700 1 -- 172.21.15.120:0/2745665545 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f97100011f0 con 0x7f97181a0c30 2021-04-09T18:22:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.108 7f9716ffd700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f96f8018930 0x7f96f801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.108 7f9716ffd700 1 -- 172.21.15.120:0/2745665545 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f9710032fb0 con 0x7f97181a0c30 2021-04-09T18:22:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.108 7f971e5db700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f96f8018930 0x7f96f801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.108 7f971e5db700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f96f8018930 0x7f96f801ae10 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.131 7f97207bf700 1 -- 172.21.15.120:0/2745665545 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971817a2e0 con 0x7f97181a0c30 2021-04-09T18:22:56.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.134 7f9716ffd700 1 -- 172.21.15.120:0/2745665545 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f971000be10 con 0x7f97181a0c30 2021-04-09T18:22:56.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.314 7f97207bf700 1 -- 172.21.15.120:0/2745665545 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f971817a2e0 con 0x7f97181a0c30 2021-04-09T18:22:56.310 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.314 7f9716ffd700 1 -- 172.21.15.120:0/2745665545 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2109 (secure 0 0 0) 0x7f9710006670 con 0x7f97181a0c30 2021-04-09T18:22:56.310 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2021-04-09T18:22:56.311 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:22:56.311 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:22:56.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 -- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f96f8018930 msgr2=0x7f96f801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:56.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f96f8018930 0x7f96f801ae10 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 -- 172.21.15.120:0/2745665545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97181a0c30 msgr2=0x7f97181a1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:56.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97181a0c30 0x7f97181a1030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f9710009980 tx=0x7f971000bcd0).stop 2021-04-09T18:22:56.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 -- 172.21.15.120:0/2745665545 shutdown_connections 2021-04-09T18:22:56.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97181a0c30 0x7f97181a1030 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f96f8018930 0x7f96f801ae10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97180aba60 0x7f97180abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 --2- 172.21.15.120:0/2745665545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f971817bac0 0x7f9718095bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:56.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 -- 172.21.15.120:0/2745665545 >> 172.21.15.120:0/2745665545 conn(0x7f9718185590 msgr2=0x7f971819bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:22:56.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 -- 172.21.15.120:0/2745665545 shutdown_connections 2021-04-09T18:22:56.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:56.317 7f97207bf700 1 -- 172.21.15.120:0/2745665545 wait complete. 2021-04-09T18:22:56.323 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:22:58.324 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:22:58.488 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.472 7f61786e3700 1 Processor -- start 2021-04-09T18:22:58.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.472 7f61786e3700 1 -- start start 2021-04-09T18:22:58.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.473 7f61786e3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61700d7160 0x7f61700e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:58.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.473 7f61786e3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61700e70a0 0x7f61700d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:58.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.473 7f61786e3700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61700d6be0 con 0x7f61700d7560 2021-04-09T18:22:58.490 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.473 7f61786e3700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61700d80f0 con 0x7f61700e70a0 2021-04-09T18:22:58.490 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.473 7f61786e3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61700e7f00 con 0x7f61700d7160 2021-04-09T18:22:58.490 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.473 7f61764ff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61700d7160 0x7f61700e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:58.490 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.473 7f6176d00700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61700e70a0 0x7f61700d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:58.491 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.473 7f6175cfe700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f61700d7560 0x7f61700d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:44162/0 (socket says 172.21.15.120:44162) 2021-04-09T18:22:58.491 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.473 7f6175cfe700 1 -- 172.21.15.120:0/1293702012 learned_addr learned my addr 172.21.15.120:0/1293702012 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:22:58.491 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f61754fd700 1 -- 172.21.15.120:0/1293702012 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632264205 0 0) 0x7f61640009b0 con 0x7f61700d7560 2021-04-09T18:22:58.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f61754fd700 1 -- 172.21.15.120:0/1293702012 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6158002fe0 con 0x7f61700d7560 2021-04-09T18:22:58.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f6176d00700 1 -- 172.21.15.120:0/1293702012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61700d7160 msgr2=0x7f61700e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:22:58.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f6176d00700 1 --2- 172.21.15.120:0/1293702012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61700d7160 0x7f61700e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f6176d00700 1 -- 172.21.15.120:0/1293702012 >> v1:172.21.15.134:6789/0 conn(0x7f61700d7560 legacy=0x7f61700d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:58.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f6176d00700 1 -- 172.21.15.120:0/1293702012 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61701a2ac0 con 0x7f61700e70a0 2021-04-09T18:22:58.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f61764ff700 1 --2- 172.21.15.120:0/1293702012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61700d7160 0x7f61700e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:22:58.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f6176d00700 1 --2- 172.21.15.120:0/1293702012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61700e70a0 0x7f61700d5d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6168006ad0 tx=0x7f6168009ad0).ready entity=mon.1 client_cookie=9ec38b6774deb0d0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:58.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f61754fd700 1 -- 172.21.15.120:0/1293702012 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61680022e0 con 0x7f61700e70a0 2021-04-09T18:22:58.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f61754fd700 1 -- 172.21.15.120:0/1293702012 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6168006410 con 0x7f61700e70a0 2021-04-09T18:22:58.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f61754fd700 1 -- 172.21.15.120:0/1293702012 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6168002620 con 0x7f61700e70a0 2021-04-09T18:22:58.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f61786e3700 1 -- 172.21.15.120:0/1293702012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61700e70a0 msgr2=0x7f61700d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:58.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.474 7f61786e3700 1 --2- 172.21.15.120:0/1293702012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61700e70a0 0x7f61700d5d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6168006ad0 tx=0x7f6168009ad0).stop 2021-04-09T18:22:58.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.475 7f61786e3700 1 -- 172.21.15.120:0/1293702012 shutdown_connections 2021-04-09T18:22:58.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.475 7f61786e3700 1 --2- 172.21.15.120:0/1293702012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61700e70a0 0x7f61700d5d90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.475 7f61786e3700 1 --2- 172.21.15.120:0/1293702012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61700d7160 0x7f61700e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.475 7f61786e3700 1 -- 172.21.15.120:0/1293702012 >> 172.21.15.120:0/1293702012 conn(0x7f61700d1590 msgr2=0x7f61700d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:22:58.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.475 7f61786e3700 1 -- 172.21.15.120:0/1293702012 shutdown_connections 2021-04-09T18:22:58.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.475 7f61786e3700 1 -- 172.21.15.120:0/1293702012 wait complete. 2021-04-09T18:22:58.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f61786e3700 1 Processor -- start 2021-04-09T18:22:58.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f61786e3700 1 -- start start 2021-04-09T18:22:58.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f61786e3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f617008aca0 0x7f617017ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:58.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f61786e3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617008b0a0 0x7f6170095890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:58.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f61786e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f617017f0b0 0x7f61700aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:58.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f61786e3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617008b690 con 0x7f617008b0a0 2021-04-09T18:22:58.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f61786e3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617008b910 con 0x7f617017f0b0 2021-04-09T18:22:58.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f61786e3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6170095eb0 con 0x7f617008aca0 2021-04-09T18:22:58.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f6175cfe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617008b0a0 0x7f6170095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:58.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f6175cfe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617008b0a0 0x7f6170095890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54438/0 (socket says 172.21.15.120:54438) 2021-04-09T18:22:58.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f6175cfe700 1 -- 172.21.15.120:0/146009160 learned_addr learned my addr 172.21.15.120:0/146009160 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:22:58.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f61764ff700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f617008aca0 0x7f617017ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:58.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.494 7f6176d00700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f617017f0b0 0x7f61700aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:58.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f6175cfe700 1 -- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f617008aca0 msgr2=0x7f617017ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:58.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f6175cfe700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f617008aca0 0x7f617017ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f6175cfe700 1 -- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f617017f0b0 msgr2=0x7f61700aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:58.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f6175cfe700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f617017f0b0 0x7f61700aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f6175cfe700 1 -- 172.21.15.120:0/146009160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700960d0 con 0x7f617008b0a0 2021-04-09T18:22:58.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f6175cfe700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617008b0a0 0x7f6170095890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6164001c60 tx=0x7f616400a8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f616effd700 1 -- 172.21.15.120:0/146009160 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f616400acc0 con 0x7f617008b0a0 2021-04-09T18:22:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f616effd700 1 -- 172.21.15.120:0/146009160 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164004140 con 0x7f617008b0a0 2021-04-09T18:22:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f61786e3700 1 -- 172.21.15.120:0/146009160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61700960d0 con 0x7f617008b0a0 2021-04-09T18:22:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f616effd700 1 -- 172.21.15.120:0/146009160 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6164004590 con 0x7f617008b0a0 2021-04-09T18:22:58.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f61786e3700 1 -- 172.21.15.120:0/146009160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61700960d0 con 0x7f617008b0a0 2021-04-09T18:22:58.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.495 7f616effd700 1 -- 172.21.15.120:0/146009160 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6164004320 con 0x7f617008b0a0 2021-04-09T18:22:58.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.496 7f616effd700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61500188c0 0x7f615001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:22:58.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.496 7f616effd700 1 -- 172.21.15.120:0/146009160 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f6164032bb0 con 0x7f617008b0a0 2021-04-09T18:22:58.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.496 7f61764ff700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61500188c0 0x7f615001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:22:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.496 7f61764ff700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61500188c0 0x7f615001adc0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:22:58.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.519 7f61786e3700 1 -- 172.21.15.120:0/146009160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61700e48e0 con 0x7f617008b0a0 2021-04-09T18:22:58.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.522 7f616effd700 1 -- 172.21.15.120:0/146009160 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f61640009b0 con 0x7f617008b0a0 2021-04-09T18:22:58.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.701 7f61786e3700 1 -- 172.21.15.120:0/146009160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61700e48e0 con 0x7f617008b0a0 2021-04-09T18:22:58.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.702 7f616effd700 1 -- 172.21.15.120:0/146009160 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2109 (secure 0 0 0) 0x7f6164004140 con 0x7f617008b0a0 2021-04-09T18:22:58.698 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2021-04-09T18:22:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:22:58.699 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:22:58.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 -- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61500188c0 msgr2=0x7f615001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:58.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61500188c0 0x7f615001adc0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 -- 172.21.15.120:0/146009160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617008b0a0 msgr2=0x7f6170095890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:22:58.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617008b0a0 0x7f6170095890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6164001c60 tx=0x7f616400a8d0).stop 2021-04-09T18:22:58.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 -- 172.21.15.120:0/146009160 shutdown_connections 2021-04-09T18:22:58.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f617017f0b0 0x7f61700aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617008b0a0 0x7f6170095890 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61500188c0 0x7f615001adc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 --2- 172.21.15.120:0/146009160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f617008aca0 0x7f617017ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:22:58.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 -- 172.21.15.120:0/146009160 >> 172.21.15.120:0/146009160 conn(0x7f61701993c0 msgr2=0x7f6170199820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:22:58.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 -- 172.21.15.120:0/146009160 shutdown_connections 2021-04-09T18:22:58.703 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:22:58.704 7f61786e3700 1 -- 172.21.15.120:0/146009160 wait complete. 2021-04-09T18:22:58.710 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:23:00.711 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:23:00.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.855 7f103c593700 1 Processor -- start 2021-04-09T18:23:00.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.855 7f103c593700 1 -- start start 2021-04-09T18:23:00.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f103c593700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340d7560 0x7f10340d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:00.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f103c593700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10340d7960 con 0x7f10340d63b0 2021-04-09T18:23:00.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f103c593700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10340d6be0 con 0x7f10340d7160 2021-04-09T18:23:00.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f103c593700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10341a2ac0 con 0x7f10340d7560 2021-04-09T18:23:00.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f103abb0700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f10340d63b0 0x7f10341ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49360/0 (socket says 172.21.15.120:49360) 2021-04-09T18:23:00.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f103abb0700 1 -- 172.21.15.120:0/513817060 learned_addr learned my addr 172.21.15.120:0/513817060 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:23:00.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f1039bae700 1 --2- 172.21.15.120:0/513817060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340d7560 0x7f10340d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:00.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f10393ad700 1 -- 172.21.15.120:0/513817060 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664280247 0 0) 0x7f102c0009b0 con 0x7f10340d63b0 2021-04-09T18:23:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f10393ad700 1 -- 172.21.15.120:0/513817060 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1020002fe0 con 0x7f10340d63b0 2021-04-09T18:23:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f10393ad700 1 -- 172.21.15.120:0/513817060 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607633463 0 0) 0x7f1024000c60 con 0x7f10340d7160 2021-04-09T18:23:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f10393ad700 1 -- 172.21.15.120:0/513817060 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1020003210 con 0x7f10340d7160 2021-04-09T18:23:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f1039bae700 1 -- 172.21.15.120:0/513817060 >> v1:172.21.15.134:6789/0 conn(0x7f10340d7160 legacy=0x7f10340d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:00.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f1039bae700 1 -- 172.21.15.120:0/513817060 >> v1:172.21.15.120:6789/0 conn(0x7f10340d63b0 legacy=0x7f10341ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:00.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f10393ad700 1 -- 172.21.15.120:0/513817060 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1665193299 0 0) 0x7f102c0010e0 con 0x7f10340d63b0 2021-04-09T18:23:00.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f1039bae700 1 -- 172.21.15.120:0/513817060 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10341a2cb0 con 0x7f10340d7560 2021-04-09T18:23:00.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.856 7f1039bae700 1 --2- 172.21.15.120:0/513817060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340d7560 0x7f10340d5d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f101c0069d0 tx=0x7f101c009dc0).ready entity=mon.2 client_cookie=53552b0baba6afe6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:00.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.857 7f10393ad700 1 -- 172.21.15.120:0/513817060 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f101c00b510 con 0x7f10340d7560 2021-04-09T18:23:00.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.857 7f10393ad700 1 -- 172.21.15.120:0/513817060 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c006ac0 con 0x7f10340d7560 2021-04-09T18:23:00.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.857 7f10393ad700 1 -- 172.21.15.120:0/513817060 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f101c00ba80 con 0x7f10340d7560 2021-04-09T18:23:00.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.857 7f103c593700 1 -- 172.21.15.120:0/513817060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340d7560 msgr2=0x7f10340d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:00.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.857 7f103c593700 1 --2- 172.21.15.120:0/513817060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340d7560 0x7f10340d5d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f101c0069d0 tx=0x7f101c009dc0).stop 2021-04-09T18:23:00.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.858 7f103c593700 1 -- 172.21.15.120:0/513817060 shutdown_connections 2021-04-09T18:23:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.858 7f103c593700 1 --2- 172.21.15.120:0/513817060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340d7560 0x7f10340d5d90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.858 7f103c593700 1 -- 172.21.15.120:0/513817060 >> 172.21.15.120:0/513817060 conn(0x7f10340d1590 msgr2=0x7f10340d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.858 7f103c593700 1 -- 172.21.15.120:0/513817060 shutdown_connections 2021-04-09T18:23:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.858 7f103c593700 1 -- 172.21.15.120:0/513817060 wait complete. 2021-04-09T18:23:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.876 7f103c593700 1 Processor -- start 2021-04-09T18:23:00.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.876 7f103c593700 1 -- start start 2021-04-09T18:23:00.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103c593700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034187670 0x7f10340a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:00.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103c593700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340a5050 0x7f10340b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:00.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103c593700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10340b5710 0x7f10341838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:00.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103c593700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10340b5b10 con 0x7f1034187670 2021-04-09T18:23:00.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103c593700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10340b5d30 con 0x7f10340b5710 2021-04-09T18:23:00.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103c593700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10340b5f50 con 0x7f10340a5050 2021-04-09T18:23:00.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103a3af700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034187670 0x7f10340a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:00.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103a3af700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034187670 0x7f10340a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54452/0 (socket says 172.21.15.120:54452) 2021-04-09T18:23:00.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103a3af700 1 -- 172.21.15.120:0/2432457906 learned_addr learned my addr 172.21.15.120:0/2432457906 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:00.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103abb0700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10340b5710 0x7f10341838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:00.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f1039bae700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340a5050 0x7f10340b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:00.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103a3af700 1 -- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340a5050 msgr2=0x7f10340b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:00.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103a3af700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340a5050 0x7f10340b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:00.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103a3af700 1 -- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10340b5710 msgr2=0x7f10341838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:00.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103a3af700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10340b5710 0x7f10341838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:00.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103a3af700 1 -- 172.21.15.120:0/2432457906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034183ef0 con 0x7f1034187670 2021-04-09T18:23:00.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103abb0700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10340b5710 0x7f10341838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:23:00.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103a3af700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034187670 0x7f10340a4a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f1024006f10 tx=0x7f102400b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:00.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f1032ffd700 1 -- 172.21.15.120:0/2432457906 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f102400bd80 con 0x7f1034187670 2021-04-09T18:23:00.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f1032ffd700 1 -- 172.21.15.120:0/2432457906 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024000e20 con 0x7f1034187670 2021-04-09T18:23:00.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103c593700 1 -- 172.21.15.120:0/2432457906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1034183ef0 con 0x7f1034187670 2021-04-09T18:23:00.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f1032ffd700 1 -- 172.21.15.120:0/2432457906 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10240054f0 con 0x7f1034187670 2021-04-09T18:23:00.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.877 7f103c593700 1 -- 172.21.15.120:0/2432457906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1034183ef0 con 0x7f1034187670 2021-04-09T18:23:00.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.878 7f1032ffd700 1 -- 172.21.15.120:0/2432457906 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1024009fe0 con 0x7f1034187670 2021-04-09T18:23:00.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.878 7f1032ffd700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1018018930 0x7f101801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:00.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.878 7f1032ffd700 1 -- 172.21.15.120:0/2432457906 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f1024032bd0 con 0x7f1034187670 2021-04-09T18:23:00.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.878 7f1039bae700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1018018930 0x7f101801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:00.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.879 7f1039bae700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1018018930 0x7f101801adc0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:00.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.902 7f103c593700 1 -- 172.21.15.120:0/2432457906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10341829e0 con 0x7f1034187670 2021-04-09T18:23:00.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:00.905 7f1032ffd700 1 -- 172.21.15.120:0/2432457906 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1024000e20 con 0x7f1034187670 2021-04-09T18:23:01.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.082 7f103c593700 1 -- 172.21.15.120:0/2432457906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10341829e0 con 0x7f1034187670 2021-04-09T18:23:01.079 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.083 7f1032ffd700 1 -- 172.21.15.120:0/2432457906 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2109 (secure 0 0 0) 0x7f1024009fe0 con 0x7f1034187670 2021-04-09T18:23:01.079 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2021-04-09T18:23:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:23:01.080 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:23:01.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 -- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1018018930 msgr2=0x7f101801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:01.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1018018930 0x7f101801adc0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:01.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 -- 172.21.15.120:0/2432457906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034187670 msgr2=0x7f10340a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:01.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034187670 0x7f10340a4a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f1024006f10 tx=0x7f102400b990).stop 2021-04-09T18:23:01.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 -- 172.21.15.120:0/2432457906 shutdown_connections 2021-04-09T18:23:01.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10340b5710 0x7f10341838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:01.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1018018930 0x7f101801adc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:01.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f10340a5050 0x7f10340b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:01.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 --2- 172.21.15.120:0/2432457906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034187670 0x7f10340a4a30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:01.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.085 7f103c593700 1 -- 172.21.15.120:0/2432457906 >> 172.21.15.120:0/2432457906 conn(0x7f103418dc90 msgr2=0x7f103408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:01.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.086 7f103c593700 1 -- 172.21.15.120:0/2432457906 shutdown_connections 2021-04-09T18:23:01.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:01.086 7f103c593700 1 -- 172.21.15.120:0/2432457906 wait complete. 2021-04-09T18:23:01.091 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:23:03.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:23:03.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.246 7f6a86e4a700 1 Processor -- start 2021-04-09T18:23:03.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.246 7f6a86e4a700 1 -- start start 2021-04-09T18:23:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a86e4a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800d6580 0x7f6a801ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a86e4a700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a800d7960 con 0x7f6a800d7160 2021-04-09T18:23:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a86e4a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a800d6980 con 0x7f6a800d7560 2021-04-09T18:23:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a86e4a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800d6be0 con 0x7f6a800d6580 2021-04-09T18:23:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a84c66700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6a800d7160 0x7f6a800d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49372/0 (socket says 172.21.15.120:49372) 2021-04-09T18:23:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a84c66700 1 -- 172.21.15.120:0/570298755 learned_addr learned my addr 172.21.15.120:0/570298755 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:23:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a85467700 1 --2- 172.21.15.120:0/570298755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800d6580 0x7f6a801ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a7f7fe700 1 -- 172.21.15.120:0/570298755 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271361027 0 0) 0x7f6a68000ce0 con 0x7f6a800d7160 2021-04-09T18:23:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a7f7fe700 1 -- 172.21.15.120:0/570298755 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a6c002fe0 con 0x7f6a800d7160 2021-04-09T18:23:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a7f7fe700 1 -- 172.21.15.120:0/570298755 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074958997 0 0) 0x7f6a70000c60 con 0x7f6a800d7560 2021-04-09T18:23:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a7f7fe700 1 -- 172.21.15.120:0/570298755 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a6c003210 con 0x7f6a800d7560 2021-04-09T18:23:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a7f7fe700 1 -- 172.21.15.120:0/570298755 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2430386414 0 0) 0x7f6a680010e0 con 0x7f6a800d7160 2021-04-09T18:23:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a85467700 1 -- 172.21.15.120:0/570298755 >> v1:172.21.15.134:6789/0 conn(0x7f6a800d7560 legacy=0x7f6a800d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a85467700 1 -- 172.21.15.120:0/570298755 >> v1:172.21.15.120:6789/0 conn(0x7f6a800d7160 legacy=0x7f6a800d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:03.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.247 7f6a85467700 1 -- 172.21.15.120:0/570298755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a801a2ac0 con 0x7f6a800d6580 2021-04-09T18:23:03.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.248 7f6a85467700 1 --2- 172.21.15.120:0/570298755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800d6580 0x7f6a801ac1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6a78006e50 tx=0x7f6a78009e70).ready entity=mon.2 client_cookie=7f628bd7c00dbf59 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:03.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.248 7f6a7f7fe700 1 -- 172.21.15.120:0/570298755 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a78006a20 con 0x7f6a800d6580 2021-04-09T18:23:03.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.248 7f6a7f7fe700 1 -- 172.21.15.120:0/570298755 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78006790 con 0x7f6a800d6580 2021-04-09T18:23:03.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.248 7f6a86e4a700 1 -- 172.21.15.120:0/570298755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800d6580 msgr2=0x7f6a801ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:03.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.248 7f6a7f7fe700 1 -- 172.21.15.120:0/570298755 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a78000f90 con 0x7f6a800d6580 2021-04-09T18:23:03.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.248 7f6a86e4a700 1 --2- 172.21.15.120:0/570298755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800d6580 0x7f6a801ac1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6a78006e50 tx=0x7f6a78009e70).stop 2021-04-09T18:23:03.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.249 7f6a86e4a700 1 -- 172.21.15.120:0/570298755 shutdown_connections 2021-04-09T18:23:03.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.249 7f6a86e4a700 1 --2- 172.21.15.120:0/570298755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800d6580 0x7f6a801ac1f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:03.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.249 7f6a86e4a700 1 -- 172.21.15.120:0/570298755 >> 172.21.15.120:0/570298755 conn(0x7f6a800d1590 msgr2=0x7f6a800d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:03.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.249 7f6a86e4a700 1 -- 172.21.15.120:0/570298755 shutdown_connections 2021-04-09T18:23:03.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.249 7f6a86e4a700 1 -- 172.21.15.120:0/570298755 wait complete. 2021-04-09T18:23:03.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.268 7f6a86e4a700 1 Processor -- start 2021-04-09T18:23:03.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.268 7f6a86e4a700 1 -- start start 2021-04-09T18:23:03.271 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.268 7f6a86e4a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a80187670 0x7f6a800a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:03.271 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.268 7f6a86e4a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a800a5050 0x7f6a800b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:03.271 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.268 7f6a86e4a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800b5710 0x7f6a801838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:03.271 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.268 7f6a86e4a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800b5b10 con 0x7f6a800a5050 2021-04-09T18:23:03.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.268 7f6a86e4a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800b5d30 con 0x7f6a80187670 2021-04-09T18:23:03.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.268 7f6a86e4a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800b5f50 con 0x7f6a800b5710 2021-04-09T18:23:03.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a800a5050 0x7f6a800b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:03.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a800a5050 0x7f6a800b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54468/0 (socket says 172.21.15.120:54468) 2021-04-09T18:23:03.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7ffff700 1 -- 172.21.15.120:0/1875348422 learned_addr learned my addr 172.21.15.120:0/1875348422 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:03.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a84c66700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a80187670 0x7f6a800a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:03.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a85467700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800b5710 0x7f6a801838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:03.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7ffff700 1 -- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800b5710 msgr2=0x7f6a801838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:03.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7ffff700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800b5710 0x7f6a801838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:03.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7ffff700 1 -- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a80187670 msgr2=0x7f6a800a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:03.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7ffff700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a80187670 0x7f6a800a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:03.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7ffff700 1 -- 172.21.15.120:0/1875348422 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80183ef0 con 0x7f6a800a5050 2021-04-09T18:23:03.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7ffff700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a800a5050 0x7f6a800b50f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f6a7000b580 tx=0x7f6a7000b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7d7fa700 1 -- 172.21.15.120:0/1875348422 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a7000bd10 con 0x7f6a800a5050 2021-04-09T18:23:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7d7fa700 1 -- 172.21.15.120:0/1875348422 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a70000e20 con 0x7f6a800a5050 2021-04-09T18:23:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a7d7fa700 1 -- 172.21.15.120:0/1875348422 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a700054f0 con 0x7f6a800a5050 2021-04-09T18:23:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a80183ef0 con 0x7f6a800a5050 2021-04-09T18:23:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.269 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a80183ef0 con 0x7f6a800a5050 2021-04-09T18:23:03.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.270 7f6a7d7fa700 1 -- 172.21.15.120:0/1875348422 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6a70009fe0 con 0x7f6a800a5050 2021-04-09T18:23:03.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.270 7f6a7d7fa700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a64018930 0x7f6a6401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:03.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.270 7f6a7d7fa700 1 -- 172.21.15.120:0/1875348422 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f6a70032c10 con 0x7f6a800a5050 2021-04-09T18:23:03.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.270 7f6a84c66700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a64018930 0x7f6a6401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:03.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.270 7f6a84c66700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a64018930 0x7f6a6401ae10 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:03.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.293 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a801829e0 con 0x7f6a800a5050 2021-04-09T18:23:03.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.296 7f6a7d7fa700 1 -- 172.21.15.120:0/1875348422 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6a70000e20 con 0x7f6a800a5050 2021-04-09T18:23:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.473 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a801829e0 con 0x7f6a800a5050 2021-04-09T18:23:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.473 7f6a7d7fa700 1 -- 172.21.15.120:0/1875348422 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2109 (secure 0 0 0) 0x7f6a70009fe0 con 0x7f6a800a5050 2021-04-09T18:23:03.470 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2021-04-09T18:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:20:58.775063","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":18,"addr":"172.21.15.120:6833/2249625664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2249625664},{"type":"v1","addr":"172.21.15.120:6833","nonce":2249625664}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:23:03.472 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a64018930 msgr2=0x7f6a6401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:03.473 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a64018930 0x7f6a6401ae10 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:03.473 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a800a5050 msgr2=0x7f6a800b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:03.473 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a800a5050 0x7f6a800b50f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f6a7000b580 tx=0x7f6a7000b920).stop 2021-04-09T18:23:03.473 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 shutdown_connections 2021-04-09T18:23:03.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a64018930 0x7f6a6401ae10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:03.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a800b5710 0x7f6a801838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:03.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a800a5050 0x7f6a800b50f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:03.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 --2- 172.21.15.120:0/1875348422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a80187670 0x7f6a800a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:03.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 >> 172.21.15.120:0/1875348422 conn(0x7f6a8018dc90 msgr2=0x7f6a8008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:03.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 shutdown_connections 2021-04-09T18:23:03.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:03.476 7f6a86e4a700 1 -- 172.21.15.120:0/1875348422 wait complete. 2021-04-09T18:23:03.482 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:23:05.483 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:23:05.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.638 7f89d3754700 1 Processor -- start 2021-04-09T18:23:05.654 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.638 7f89d3754700 1 -- start start 2021-04-09T18:23:05.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.638 7f89d3754700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f89cc0d6580 0x7f89cc1ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:05.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.638 7f89d3754700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0d7960 con 0x7f89cc0d7560 2021-04-09T18:23:05.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.638 7f89d3754700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0d6980 con 0x7f89cc0d7160 2021-04-09T18:23:05.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.638 7f89d3754700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0d6be0 con 0x7f89cc0d6580 2021-04-09T18:23:05.655 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.638 7f89d1d71700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f89cc0d6580 0x7f89cc1ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:05.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.638 7f89d0d6f700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f89cc0d7560 0x7f89cc0d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49390/0 (socket says 172.21.15.120:49390) 2021-04-09T18:23:05.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.638 7f89d0d6f700 1 -- 172.21.15.120:0/3471585538 learned_addr learned my addr 172.21.15.120:0/3471585538 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:23:05.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89d1d71700 1 -- 172.21.15.120:0/3471585538 >> v1:172.21.15.134:6789/0 conn(0x7f89cc0d7160 legacy=0x7f89cc0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:05.656 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89d1d71700 1 -- 172.21.15.120:0/3471585538 >> v1:172.21.15.120:6789/0 conn(0x7f89cc0d7560 legacy=0x7f89cc0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:05.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89d1d71700 1 -- 172.21.15.120:0/3471585538 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc1a2ac0 con 0x7f89cc0d6580 2021-04-09T18:23:05.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89cbfff700 1 -- 172.21.15.120:0/3471585538 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103256330 0 0) 0x7f89c00009b0 con 0x7f89cc0d7560 2021-04-09T18:23:05.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89d1d71700 1 --2- 172.21.15.120:0/3471585538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc0d6580 0x7f89cc1ac1f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f89c4006ab0 tx=0x7f89c4009ac0).ready entity=mon.0 client_cookie=5dacca1c7f60686c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:05.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89cbfff700 1 -- 172.21.15.120:0/3471585538 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f89c40066d0 con 0x7f89cc0d6580 2021-04-09T18:23:05.657 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89cbfff700 1 -- 172.21.15.120:0/3471585538 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c40022e0 con 0x7f89cc0d6580 2021-04-09T18:23:05.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89cbfff700 1 -- 172.21.15.120:0/3471585538 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f89c40027c0 con 0x7f89cc0d6580 2021-04-09T18:23:05.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89d3754700 1 -- 172.21.15.120:0/3471585538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc0d6580 msgr2=0x7f89cc1ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:05.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.639 7f89d3754700 1 --2- 172.21.15.120:0/3471585538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc0d6580 0x7f89cc1ac1f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f89c4006ab0 tx=0x7f89c4009ac0).stop 2021-04-09T18:23:05.658 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.640 7f89d3754700 1 -- 172.21.15.120:0/3471585538 shutdown_connections 2021-04-09T18:23:05.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.640 7f89d3754700 1 --2- 172.21.15.120:0/3471585538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc0d6580 0x7f89cc1ac1f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:05.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.640 7f89d3754700 1 -- 172.21.15.120:0/3471585538 >> 172.21.15.120:0/3471585538 conn(0x7f89cc0d1590 msgr2=0x7f89cc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:05.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.640 7f89d3754700 1 -- 172.21.15.120:0/3471585538 shutdown_connections 2021-04-09T18:23:05.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.640 7f89d3754700 1 -- 172.21.15.120:0/3471585538 wait complete. 2021-04-09T18:23:05.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.659 7f89d3754700 1 Processor -- start 2021-04-09T18:23:05.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.659 7f89d3754700 1 -- start start 2021-04-09T18:23:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.659 7f89d3754700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89cc08ba40 0x7f89cc08a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.659 7f89d3754700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89cc08afd0 0x7f89cc0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.659 7f89d3754700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc08be40 0x7f89cc0b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.659 7f89d3754700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc196e30 con 0x7f89cc08be40 2021-04-09T18:23:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.659 7f89d3754700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc191f20 con 0x7f89cc08afd0 2021-04-09T18:23:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.659 7f89d3754700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0b1380 con 0x7f89cc08ba40 2021-04-09T18:23:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1d71700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc08be40 0x7f89cc0b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1d71700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc08be40 0x7f89cc0b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54482/0 (socket says 172.21.15.120:54482) 2021-04-09T18:23:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1d71700 1 -- 172.21.15.120:0/1417037706 learned_addr learned my addr 172.21.15.120:0/1417037706 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1570700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89cc08ba40 0x7f89cc08a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d0d6f700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89cc08afd0 0x7f89cc0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1d71700 1 -- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89cc08ba40 msgr2=0x7f89cc08a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1d71700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89cc08ba40 0x7f89cc08a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1d71700 1 -- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89cc08afd0 msgr2=0x7f89cc0b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1d71700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89cc08afd0 0x7f89cc0b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1d71700 1 -- 172.21.15.120:0/1417037706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc08f150 con 0x7f89cc08be40 2021-04-09T18:23:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1570700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89cc08ba40 0x7f89cc08a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:23:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d0d6f700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89cc08afd0 0x7f89cc0b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:23:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d1d71700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc08be40 0x7f89cc0b0d60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f89c400afc0 tx=0x7f89c4002850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89c9ffb700 1 -- 172.21.15.120:0/1417037706 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f89c40009b0 con 0x7f89cc08be40 2021-04-09T18:23:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89c9ffb700 1 -- 172.21.15.120:0/1417037706 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c400a070 con 0x7f89cc08be40 2021-04-09T18:23:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d3754700 1 -- 172.21.15.120:0/1417037706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc08f150 con 0x7f89cc08be40 2021-04-09T18:23:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89c9ffb700 1 -- 172.21.15.120:0/1417037706 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f89c400a590 con 0x7f89cc08be40 2021-04-09T18:23:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.660 7f89d3754700 1 -- 172.21.15.120:0/1417037706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc08f150 con 0x7f89cc08be40 2021-04-09T18:23:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.661 7f89c9ffb700 1 -- 172.21.15.120:0/1417037706 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f89c400a250 con 0x7f89cc08be40 2021-04-09T18:23:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.661 7f89c9ffb700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f89ac018930 0x7f89ac01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.661 7f89c9ffb700 1 -- 172.21.15.120:0/1417037706 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f89c4032bc0 con 0x7f89cc08be40 2021-04-09T18:23:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.661 7f89d1570700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f89ac018930 0x7f89ac01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.662 7f89d1570700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f89ac018930 0x7f89ac01adc0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.684 7f89d3754700 1 -- 172.21.15.120:0/1417037706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc17f310 con 0x7f89cc08be40 2021-04-09T18:23:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.687 7f89c9ffb700 1 -- 172.21.15.120:0/1417037706 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f89c4002c40 con 0x7f89cc08be40 2021-04-09T18:23:05.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.877 7f89d3754700 1 -- 172.21.15.120:0/1417037706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89cc17f310 con 0x7f89cc08be40 2021-04-09T18:23:05.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.877 7f89c9ffb700 1 -- 172.21.15.120:0/1417037706 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f89c400a070 con 0x7f89cc08be40 2021-04-09T18:23:05.873 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 13 2021-04-09T18:23:05.874 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:23:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:05.777454","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:replay","state_seq":2,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:23:05.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 -- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f89ac018930 msgr2=0x7f89ac01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:05.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f89ac018930 0x7f89ac01adc0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:05.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 -- 172.21.15.120:0/1417037706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc08be40 msgr2=0x7f89cc0b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:05.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc08be40 0x7f89cc0b0d60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f89c400afc0 tx=0x7f89c4002850).stop 2021-04-09T18:23:05.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 -- 172.21.15.120:0/1417037706 shutdown_connections 2021-04-09T18:23:05.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89cc08be40 0x7f89cc0b0d60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:05.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89cc08afd0 0x7f89cc0b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:05.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f89ac018930 0x7f89ac01adc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:05.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 --2- 172.21.15.120:0/1417037706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89cc08ba40 0x7f89cc08a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:05.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 -- 172.21.15.120:0/1417037706 >> 172.21.15.120:0/1417037706 conn(0x7f89cc18a5c0 msgr2=0x7f89cc098350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:05.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 -- 172.21.15.120:0/1417037706 shutdown_connections 2021-04-09T18:23:05.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:05.880 7f89d3754700 1 -- 172.21.15.120:0/1417037706 wait complete. 2021-04-09T18:23:05.886 INFO:tasks.mds_thrash.fs.[None]:mds.a down, removed from mdsmap 2021-04-09T18:23:05.886 INFO:tasks.mds_thrash.fs.[None]:waiting for mds cluster to stabilize... 2021-04-09T18:23:05.886 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:23:06.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.030 7f88f28d3700 1 Processor -- start 2021-04-09T18:23:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.030 7f88f28d3700 1 -- start start 2021-04-09T18:23:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.030 7f88f28d3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0d7160 0x7f88ec0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.030 7f88f28d3700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec0d6be0 con 0x7f88ec0e70a0 2021-04-09T18:23:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.030 7f88f28d3700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec0e7f00 con 0x7f88ec0d7560 2021-04-09T18:23:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.030 7f88f28d3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0d80f0 con 0x7f88ec0d7160 2021-04-09T18:23:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.030 7f88f0ef0700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f88ec0e70a0 0x7f88ec0d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49404/0 (socket says 172.21.15.120:49404) 2021-04-09T18:23:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.030 7f88f0ef0700 1 -- 172.21.15.120:0/426477487 learned_addr learned my addr 172.21.15.120:0/426477487 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:23:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.030 7f88ebfff700 1 --2- 172.21.15.120:0/426477487 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0d7160 0x7f88ec0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88eb7fe700 1 -- 172.21.15.120:0/426477487 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247590418 0 0) 0x7f88e4000f90 con 0x7f88ec0e70a0 2021-04-09T18:23:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88eb7fe700 1 -- 172.21.15.120:0/426477487 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d8002fe0 con 0x7f88ec0e70a0 2021-04-09T18:23:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88eb7fe700 1 -- 172.21.15.120:0/426477487 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444178493 0 0) 0x7f88d4000c60 con 0x7f88ec0d7560 2021-04-09T18:23:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88eb7fe700 1 -- 172.21.15.120:0/426477487 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d8003210 con 0x7f88ec0d7560 2021-04-09T18:23:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88eb7fe700 1 -- 172.21.15.120:0/426477487 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2556380162 0 0) 0x7f88e4001270 con 0x7f88ec0e70a0 2021-04-09T18:23:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88ebfff700 1 -- 172.21.15.120:0/426477487 >> v1:172.21.15.134:6789/0 conn(0x7f88ec0d7560 legacy=0x7f88ec0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88ebfff700 1 -- 172.21.15.120:0/426477487 >> v1:172.21.15.120:6789/0 conn(0x7f88ec0e70a0 legacy=0x7f88ec0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88ebfff700 1 -- 172.21.15.120:0/426477487 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec1a2ac0 con 0x7f88ec0d7160 2021-04-09T18:23:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88ebfff700 1 --2- 172.21.15.120:0/426477487 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0d7160 0x7f88ec0e78e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f88dc006650 tx=0x7f88dc009a80).ready entity=mon.2 client_cookie=c59e6e6ab24fc57b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88eb7fe700 1 -- 172.21.15.120:0/426477487 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88dc0009b0 con 0x7f88ec0d7160 2021-04-09T18:23:06.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88eb7fe700 1 -- 172.21.15.120:0/426477487 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc00c0c0 con 0x7f88ec0d7160 2021-04-09T18:23:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88eb7fe700 1 -- 172.21.15.120:0/426477487 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88dc0009b0 con 0x7f88ec0d7160 2021-04-09T18:23:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88f28d3700 1 -- 172.21.15.120:0/426477487 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0d7160 msgr2=0x7f88ec0e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.031 7f88f28d3700 1 --2- 172.21.15.120:0/426477487 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0d7160 0x7f88ec0e78e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f88dc006650 tx=0x7f88dc009a80).stop 2021-04-09T18:23:06.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.032 7f88f28d3700 1 -- 172.21.15.120:0/426477487 shutdown_connections 2021-04-09T18:23:06.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.032 7f88f28d3700 1 --2- 172.21.15.120:0/426477487 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0d7160 0x7f88ec0e78e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:06.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.032 7f88f28d3700 1 -- 172.21.15.120:0/426477487 >> 172.21.15.120:0/426477487 conn(0x7f88ec0d1590 msgr2=0x7f88ec0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:06.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.032 7f88f28d3700 1 -- 172.21.15.120:0/426477487 shutdown_connections 2021-04-09T18:23:06.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.032 7f88f28d3700 1 -- 172.21.15.120:0/426477487 wait complete. 2021-04-09T18:23:06.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.051 7f88f28d3700 1 Processor -- start 2021-04-09T18:23:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.051 7f88f28d3700 1 -- start start 2021-04-09T18:23:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.051 7f88f28d3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ec187670 0x7f88ec0a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.051 7f88f28d3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0a5050 0x7f88ec0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.051 7f88f28d3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88ec0b5710 0x7f88ec1838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.051 7f88f28d3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0b5b10 con 0x7f88ec0b5710 2021-04-09T18:23:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.051 7f88f28d3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0b5d30 con 0x7f88ec187670 2021-04-09T18:23:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.051 7f88f28d3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0b5f50 con 0x7f88ec0a5050 2021-04-09T18:23:06.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.051 7f88f0ef0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88ec0b5710 0x7f88ec1838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:06.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88ebfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ec187670 0x7f88ec0a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:06.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f0ef0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88ec0b5710 0x7f88ec1838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54498/0 (socket says 172.21.15.120:54498) 2021-04-09T18:23:06.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f0ef0700 1 -- 172.21.15.120:0/2995929934 learned_addr learned my addr 172.21.15.120:0/2995929934 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:06.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88e3fff700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0a5050 0x7f88ec0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:06.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f0ef0700 1 -- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0a5050 msgr2=0x7f88ec0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:06.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f0ef0700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0a5050 0x7f88ec0b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:06.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f0ef0700 1 -- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ec187670 msgr2=0x7f88ec0a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:06.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f0ef0700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ec187670 0x7f88ec0a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:06.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f0ef0700 1 -- 172.21.15.120:0/2995929934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec183ef0 con 0x7f88ec0b5710 2021-04-09T18:23:06.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f0ef0700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88ec0b5710 0x7f88ec1838d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f88e400a8f0 tx=0x7f88e400ac90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:06.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88e97fa700 1 -- 172.21.15.120:0/2995929934 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88e40070d0 con 0x7f88ec0b5710 2021-04-09T18:23:06.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88e97fa700 1 -- 172.21.15.120:0/2995929934 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4007410 con 0x7f88ec0b5710 2021-04-09T18:23:06.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec183ef0 con 0x7f88ec0b5710 2021-04-09T18:23:06.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88e97fa700 1 -- 172.21.15.120:0/2995929934 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88e4004720 con 0x7f88ec0b5710 2021-04-09T18:23:06.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.052 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec183ef0 con 0x7f88ec0b5710 2021-04-09T18:23:06.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.053 7f88e97fa700 1 -- 172.21.15.120:0/2995929934 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f88e4004720 con 0x7f88ec0b5710 2021-04-09T18:23:06.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.053 7f88e97fa700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f88d0018930 0x7f88d001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:06.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.053 7f88e97fa700 1 -- 172.21.15.120:0/2995929934 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7f88e4032f90 con 0x7f88ec0b5710 2021-04-09T18:23:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.053 7f88ebfff700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f88d0018930 0x7f88d001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.053 7f88ebfff700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f88d0018930 0x7f88d001ae10 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:06.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.076 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec1829e0 con 0x7f88ec0b5710 2021-04-09T18:23:06.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.079 7f88e97fa700 1 -- 172.21.15.120:0/2995929934 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f88e4007940 con 0x7f88ec0b5710 2021-04-09T18:23:06.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.256 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88ec1829e0 con 0x7f88ec0b5710 2021-04-09T18:23:06.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.256 7f88e97fa700 1 -- 172.21.15.120:0/2995929934 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f88e40073f0 con 0x7f88ec0b5710 2021-04-09T18:23:06.252 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 13 2021-04-09T18:23:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:23:06.253 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:05.777454","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:replay","state_seq":2,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:23:06.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f88d0018930 msgr2=0x7f88d001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:06.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f88d0018930 0x7f88d001ae10 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:06.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88ec0b5710 msgr2=0x7f88ec1838d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:06.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88ec0b5710 0x7f88ec1838d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f88e400a8f0 tx=0x7f88e400ac90).stop 2021-04-09T18:23:06.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 shutdown_connections 2021-04-09T18:23:06.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88ec0b5710 0x7f88ec1838d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:06.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f88d0018930 0x7f88d001ae10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:06.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88ec0a5050 0x7f88ec0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:06.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 --2- 172.21.15.120:0/2995929934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88ec187670 0x7f88ec0a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:06.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.258 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 >> 172.21.15.120:0/2995929934 conn(0x7f88ec18dc90 msgr2=0x7f88ec08fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:06.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.259 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 shutdown_connections 2021-04-09T18:23:06.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:06.259 7f88f28d3700 1 -- 172.21.15.120:0/2995929934 wait complete. 2021-04-09T18:23:06.265 INFO:tasks.mds_thrash.fs.[None]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 13, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-04-09 18:19:55.049244", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 13, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4759": { "addr": "172.21.15.134:6835/3982642658", "addrs": { "addrvec": [ { "addr": "172.21.15.134:6834", "nonce": 3982642658, "type": "v2" }, { "addr": "172.21.15.134:6835", "nonce": 3982642658, "type": "v1" } ] }, "export_targets": [], "features": 4611087854035861503, "flags": 0, "gid": 4759, "incarnation": 13, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 24, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "-1 (unspecified)", "modified": "2021-04-09 18:23:05.777454", "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4759 } } } ], "standbys": [] } 2021-04-09T18:23:08.266 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:23:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.418 7fd170cfc700 1 Processor -- start 2021-04-09T18:23:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.419 7fd170cfc700 1 -- start start 2021-04-09T18:23:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.419 7fd170cfc700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd16c0d7560 0x7fd16c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.419 7fd170cfc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd16c0d63b0 0x7fd16c1ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.419 7fd170cfc700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c0d7960 con 0x7fd16c0d7160 2021-04-09T18:23:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.419 7fd170cfc700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c0d80f0 con 0x7fd16c0d7560 2021-04-09T18:23:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.419 7fd170cfc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0d6be0 con 0x7fd16c0d63b0 2021-04-09T18:23:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.419 7fd16a312700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd16c0d7560 0x7fd16c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:08.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.419 7fd16a312700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd16c0d7560 0x7fd16c0d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54510/0 (socket says 172.21.15.120:54510) 2021-04-09T18:23:08.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.419 7fd16a312700 1 -- 172.21.15.120:0/2624440350 learned_addr learned my addr 172.21.15.120:0/2624440350 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:08.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd16b314700 1 --2- 172.21.15.120:0/2624440350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd16c0d63b0 0x7fd16c1ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:08.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd16a312700 1 -- 172.21.15.120:0/2624440350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd16c0d63b0 msgr2=0x7fd16c1ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:23:08.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd16a312700 1 --2- 172.21.15.120:0/2624440350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd16c0d63b0 0x7fd16c1ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:08.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd16a312700 1 -- 172.21.15.120:0/2624440350 >> v1:172.21.15.134:6789/0 conn(0x7fd16c0d7160 legacy=0x7fd16c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:08.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd169b11700 1 -- 172.21.15.120:0/2624440350 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470789056 0 0) 0x7fd15c000fe0 con 0x7fd16c0d7160 2021-04-09T18:23:08.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd16a312700 1 -- 172.21.15.120:0/2624440350 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c1a2ac0 con 0x7fd16c0d7560 2021-04-09T18:23:08.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd16a312700 1 --2- 172.21.15.120:0/2624440350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c0d7560 0x7fd16c0d5d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fd160006700 tx=0x7fd160009b00).ready entity=mon.0 client_cookie=7fc0830270b1f182 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:08.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd169b11700 1 -- 172.21.15.120:0/2624440350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd16000c0c0 con 0x7fd16c0d7560 2021-04-09T18:23:08.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd169b11700 1 -- 172.21.15.120:0/2624440350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16000c400 con 0x7fd16c0d7560 2021-04-09T18:23:08.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd169b11700 1 -- 172.21.15.120:0/2624440350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd16000c8e0 con 0x7fd16c0d7560 2021-04-09T18:23:08.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd170cfc700 1 -- 172.21.15.120:0/2624440350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c0d7560 msgr2=0x7fd16c0d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:08.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.420 7fd170cfc700 1 --2- 172.21.15.120:0/2624440350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c0d7560 0x7fd16c0d5d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fd160006700 tx=0x7fd160009b00).stop 2021-04-09T18:23:08.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.421 7fd170cfc700 1 -- 172.21.15.120:0/2624440350 shutdown_connections 2021-04-09T18:23:08.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.421 7fd170cfc700 1 --2- 172.21.15.120:0/2624440350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c0d7560 0x7fd16c0d5d90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:08.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.421 7fd170cfc700 1 --2- 172.21.15.120:0/2624440350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd16c0d63b0 0x7fd16c1ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:08.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.421 7fd170cfc700 1 -- 172.21.15.120:0/2624440350 >> 172.21.15.120:0/2624440350 conn(0x7fd16c0d1590 msgr2=0x7fd16c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:08.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.421 7fd170cfc700 1 -- 172.21.15.120:0/2624440350 shutdown_connections 2021-04-09T18:23:08.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.421 7fd170cfc700 1 -- 172.21.15.120:0/2624440350 wait complete. 2021-04-09T18:23:08.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.440 7fd170cfc700 1 Processor -- start 2021-04-09T18:23:08.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.440 7fd170cfc700 1 -- start start 2021-04-09T18:23:08.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.440 7fd170cfc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd16c19e0e0 0x7fd16c19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:08.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.440 7fd170cfc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c182ed0 0x7fd16c181f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:08.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.440 7fd170cfc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd16c1832d0 0x7fd16c0af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:08.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.440 7fd170cfc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c19e4e0 con 0x7fd16c182ed0 2021-04-09T18:23:08.445 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.440 7fd170cfc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c19dd90 con 0x7fd16c1832d0 2021-04-09T18:23:08.446 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.440 7fd170cfc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c182950 con 0x7fd16c19e0e0 2021-04-09T18:23:08.446 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd16a312700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c182ed0 0x7fd16c181f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:08.446 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd16a312700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c182ed0 0x7fd16c181f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54512/0 (socket says 172.21.15.120:54512) 2021-04-09T18:23:08.446 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd16a312700 1 -- 172.21.15.120:0/1572355591 learned_addr learned my addr 172.21.15.120:0/1572355591 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:08.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd16a312700 1 -- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd16c19e0e0 msgr2=0x7fd16c19d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:08.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd16a312700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd16c19e0e0 0x7fd16c19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:23:08.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd16a312700 1 -- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd16c1832d0 msgr2=0x7fd16c0af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:08.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd16a312700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd16c1832d0 0x7fd16c0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:23:08.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd16a312700 1 -- 172.21.15.120:0/1572355591 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c182570 con 0x7fd16c182ed0 2021-04-09T18:23:08.448 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd16a312700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c182ed0 0x7fd16c181f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fd16000b660 tx=0x7fd16000ba00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:08.448 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd15b7fe700 1 -- 172.21.15.120:0/1572355591 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd160009440 con 0x7fd16c182ed0 2021-04-09T18:23:08.448 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd15b7fe700 1 -- 172.21.15.120:0/1572355591 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160006390 con 0x7fd16c182ed0 2021-04-09T18:23:08.448 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd15b7fe700 1 -- 172.21.15.120:0/1572355591 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd160002030 con 0x7fd16c182ed0 2021-04-09T18:23:08.449 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c182570 con 0x7fd16c182ed0 2021-04-09T18:23:08.449 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.441 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c182570 con 0x7fd16c182ed0 2021-04-09T18:23:08.449 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.442 7fd15b7fe700 1 -- 172.21.15.120:0/1572355591 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd1600093e0 con 0x7fd16c182ed0 2021-04-09T18:23:08.449 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.442 7fd15b7fe700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1500188c0 0x7fd15001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:08.449 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.442 7fd15b7fe700 1 -- 172.21.15.120:0/1572355591 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7fd160032a00 con 0x7fd16c182ed0 2021-04-09T18:23:08.450 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.442 7fd16ab13700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1500188c0 0x7fd15001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:08.450 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.442 7fd16ab13700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1500188c0 0x7fd15001adc0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:08.460 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.465 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c179cb0 con 0x7fd16c182ed0 2021-04-09T18:23:08.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.469 7fd15b7fe700 1 -- 172.21.15.120:0/1572355591 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd16002dfe0 con 0x7fd16c182ed0 2021-04-09T18:23:08.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.645 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd16c182570 con 0x7fd16c182ed0 2021-04-09T18:23:08.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.646 7fd15b7fe700 1 -- 172.21.15.120:0/1572355591 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+1771 (secure 0 0 0) 0x7fd16002dfe0 con 0x7fd16c182ed0 2021-04-09T18:23:08.642 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2021-04-09T18:23:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:23:08.642 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:07.845953","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:rejoin","state_seq":32,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:23:08.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.648 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1500188c0 msgr2=0x7fd15001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:08.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.648 7fd170cfc700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1500188c0 0x7fd15001adc0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:08.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.648 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c182ed0 msgr2=0x7fd16c181f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:08.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.648 7fd170cfc700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c182ed0 0x7fd16c181f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fd16000b660 tx=0x7fd16000ba00).stop 2021-04-09T18:23:08.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.648 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 shutdown_connections 2021-04-09T18:23:08.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.649 7fd170cfc700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd16c1832d0 0x7fd16c0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:23:08.645 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.649 7fd170cfc700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd16c182ed0 0x7fd16c181f50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:08.646 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.649 7fd170cfc700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd1500188c0 0x7fd15001adc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:08.646 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.649 7fd170cfc700 1 --2- 172.21.15.120:0/1572355591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd16c19e0e0 0x7fd16c19d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:23:08.646 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.649 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 >> 172.21.15.120:0/1572355591 conn(0x7fd16c184f60 msgr2=0x7fd16c094050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:08.646 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.649 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 shutdown_connections 2021-04-09T18:23:08.647 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:08.649 7fd170cfc700 1 -- 172.21.15.120:0/1572355591 wait complete. 2021-04-09T18:23:08.654 INFO:tasks.mds_thrash.fs.[None]:no change 2021-04-09T18:23:10.655 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:23:10.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.797 7fcdd279c700 1 Processor -- start 2021-04-09T18:23:10.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.797 7fcdd279c700 1 -- start start 2021-04-09T18:23:10.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdd279c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcdcc0d7160 0x7fcdcc0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:10.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdd279c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcdcc0d55a0 0x7fcdcc0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:10.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdd279c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc0d6be0 con 0x7fcdcc0d5fc0 2021-04-09T18:23:10.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdd279c700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0d80f0 con 0x7fcdcc0d7160 2021-04-09T18:23:10.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdd279c700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc1a2ac0 con 0x7fcdcc0d55a0 2021-04-09T18:23:10.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdcbfff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcdcc0d7160 0x7fcdcc0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:10.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdcbfff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcdcc0d7160 0x7fcdcc0d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54550/0 (socket says 172.21.15.120:54550) 2021-04-09T18:23:10.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdcbfff700 1 -- 172.21.15.120:0/1778271950 learned_addr learned my addr 172.21.15.120:0/1778271950 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:10.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdc3fff700 1 --2- 172.21.15.120:0/1778271950 >> v2:172.21.15.134:3300/0 conn(0x7fcdcc0d55a0 0x7fcdcc0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:10.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdcbfff700 1 -- 172.21.15.120:0/1778271950 >> v2:172.21.15.134:3300/0 conn(0x7fcdcc0d55a0 msgr2=0x7fcdcc0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:23:10.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdcbfff700 1 --2- 172.21.15.120:0/1778271950 >> v2:172.21.15.134:3300/0 conn(0x7fcdcc0d55a0 0x7fcdcc0d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:10.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdcbfff700 1 -- 172.21.15.120:0/1778271950 >> v1:172.21.15.134:6789/0 conn(0x7fcdcc0d5fc0 legacy=0x7fcdcc0d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:23:10.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdcbfff700 1 -- 172.21.15.120:0/1778271950 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc1ac1f0 con 0x7fcdcc0d7160 2021-04-09T18:23:10.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdc3fff700 1 --2- 172.21.15.120:0/1778271950 >> v2:172.21.15.134:3300/0 conn(0x7fcdcc0d55a0 0x7fcdcc0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:23:10.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdcbfff700 1 --2- 172.21.15.120:0/1778271950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc0d7160 0x7fcdcc0d7560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fcdbc006700 tx=0x7fcdbc009b80).ready entity=mon.0 client_cookie=c201a465eb9ccd54 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:10.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.798 7fcdcb7fe700 1 -- 172.21.15.120:0/1778271950 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcdbc00c0c0 con 0x7fcdcc0d7160 2021-04-09T18:23:10.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdcb7fe700 1 -- 172.21.15.120:0/1778271950 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc00c440 con 0x7fcdcc0d7160 2021-04-09T18:23:10.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdcb7fe700 1 -- 172.21.15.120:0/1778271950 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcdbc00c920 con 0x7fcdcc0d7160 2021-04-09T18:23:10.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdd279c700 1 -- 172.21.15.120:0/1778271950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc0d7160 msgr2=0x7fcdcc0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:10.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdd279c700 1 --2- 172.21.15.120:0/1778271950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc0d7160 0x7fcdcc0d7560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fcdbc006700 tx=0x7fcdbc009b80).stop 2021-04-09T18:23:10.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdd279c700 1 -- 172.21.15.120:0/1778271950 shutdown_connections 2021-04-09T18:23:10.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdd279c700 1 --2- 172.21.15.120:0/1778271950 >> v2:172.21.15.134:3300/0 conn(0x7fcdcc0d55a0 0x7fcdcc0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:10.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdd279c700 1 --2- 172.21.15.120:0/1778271950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc0d7160 0x7fcdcc0d7560 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:10.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdd279c700 1 -- 172.21.15.120:0/1778271950 >> 172.21.15.120:0/1778271950 conn(0x7fcdcc0d1590 msgr2=0x7fcdcc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:10.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdd279c700 1 -- 172.21.15.120:0/1778271950 shutdown_connections 2021-04-09T18:23:10.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.799 7fcdd279c700 1 -- 172.21.15.120:0/1778271950 wait complete. 2021-04-09T18:23:10.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.818 7fcdd279c700 1 Processor -- start 2021-04-09T18:23:10.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.818 7fcdd279c700 1 -- start start 2021-04-09T18:23:10.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdd279c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc09a210 0x7fcdcc17b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:10.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdd279c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcdcc099820 0x7fcdcc17bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:10.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdd279c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdcc09a610 0x7fcdcc0b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:10.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdd279c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc17c500 con 0x7fcdcc09a210 2021-04-09T18:23:10.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdd279c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc099c90 con 0x7fcdcc09a610 2021-04-09T18:23:10.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdd279c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc183480 con 0x7fcdcc099820 2021-04-09T18:23:10.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdcbfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc09a210 0x7fcdcc17b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:10.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdcbfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc09a210 0x7fcdcc17b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54556/0 (socket says 172.21.15.120:54556) 2021-04-09T18:23:10.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdcbfff700 1 -- 172.21.15.120:0/3046165778 learned_addr learned my addr 172.21.15.120:0/3046165778 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:10.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdd0db9700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdcc09a610 0x7fcdcc0b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:10.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdc3fff700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcdcc099820 0x7fcdcc17bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:10.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdcbfff700 1 -- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcdcc099820 msgr2=0x7fcdcc17bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:10.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdcbfff700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcdcc099820 0x7fcdcc17bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:10.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdcbfff700 1 -- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdcc09a610 msgr2=0x7fcdcc0b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:10.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdcbfff700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdcc09a610 0x7fcdcc0b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:10.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdcbfff700 1 -- 172.21.15.120:0/3046165778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc08e6d0 con 0x7fcdcc09a210 2021-04-09T18:23:10.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdcbfff700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc09a210 0x7fcdcc17b8c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fcdbc00b580 tx=0x7fcdbc00b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:10.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdc97fa700 1 -- 172.21.15.120:0/3046165778 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcdbc00bd10 con 0x7fcdcc09a210 2021-04-09T18:23:10.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdc97fa700 1 -- 172.21.15.120:0/3046165778 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc002030 con 0x7fcdcc09a210 2021-04-09T18:23:10.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc08e6d0 con 0x7fcdcc09a210 2021-04-09T18:23:10.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdc97fa700 1 -- 172.21.15.120:0/3046165778 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcdbc002480 con 0x7fcdcc09a210 2021-04-09T18:23:10.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.819 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc08e6d0 con 0x7fcdcc09a210 2021-04-09T18:23:10.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.820 7fcdc97fa700 1 -- 172.21.15.120:0/3046165778 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fcdbc000c90 con 0x7fcdcc09a210 2021-04-09T18:23:10.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.820 7fcdc97fa700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcdb0018930 0x7fcdb001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:10.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.820 7fcdc97fa700 1 -- 172.21.15.120:0/3046165778 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7fcdbc032c70 con 0x7fcdcc09a210 2021-04-09T18:23:10.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.820 7fcdc3fff700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcdb0018930 0x7fcdb001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:10.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.820 7fcdc3fff700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcdb0018930 0x7fcdb001adc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:10.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.843 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc17a6c0 con 0x7fcdcc09a210 2021-04-09T18:23:10.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:10.847 7fcdc97fa700 1 -- 172.21.15.120:0/3046165778 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fcdbc01f7a0 con 0x7fcdcc09a210 2021-04-09T18:23:11.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.027 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcdcc0d6be0 con 0x7fcdcc09a210 2021-04-09T18:23:11.023 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.028 7fcdc97fa700 1 -- 172.21.15.120:0/3046165778 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1771 (secure 0 0 0) 0x7fcdbc00bd10 con 0x7fcdcc09a210 2021-04-09T18:23:11.023 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2021-04-09T18:23:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:23:11.024 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:23:11.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcdb0018930 msgr2=0x7fcdb001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:11.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcdb0018930 0x7fcdb001adc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:11.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc09a210 msgr2=0x7fcdcc17b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:11.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc09a210 0x7fcdcc17b8c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fcdbc00b580 tx=0x7fcdbc00b920).stop 2021-04-09T18:23:11.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 shutdown_connections 2021-04-09T18:23:11.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdcc09a610 0x7fcdcc0b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:11.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcdb0018930 0x7fcdb001adc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:11.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcdcc099820 0x7fcdcc17bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:11.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 --2- 172.21.15.120:0/3046165778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdcc09a210 0x7fcdcc17b8c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:11.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 >> 172.21.15.120:0/3046165778 conn(0x7fcdcc1859b0 msgr2=0x7fcdcc17e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:11.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 shutdown_connections 2021-04-09T18:23:11.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:11.030 7fcdd279c700 1 -- 172.21.15.120:0/3046165778 wait complete. 2021-04-09T18:23:11.035 INFO:tasks.mds_thrash.fs.[None]:mds.b has gained rank=0, replacing gid=4329 2021-04-09T18:23:11.036 INFO:tasks.mds_thrash.fs.[None]:waiting for 4 secs before reviving mds.a 2021-04-09T18:23:15.037 INFO:tasks.mds_thrash.fs.[None]:reviving mds.a 2021-04-09T18:23:15.037 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:23:15.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:23:15.041 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:23:15.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:23:15.189 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2021-04-09T18:23:15.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.199 7ff022164700 1 Processor -- start 2021-04-09T18:23:15.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.199 7ff022164700 1 -- start start 2021-04-09T18:23:15.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff022164700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff01c0d7160 0x7ff01c0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:15.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff022164700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c0d6190 0x7ff01c0d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:15.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff022164700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c0d6be0 con 0x7ff01c0d55a0 2021-04-09T18:23:15.218 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff022164700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c0d80f0 con 0x7ff01c0d7160 2021-04-09T18:23:15.218 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff022164700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0d0f10 con 0x7ff01c0d6190 2021-04-09T18:23:15.218 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01affd700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff01c0d55a0 0x7ff01c0d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49532/0 (socket says 172.21.15.120:49532) 2021-04-09T18:23:15.218 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01b7fe700 1 --2- 172.21.15.120:0/273432435 >> v2:172.21.15.134:3300/0 conn(0x7ff01c0d7160 0x7ff01c0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:15.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01affd700 1 -- 172.21.15.120:0/273432435 learned_addr learned my addr 172.21.15.120:0/273432435 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:23:15.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01bfff700 1 --2- 172.21.15.120:0/273432435 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c0d6190 0x7ff01c0d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:15.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01a7fc700 1 -- 172.21.15.120:0/273432435 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520647796 0 0) 0x7ff004000ce0 con 0x7ff01c0d55a0 2021-04-09T18:23:15.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01b7fe700 1 -- 172.21.15.120:0/273432435 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c0d6190 msgr2=0x7ff01c0d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:23:15.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01b7fe700 1 --2- 172.21.15.120:0/273432435 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c0d6190 0x7ff01c0d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01b7fe700 1 -- 172.21.15.120:0/273432435 >> v1:172.21.15.120:6789/0 conn(0x7ff01c0d55a0 legacy=0x7ff01c0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:15.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01b7fe700 1 -- 172.21.15.120:0/273432435 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c1a2ac0 con 0x7ff01c0d7160 2021-04-09T18:23:15.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.200 7ff01bfff700 1 --2- 172.21.15.120:0/273432435 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c0d6190 0x7ff01c0d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:23:15.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.201 7ff01b7fe700 1 --2- 172.21.15.120:0/273432435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff01c0d7160 0x7ff01c0d7560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff0140069d0 tx=0x7ff014009e40).ready entity=mon.1 client_cookie=691f57ccecfefc55 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:15.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.201 7ff01a7fc700 1 -- 172.21.15.120:0/273432435 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff01400b510 con 0x7ff01c0d7160 2021-04-09T18:23:15.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.201 7ff01a7fc700 1 -- 172.21.15.120:0/273432435 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400b510 con 0x7ff01c0d7160 2021-04-09T18:23:15.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.201 7ff01a7fc700 1 -- 172.21.15.120:0/273432435 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff01400b890 con 0x7ff01c0d7160 2021-04-09T18:23:15.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.201 7ff022164700 1 -- 172.21.15.120:0/273432435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff01c0d7160 msgr2=0x7ff01c0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:15.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.201 7ff022164700 1 --2- 172.21.15.120:0/273432435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff01c0d7160 0x7ff01c0d7560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff0140069d0 tx=0x7ff014009e40).stop 2021-04-09T18:23:15.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.202 7ff022164700 1 -- 172.21.15.120:0/273432435 shutdown_connections 2021-04-09T18:23:15.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.202 7ff022164700 1 --2- 172.21.15.120:0/273432435 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c0d6190 0x7ff01c0d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.202 7ff022164700 1 --2- 172.21.15.120:0/273432435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff01c0d7160 0x7ff01c0d7560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.202 7ff022164700 1 -- 172.21.15.120:0/273432435 >> 172.21.15.120:0/273432435 conn(0x7ff01c0d1590 msgr2=0x7ff01c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:15.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.202 7ff022164700 1 -- 172.21.15.120:0/273432435 shutdown_connections 2021-04-09T18:23:15.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.202 7ff022164700 1 -- 172.21.15.120:0/273432435 wait complete. 2021-04-09T18:23:15.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.221 7ff022164700 1 Processor -- start 2021-04-09T18:23:15.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff022164700 1 -- start start 2021-04-09T18:23:15.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff022164700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c09ed10 0x7ff01c1913d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:15.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff022164700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff01c1971c0 0x7ff01c192290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:15.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff022164700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff01c1928b0 0x7ff01c0b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:15.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff022164700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c191d90 con 0x7ff01c1971c0 2021-04-09T18:23:15.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff022164700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c1919f0 con 0x7ff01c1928b0 2021-04-09T18:23:15.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff022164700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0b78a0 con 0x7ff01c09ed10 2021-04-09T18:23:15.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff01affd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff01c1971c0 0x7ff01c192290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:15.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff01affd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff01c1971c0 0x7ff01c192290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54624/0 (socket says 172.21.15.120:54624) 2021-04-09T18:23:15.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff01affd700 1 -- 172.21.15.120:0/3415989913 learned_addr learned my addr 172.21.15.120:0/3415989913 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:15.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff01bfff700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff01c1928b0 0x7ff01c0b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:15.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.222 7ff01b7fe700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c09ed10 0x7ff01c1913d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:15.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff01affd700 1 -- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c09ed10 msgr2=0x7ff01c1913d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:15.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff01affd700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c09ed10 0x7ff01c1913d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff01affd700 1 -- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff01c1928b0 msgr2=0x7ff01c0b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:15.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff01affd700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff01c1928b0 0x7ff01c0b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.229 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff01affd700 1 -- 172.21.15.120:0/3415989913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0b7ac0 con 0x7ff01c1971c0 2021-04-09T18:23:15.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff01affd700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff01c1971c0 0x7ff01c192290 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff00400b530 tx=0x7ff00400b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:15.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff013fff700 1 -- 172.21.15.120:0/3415989913 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff004006020 con 0x7ff01c1971c0 2021-04-09T18:23:15.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff013fff700 1 -- 172.21.15.120:0/3415989913 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0040063a0 con 0x7ff01c1971c0 2021-04-09T18:23:15.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff013fff700 1 -- 172.21.15.120:0/3415989913 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff004004590 con 0x7ff01c1971c0 2021-04-09T18:23:15.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff022164700 1 -- 172.21.15.120:0/3415989913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c0b7ac0 con 0x7ff01c1971c0 2021-04-09T18:23:15.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.223 7ff022164700 1 -- 172.21.15.120:0/3415989913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c0b7ac0 con 0x7ff01c1971c0 2021-04-09T18:23:15.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.224 7ff013fff700 1 -- 172.21.15.120:0/3415989913 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff00400a000 con 0x7ff01c1971c0 2021-04-09T18:23:15.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.224 7ff013fff700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff0000188c0 0x7ff00001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:15.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.224 7ff013fff700 1 -- 172.21.15.120:0/3415989913 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7ff00400a000 con 0x7ff01c1971c0 2021-04-09T18:23:15.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.225 7ff01b7fe700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff0000188c0 0x7ff00001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:15.232 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.225 7ff01b7fe700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff0000188c0 0x7ff00001adc0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:15.237 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.242 7ff022164700 1 -- 172.21.15.120:0/3415989913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c1919f0 con 0x7ff01c1971c0 2021-04-09T18:23:15.241 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.246 7ff013fff700 1 -- 172.21.15.120:0/3415989913 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff00400a000 con 0x7ff01c1971c0 2021-04-09T18:23:15.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.423 7ff022164700 1 -- 172.21.15.120:0/3415989913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff01c1919f0 con 0x7ff01c1971c0 2021-04-09T18:23:15.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.423 7ff013fff700 1 -- 172.21.15.120:0/3415989913 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1771 (secure 0 0 0) 0x7ff00400bcc0 con 0x7ff01c1971c0 2021-04-09T18:23:15.419 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2021-04-09T18:23:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:23:15.420 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:23:15.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.425 7ff022164700 1 -- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff0000188c0 msgr2=0x7ff00001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:15.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.425 7ff022164700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff0000188c0 0x7ff00001adc0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.425 7ff022164700 1 -- 172.21.15.120:0/3415989913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff01c1971c0 msgr2=0x7ff01c192290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:15.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.425 7ff022164700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff01c1971c0 0x7ff01c192290 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff00400b530 tx=0x7ff00400b8d0).stop 2021-04-09T18:23:15.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.425 7ff022164700 1 -- 172.21.15.120:0/3415989913 shutdown_connections 2021-04-09T18:23:15.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.426 7ff022164700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff01c1928b0 0x7ff01c0b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.426 7ff022164700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff01c1971c0 0x7ff01c192290 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.426 7ff022164700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff0000188c0 0x7ff00001adc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.426 7ff022164700 1 --2- 172.21.15.120:0/3415989913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff01c09ed10 0x7ff01c1913d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:15.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.426 7ff022164700 1 -- 172.21.15.120:0/3415989913 >> 172.21.15.120:0/3415989913 conn(0x7ff01c18dcd0 msgr2=0x7ff01c187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:15.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.426 7ff022164700 1 -- 172.21.15.120:0/3415989913 shutdown_connections 2021-04-09T18:23:15.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:15.426 7ff022164700 1 -- 172.21.15.120:0/3415989913 wait complete. 2021-04-09T18:23:15.431 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-04-09T18:23:17.432 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:23:17.603 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.580 7fc317611700 1 Processor -- start 2021-04-09T18:23:17.603 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc317611700 1 -- start start 2021-04-09T18:23:17.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc317611700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3100d7160 0x7fc3100e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:17.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc317611700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc3100d7560 0x7fc3100d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:17.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc317611700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc3100d5bc0 0x7fc3100d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:17.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc317611700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3100d80f0 con 0x7fc3100d7560 2021-04-09T18:23:17.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc317611700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3100d6be0 con 0x7fc3100d5bc0 2021-04-09T18:23:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc317611700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100e7f00 con 0x7fc3100d7160 2021-04-09T18:23:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc314c2c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc3100d7560 0x7fc3100d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:17.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc314c2c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc3100d7560 0x7fc3100d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54654/0 (socket says 172.21.15.120:54654) 2021-04-09T18:23:17.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc314c2c700 1 -- 172.21.15.120:0/758012951 learned_addr learned my addr 172.21.15.120:0/758012951 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:17.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc31542d700 1 --2- 172.21.15.120:0/758012951 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3100d7160 0x7fc3100e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:17.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.581 7fc315c2e700 1 --2- 172.21.15.120:0/758012951 >> v2:172.21.15.134:3300/0 conn(0x7fc3100d5bc0 0x7fc3100d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:17.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc314c2c700 1 -- 172.21.15.120:0/758012951 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3100d7160 msgr2=0x7fc3100e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:23:17.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc314c2c700 1 --2- 172.21.15.120:0/758012951 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3100d7160 0x7fc3100e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc314c2c700 1 -- 172.21.15.120:0/758012951 >> v2:172.21.15.134:3300/0 conn(0x7fc3100d5bc0 msgr2=0x7fc3100d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:23:17.610 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc314c2c700 1 --2- 172.21.15.120:0/758012951 >> v2:172.21.15.134:3300/0 conn(0x7fc3100d5bc0 0x7fc3100d5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.610 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc314c2c700 1 -- 172.21.15.120:0/758012951 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3101a2ac0 con 0x7fc3100d7560 2021-04-09T18:23:17.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc314c2c700 1 --2- 172.21.15.120:0/758012951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3100d7560 0x7fc3100d55a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fc300006700 tx=0x7fc300009b00).ready entity=mon.0 client_cookie=fff635eafac6af9e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:17.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc307fff700 1 -- 172.21.15.120:0/758012951 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc30000c0c0 con 0x7fc3100d7560 2021-04-09T18:23:17.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc307fff700 1 -- 172.21.15.120:0/758012951 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30000c400 con 0x7fc3100d7560 2021-04-09T18:23:17.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc307fff700 1 -- 172.21.15.120:0/758012951 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc30000c8e0 con 0x7fc3100d7560 2021-04-09T18:23:17.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc317611700 1 -- 172.21.15.120:0/758012951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3100d7560 msgr2=0x7fc3100d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:17.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.582 7fc317611700 1 --2- 172.21.15.120:0/758012951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3100d7560 0x7fc3100d55a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fc300006700 tx=0x7fc300009b00).stop 2021-04-09T18:23:17.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.583 7fc317611700 1 -- 172.21.15.120:0/758012951 shutdown_connections 2021-04-09T18:23:17.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.583 7fc317611700 1 --2- 172.21.15.120:0/758012951 >> v2:172.21.15.134:3300/0 conn(0x7fc3100d5bc0 0x7fc3100d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.583 7fc317611700 1 --2- 172.21.15.120:0/758012951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3100d7560 0x7fc3100d55a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.583 7fc317611700 1 --2- 172.21.15.120:0/758012951 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3100d7160 0x7fc3100e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.583 7fc317611700 1 -- 172.21.15.120:0/758012951 >> 172.21.15.120:0/758012951 conn(0x7fc3100d1590 msgr2=0x7fc3100d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:17.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.583 7fc317611700 1 -- 172.21.15.120:0/758012951 shutdown_connections 2021-04-09T18:23:17.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.583 7fc317611700 1 -- 172.21.15.120:0/758012951 wait complete. 2021-04-09T18:23:17.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.602 7fc317611700 1 Processor -- start 2021-04-09T18:23:17.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.602 7fc317611700 1 -- start start 2021-04-09T18:23:17.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc317611700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3100b2450 0x7fc31019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:17.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc317611700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc31019dcc0 0x7fc31008cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:17.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc317611700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc31008d5a0 0x7fc3101838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:17.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc317611700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31019c030 con 0x7fc31008d5a0 2021-04-09T18:23:17.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc317611700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31019af80 con 0x7fc3100b2450 2021-04-09T18:23:17.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc317611700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31019b1a0 con 0x7fc31019dcc0 2021-04-09T18:23:17.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc315c2e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc31008d5a0 0x7fc3101838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:17.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc315c2e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc31008d5a0 0x7fc3101838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54664/0 (socket says 172.21.15.120:54664) 2021-04-09T18:23:17.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc315c2e700 1 -- 172.21.15.120:0/2722826814 learned_addr learned my addr 172.21.15.120:0/2722826814 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:17.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc31542d700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3100b2450 0x7fc31019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:17.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc314c2c700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc31019dcc0 0x7fc31008cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:17.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc315c2e700 1 -- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc31019dcc0 msgr2=0x7fc31008cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:17.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc315c2e700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc31019dcc0 0x7fc31008cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc315c2e700 1 -- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3100b2450 msgr2=0x7fc31019ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:17.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc315c2e700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3100b2450 0x7fc31019ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc315c2e700 1 -- 172.21.15.120:0/2722826814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310183ef0 con 0x7fc31008d5a0 2021-04-09T18:23:17.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.603 7fc315c2e700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc31008d5a0 0x7fc3101838d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc308005fd0 tx=0x7fc30800ac50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:17.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.604 7fc305ffb700 1 -- 172.21.15.120:0/2722826814 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc30800c300 con 0x7fc31008d5a0 2021-04-09T18:23:17.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.604 7fc305ffb700 1 -- 172.21.15.120:0/2722826814 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308003030 con 0x7fc31008d5a0 2021-04-09T18:23:17.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.604 7fc317611700 1 -- 172.21.15.120:0/2722826814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc310183ef0 con 0x7fc31008d5a0 2021-04-09T18:23:17.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.604 7fc305ffb700 1 -- 172.21.15.120:0/2722826814 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc30800c7b0 con 0x7fc31008d5a0 2021-04-09T18:23:17.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.604 7fc317611700 1 -- 172.21.15.120:0/2722826814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc310183ef0 con 0x7fc31008d5a0 2021-04-09T18:23:17.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.604 7fc305ffb700 1 -- 172.21.15.120:0/2722826814 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc3080011f0 con 0x7fc31008d5a0 2021-04-09T18:23:17.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.604 7fc305ffb700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc2f0018930 0x7fc2f001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:17.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.604 7fc305ffb700 1 -- 172.21.15.120:0/2722826814 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7fc308032fb0 con 0x7fc31008d5a0 2021-04-09T18:23:17.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.604 7fc31542d700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc2f0018930 0x7fc2f001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:17.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.605 7fc31542d700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc2f0018930 0x7fc2f001ae10 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:17.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.627 7fc317611700 1 -- 172.21.15.120:0/2722826814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3101829c0 con 0x7fc31008d5a0 2021-04-09T18:23:17.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.630 7fc305ffb700 1 -- 172.21.15.120:0/2722826814 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc30800ad90 con 0x7fc31008d5a0 2021-04-09T18:23:17.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.826 7fc317611700 1 -- 172.21.15.120:0/2722826814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3101829c0 con 0x7fc31008d5a0 2021-04-09T18:23:17.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.827 7fc305ffb700 1 -- 172.21.15.120:0/2722826814 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1771 (secure 0 0 0) 0x7fc3080011f0 con 0x7fc31008d5a0 2021-04-09T18:23:17.824 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2021-04-09T18:23:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:23:17.825 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:23:17.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.829 7fc317611700 1 -- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc2f0018930 msgr2=0x7fc2f001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:17.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.829 7fc317611700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc2f0018930 0x7fc2f001ae10 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.829 7fc317611700 1 -- 172.21.15.120:0/2722826814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc31008d5a0 msgr2=0x7fc3101838d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:17.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.829 7fc317611700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc31008d5a0 0x7fc3101838d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc308005fd0 tx=0x7fc30800ac50).stop 2021-04-09T18:23:17.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.830 7fc317611700 1 -- 172.21.15.120:0/2722826814 shutdown_connections 2021-04-09T18:23:17.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.830 7fc317611700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc31008d5a0 0x7fc3101838d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.830 7fc317611700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc2f0018930 0x7fc2f001ae10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.830 7fc317611700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc31019dcc0 0x7fc31008cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.830 7fc317611700 1 --2- 172.21.15.120:0/2722826814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3100b2450 0x7fc31019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:17.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.830 7fc317611700 1 -- 172.21.15.120:0/2722826814 >> 172.21.15.120:0/2722826814 conn(0x7fc31018dc90 msgr2=0x7fc310186cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:17.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.830 7fc317611700 1 -- 172.21.15.120:0/2722826814 shutdown_connections 2021-04-09T18:23:17.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:17.830 7fc317611700 1 -- 172.21.15.120:0/2722826814 wait complete. 2021-04-09T18:23:17.835 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-04-09T18:23:19.837 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:23:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.981 7f6400fad700 1 Processor -- start 2021-04-09T18:23:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.981 7f6400fad700 1 -- start start 2021-04-09T18:23:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.981 7f6400fad700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc0d7160 0x7f63fc0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:19.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.981 7f6400fad700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63fc0d7560 0x7f63fc0d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:19.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.981 7f6400fad700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f63fc0d5bc0 0x7f63fc0d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:19.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.981 7f6400fad700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc0d80f0 con 0x7f63fc0d5bc0 2021-04-09T18:23:19.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.981 7f6400fad700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc0d6be0 con 0x7f63fc0d7560 2021-04-09T18:23:19.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.981 7f6400fad700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0e7f00 con 0x7f63fc0d7160 2021-04-09T18:23:19.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fb59e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f63fc0d5bc0 0x7f63fc0d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:19.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fb59e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f63fc0d5bc0 0x7f63fc0d5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54694/0 (socket says 172.21.15.120:54694) 2021-04-09T18:23:19.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fb59e700 1 -- 172.21.15.120:0/993314728 learned_addr learned my addr 172.21.15.120:0/993314728 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:20.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fa59c700 1 --2- 172.21.15.120:0/993314728 >> v2:172.21.15.134:3300/0 conn(0x7f63fc0d7560 0x7f63fc0d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:20.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fad9d700 1 --2- 172.21.15.120:0/993314728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc0d7160 0x7f63fc0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:20.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fb59e700 1 -- 172.21.15.120:0/993314728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc0d7160 msgr2=0x7f63fc0e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:23:20.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fb59e700 1 --2- 172.21.15.120:0/993314728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc0d7160 0x7f63fc0e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fb59e700 1 -- 172.21.15.120:0/993314728 >> v2:172.21.15.134:3300/0 conn(0x7f63fc0d7560 msgr2=0x7f63fc0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:23:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fb59e700 1 --2- 172.21.15.120:0/993314728 >> v2:172.21.15.134:3300/0 conn(0x7f63fc0d7560 0x7f63fc0d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fb59e700 1 -- 172.21.15.120:0/993314728 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc1a2ac0 con 0x7f63fc0d5bc0 2021-04-09T18:23:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fad9d700 1 --2- 172.21.15.120:0/993314728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc0d7160 0x7f63fc0e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:23:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fa59c700 1 --2- 172.21.15.120:0/993314728 >> v2:172.21.15.134:3300/0 conn(0x7f63fc0d7560 0x7f63fc0d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:23:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63fb59e700 1 --2- 172.21.15.120:0/993314728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc0d5bc0 0x7f63fc0d5fc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f63f4006f00 tx=0x7f63f4009f10).ready entity=mon.0 client_cookie=ce04dd8d0aca9592 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63f9d9b700 1 -- 172.21.15.120:0/993314728 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63f400b3b0 con 0x7f63fc0d5bc0 2021-04-09T18:23:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63f9d9b700 1 -- 172.21.15.120:0/993314728 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f400b730 con 0x7f63fc0d5bc0 2021-04-09T18:23:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f63f9d9b700 1 -- 172.21.15.120:0/993314728 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63f400bc10 con 0x7f63fc0d5bc0 2021-04-09T18:23:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f6400fad700 1 -- 172.21.15.120:0/993314728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc0d5bc0 msgr2=0x7f63fc0d5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.982 7f6400fad700 1 --2- 172.21.15.120:0/993314728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc0d5bc0 0x7f63fc0d5fc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f63f4006f00 tx=0x7f63f4009f10).stop 2021-04-09T18:23:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.983 7f6400fad700 1 -- 172.21.15.120:0/993314728 shutdown_connections 2021-04-09T18:23:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.983 7f6400fad700 1 --2- 172.21.15.120:0/993314728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc0d5bc0 0x7f63fc0d5fc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.983 7f6400fad700 1 --2- 172.21.15.120:0/993314728 >> v2:172.21.15.134:3300/0 conn(0x7f63fc0d7560 0x7f63fc0d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.983 7f6400fad700 1 --2- 172.21.15.120:0/993314728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc0d7160 0x7f63fc0e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.983 7f6400fad700 1 -- 172.21.15.120:0/993314728 >> 172.21.15.120:0/993314728 conn(0x7f63fc0d1590 msgr2=0x7f63fc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:20.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.983 7f6400fad700 1 -- 172.21.15.120:0/993314728 shutdown_connections 2021-04-09T18:23:20.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:19.983 7f6400fad700 1 -- 172.21.15.120:0/993314728 wait complete. 2021-04-09T18:23:20.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f6400fad700 1 Processor -- start 2021-04-09T18:23:20.005 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f6400fad700 1 -- start start 2021-04-09T18:23:20.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f6400fad700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc187380 0x7f63fc189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:20.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f6400fad700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc187780 0x7f63fc0987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:20.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f6400fad700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63fc189c50 0x7f63fc0b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:20.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f6400fad700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc18ce60 con 0x7f63fc187380 2021-04-09T18:23:20.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f6400fad700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc098e10 con 0x7f63fc189c50 2021-04-09T18:23:20.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f6400fad700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc099030 con 0x7f63fc187780 2021-04-09T18:23:20.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f63fad9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc187380 0x7f63fc189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:20.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f63fad9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc187380 0x7f63fc189630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54698/0 (socket says 172.21.15.120:54698) 2021-04-09T18:23:20.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.002 7f63fad9d700 1 -- 172.21.15.120:0/3345521526 learned_addr learned my addr 172.21.15.120:0/3345521526 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:23:20.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fa59c700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc187780 0x7f63fc0987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:20.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fb59e700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63fc189c50 0x7f63fc0b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:20.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fad9d700 1 -- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc187780 msgr2=0x7f63fc0987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:20.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fad9d700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc187780 0x7f63fc0987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fad9d700 1 -- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63fc189c50 msgr2=0x7f63fc0b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:20.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fad9d700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63fc189c50 0x7f63fc0b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fad9d700 1 -- 172.21.15.120:0/3345521526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc0b8b30 con 0x7f63fc187380 2021-04-09T18:23:20.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fa59c700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc187780 0x7f63fc0987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:23:20.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fb59e700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63fc189c50 0x7f63fc0b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:23:20.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63fad9d700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc187380 0x7f63fc189630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f63f0006f20 tx=0x7f63f000b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:20.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63eb7fe700 1 -- 172.21.15.120:0/3345521526 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63f0006bb0 con 0x7f63fc187380 2021-04-09T18:23:20.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63eb7fe700 1 -- 172.21.15.120:0/3345521526 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f000bd80 con 0x7f63fc187380 2021-04-09T18:23:20.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f63eb7fe700 1 -- 172.21.15.120:0/3345521526 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63f0002220 con 0x7f63fc187380 2021-04-09T18:23:20.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f6400fad700 1 -- 172.21.15.120:0/3345521526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc0b8b30 con 0x7f63fc187380 2021-04-09T18:23:20.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.003 7f6400fad700 1 -- 172.21.15.120:0/3345521526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc0b90c0 con 0x7f63fc187380 2021-04-09T18:23:20.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.004 7f63eb7fe700 1 -- 172.21.15.120:0/3345521526 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f63f000a000 con 0x7f63fc187380 2021-04-09T18:23:20.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.004 7f63eb7fe700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f63e00188c0 0x7f63e001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:23:20.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.004 7f63eb7fe700 1 -- 172.21.15.120:0/3345521526 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7f63f00329f0 con 0x7f63fc187380 2021-04-09T18:23:20.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.004 7f63fa59c700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f63e00188c0 0x7f63e001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:23:20.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.004 7f63fa59c700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f63e00188c0 0x7f63e001adc0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:23:20.022 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.027 7f6400fad700 1 -- 172.21.15.120:0/3345521526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc189100 con 0x7f63fc187380 2021-04-09T18:23:20.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.031 7f63eb7fe700 1 -- 172.21.15.120:0/3345521526 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f63f0000940 con 0x7f63fc187380 2021-04-09T18:23:20.207 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.212 7f6400fad700 1 -- 172.21.15.120:0/3345521526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63fc189100 con 0x7f63fc187380 2021-04-09T18:23:20.208 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.212 7f63eb7fe700 1 -- 172.21.15.120:0/3345521526 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f63f000a000 con 0x7f63fc187380 2021-04-09T18:23:20.208 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2021-04-09T18:23:20.208 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:23:20.209 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:23:20.210 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 -- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f63e00188c0 msgr2=0x7f63e001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:20.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f63e00188c0 0x7f63e001adc0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 -- 172.21.15.120:0/3345521526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc187380 msgr2=0x7f63fc189630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:23:20.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc187380 0x7f63fc189630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f63f0006f20 tx=0x7f63f000b990).stop 2021-04-09T18:23:20.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 -- 172.21.15.120:0/3345521526 shutdown_connections 2021-04-09T18:23:20.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63fc189c50 0x7f63fc0b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f63e00188c0 0x7f63e001adc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63fc187780 0x7f63fc0987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 --2- 172.21.15.120:0/3345521526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63fc187380 0x7f63fc189630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:23:20.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 -- 172.21.15.120:0/3345521526 >> 172.21.15.120:0/3345521526 conn(0x7f63fc18dc90 msgr2=0x7f63fc08fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:23:20.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 -- 172.21.15.120:0/3345521526 shutdown_connections 2021-04-09T18:23:20.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:23:20.215 7f6400fad700 1 -- 172.21.15.120:0/3345521526 wait complete. 2021-04-09T18:23:20.220 INFO:tasks.mds_thrash.fs.[None]:mds.a reported in up:standby state 2021-04-09T18:23:20.220 INFO:tasks.mds_thrash.fs.[None]:waiting for 92 secs before thrashing 2021-04-09T18:23:24.930 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:23:24.934 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:23:55.970 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:23:55.973 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:24:27.435 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:24:27.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:24:52.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:24:52.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.376 7f1f02fd0700 1 Processor -- start 2021-04-09T18:24:52.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.376 7f1f02fd0700 1 -- start start 2021-04-09T18:24:52.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1f02fd0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1efc0d7160 0x7f1efc0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1f02fd0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc0d6190 0x7f1efc0d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1f02fd0700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0d6be0 con 0x7f1efc0d55a0 2021-04-09T18:24:52.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1f02fd0700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1efc0d80f0 con 0x7f1efc0d7160 2021-04-09T18:24:52.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1f02fd0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc1a2ac0 con 0x7f1efc0d6190 2021-04-09T18:24:52.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1f00dec700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1efc0d7160 0x7f1efc0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1efbfff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1efc0d55a0 0x7f1efc0d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50470/0 (socket says 172.21.15.120:50470) 2021-04-09T18:24:52.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1efbfff700 1 -- 172.21.15.120:0/1892466073 learned_addr learned my addr 172.21.15.120:0/1892466073 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:24:52.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1f015ed700 1 --2- 172.21.15.120:0/1892466073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc0d6190 0x7f1efc0d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1efb7fe700 1 -- 172.21.15.120:0/1892466073 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167360404 0 0) 0x7f1eec000ce0 con 0x7f1efc0d55a0 2021-04-09T18:24:52.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.377 7f1efb7fe700 1 -- 172.21.15.120:0/1892466073 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee8002fe0 con 0x7f1efc0d55a0 2021-04-09T18:24:52.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1f00dec700 1 -- 172.21.15.120:0/1892466073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc0d6190 msgr2=0x7f1efc0d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:24:52.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1f00dec700 1 --2- 172.21.15.120:0/1892466073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc0d6190 0x7f1efc0d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1f00dec700 1 -- 172.21.15.120:0/1892466073 >> v1:172.21.15.120:6789/0 conn(0x7f1efc0d55a0 legacy=0x7f1efc0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1f00dec700 1 -- 172.21.15.120:0/1892466073 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc1a2cb0 con 0x7f1efc0d7160 2021-04-09T18:24:52.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1f015ed700 1 --2- 172.21.15.120:0/1892466073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc0d6190 0x7f1efc0d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:24:52.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1f00dec700 1 --2- 172.21.15.120:0/1892466073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc0d7160 0x7f1efc0d7560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1ee4006650 tx=0x7f1ee4009a80).ready entity=mon.0 client_cookie=4c5f495fd618aab0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:52.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1efb7fe700 1 -- 172.21.15.120:0/1892466073 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ee40009b0 con 0x7f1efc0d7160 2021-04-09T18:24:52.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1efb7fe700 1 -- 172.21.15.120:0/1892466073 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee400c0c0 con 0x7f1efc0d7160 2021-04-09T18:24:52.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1efb7fe700 1 -- 172.21.15.120:0/1892466073 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ee400c510 con 0x7f1efc0d7160 2021-04-09T18:24:52.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1f02fd0700 1 -- 172.21.15.120:0/1892466073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc0d7160 msgr2=0x7f1efc0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.378 7f1f02fd0700 1 --2- 172.21.15.120:0/1892466073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc0d7160 0x7f1efc0d7560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1ee4006650 tx=0x7f1ee4009a80).stop 2021-04-09T18:24:52.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.379 7f1f02fd0700 1 -- 172.21.15.120:0/1892466073 shutdown_connections 2021-04-09T18:24:52.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.379 7f1f02fd0700 1 --2- 172.21.15.120:0/1892466073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc0d6190 0x7f1efc0d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.379 7f1f02fd0700 1 --2- 172.21.15.120:0/1892466073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc0d7160 0x7f1efc0d7560 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.379 7f1f02fd0700 1 -- 172.21.15.120:0/1892466073 >> 172.21.15.120:0/1892466073 conn(0x7f1efc0d1590 msgr2=0x7f1efc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:24:52.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.379 7f1f02fd0700 1 -- 172.21.15.120:0/1892466073 shutdown_connections 2021-04-09T18:24:52.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.379 7f1f02fd0700 1 -- 172.21.15.120:0/1892466073 wait complete. 2021-04-09T18:24:52.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.400 7f1f02fd0700 1 Processor -- start 2021-04-09T18:24:52.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.400 7f1f02fd0700 1 -- start start 2021-04-09T18:24:52.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.400 7f1f02fd0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1efc095ef0 0x7f1efc0b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.400 7f1f02fd0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc099c40 0x7f1efc0985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.400 7f1f02fd0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc098c10 0x7f1efc099010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.400 7f1f02fd0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0996c0 con 0x7f1efc098c10 2021-04-09T18:24:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.400 7f1f02fd0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc09a260 con 0x7f1efc095ef0 2021-04-09T18:24:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.400 7f1f02fd0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0b8b50 con 0x7f1efc099c40 2021-04-09T18:24:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f015ed700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc098c10 0x7f1efc099010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f015ed700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc098c10 0x7f1efc099010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55568/0 (socket says 172.21.15.120:55568) 2021-04-09T18:24:52.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f015ed700 1 -- 172.21.15.120:0/2788942037 learned_addr learned my addr 172.21.15.120:0/2788942037 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:24:52.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1efbfff700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc099c40 0x7f1efc0985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f00dec700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1efc095ef0 0x7f1efc0b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f015ed700 1 -- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc099c40 msgr2=0x7f1efc0985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f015ed700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc099c40 0x7f1efc0985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f015ed700 1 -- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1efc095ef0 msgr2=0x7f1efc0b8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f015ed700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1efc095ef0 0x7f1efc0b8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f015ed700 1 -- 172.21.15.120:0/2788942037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0c0240 con 0x7f1efc098c10 2021-04-09T18:24:52.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f015ed700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc098c10 0x7f1efc099010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f1ef400b910 tx=0x7f1ef400bcb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:52.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1ef97fa700 1 -- 172.21.15.120:0/2788942037 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ef4006aa0 con 0x7f1efc098c10 2021-04-09T18:24:52.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1ef97fa700 1 -- 172.21.15.120:0/2788942037 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef40011f0 con 0x7f1efc098c10 2021-04-09T18:24:52.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1ef97fa700 1 -- 172.21.15.120:0/2788942037 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ef4001640 con 0x7f1efc098c10 2021-04-09T18:24:52.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc0c0240 con 0x7f1efc098c10 2021-04-09T18:24:52.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.401 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc0c0240 con 0x7f1efc098c10 2021-04-09T18:24:52.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.402 7f1ef97fa700 1 -- 172.21.15.120:0/2788942037 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1ef40013d0 con 0x7f1efc098c10 2021-04-09T18:24:52.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.402 7f1ef97fa700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ee0018930 0x7f1ee001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.402 7f1ef97fa700 1 -- 172.21.15.120:0/2788942037 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7f1ef4032fe0 con 0x7f1efc098c10 2021-04-09T18:24:52.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.402 7f1f00dec700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ee0018930 0x7f1ee001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.403 7f1f00dec700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ee0018930 0x7f1ee001ae10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:52.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.422 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc179f80 con 0x7f1efc098c10 2021-04-09T18:24:52.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.425 7f1ef97fa700 1 -- 172.21.15.120:0/2788942037 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1ef400bdf0 con 0x7f1efc098c10 2021-04-09T18:24:52.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.619 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1efc17a2b0 con 0x7f1efc098c10 2021-04-09T18:24:52.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.619 7f1ef97fa700 1 -- 172.21.15.120:0/2788942037 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f1ef40011f0 con 0x7f1efc098c10 2021-04-09T18:24:52.614 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2021-04-09T18:24:52.614 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:24:52.614 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:24:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ee0018930 msgr2=0x7f1ee001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ee0018930 0x7f1ee001ae10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc098c10 msgr2=0x7f1efc099010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc098c10 0x7f1efc099010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f1ef400b910 tx=0x7f1ef400bcb0).stop 2021-04-09T18:24:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 shutdown_connections 2021-04-09T18:24:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1efc098c10 0x7f1efc099010 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ee0018930 0x7f1ee001ae10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1efc099c40 0x7f1efc0985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 --2- 172.21.15.120:0/2788942037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1efc095ef0 0x7f1efc0b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 >> 172.21.15.120:0/2788942037 conn(0x7f1efc09f080 msgr2=0x7f1efc19b260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:24:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 shutdown_connections 2021-04-09T18:24:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.622 7f1f02fd0700 1 -- 172.21.15.120:0/2788942037 wait complete. 2021-04-09T18:24:52.625 INFO:tasks.mds_thrash.fs.[None]:kill mds.b (rank=0) 2021-04-09T18:24:52.626 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:24:52.626 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:24:52.637 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:24:52.638 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:24:52.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.785 7f31ee116700 1 Processor -- start 2021-04-09T18:24:52.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.785 7f31ee116700 1 -- start start 2021-04-09T18:24:52.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.785 7f31ee116700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e80d7160 0x7f31e80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.785 7f31ee116700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31e80e70a0 0x7f31e80d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31ee116700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80d6be0 con 0x7f31e80d7560 2021-04-09T18:24:52.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31ee116700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80d80f0 con 0x7f31e80e70a0 2021-04-09T18:24:52.801 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31ee116700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80e7f00 con 0x7f31e80d7160 2021-04-09T18:24:52.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e77fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e80d7160 0x7f31e80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e6ffd700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f31e80d7560 0x7f31e80d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:45316/0 (socket says 172.21.15.120:45316) 2021-04-09T18:24:52.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e6ffd700 1 -- 172.21.15.120:0/2690070851 learned_addr learned my addr 172.21.15.120:0/2690070851 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:24:52.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e7fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31e80e70a0 0x7f31e80d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e77fe700 1 -- 172.21.15.120:0/2690070851 >> v2:172.21.15.134:3300/0 conn(0x7f31e80e70a0 msgr2=0x7f31e80d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:24:52.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e77fe700 1 --2- 172.21.15.120:0/2690070851 >> v2:172.21.15.134:3300/0 conn(0x7f31e80e70a0 0x7f31e80d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e77fe700 1 -- 172.21.15.120:0/2690070851 >> v1:172.21.15.134:6789/0 conn(0x7f31e80d7560 legacy=0x7f31e80d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e77fe700 1 -- 172.21.15.120:0/2690070851 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e81a2ac0 con 0x7f31e80d7160 2021-04-09T18:24:52.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e67fc700 1 -- 172.21.15.120:0/2690070851 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660661300 0 0) 0x7f31d80009b0 con 0x7f31e80d7560 2021-04-09T18:24:52.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e7fff700 1 --2- 172.21.15.120:0/2690070851 >> v2:172.21.15.134:3300/0 conn(0x7f31e80e70a0 0x7f31e80d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:24:52.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e77fe700 1 --2- 172.21.15.120:0/2690070851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e80d7160 0x7f31e80e78e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f31d00069d0 tx=0x7f31d0009e40).ready entity=mon.2 client_cookie=454aa9b13c6bedd6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:52.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e67fc700 1 -- 172.21.15.120:0/2690070851 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31d000b510 con 0x7f31e80d7160 2021-04-09T18:24:52.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e67fc700 1 -- 172.21.15.120:0/2690070851 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d000b890 con 0x7f31e80d7160 2021-04-09T18:24:52.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31e67fc700 1 -- 172.21.15.120:0/2690070851 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31d000bd70 con 0x7f31e80d7160 2021-04-09T18:24:52.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31ee116700 1 -- 172.21.15.120:0/2690070851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e80d7160 msgr2=0x7f31e80e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.786 7f31ee116700 1 --2- 172.21.15.120:0/2690070851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e80d7160 0x7f31e80e78e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f31d00069d0 tx=0x7f31d0009e40).stop 2021-04-09T18:24:52.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.787 7f31ee116700 1 -- 172.21.15.120:0/2690070851 shutdown_connections 2021-04-09T18:24:52.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.787 7f31ee116700 1 --2- 172.21.15.120:0/2690070851 >> v2:172.21.15.134:3300/0 conn(0x7f31e80e70a0 0x7f31e80d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.787 7f31ee116700 1 --2- 172.21.15.120:0/2690070851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e80d7160 0x7f31e80e78e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.787 7f31ee116700 1 -- 172.21.15.120:0/2690070851 >> 172.21.15.120:0/2690070851 conn(0x7f31e80d1590 msgr2=0x7f31e80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:24:52.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.787 7f31ee116700 1 -- 172.21.15.120:0/2690070851 shutdown_connections 2021-04-09T18:24:52.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.787 7f31ee116700 1 -- 172.21.15.120:0/2690070851 wait complete. 2021-04-09T18:24:52.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.806 7f31ee116700 1 Processor -- start 2021-04-09T18:24:52.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.806 7f31ee116700 1 -- start start 2021-04-09T18:24:52.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31ee116700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e808aca0 0x7f31e817ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31ee116700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e808b0a0 0x7f31e8095890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31ee116700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31e817f0b0 0x7f31e80aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31ee116700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e808b690 con 0x7f31e808aca0 2021-04-09T18:24:52.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31ee116700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e808b910 con 0x7f31e817f0b0 2021-04-09T18:24:52.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31ee116700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8095eb0 con 0x7f31e808b0a0 2021-04-09T18:24:52.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e77fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e808aca0 0x7f31e817ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e77fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e808aca0 0x7f31e817ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55592/0 (socket says 172.21.15.120:55592) 2021-04-09T18:24:52.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e77fe700 1 -- 172.21.15.120:0/1210515678 learned_addr learned my addr 172.21.15.120:0/1210515678 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:24:52.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e6ffd700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e808b0a0 0x7f31e8095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e7fff700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31e817f0b0 0x7f31e80aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e77fe700 1 -- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e808b0a0 msgr2=0x7f31e8095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e77fe700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e808b0a0 0x7f31e8095890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e77fe700 1 -- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31e817f0b0 msgr2=0x7f31e80aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:52.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e77fe700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31e817f0b0 0x7f31e80aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:52.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e77fe700 1 -- 172.21.15.120:0/1210515678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80960d0 con 0x7f31e808aca0 2021-04-09T18:24:52.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31e77fe700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e808aca0 0x7f31e817ea90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f31d0009f40 tx=0x7f31d000bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:52.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31dffff700 1 -- 172.21.15.120:0/1210515678 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31d000c2f0 con 0x7f31e808aca0 2021-04-09T18:24:52.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31dffff700 1 -- 172.21.15.120:0/1210515678 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d000c5f0 con 0x7f31e808aca0 2021-04-09T18:24:52.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31ee116700 1 -- 172.21.15.120:0/1210515678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e80960d0 con 0x7f31e808aca0 2021-04-09T18:24:52.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31dffff700 1 -- 172.21.15.120:0/1210515678 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31d000cad0 con 0x7f31e808aca0 2021-04-09T18:24:52.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.807 7f31ee116700 1 -- 172.21.15.120:0/1210515678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e80960d0 con 0x7f31e808aca0 2021-04-09T18:24:52.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.808 7f31dffff700 1 -- 172.21.15.120:0/1210515678 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f31d000c2f0 con 0x7f31e808aca0 2021-04-09T18:24:52.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.808 7f31dffff700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f31cc018930 0x7f31cc01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:52.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.808 7f31dffff700 1 -- 172.21.15.120:0/1210515678 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7f31d0032fa0 con 0x7f31e808aca0 2021-04-09T18:24:52.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.808 7f31e6ffd700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f31cc018930 0x7f31cc01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:52.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.809 7f31e6ffd700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f31cc018930 0x7f31cc01ae10 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:52.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.831 7f31ee116700 1 -- 172.21.15.120:0/1210515678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e80e48e0 con 0x7f31e808aca0 2021-04-09T18:24:52.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:52.835 7f31dffff700 1 -- 172.21.15.120:0/1210515678 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f31d000be10 con 0x7f31e808aca0 2021-04-09T18:24:53.007 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.014 7f31ee116700 1 -- 172.21.15.120:0/1210515678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31e80e48e0 con 0x7f31e808aca0 2021-04-09T18:24:53.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.014 7f31dffff700 1 -- 172.21.15.120:0/1210515678 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f31d000c2f0 con 0x7f31e808aca0 2021-04-09T18:24:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:24:53.009 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:24:53.009 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2021-04-09T18:24:53.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.016 7f31ee116700 1 -- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f31cc018930 msgr2=0x7f31cc01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:53.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.016 7f31ee116700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f31cc018930 0x7f31cc01ae10 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:53.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.016 7f31ee116700 1 -- 172.21.15.120:0/1210515678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e808aca0 msgr2=0x7f31e817ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:53.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.016 7f31ee116700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e808aca0 0x7f31e817ea90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f31d0009f40 tx=0x7f31d000bcd0).stop 2021-04-09T18:24:53.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.017 7f31ee116700 1 -- 172.21.15.120:0/1210515678 shutdown_connections 2021-04-09T18:24:53.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.017 7f31ee116700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31e817f0b0 0x7f31e80aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:53.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.017 7f31ee116700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f31cc018930 0x7f31cc01ae10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:53.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.017 7f31ee116700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f31e808b0a0 0x7f31e8095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:53.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.017 7f31ee116700 1 --2- 172.21.15.120:0/1210515678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31e808aca0 0x7f31e817ea90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:53.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.017 7f31ee116700 1 -- 172.21.15.120:0/1210515678 >> 172.21.15.120:0/1210515678 conn(0x7f31e81993c0 msgr2=0x7f31e8199820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:24:53.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.017 7f31ee116700 1 -- 172.21.15.120:0/1210515678 shutdown_connections 2021-04-09T18:24:53.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:53.017 7f31ee116700 1 -- 172.21.15.120:0/1210515678 wait complete. 2021-04-09T18:24:53.020 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:24:55.021 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:24:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.177 7f6a42d66700 1 Processor -- start 2021-04-09T18:24:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.177 7f6a42d66700 1 -- start start 2021-04-09T18:24:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a42d66700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6a3c0d7160 0x7f6a3c0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a42d66700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c0d6be0 con 0x7f6a3c0d55a0 2021-04-09T18:24:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a42d66700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c1a2ac0 con 0x7f6a3c0d6190 2021-04-09T18:24:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a42d66700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c1a2ce0 con 0x7f6a3c0d7160 2021-04-09T18:24:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a40b82700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6a3c0d7160 0x7f6a3c0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a3bfff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6a3c0d55a0 0x7f6a3c0d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50516/0 (socket says 172.21.15.120:50516) 2021-04-09T18:24:55.194 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a3bfff700 1 -- 172.21.15.120:0/1935800172 learned_addr learned my addr 172.21.15.120:0/1935800172 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:24:55.194 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a40b82700 1 -- 172.21.15.120:0/1935800172 >> v1:172.21.15.134:6789/0 conn(0x7f6a3c0d6190 legacy=0x7f6a3c1ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:24:55.194 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a40b82700 1 -- 172.21.15.120:0/1935800172 >> v1:172.21.15.120:6789/0 conn(0x7f6a3c0d55a0 legacy=0x7f6a3c0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a3b7fe700 1 -- 172.21.15.120:0/1935800172 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821522096 0 0) 0x7f6a2c001060 con 0x7f6a3c0d55a0 2021-04-09T18:24:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.178 7f6a40b82700 1 -- 172.21.15.120:0/1935800172 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0d6590 con 0x7f6a3c0d7160 2021-04-09T18:24:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.179 7f6a40b82700 1 --2- 172.21.15.120:0/1935800172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c0d7160 0x7f6a3c0d7560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6a24006650 tx=0x7f6a24009a80).ready entity=mon.0 client_cookie=4878771c97c754ac server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.179 7f6a3b7fe700 1 -- 172.21.15.120:0/1935800172 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a240009b0 con 0x7f6a3c0d7160 2021-04-09T18:24:55.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.179 7f6a3b7fe700 1 -- 172.21.15.120:0/1935800172 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2400c0c0 con 0x7f6a3c0d7160 2021-04-09T18:24:55.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.179 7f6a3b7fe700 1 -- 172.21.15.120:0/1935800172 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a2400c510 con 0x7f6a3c0d7160 2021-04-09T18:24:55.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.179 7f6a42d66700 1 -- 172.21.15.120:0/1935800172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c0d7160 msgr2=0x7f6a3c0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:55.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.179 7f6a42d66700 1 --2- 172.21.15.120:0/1935800172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c0d7160 0x7f6a3c0d7560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6a24006650 tx=0x7f6a24009a80).stop 2021-04-09T18:24:55.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.179 7f6a42d66700 1 -- 172.21.15.120:0/1935800172 shutdown_connections 2021-04-09T18:24:55.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.179 7f6a42d66700 1 --2- 172.21.15.120:0/1935800172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c0d7160 0x7f6a3c0d7560 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:55.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.179 7f6a42d66700 1 -- 172.21.15.120:0/1935800172 >> 172.21.15.120:0/1935800172 conn(0x7f6a3c0d1590 msgr2=0x7f6a3c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:24:55.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.180 7f6a42d66700 1 -- 172.21.15.120:0/1935800172 shutdown_connections 2021-04-09T18:24:55.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.180 7f6a42d66700 1 -- 172.21.15.120:0/1935800172 wait complete. 2021-04-09T18:24:55.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.198 7f6a42d66700 1 Processor -- start 2021-04-09T18:24:55.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.198 7f6a42d66700 1 -- start start 2021-04-09T18:24:55.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a42d66700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c186ed0 0x7f6a3c180850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:55.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a42d66700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a3c180e70 0x7f6a3c0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:55.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a42d66700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c1872d0 0x7f6a3c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:55.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a42d66700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c186950 con 0x7f6a3c186ed0 2021-04-09T18:24:55.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a42d66700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0b2450 con 0x7f6a3c1872d0 2021-04-09T18:24:55.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a42d66700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0b2630 con 0x7f6a3c180e70 2021-04-09T18:24:55.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a40b82700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c186ed0 0x7f6a3c180850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:55.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a40b82700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c186ed0 0x7f6a3c180850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55612/0 (socket says 172.21.15.120:55612) 2021-04-09T18:24:55.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a40b82700 1 -- 172.21.15.120:0/471601238 learned_addr learned my addr 172.21.15.120:0/471601238 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:24:55.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a3bfff700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a3c180e70 0x7f6a3c0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:55.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a41383700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c1872d0 0x7f6a3c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:55.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a40b82700 1 -- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a3c180e70 msgr2=0x7f6a3c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:55.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a40b82700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a3c180e70 0x7f6a3c0b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:55.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a40b82700 1 -- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c1872d0 msgr2=0x7f6a3c0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:55.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a40b82700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c1872d0 0x7f6a3c0b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:55.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a40b82700 1 -- 172.21.15.120:0/471601238 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c19d110 con 0x7f6a3c186ed0 2021-04-09T18:24:55.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a41383700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c1872d0 0x7f6a3c0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:24:55.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.199 7f6a40b82700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c186ed0 0x7f6a3c180850 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6a24009650 tx=0x7f6a2400b8e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:55.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.200 7f6a397fa700 1 -- 172.21.15.120:0/471601238 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a240093a0 con 0x7f6a3c186ed0 2021-04-09T18:24:55.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.200 7f6a397fa700 1 -- 172.21.15.120:0/471601238 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24006070 con 0x7f6a3c186ed0 2021-04-09T18:24:55.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.200 7f6a42d66700 1 -- 172.21.15.120:0/471601238 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c19d110 con 0x7f6a3c186ed0 2021-04-09T18:24:55.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.200 7f6a397fa700 1 -- 172.21.15.120:0/471601238 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6a240052e0 con 0x7f6a3c186ed0 2021-04-09T18:24:55.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.200 7f6a42d66700 1 -- 172.21.15.120:0/471601238 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c19d110 con 0x7f6a3c186ed0 2021-04-09T18:24:55.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.200 7f6a397fa700 1 -- 172.21.15.120:0/471601238 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6a24009300 con 0x7f6a3c186ed0 2021-04-09T18:24:55.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.200 7f6a397fa700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a20018930 0x7f6a2001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:55.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.200 7f6a397fa700 1 -- 172.21.15.120:0/471601238 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7f6a24032c20 con 0x7f6a3c186ed0 2021-04-09T18:24:55.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.201 7f6a3bfff700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a20018930 0x7f6a2001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:55.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.201 7f6a3bfff700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a20018930 0x7f6a2001ae10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:55.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.224 7f6a42d66700 1 -- 172.21.15.120:0/471601238 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c17f360 con 0x7f6a3c186ed0 2021-04-09T18:24:55.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.227 7f6a397fa700 1 -- 172.21.15.120:0/471601238 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6a24006030 con 0x7f6a3c186ed0 2021-04-09T18:24:55.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.403 7f6a42d66700 1 -- 172.21.15.120:0/471601238 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a3c17f360 con 0x7f6a3c186ed0 2021-04-09T18:24:55.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.404 7f6a397fa700 1 -- 172.21.15.120:0/471601238 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f6a24000940 con 0x7f6a3c186ed0 2021-04-09T18:24:55.398 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2021-04-09T18:24:55.399 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:24:55.399 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:24:55.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 -- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a20018930 msgr2=0x7f6a2001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:55.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a20018930 0x7f6a2001ae10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:55.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 -- 172.21.15.120:0/471601238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c186ed0 msgr2=0x7f6a3c180850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:55.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c186ed0 0x7f6a3c180850 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6a24009650 tx=0x7f6a2400b8e0).stop 2021-04-09T18:24:55.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 -- 172.21.15.120:0/471601238 shutdown_connections 2021-04-09T18:24:55.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a3c1872d0 0x7f6a3c0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:55.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6a20018930 0x7f6a2001ae10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:55.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6a3c180e70 0x7f6a3c0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:55.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 --2- 172.21.15.120:0/471601238 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a3c186ed0 0x7f6a3c180850 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:55.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 -- 172.21.15.120:0/471601238 >> 172.21.15.120:0/471601238 conn(0x7f6a3c0945f0 msgr2=0x7f6a3c097cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:24:55.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 -- 172.21.15.120:0/471601238 shutdown_connections 2021-04-09T18:24:55.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:55.406 7f6a42d66700 1 -- 172.21.15.120:0/471601238 wait complete. 2021-04-09T18:24:55.410 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:24:57.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:24:57.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.566 7ff7cf324700 1 Processor -- start 2021-04-09T18:24:57.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.566 7ff7cf324700 1 -- start start 2021-04-09T18:24:57.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7cf324700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7c80d7160 0x7ff7c80d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:57.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7cf324700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c80d6be0 con 0x7ff7c80d55a0 2021-04-09T18:24:57.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7cf324700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c81a2ac0 con 0x7ff7c80d6190 2021-04-09T18:24:57.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7cf324700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c81a2ce0 con 0x7ff7c80d7160 2021-04-09T18:24:57.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7cc93f700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff7c80d55a0 0x7ff7c80d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50544/0 (socket says 172.21.15.120:50544) 2021-04-09T18:24:57.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7cc93f700 1 -- 172.21.15.120:0/4016073723 learned_addr learned my addr 172.21.15.120:0/4016073723 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:24:57.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7cd140700 1 --2- 172.21.15.120:0/4016073723 >> v2:172.21.15.134:3300/0 conn(0x7ff7c80d7160 0x7ff7c80d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:57.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156518271 0 0) 0x7ff7b80009b0 con 0x7ff7c80d55a0 2021-04-09T18:24:57.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b4002fe0 con 0x7ff7c80d55a0 2021-04-09T18:24:57.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3065167732 0 0) 0x7ff7b8001010 con 0x7ff7c80d55a0 2021-04-09T18:24:57.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 >> v2:172.21.15.134:3300/0 conn(0x7ff7c80d7160 msgr2=0x7ff7c80d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:24:57.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7bffff700 1 --2- 172.21.15.120:0/4016073723 >> v2:172.21.15.134:3300/0 conn(0x7ff7c80d7160 0x7ff7c80d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 >> v1:172.21.15.134:6789/0 conn(0x7ff7c80d6190 legacy=0x7ff7c81ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:57.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80d6590 con 0x7ff7c80d55a0 2021-04-09T18:24:57.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.567 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7ff7b8001530 con 0x7ff7c80d55a0 2021-04-09T18:24:57.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 >> v1:172.21.15.120:6789/0 conn(0x7ff7c80d55a0 legacy=0x7ff7c80d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:57.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7b4003a40 0x7ff7b4005f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:57.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7b4006780 0x7ff7b4008ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:57.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7b40095a0 0x7ff7b400baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:57.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b400c2f0 con 0x7ff7b40095a0 2021-04-09T18:24:57.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b400c510 con 0x7ff7b4003a40 2021-04-09T18:24:57.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b4050740 con 0x7ff7b4006780 2021-04-09T18:24:57.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cd941700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7b40095a0 0x7ff7b400baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:57.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cd140700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7b4003a40 0x7ff7b4005f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:57.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cc93f700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7b4006780 0x7ff7b4008ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:57.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cd941700 1 -- 172.21.15.120:0/4016073723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7b4006780 msgr2=0x7ff7b4008ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:24:57.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cd941700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7b4006780 0x7ff7b4008ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cd941700 1 -- 172.21.15.120:0/4016073723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7b4003a40 msgr2=0x7ff7b4005f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:24:57.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cd941700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7b4003a40 0x7ff7b4005f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cd941700 1 -- 172.21.15.120:0/4016073723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b40509a0 con 0x7ff7b40095a0 2021-04-09T18:24:57.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cd941700 1 -- 172.21.15.120:0/4016073723 reap_dead start 2021-04-09T18:24:57.593 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cd941700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7b40095a0 0x7ff7b400baa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff7c0006ac0 tx=0x7ff7c0009af0).ready entity=mon.0 client_cookie=5c73c539f767237 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:57.593 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7c000c0c0 con 0x7ff7b40095a0 2021-04-09T18:24:57.593 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000c3c0 con 0x7ff7b40095a0 2021-04-09T18:24:57.593 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7bffff700 1 -- 172.21.15.120:0/4016073723 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7c000c8a0 con 0x7ff7b40095a0 2021-04-09T18:24:57.594 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cf324700 1 -- 172.21.15.120:0/4016073723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7b40095a0 msgr2=0x7ff7b400baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:57.594 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.568 7ff7cf324700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7b40095a0 0x7ff7b400baa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff7c0006ac0 tx=0x7ff7c0009af0).stop 2021-04-09T18:24:57.594 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.569 7ff7cf324700 1 -- 172.21.15.120:0/4016073723 shutdown_connections 2021-04-09T18:24:57.594 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.569 7ff7cf324700 1 --2- 172.21.15.120:0/4016073723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7b40095a0 0x7ff7b400baa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.594 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.569 7ff7cf324700 1 -- 172.21.15.120:0/4016073723 >> 172.21.15.120:0/4016073723 conn(0x7ff7c80d1590 msgr2=0x7ff7c80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:24:57.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.569 7ff7cf324700 1 -- 172.21.15.120:0/4016073723 shutdown_connections 2021-04-09T18:24:57.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.569 7ff7cf324700 1 -- 172.21.15.120:0/4016073723 wait complete. 2021-04-09T18:24:57.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.588 7ff7cf324700 1 Processor -- start 2021-04-09T18:24:57.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.588 7ff7cf324700 1 -- start start 2021-04-09T18:24:57.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cf324700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c8196500 0x7ff7c8196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:57.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cf324700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c8183f20 0x7ff7c8184320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:57.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cf324700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7c8195040 0x7ff7c8195440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:57.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cf324700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c819a280 con 0x7ff7c8196500 2021-04-09T18:24:57.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cf324700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8195a60 con 0x7ff7c8183f20 2021-04-09T18:24:57.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cf324700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8195c80 con 0x7ff7c8195040 2021-04-09T18:24:57.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd140700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c8196500 0x7ff7c8196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:57.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd140700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c8196500 0x7ff7c8196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55640/0 (socket says 172.21.15.120:55640) 2021-04-09T18:24:57.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd140700 1 -- 172.21.15.120:0/2250592106 learned_addr learned my addr 172.21.15.120:0/2250592106 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:24:57.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd941700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7c8195040 0x7ff7c8195440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:57.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cc93f700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c8183f20 0x7ff7c8184320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:57.598 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd140700 1 -- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7c8195040 msgr2=0x7ff7c8195440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:57.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd140700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7c8195040 0x7ff7c8195440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd140700 1 -- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c8183f20 msgr2=0x7ff7c8184320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:57.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd140700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c8183f20 0x7ff7c8184320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd140700 1 -- 172.21.15.120:0/2250592106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80b4f50 con 0x7ff7c8196500 2021-04-09T18:24:57.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cc93f700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c8183f20 0x7ff7c8184320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:24:57.600 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cd140700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c8196500 0x7ff7c8196900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7ff7c40099e0 tx=0x7ff7c400bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:57.600 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7bdffb700 1 -- 172.21.15.120:0/2250592106 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7c400c2f0 con 0x7ff7c8196500 2021-04-09T18:24:57.600 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7bdffb700 1 -- 172.21.15.120:0/2250592106 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400c630 con 0x7ff7c8196500 2021-04-09T18:24:57.600 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c80b4f50 con 0x7ff7c8196500 2021-04-09T18:24:57.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7bdffb700 1 -- 172.21.15.120:0/2250592106 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7c400cb10 con 0x7ff7c8196500 2021-04-09T18:24:57.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.589 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c80b4f50 con 0x7ff7c8196500 2021-04-09T18:24:57.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.590 7ff7bdffb700 1 -- 172.21.15.120:0/2250592106 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff7c4001010 con 0x7ff7c8196500 2021-04-09T18:24:57.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.590 7ff7bdffb700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7a8018930 0x7ff7a801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:57.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.590 7ff7bdffb700 1 -- 172.21.15.120:0/2250592106 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7ff7c4033030 con 0x7ff7c8196500 2021-04-09T18:24:57.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.590 7ff7cc93f700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7a8018930 0x7ff7a801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:57.602 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.591 7ff7cc93f700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7a8018930 0x7ff7a801ae10 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:57.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.613 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c8195c80 con 0x7ff7c8196500 2021-04-09T18:24:57.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.616 7ff7bdffb700 1 -- 172.21.15.120:0/2250592106 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff7c400be30 con 0x7ff7c8196500 2021-04-09T18:24:57.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.792 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7c8195c80 con 0x7ff7c8196500 2021-04-09T18:24:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.793 7ff7bdffb700 1 -- 172.21.15.120:0/2250592106 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2110 (secure 0 0 0) 0x7ff7c4001010 con 0x7ff7c8196500 2021-04-09T18:24:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2021-04-09T18:24:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:24:57.789 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:24:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7a8018930 msgr2=0x7ff7a801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7a8018930 0x7ff7a801ae10 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c8196500 msgr2=0x7ff7c8196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:57.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c8196500 0x7ff7c8196900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7ff7c40099e0 tx=0x7ff7c400bcf0).stop 2021-04-09T18:24:57.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 shutdown_connections 2021-04-09T18:24:57.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff7a8018930 0x7ff7a801ae10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7c8195040 0x7ff7c8195440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c8183f20 0x7ff7c8184320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 --2- 172.21.15.120:0/2250592106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c8196500 0x7ff7c8196900 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:57.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 >> 172.21.15.120:0/2250592106 conn(0x7ff7c818dcc0 msgr2=0x7ff7c8186a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:24:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 shutdown_connections 2021-04-09T18:24:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:57.795 7ff7cf324700 1 -- 172.21.15.120:0/2250592106 wait complete. 2021-04-09T18:24:57.799 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:24:58.512 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:24:58.515 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:24:59.800 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:24:59.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.956 7f0997320700 1 Processor -- start 2021-04-09T18:24:59.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.956 7f0997320700 1 -- start start 2021-04-09T18:24:59.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.956 7f0997320700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f09900d7560 0x7f09900d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:59.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.956 7f0997320700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09900d7960 con 0x7f09900d7160 2021-04-09T18:24:59.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.956 7f0997320700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09900d6be0 con 0x7f09900d63b0 2021-04-09T18:24:59.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.956 7f0997320700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09900d80f0 con 0x7f09900d7560 2021-04-09T18:24:59.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.956 7f099513c700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f09900d7160 0x7f09900d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50562/0 (socket says 172.21.15.120:50562) 2021-04-09T18:24:59.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.956 7f099513c700 1 -- 172.21.15.120:0/892120890 learned_addr learned my addr 172.21.15.120:0/892120890 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:24:59.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f099493b700 1 --2- 172.21.15.120:0/892120890 >> v2:172.21.15.134:3300/0 conn(0x7f09900d7560 0x7f09900d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:59.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254880911 0 0) 0x7f098c000ce0 con 0x7f09900d7160 2021-04-09T18:24:59.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c002fe0 con 0x7f09900d7160 2021-04-09T18:24:59.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1689671792 0 0) 0x7f098c0010e0 con 0x7f09900d7160 2021-04-09T18:24:59.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 >> v2:172.21.15.134:3300/0 conn(0x7f09900d7560 msgr2=0x7f09900d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:24:59.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 --2- 172.21.15.120:0/892120890 >> v2:172.21.15.134:3300/0 conn(0x7f09900d7560 0x7f09900d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:59.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 >> v1:172.21.15.134:6789/0 conn(0x7f09900d63b0 legacy=0x7f09901ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:59.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09901a2af0 con 0x7f09900d7160 2021-04-09T18:24:59.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f098c001660 con 0x7f09900d7160 2021-04-09T18:24:59.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 >> v1:172.21.15.120:6789/0 conn(0x7f09900d7160 legacy=0x7f09900d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:59.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f097c003a70 0x7f097c005f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:59.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f097c0067a0 0x7f097c008ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:59.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f097c0095a0 0x7f097c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:59.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c00c310 con 0x7f097c003a70 2021-04-09T18:24:59.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c00c530 con 0x7f097c0067a0 2021-04-09T18:24:59.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f099513c700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f097c003a70 0x7f097c005f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:59.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f0987fff700 1 -- 172.21.15.120:0/892120890 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c050760 con 0x7f097c0095a0 2021-04-09T18:24:59.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f099493b700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f097c0067a0 0x7f097c008ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:59.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f099593d700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f097c0095a0 0x7f097c00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:59.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f099513c700 1 -- 172.21.15.120:0/892120890 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f097c0095a0 msgr2=0x7f097c00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:24:59.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f099513c700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f097c0095a0 0x7f097c00bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:59.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f099513c700 1 -- 172.21.15.120:0/892120890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f097c0067a0 msgr2=0x7f097c008ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:24:59.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.957 7f099513c700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f097c0067a0 0x7f097c008ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:59.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f099593d700 1 -- 172.21.15.120:0/892120890 reap_dead start 2021-04-09T18:24:59.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f099513c700 1 -- 172.21.15.120:0/892120890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0509c0 con 0x7f097c003a70 2021-04-09T18:24:59.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f099513c700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f097c003a70 0x7f097c005f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f098c001430 tx=0x7f098c007c50).ready entity=mon.0 client_cookie=4f35a211d771670d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:59.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f0987fff700 1 -- 172.21.15.120:0/892120890 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f098c0010e0 con 0x7f097c003a70 2021-04-09T18:24:59.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f0987fff700 1 -- 172.21.15.120:0/892120890 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00a520 con 0x7f097c003a70 2021-04-09T18:24:59.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f0987fff700 1 -- 172.21.15.120:0/892120890 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f098c00a9b0 con 0x7f097c003a70 2021-04-09T18:24:59.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f0997320700 1 -- 172.21.15.120:0/892120890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f097c003a70 msgr2=0x7f097c005f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:59.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f0997320700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f097c003a70 0x7f097c005f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f098c001430 tx=0x7f098c007c50).stop 2021-04-09T18:24:59.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f0997320700 1 -- 172.21.15.120:0/892120890 shutdown_connections 2021-04-09T18:24:59.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f0997320700 1 --2- 172.21.15.120:0/892120890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f097c003a70 0x7f097c005f00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:59.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.958 7f0997320700 1 -- 172.21.15.120:0/892120890 >> 172.21.15.120:0/892120890 conn(0x7f09900d1590 msgr2=0x7f09900d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:24:59.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.959 7f0997320700 1 -- 172.21.15.120:0/892120890 shutdown_connections 2021-04-09T18:24:59.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.959 7f0997320700 1 -- 172.21.15.120:0/892120890 wait complete. 2021-04-09T18:24:59.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f0997320700 1 Processor -- start 2021-04-09T18:24:59.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f0997320700 1 -- start start 2021-04-09T18:24:59.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f0997320700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0990187670 0x7f09900a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:59.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f0997320700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09900a5050 0x7f09900b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:59.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f0997320700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09900b5710 0x7f09901838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:59.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f0997320700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900b5b10 con 0x7f0990187670 2021-04-09T18:24:59.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f0997320700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900b5d30 con 0x7f09900b5710 2021-04-09T18:24:59.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f0997320700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09900b5f50 con 0x7f09900a5050 2021-04-09T18:24:59.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f099513c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0990187670 0x7f09900a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:59.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f099513c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0990187670 0x7f09900a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55662/0 (socket says 172.21.15.120:55662) 2021-04-09T18:24:59.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f099513c700 1 -- 172.21.15.120:0/2654574431 learned_addr learned my addr 172.21.15.120:0/2654574431 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:24:59.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f099593d700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09900b5710 0x7f09901838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:59.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.978 7f099493b700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09900a5050 0x7f09900b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:59.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f099513c700 1 -- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09900a5050 msgr2=0x7f09900b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:59.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f099513c700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09900a5050 0x7f09900b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:59.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f099513c700 1 -- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09900b5710 msgr2=0x7f09901838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:24:59.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f099513c700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09900b5710 0x7f09901838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:24:59.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f099513c700 1 -- 172.21.15.120:0/2654574431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990183ef0 con 0x7f0990187670 2021-04-09T18:24:59.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f099513c700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0990187670 0x7f09900a4a30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f098c00ab90 tx=0x7f098c007960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:59.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f0985ffb700 1 -- 172.21.15.120:0/2654574431 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f098c00ac70 con 0x7f0990187670 2021-04-09T18:24:59.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f0985ffb700 1 -- 172.21.15.120:0/2654574431 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c0045b0 con 0x7f0990187670 2021-04-09T18:24:59.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f0997320700 1 -- 172.21.15.120:0/2654574431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0990183ef0 con 0x7f0990187670 2021-04-09T18:24:59.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f0985ffb700 1 -- 172.21.15.120:0/2654574431 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f098c004a00 con 0x7f0990187670 2021-04-09T18:24:59.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f0997320700 1 -- 172.21.15.120:0/2654574431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0990183ef0 con 0x7f0990187670 2021-04-09T18:24:59.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.979 7f0985ffb700 1 -- 172.21.15.120:0/2654574431 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f098c004790 con 0x7f0990187670 2021-04-09T18:24:59.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.980 7f0985ffb700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0970018930 0x7f097001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:24:59.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.980 7f0985ffb700 1 -- 172.21.15.120:0/2654574431 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7f098c032bc0 con 0x7f0990187670 2021-04-09T18:24:59.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.980 7f099493b700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0970018930 0x7f097001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:24:59.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:24:59.980 7f099493b700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0970018930 0x7f097001ae10 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:24:59.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.002 7f0997320700 1 -- 172.21.15.120:0/2654574431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09901829e0 con 0x7f0990187670 2021-04-09T18:24:59.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.006 7f0985ffb700 1 -- 172.21.15.120:0/2654574431 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f098c0043a0 con 0x7f0990187670 2021-04-09T18:25:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.184 7f0997320700 1 -- 172.21.15.120:0/2654574431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09901829e0 con 0x7f0990187670 2021-04-09T18:25:00.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.184 7f0985ffb700 1 -- 172.21.15.120:0/2654574431 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f098c00ac70 con 0x7f0990187670 2021-04-09T18:25:00.178 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2021-04-09T18:25:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:00.179 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:00.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.186 7f0997320700 1 -- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0970018930 msgr2=0x7f097001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.186 7f0997320700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0970018930 0x7f097001ae10 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.186 7f0997320700 1 -- 172.21.15.120:0/2654574431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0990187670 msgr2=0x7f09900a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.186 7f0997320700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0990187670 0x7f09900a4a30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f098c00ab90 tx=0x7f098c007960).stop 2021-04-09T18:25:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.187 7f0997320700 1 -- 172.21.15.120:0/2654574431 shutdown_connections 2021-04-09T18:25:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.187 7f0997320700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09900b5710 0x7f09901838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.187 7f0997320700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0970018930 0x7f097001ae10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.187 7f0997320700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09900a5050 0x7f09900b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.187 7f0997320700 1 --2- 172.21.15.120:0/2654574431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0990187670 0x7f09900a4a30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.187 7f0997320700 1 -- 172.21.15.120:0/2654574431 >> 172.21.15.120:0/2654574431 conn(0x7f099018dc90 msgr2=0x7f099008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:00.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.187 7f0997320700 1 -- 172.21.15.120:0/2654574431 shutdown_connections 2021-04-09T18:25:00.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:00.187 7f0997320700 1 -- 172.21.15.120:0/2654574431 wait complete. 2021-04-09T18:25:00.190 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:25:02.191 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.344 7fb3b33e0700 1 Processor -- start 2021-04-09T18:25:02.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.344 7fb3b33e0700 1 -- start start 2021-04-09T18:25:02.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b33e0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb3ac0d7560 0x7fb3ac0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:02.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b33e0700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ac0d7960 con 0x7fb3ac0d7160 2021-04-09T18:25:02.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b33e0700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ac0d6be0 con 0x7fb3ac0d63b0 2021-04-09T18:25:02.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b33e0700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ac0d80f0 con 0x7fb3ac0d7560 2021-04-09T18:25:02.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b09fb700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb3ac0d7560 0x7fb3ac0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:02.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b11fc700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb3ac0d7160 0x7fb3ac0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50582/0 (socket says 172.21.15.120:50582) 2021-04-09T18:25:02.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b11fc700 1 -- 172.21.15.120:0/2612888858 learned_addr learned my addr 172.21.15.120:0/2612888858 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:25:02.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b09fb700 1 -- 172.21.15.120:0/2612888858 >> v1:172.21.15.134:6789/0 conn(0x7fb3ac0d63b0 legacy=0x7fb3ac1ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:02.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b09fb700 1 -- 172.21.15.120:0/2612888858 >> v1:172.21.15.120:6789/0 conn(0x7fb3ac0d7160 legacy=0x7fb3ac0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:02.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b09fb700 1 -- 172.21.15.120:0/2612888858 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac1a2af0 con 0x7fb3ac0d7560 2021-04-09T18:25:02.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb39ffff700 1 -- 172.21.15.120:0/2612888858 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665002923 0 0) 0x7fb3a8000ce0 con 0x7fb3ac0d7160 2021-04-09T18:25:02.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.345 7fb3b09fb700 1 --2- 172.21.15.120:0/2612888858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0d7560 0x7fb3ac0d5d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fb3a00069d0 tx=0x7fb3a0009dc0).ready entity=mon.0 client_cookie=4debba9726a08b2c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:02.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb39ffff700 1 -- 172.21.15.120:0/2612888858 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3a000b510 con 0x7fb3ac0d7560 2021-04-09T18:25:02.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb39ffff700 1 -- 172.21.15.120:0/2612888858 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a0006ac0 con 0x7fb3ac0d7560 2021-04-09T18:25:02.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb39ffff700 1 -- 172.21.15.120:0/2612888858 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3a000ba80 con 0x7fb3ac0d7560 2021-04-09T18:25:02.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb3b33e0700 1 -- 172.21.15.120:0/2612888858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0d7560 msgr2=0x7fb3ac0d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:02.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb3b33e0700 1 --2- 172.21.15.120:0/2612888858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0d7560 0x7fb3ac0d5d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fb3a00069d0 tx=0x7fb3a0009dc0).stop 2021-04-09T18:25:02.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb3b33e0700 1 -- 172.21.15.120:0/2612888858 shutdown_connections 2021-04-09T18:25:02.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb3b33e0700 1 --2- 172.21.15.120:0/2612888858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0d7560 0x7fb3ac0d5d90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:02.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb3b33e0700 1 -- 172.21.15.120:0/2612888858 >> 172.21.15.120:0/2612888858 conn(0x7fb3ac0d1590 msgr2=0x7fb3ac0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:02.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb3b33e0700 1 -- 172.21.15.120:0/2612888858 shutdown_connections 2021-04-09T18:25:02.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.346 7fb3b33e0700 1 -- 172.21.15.120:0/2612888858 wait complete. 2021-04-09T18:25:02.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.365 7fb3b33e0700 1 Processor -- start 2021-04-09T18:25:02.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.365 7fb3b33e0700 1 -- start start 2021-04-09T18:25:02.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b33e0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac186ed0 0x7fb3ac180850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:02.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b33e0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac180e70 0x7fb3ac0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:02.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b33e0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3ac1872d0 0x7fb3ac0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:02.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b33e0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac186950 con 0x7fb3ac180e70 2021-04-09T18:25:02.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b33e0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac0b2450 con 0x7fb3ac186ed0 2021-04-09T18:25:02.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b33e0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac0b2630 con 0x7fb3ac1872d0 2021-04-09T18:25:02.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b09fb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac180e70 0x7fb3ac0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:02.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b09fb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac180e70 0x7fb3ac0b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55678/0 (socket says 172.21.15.120:55678) 2021-04-09T18:25:02.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b09fb700 1 -- 172.21.15.120:0/2308163936 learned_addr learned my addr 172.21.15.120:0/2308163936 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:02.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b19fd700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3ac1872d0 0x7fb3ac0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:02.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b09fb700 1 -- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3ac1872d0 msgr2=0x7fb3ac0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:02.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b09fb700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3ac1872d0 0x7fb3ac0b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:02.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b11fc700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac186ed0 0x7fb3ac180850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:02.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b09fb700 1 -- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac186ed0 msgr2=0x7fb3ac180850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:02.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b09fb700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac186ed0 0x7fb3ac180850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:02.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b09fb700 1 -- 172.21.15.120:0/2308163936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac19d110 con 0x7fb3ac180e70 2021-04-09T18:25:02.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b19fd700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3ac1872d0 0x7fb3ac0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:25:02.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.366 7fb3b09fb700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac180e70 0x7fb3ac0b1810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fb3a00099e0 tx=0x7fb3a000bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:02.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.367 7fb39dffb700 1 -- 172.21.15.120:0/2308163936 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3a0006030 con 0x7fb3ac180e70 2021-04-09T18:25:02.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.367 7fb39dffb700 1 -- 172.21.15.120:0/2308163936 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a00062b0 con 0x7fb3ac180e70 2021-04-09T18:25:02.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.367 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ac19d110 con 0x7fb3ac180e70 2021-04-09T18:25:02.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.367 7fb39dffb700 1 -- 172.21.15.120:0/2308163936 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3a0005660 con 0x7fb3ac180e70 2021-04-09T18:25:02.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.367 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ac19d110 con 0x7fb3ac180e70 2021-04-09T18:25:02.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.367 7fb39dffb700 1 -- 172.21.15.120:0/2308163936 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb3a0006490 con 0x7fb3ac180e70 2021-04-09T18:25:02.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.367 7fb39dffb700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb38c018930 0x7fb38c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:02.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.367 7fb39dffb700 1 -- 172.21.15.120:0/2308163936 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7fb3a0032f70 con 0x7fb3ac180e70 2021-04-09T18:25:02.412 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.368 7fb3b11fc700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb38c018930 0x7fb38c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:02.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.368 7fb3b11fc700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb38c018930 0x7fb38c01ae10 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:02.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.391 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ac17f360 con 0x7fb3ac180e70 2021-04-09T18:25:02.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.394 7fb39dffb700 1 -- 172.21.15.120:0/2308163936 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb3a000be10 con 0x7fb3ac180e70 2021-04-09T18:25:02.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.571 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3ac17f360 con 0x7fb3ac180e70 2021-04-09T18:25:02.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.571 7fb39dffb700 1 -- 172.21.15.120:0/2308163936 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2110 (secure 0 0 0) 0x7fb3a00062b0 con 0x7fb3ac180e70 2021-04-09T18:25:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2021-04-09T18:25:02.566 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:02.567 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:02.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.573 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb38c018930 msgr2=0x7fb38c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:02.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.573 7fb3b33e0700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb38c018930 0x7fb38c01ae10 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:02.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.573 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac180e70 msgr2=0x7fb3ac0b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:02.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.573 7fb3b33e0700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac180e70 0x7fb3ac0b1810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fb3a00099e0 tx=0x7fb3a000bcd0).stop 2021-04-09T18:25:02.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.574 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 shutdown_connections 2021-04-09T18:25:02.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.574 7fb3b33e0700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb38c018930 0x7fb38c01ae10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:02.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.574 7fb3b33e0700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3ac1872d0 0x7fb3ac0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:02.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.574 7fb3b33e0700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac180e70 0x7fb3ac0b1810 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:02.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.574 7fb3b33e0700 1 --2- 172.21.15.120:0/2308163936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac186ed0 0x7fb3ac180850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:02.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.574 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 >> 172.21.15.120:0/2308163936 conn(0x7fb3ac0945f0 msgr2=0x7fb3ac097cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:02.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.574 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 shutdown_connections 2021-04-09T18:25:02.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:02.574 7fb3b33e0700 1 -- 172.21.15.120:0/2308163936 wait complete. 2021-04-09T18:25:02.578 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:25:04.579 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:04.750 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.736 7f978a77c700 1 Processor -- start 2021-04-09T18:25:04.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.736 7f978a77c700 1 -- start start 2021-04-09T18:25:04.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f978a77c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97840d7160 0x7f97840d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:04.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f978a77c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97840d6190 0x7f97840d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:04.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f978a77c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97840d6be0 con 0x7f97840d55a0 2021-04-09T18:25:04.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f978a77c700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97840d80f0 con 0x7f97840d7160 2021-04-09T18:25:04.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f978a77c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97841a2ac0 con 0x7f97840d6190 2021-04-09T18:25:04.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f9788d99700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97840d6190 0x7f97840d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:04.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f9783fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97840d7160 0x7f97840d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:04.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f9788d99700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97840d6190 0x7f97840d6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:42350/0 (socket says 172.21.15.120:42350) 2021-04-09T18:25:04.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f9783fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97840d7160 0x7f97840d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:44520/0 (socket says 172.21.15.120:44520) 2021-04-09T18:25:04.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f977bfff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f97840d55a0 0x7f97840d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:45416/0 (socket says 172.21.15.120:45416) 2021-04-09T18:25:04.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f9783fff700 1 -- 172.21.15.120:0/2247845616 learned_addr learned my addr 172.21.15.120:0/2247845616 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:04.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f9783fff700 1 -- 172.21.15.120:0/2247845616 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97840d6190 msgr2=0x7f97840d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:04.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f9783fff700 1 --2- 172.21.15.120:0/2247845616 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97840d6190 0x7f97840d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f9783fff700 1 -- 172.21.15.120:0/2247845616 >> v1:172.21.15.134:6789/0 conn(0x7f97840d55a0 legacy=0x7f97840d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:04.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f9783fff700 1 -- 172.21.15.120:0/2247845616 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97841a2cb0 con 0x7f97840d7160 2021-04-09T18:25:04.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.737 7f97837fe700 1 -- 172.21.15.120:0/2247845616 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451868611 0 0) 0x7f976c0009b0 con 0x7f97840d55a0 2021-04-09T18:25:04.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.738 7f9788d99700 1 --2- 172.21.15.120:0/2247845616 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97840d6190 0x7f97840d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:04.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.738 7f9783fff700 1 --2- 172.21.15.120:0/2247845616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97840d7160 0x7f97840d7560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9774006700 tx=0x7f9774009b80).ready entity=mon.1 client_cookie=ec03c51926f68874 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:04.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.738 7f97837fe700 1 -- 172.21.15.120:0/2247845616 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f977400c0c0 con 0x7f97840d7160 2021-04-09T18:25:04.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.738 7f97837fe700 1 -- 172.21.15.120:0/2247845616 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400c440 con 0x7f97840d7160 2021-04-09T18:25:04.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.738 7f97837fe700 1 -- 172.21.15.120:0/2247845616 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f97740009b0 con 0x7f97840d7160 2021-04-09T18:25:04.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.738 7f978a77c700 1 -- 172.21.15.120:0/2247845616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97840d7160 msgr2=0x7f97840d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:04.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.738 7f978a77c700 1 --2- 172.21.15.120:0/2247845616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97840d7160 0x7f97840d7560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9774006700 tx=0x7f9774009b80).stop 2021-04-09T18:25:04.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.739 7f978a77c700 1 -- 172.21.15.120:0/2247845616 shutdown_connections 2021-04-09T18:25:04.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.739 7f978a77c700 1 --2- 172.21.15.120:0/2247845616 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97840d6190 0x7f97840d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.739 7f978a77c700 1 --2- 172.21.15.120:0/2247845616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97840d7160 0x7f97840d7560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.739 7f978a77c700 1 -- 172.21.15.120:0/2247845616 >> 172.21.15.120:0/2247845616 conn(0x7f97840d1590 msgr2=0x7f97840d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:04.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.739 7f978a77c700 1 -- 172.21.15.120:0/2247845616 shutdown_connections 2021-04-09T18:25:04.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.739 7f978a77c700 1 -- 172.21.15.120:0/2247845616 wait complete. 2021-04-09T18:25:04.760 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.757 7f978a77c700 1 Processor -- start 2021-04-09T18:25:04.761 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.757 7f978a77c700 1 -- start start 2021-04-09T18:25:04.761 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f978a77c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f978417b4b0 0x7f97841a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:04.761 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f978a77c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97841a1760 0x7f978419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:04.761 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f978a77c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f978417b8b0 0x7f978419ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:04.762 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f978a77c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97841a0c40 con 0x7f97841a1760 2021-04-09T18:25:04.762 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f978a77c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978417be20 con 0x7f978417b4b0 2021-04-09T18:25:04.762 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f978a77c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97841a0550 con 0x7f978417b8b0 2021-04-09T18:25:04.762 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f977bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97841a1760 0x7f978419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:04.763 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f977bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97841a1760 0x7f978419f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55692/0 (socket says 172.21.15.120:55692) 2021-04-09T18:25:04.763 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f977bfff700 1 -- 172.21.15.120:0/1932394467 learned_addr learned my addr 172.21.15.120:0/1932394467 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:04.763 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f9783fff700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f978417b4b0 0x7f97841a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:04.763 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f9788d99700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f978417b8b0 0x7f978419ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:04.763 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f977bfff700 1 -- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f978417b8b0 msgr2=0x7f978419ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:04.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f977bfff700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f978417b8b0 0x7f978419ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f977bfff700 1 -- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f978417b4b0 msgr2=0x7f97841a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:04.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f977bfff700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f978417b4b0 0x7f97841a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f977bfff700 1 -- 172.21.15.120:0/1932394467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97841a0770 con 0x7f97841a1760 2021-04-09T18:25:04.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f9783fff700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f978417b4b0 0x7f97841a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:25:04.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.758 7f977bfff700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97841a1760 0x7f978419f910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f976c001c10 tx=0x7f976c00a8f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:04.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.759 7f97817fa700 1 -- 172.21.15.120:0/1932394467 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f976c00ace0 con 0x7f97841a1760 2021-04-09T18:25:04.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.759 7f97817fa700 1 -- 172.21.15.120:0/1932394467 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c004350 con 0x7f97841a1760 2021-04-09T18:25:04.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.759 7f978a77c700 1 -- 172.21.15.120:0/1932394467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97841a0770 con 0x7f97841a1760 2021-04-09T18:25:04.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.759 7f97817fa700 1 -- 172.21.15.120:0/1932394467 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f976c0047a0 con 0x7f97841a1760 2021-04-09T18:25:04.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.759 7f978a77c700 1 -- 172.21.15.120:0/1932394467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97841a0770 con 0x7f97841a1760 2021-04-09T18:25:04.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.759 7f97817fa700 1 -- 172.21.15.120:0/1932394467 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f976c007fd0 con 0x7f97841a1760 2021-04-09T18:25:04.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.760 7f97817fa700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97680188d0 0x7f976801add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:04.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.760 7f97817fa700 1 -- 172.21.15.120:0/1932394467 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6107+0+0 (secure 0 0 0) 0x7f976c032bf0 con 0x7f97841a1760 2021-04-09T18:25:04.767 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.760 7f9783fff700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97680188d0 0x7f976801add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:04.767 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.760 7f9783fff700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97680188d0 0x7f976801add0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:04.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.782 7f978a77c700 1 -- 172.21.15.120:0/1932394467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978417a2b0 con 0x7f97841a1760 2021-04-09T18:25:04.779 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.786 7f97817fa700 1 -- 172.21.15.120:0/1932394467 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f976c004140 con 0x7f97841a1760 2021-04-09T18:25:04.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.964 7f978a77c700 1 -- 172.21.15.120:0/1932394467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f978417a2b0 con 0x7f97841a1760 2021-04-09T18:25:04.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.965 7f97817fa700 1 -- 172.21.15.120:0/1932394467 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f976c004350 con 0x7f97841a1760 2021-04-09T18:25:04.960 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2021-04-09T18:25:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:04.961 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:23:09.857791","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":34,"addr":"172.21.15.134:6835/3982642658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3982642658},{"type":"v1","addr":"172.21.15.134:6835","nonce":3982642658}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:04.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 -- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97680188d0 msgr2=0x7f976801add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:04.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97680188d0 0x7f976801add0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 -- 172.21.15.120:0/1932394467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97841a1760 msgr2=0x7f978419f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:04.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97841a1760 0x7f978419f910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f976c001c10 tx=0x7f976c00a8f0).stop 2021-04-09T18:25:04.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 -- 172.21.15.120:0/1932394467 shutdown_connections 2021-04-09T18:25:04.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f97680188d0 0x7f976801add0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f978417b8b0 0x7f978419ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97841a1760 0x7f978419f910 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 --2- 172.21.15.120:0/1932394467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f978417b4b0 0x7f97841a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:04.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 -- 172.21.15.120:0/1932394467 >> 172.21.15.120:0/1932394467 conn(0x7f9784185580 msgr2=0x7f9784188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:04.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 -- 172.21.15.120:0/1932394467 shutdown_connections 2021-04-09T18:25:04.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:04.967 7f978a77c700 1 -- 172.21.15.120:0/1932394467 wait complete. 2021-04-09T18:25:04.971 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:25:06.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:07.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.120 7fd96e0a4700 1 Processor -- start 2021-04-09T18:25:07.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.120 7fd96e0a4700 1 -- start start 2021-04-09T18:25:07.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.121 7fd96e0a4700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd9680d7160 0x7fd9680d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.121 7fd96e0a4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd9680d6190 0x7fd9680d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.121 7fd96e0a4700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9680d6be0 con 0x7fd9680d55a0 2021-04-09T18:25:07.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.121 7fd96e0a4700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9680d80f0 con 0x7fd9680d7160 2021-04-09T18:25:07.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.121 7fd96e0a4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9681a2ac0 con 0x7fd9680d6190 2021-04-09T18:25:07.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.121 7fd9677fe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd9680d7160 0x7fd9680d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.121 7fd9677fe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd9680d7160 0x7fd9680d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55714/0 (socket says 172.21.15.120:55714) 2021-04-09T18:25:07.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.121 7fd9677fe700 1 -- 172.21.15.120:0/3564309584 learned_addr learned my addr 172.21.15.120:0/3564309584 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:07.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.121 7fd967fff700 1 --2- 172.21.15.120:0/3564309584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd9680d6190 0x7fd9680d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd9677fe700 1 -- 172.21.15.120:0/3564309584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd9680d6190 msgr2=0x7fd9680d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:07.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd9677fe700 1 --2- 172.21.15.120:0/3564309584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd9680d6190 0x7fd9680d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd9677fe700 1 -- 172.21.15.120:0/3564309584 >> v1:172.21.15.134:6789/0 conn(0x7fd9680d55a0 legacy=0x7fd9680d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd9677fe700 1 -- 172.21.15.120:0/3564309584 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9681a2cb0 con 0x7fd9680d7160 2021-04-09T18:25:07.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd9667fc700 1 -- 172.21.15.120:0/3564309584 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852930022 0 0) 0x7fd950000c60 con 0x7fd9680d55a0 2021-04-09T18:25:07.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd9677fe700 1 --2- 172.21.15.120:0/3564309584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9680d7160 0x7fd9680d7560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fd960006a80 tx=0x7fd960009e80).ready entity=mon.0 client_cookie=ffd104f067f6578f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:07.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd9667fc700 1 -- 172.21.15.120:0/3564309584 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd96000b510 con 0x7fd9680d7160 2021-04-09T18:25:07.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd9667fc700 1 -- 172.21.15.120:0/3564309584 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000b7d0 con 0x7fd9680d7160 2021-04-09T18:25:07.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd9667fc700 1 -- 172.21.15.120:0/3564309584 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd96000bcb0 con 0x7fd9680d7160 2021-04-09T18:25:07.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd96e0a4700 1 -- 172.21.15.120:0/3564309584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9680d7160 msgr2=0x7fd9680d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.122 7fd96e0a4700 1 --2- 172.21.15.120:0/3564309584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9680d7160 0x7fd9680d7560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fd960006a80 tx=0x7fd960009e80).stop 2021-04-09T18:25:07.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.123 7fd96e0a4700 1 -- 172.21.15.120:0/3564309584 shutdown_connections 2021-04-09T18:25:07.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.123 7fd96e0a4700 1 --2- 172.21.15.120:0/3564309584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd9680d6190 0x7fd9680d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.123 7fd96e0a4700 1 --2- 172.21.15.120:0/3564309584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9680d7160 0x7fd9680d7560 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.123 7fd96e0a4700 1 -- 172.21.15.120:0/3564309584 >> 172.21.15.120:0/3564309584 conn(0x7fd9680d1590 msgr2=0x7fd9680d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:07.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.123 7fd96e0a4700 1 -- 172.21.15.120:0/3564309584 shutdown_connections 2021-04-09T18:25:07.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.123 7fd96e0a4700 1 -- 172.21.15.120:0/3564309584 wait complete. 2021-04-09T18:25:07.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.142 7fd96e0a4700 1 Processor -- start 2021-04-09T18:25:07.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.142 7fd96e0a4700 1 -- start start 2021-04-09T18:25:07.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd96e0a4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9681986d0 0x7fd968094570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd96e0a4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9680a86c0 0x7fd9680a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd96e0a4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd96819ada0 0x7fd96819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd96e0a4700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96819b7c0 con 0x7fd9681986d0 2021-04-09T18:25:07.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd96e0a4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd968094b90 con 0x7fd9680a86c0 2021-04-09T18:25:07.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd96e0a4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd968093c40 con 0x7fd96819ada0 2021-04-09T18:25:07.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd9677fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9681986d0 0x7fd968094570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd9677fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9681986d0 0x7fd968094570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55718/0 (socket says 172.21.15.120:55718) 2021-04-09T18:25:07.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd9677fe700 1 -- 172.21.15.120:0/2860292729 learned_addr learned my addr 172.21.15.120:0/2860292729 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:07.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd967fff700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd96819ada0 0x7fd96819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd966ffd700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9680a86c0 0x7fd9680a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd9677fe700 1 -- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd96819ada0 msgr2=0x7fd96819b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd9677fe700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd96819ada0 0x7fd96819b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd9677fe700 1 -- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9680a86c0 msgr2=0x7fd9680a8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd9677fe700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9680a86c0 0x7fd9680a8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd9677fe700 1 -- 172.21.15.120:0/2860292729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680b0430 con 0x7fd9681986d0 2021-04-09T18:25:07.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.143 7fd9677fe700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9681986d0 0x7fd968094570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fd96000b920 tx=0x7fd96000bcc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:07.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.144 7fd95ffff700 1 -- 172.21.15.120:0/2860292729 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd96000e500 con 0x7fd9681986d0 2021-04-09T18:25:07.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.144 7fd95ffff700 1 -- 172.21.15.120:0/2860292729 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000e880 con 0x7fd9681986d0 2021-04-09T18:25:07.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.144 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9680b0430 con 0x7fd9681986d0 2021-04-09T18:25:07.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.144 7fd95ffff700 1 -- 172.21.15.120:0/2860292729 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd96000ed60 con 0x7fd9681986d0 2021-04-09T18:25:07.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.144 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9680b0430 con 0x7fd9681986d0 2021-04-09T18:25:07.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.144 7fd95ffff700 1 -- 172.21.15.120:0/2860292729 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fd960001010 con 0x7fd9681986d0 2021-04-09T18:25:07.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.145 7fd95ffff700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd94c018930 0x7fd94c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.145 7fd95ffff700 1 -- 172.21.15.120:0/2860292729 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fd9600355c0 con 0x7fd9681986d0 2021-04-09T18:25:07.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.145 7fd966ffd700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd94c018930 0x7fd94c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.145 7fd966ffd700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd94c018930 0x7fd94c01ae10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:07.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.166 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96817a2e0 con 0x7fd9681986d0 2021-04-09T18:25:07.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.169 7fd95ffff700 1 -- 172.21.15.120:0/2860292729 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fd9600338f0 con 0x7fd9681986d0 2021-04-09T18:25:07.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.354 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd96817a2e0 con 0x7fd9681986d0 2021-04-09T18:25:07.349 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.355 7fd95ffff700 1 -- 172.21.15.120:0/2860292729 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+1770 (secure 0 0 0) 0x7fd960000d30 con 0x7fd9681986d0 2021-04-09T18:25:07.349 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 19 2021-04-09T18:25:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:07.349 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:05.786872","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:07.351 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd94c018930 msgr2=0x7fd94c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.351 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd94c018930 0x7fd94c01ae10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.352 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9681986d0 msgr2=0x7fd968094570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.352 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9681986d0 0x7fd968094570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fd96000b920 tx=0x7fd96000bcc0).stop 2021-04-09T18:25:07.352 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 shutdown_connections 2021-04-09T18:25:07.352 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fd94c018930 0x7fd94c01ae10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.353 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd96819ada0 0x7fd96819b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.353 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9680a86c0 0x7fd9680a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.353 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 --2- 172.21.15.120:0/2860292729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9681986d0 0x7fd968094570 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.353 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 >> 172.21.15.120:0/2860292729 conn(0x7fd968185590 msgr2=0x7fd96819bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:07.354 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 shutdown_connections 2021-04-09T18:25:07.354 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.357 7fd96e0a4700 1 -- 172.21.15.120:0/2860292729 wait complete. 2021-04-09T18:25:07.360 INFO:tasks.mds_thrash.fs.[None]:mds.b down, removed from mdsmap 2021-04-09T18:25:07.361 INFO:tasks.mds_thrash.fs.[None]:waiting for mds cluster to stabilize... 2021-04-09T18:25:07.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:07.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.507 7f6fbaf7d700 1 Processor -- start 2021-04-09T18:25:07.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.507 7f6fbaf7d700 1 -- start start 2021-04-09T18:25:07.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fbaf7d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6fb40d7160 0x7f6fb40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fbaf7d700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb40d6be0 con 0x7f6fb40d55a0 2021-04-09T18:25:07.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fbaf7d700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb41a2ac0 con 0x7f6fb40d6190 2021-04-09T18:25:07.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fbaf7d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb41a2ce0 con 0x7f6fb40d7160 2021-04-09T18:25:07.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb3fff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6fb40d55a0 0x7f6fb40d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50638/0 (socket says 172.21.15.120:50638) 2021-04-09T18:25:07.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb3fff700 1 -- 172.21.15.120:0/519491155 learned_addr learned my addr 172.21.15.120:0/519491155 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:25:07.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb8d99700 1 --2- 172.21.15.120:0/519491155 >> v2:172.21.15.134:3300/0 conn(0x7f6fb40d7160 0x7f6fb40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb37fe700 1 -- 172.21.15.120:0/519491155 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403676324 0 0) 0x7f6fa4000ce0 con 0x7f6fb40d55a0 2021-04-09T18:25:07.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb37fe700 1 -- 172.21.15.120:0/519491155 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa0002fe0 con 0x7f6fb40d55a0 2021-04-09T18:25:07.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb37fe700 1 -- 172.21.15.120:0/519491155 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897121776 0 0) 0x7f6fac000d30 con 0x7f6fb40d6190 2021-04-09T18:25:07.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb37fe700 1 -- 172.21.15.120:0/519491155 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa0003090 con 0x7f6fb40d6190 2021-04-09T18:25:07.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb8d99700 1 -- 172.21.15.120:0/519491155 >> v1:172.21.15.134:6789/0 conn(0x7f6fb40d6190 legacy=0x7f6fb41ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb37fe700 1 -- 172.21.15.120:0/519491155 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 679064791 0 0) 0x7f6fa40010e0 con 0x7f6fb40d55a0 2021-04-09T18:25:07.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb8d99700 1 -- 172.21.15.120:0/519491155 >> v1:172.21.15.120:6789/0 conn(0x7f6fb40d55a0 legacy=0x7f6fb40d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.508 7f6fb8d99700 1 -- 172.21.15.120:0/519491155 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40d6590 con 0x7f6fb40d7160 2021-04-09T18:25:07.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fb8d99700 1 --2- 172.21.15.120:0/519491155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb40d7160 0x7f6fb40d7560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f6f9c006650 tx=0x7f6f9c009a80).ready entity=mon.1 client_cookie=c64b6d226aa98f5d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:07.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fb37fe700 1 -- 172.21.15.120:0/519491155 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6f9c0009b0 con 0x7f6fb40d7160 2021-04-09T18:25:07.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fb37fe700 1 -- 172.21.15.120:0/519491155 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00c0c0 con 0x7f6fb40d7160 2021-04-09T18:25:07.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fb37fe700 1 -- 172.21.15.120:0/519491155 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6f9c00c510 con 0x7f6fb40d7160 2021-04-09T18:25:07.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fbaf7d700 1 -- 172.21.15.120:0/519491155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb40d7160 msgr2=0x7f6fb40d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fbaf7d700 1 --2- 172.21.15.120:0/519491155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb40d7160 0x7f6fb40d7560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f6f9c006650 tx=0x7f6f9c009a80).stop 2021-04-09T18:25:07.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fbaf7d700 1 -- 172.21.15.120:0/519491155 shutdown_connections 2021-04-09T18:25:07.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fbaf7d700 1 --2- 172.21.15.120:0/519491155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb40d7160 0x7f6fb40d7560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fbaf7d700 1 -- 172.21.15.120:0/519491155 >> 172.21.15.120:0/519491155 conn(0x7f6fb40d1590 msgr2=0x7f6fb40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:07.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fbaf7d700 1 -- 172.21.15.120:0/519491155 shutdown_connections 2021-04-09T18:25:07.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.509 7f6fbaf7d700 1 -- 172.21.15.120:0/519491155 wait complete. 2021-04-09T18:25:07.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.528 7f6fbaf7d700 1 Processor -- start 2021-04-09T18:25:07.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.528 7f6fbaf7d700 1 -- start start 2021-04-09T18:25:07.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fbaf7d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6fb408a9b0 0x7f6fb408b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fbaf7d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6fb40b1fe0 0x7f6fb40b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fbaf7d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb4183f10 0x7f6fb4184310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fbaf7d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4197600 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fbaf7d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb408ae30 con 0x7f6fb4183f10 2021-04-09T18:25:07.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fbaf7d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb408b990 con 0x7f6fb408a9b0 2021-04-09T18:25:07.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6fb40b1fe0 0x7f6fb40b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6fb40b1fe0 0x7f6fb40b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55732/0 (socket says 172.21.15.120:55732) 2021-04-09T18:25:07.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb3fff700 1 -- 172.21.15.120:0/1708623092 learned_addr learned my addr 172.21.15.120:0/1708623092 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:07.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb8d99700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6fb408a9b0 0x7f6fb408b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb959a700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb4183f10 0x7f6fb4184310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb3fff700 1 -- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6fb408a9b0 msgr2=0x7f6fb408b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb3fff700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6fb408a9b0 0x7f6fb408b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb3fff700 1 -- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb4183f10 msgr2=0x7f6fb4184310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb3fff700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb4183f10 0x7f6fb4184310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb3fff700 1 -- 172.21.15.120:0/1708623092 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb41971c0 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb3fff700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6fb40b1fe0 0x7f6fb40b23e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f6fa4000f90 tx=0x7f6fa400a8c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:07.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.529 7f6fb17fa700 1 -- 172.21.15.120:0/1708623092 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6fa4001a30 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.530 7f6fb17fa700 1 -- 172.21.15.120:0/1708623092 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa40043a0 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.530 7f6fb17fa700 1 -- 172.21.15.120:0/1708623092 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6fa4004880 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.530 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb41971c0 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.530 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb41971c0 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.530 7f6fb17fa700 1 -- 172.21.15.120:0/1708623092 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6fa4004580 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.530 7f6fb17fa700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6f98018930 0x7f6f9801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:07.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.530 7f6fb17fa700 1 -- 172.21.15.120:0/1708623092 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f6fa4032c40 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.530 7f6fb8d99700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6f98018930 0x7f6f9801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:07.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.531 7f6fb8d99700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6f98018930 0x7f6f9801ae10 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:07.547 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.554 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb4182a20 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.557 7f6fb17fa700 1 -- 172.21.15.120:0/1708623092 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6fa4001a30 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.744 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fb41975b0 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.745 7f6fb17fa700 1 -- 172.21.15.120:0/1708623092 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+1774 (secure 0 0 0) 0x7f6fa400acb0 con 0x7f6fb40b1fe0 2021-04-09T18:25:07.739 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 20 2021-04-09T18:25:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:07.740 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:07.631994","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:reconnect","state_seq":30,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:07.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.747 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6f98018930 msgr2=0x7f6f9801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.747 7f6fbaf7d700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6f98018930 0x7f6f9801ae10 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.747 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6fb40b1fe0 msgr2=0x7f6fb40b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:07.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.747 7f6fbaf7d700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6fb40b1fe0 0x7f6fb40b23e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f6fa4000f90 tx=0x7f6fa400a8c0).stop 2021-04-09T18:25:07.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.748 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 shutdown_connections 2021-04-09T18:25:07.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.748 7f6fbaf7d700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb4183f10 0x7f6fb4184310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.748 7f6fbaf7d700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6fb40b1fe0 0x7f6fb40b23e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.748 7f6fbaf7d700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6f98018930 0x7f6f9801ae10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.748 7f6fbaf7d700 1 --2- 172.21.15.120:0/1708623092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6fb408a9b0 0x7f6fb408b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:07.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.748 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 >> 172.21.15.120:0/1708623092 conn(0x7f6fb418dcd0 msgr2=0x7f6fb4187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:07.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.748 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 shutdown_connections 2021-04-09T18:25:07.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:07.748 7f6fbaf7d700 1 -- 172.21.15.120:0/1708623092 wait complete. 2021-04-09T18:25:07.751 INFO:tasks.mds_thrash.fs.[None]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 20, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-04-09 18:19:55.049244", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 20, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4839": { "addr": "172.21.15.120:6833/3967329066", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 3967329066, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 3967329066, "type": "v1" } ] }, "export_targets": [], "features": 4611087854035861503, "flags": 0, "gid": 4839, "incarnation": 19, "name": "a", "rank": 0, "state": "up:reconnect", "state_seq": 30 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "-1 (unspecified)", "modified": "2021-04-09 18:25:07.631994", "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4839 } } } ], "standbys": [] } 2021-04-09T18:25:09.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:09.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f874e9b1700 1 Processor -- start 2021-04-09T18:25:09.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f874e9b1700 1 -- start start 2021-04-09T18:25:09.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f874e9b1700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f87480d7160 0x7f87480d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:09.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f874e9b1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f87480d55a0 0x7f87480d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:09.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f874e9b1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87480d5fc0 0x7f87480d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:09.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f874e9b1700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87480e80a0 con 0x7f87480d7160 2021-04-09T18:25:09.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f874e9b1700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87480d80f0 con 0x7f87480d55a0 2021-04-09T18:25:09.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f874e9b1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87480d6be0 con 0x7f87480d5fc0 2021-04-09T18:25:09.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f8747fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f87480d7160 0x7f87480d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:09.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f8747fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f87480d7160 0x7f87480d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55760/0 (socket says 172.21.15.120:55760) 2021-04-09T18:25:09.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f8747fff700 1 -- 172.21.15.120:0/698346445 learned_addr learned my addr 172.21.15.120:0/698346445 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:09.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f873ffff700 1 --2- 172.21.15.120:0/698346445 >> v2:172.21.15.134:3300/0 conn(0x7f87480d55a0 0x7f87480d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:09.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.938 7f874cfce700 1 --2- 172.21.15.120:0/698346445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87480d5fc0 0x7f87480d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:09.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f8747fff700 1 -- 172.21.15.120:0/698346445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87480d5fc0 msgr2=0x7f87480d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:09.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f8747fff700 1 --2- 172.21.15.120:0/698346445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87480d5fc0 0x7f87480d63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:09.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f8747fff700 1 -- 172.21.15.120:0/698346445 >> v2:172.21.15.134:3300/0 conn(0x7f87480d55a0 msgr2=0x7f87480d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:09.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f8747fff700 1 --2- 172.21.15.120:0/698346445 >> v2:172.21.15.134:3300/0 conn(0x7f87480d55a0 0x7f87480d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:09.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f8747fff700 1 -- 172.21.15.120:0/698346445 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87481a2ac0 con 0x7f87480d7160 2021-04-09T18:25:09.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f8747fff700 1 --2- 172.21.15.120:0/698346445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87480d7160 0x7f87480d7560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f8730006700 tx=0x7f8730009b00).ready entity=mon.0 client_cookie=5030bebe1fb3b5c6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:09.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f87477fe700 1 -- 172.21.15.120:0/698346445 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f873000c0c0 con 0x7f87480d7160 2021-04-09T18:25:09.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f87477fe700 1 -- 172.21.15.120:0/698346445 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873000c400 con 0x7f87480d7160 2021-04-09T18:25:09.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f87477fe700 1 -- 172.21.15.120:0/698346445 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f873000c8e0 con 0x7f87480d7160 2021-04-09T18:25:09.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f874e9b1700 1 -- 172.21.15.120:0/698346445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87480d7160 msgr2=0x7f87480d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:09.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.939 7f874e9b1700 1 --2- 172.21.15.120:0/698346445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87480d7160 0x7f87480d7560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f8730006700 tx=0x7f8730009b00).stop 2021-04-09T18:25:09.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.940 7f874e9b1700 1 -- 172.21.15.120:0/698346445 shutdown_connections 2021-04-09T18:25:09.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.940 7f874e9b1700 1 --2- 172.21.15.120:0/698346445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87480d5fc0 0x7f87480d63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:09.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.940 7f874e9b1700 1 --2- 172.21.15.120:0/698346445 >> v2:172.21.15.134:3300/0 conn(0x7f87480d55a0 0x7f87480d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:09.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.940 7f874e9b1700 1 --2- 172.21.15.120:0/698346445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87480d7160 0x7f87480d7560 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:09.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.940 7f874e9b1700 1 -- 172.21.15.120:0/698346445 >> 172.21.15.120:0/698346445 conn(0x7f87480d1590 msgr2=0x7f87480d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:09.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.940 7f874e9b1700 1 -- 172.21.15.120:0/698346445 shutdown_connections 2021-04-09T18:25:09.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.940 7f874e9b1700 1 -- 172.21.15.120:0/698346445 wait complete. 2021-04-09T18:25:09.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f874e9b1700 1 Processor -- start 2021-04-09T18:25:09.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f874e9b1700 1 -- start start 2021-04-09T18:25:09.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f874e9b1700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8748191390 0x7f874818c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:09.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f874e9b1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8748188900 0x7f8748188d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:09.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f874e9b1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8748189320 0x7f87480b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:09.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f874e9b1700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874818bb00 con 0x7f8748189320 2021-04-09T18:25:09.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f874e9b1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874818c660 con 0x7f8748188900 2021-04-09T18:25:09.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f874e9b1700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87480b4260 con 0x7f8748191390 2021-04-09T18:25:09.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f874cfce700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8748189320 0x7f87480b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:09.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f8747fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8748191390 0x7f874818c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:09.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f8747fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8748191390 0x7f874818c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:42430/0 (socket says 172.21.15.120:42430) 2021-04-09T18:25:09.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f874cfce700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8748189320 0x7f87480b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55770/0 (socket says 172.21.15.120:55770) 2021-04-09T18:25:09.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f8747fff700 1 -- 172.21.15.120:0/574990500 learned_addr learned my addr 172.21.15.120:0/574990500 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:09.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.963 7f873ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8748188900 0x7f8748188d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:09.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f8747fff700 1 -- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8748188900 msgr2=0x7f8748188d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:09.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f8747fff700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8748188900 0x7f8748188d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:09.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f8747fff700 1 -- 172.21.15.120:0/574990500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8748189320 msgr2=0x7f87480b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:09.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f8747fff700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8748189320 0x7f87480b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:09.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f8747fff700 1 -- 172.21.15.120:0/574990500 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87480b4480 con 0x7f8748191390 2021-04-09T18:25:09.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f8747fff700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8748191390 0x7f874818c000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f8730006f20 tx=0x7f873000b8e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f87457fa700 1 -- 172.21.15.120:0/574990500 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8730006390 con 0x7f8748191390 2021-04-09T18:25:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f87457fa700 1 -- 172.21.15.120:0/574990500 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873000bcd0 con 0x7f8748191390 2021-04-09T18:25:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f87457fa700 1 -- 172.21.15.120:0/574990500 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8730002270 con 0x7f8748191390 2021-04-09T18:25:09.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f874e9b1700 1 -- 172.21.15.120:0/574990500 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87480b4480 con 0x7f8748191390 2021-04-09T18:25:09.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.964 7f874e9b1700 1 -- 172.21.15.120:0/574990500 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87480b4a10 con 0x7f8748191390 2021-04-09T18:25:09.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.965 7f87457fa700 1 -- 172.21.15.120:0/574990500 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8730000c90 con 0x7f8748191390 2021-04-09T18:25:09.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.965 7f87457fa700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f872c01cce0 0x7f872c01f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:09.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.965 7f87457fa700 1 -- 172.21.15.120:0/574990500 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f8730032ba0 con 0x7f8748191390 2021-04-09T18:25:09.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.966 7f873ffff700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f872c01cce0 0x7f872c01f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:09.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.966 7f873ffff700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f872c01cce0 0x7f872c01f1e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:09.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.979 7f874e9b1700 1 -- 172.21.15.120:0/574990500 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87481829c0 con 0x7f8748191390 2021-04-09T18:25:09.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:09.983 7f87457fa700 1 -- 172.21.15.120:0/574990500 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8730009440 con 0x7f8748191390 2021-04-09T18:25:10.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.179 7f874e9b1700 1 -- 172.21.15.120:0/574990500 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87480d6be0 con 0x7f8748191390 2021-04-09T18:25:10.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.179 7f87457fa700 1 -- 172.21.15.120:0/574990500 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+1777 (secure 0 0 0) 0x7f8730000c90 con 0x7f8748191390 2021-04-09T18:25:10.173 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 22 2021-04-09T18:25:10.174 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:10.174 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:09.641665","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:clientreplay","state_seq":32,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:10.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 -- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f872c01cce0 msgr2=0x7f872c01f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:10.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f872c01cce0 0x7f872c01f1e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:10.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 -- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8748191390 msgr2=0x7f874818c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:10.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8748191390 0x7f874818c000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f8730006f20 tx=0x7f873000b8e0).stop 2021-04-09T18:25:10.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 -- 172.21.15.120:0/574990500 shutdown_connections 2021-04-09T18:25:10.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8748189320 0x7f87480b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:10.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8748188900 0x7f8748188d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:10.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f872c01cce0 0x7f872c01f1e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:10.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 --2- 172.21.15.120:0/574990500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8748191390 0x7f874818c000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:10.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 -- 172.21.15.120:0/574990500 >> 172.21.15.120:0/574990500 conn(0x7f874819a7e0 msgr2=0x7f8748093af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:10.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 -- 172.21.15.120:0/574990500 shutdown_connections 2021-04-09T18:25:10.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:10.184 7f874e9b1700 1 -- 172.21.15.120:0/574990500 wait complete. 2021-04-09T18:25:10.191 INFO:tasks.mds_thrash.fs.[None]:no change 2021-04-09T18:25:12.192 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:12.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.363 7f650e8bc700 1 Processor -- start 2021-04-09T18:25:12.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.363 7f650e8bc700 1 -- start start 2021-04-09T18:25:12.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f650e8bc700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f65080d7560 0x7f65080d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:12.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f650e8bc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65080d63b0 0x7f65081ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:12.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f650e8bc700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65080d7960 con 0x7f65080d7160 2021-04-09T18:25:12.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f650e8bc700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65080d80f0 con 0x7f65080d7560 2021-04-09T18:25:12.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f650e8bc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65080d0f10 con 0x7f65080d63b0 2021-04-09T18:25:12.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f64fffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f65080d7560 0x7f65080d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:12.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f64fffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f65080d7560 0x7f65080d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55816/0 (socket says 172.21.15.120:55816) 2021-04-09T18:25:12.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f64fffff700 1 -- 172.21.15.120:0/1888141321 learned_addr learned my addr 172.21.15.120:0/1888141321 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:12.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f650ced9700 1 --2- 172.21.15.120:0/1888141321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65080d63b0 0x7f65081ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:12.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f64fffff700 1 -- 172.21.15.120:0/1888141321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65080d63b0 msgr2=0x7f65081ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f64fffff700 1 --2- 172.21.15.120:0/1888141321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65080d63b0 0x7f65081ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f64fffff700 1 -- 172.21.15.120:0/1888141321 >> v1:172.21.15.134:6789/0 conn(0x7f65080d7160 legacy=0x7f65080d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f64fffff700 1 -- 172.21.15.120:0/1888141321 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080d6be0 con 0x7f65080d7560 2021-04-09T18:25:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.364 7f65077fe700 1 -- 172.21.15.120:0/1888141321 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54189670 0 0) 0x7f64f8000c60 con 0x7f65080d7160 2021-04-09T18:25:12.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.365 7f64fffff700 1 --2- 172.21.15.120:0/1888141321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65080d7560 0x7f65080d5d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f64f0006700 tx=0x7f64f0009b00).ready entity=mon.0 client_cookie=a6e71bc00203fde4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:12.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.365 7f65077fe700 1 -- 172.21.15.120:0/1888141321 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64f000c0c0 con 0x7f65080d7560 2021-04-09T18:25:12.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.365 7f65077fe700 1 -- 172.21.15.120:0/1888141321 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f000c400 con 0x7f65080d7560 2021-04-09T18:25:12.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.365 7f65077fe700 1 -- 172.21.15.120:0/1888141321 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64f000c8e0 con 0x7f65080d7560 2021-04-09T18:25:12.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.365 7f650e8bc700 1 -- 172.21.15.120:0/1888141321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65080d7560 msgr2=0x7f65080d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:12.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.365 7f650e8bc700 1 --2- 172.21.15.120:0/1888141321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65080d7560 0x7f65080d5d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f64f0006700 tx=0x7f64f0009b00).stop 2021-04-09T18:25:12.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.366 7f650e8bc700 1 -- 172.21.15.120:0/1888141321 shutdown_connections 2021-04-09T18:25:12.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.366 7f650e8bc700 1 --2- 172.21.15.120:0/1888141321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65080d7560 0x7f65080d5d90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.366 7f650e8bc700 1 --2- 172.21.15.120:0/1888141321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65080d63b0 0x7f65081ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.366 7f650e8bc700 1 -- 172.21.15.120:0/1888141321 >> 172.21.15.120:0/1888141321 conn(0x7f65080d1590 msgr2=0x7f65080d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:12.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.366 7f650e8bc700 1 -- 172.21.15.120:0/1888141321 shutdown_connections 2021-04-09T18:25:12.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.366 7f650e8bc700 1 -- 172.21.15.120:0/1888141321 wait complete. 2021-04-09T18:25:12.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.386 7f650e8bc700 1 Processor -- start 2021-04-09T18:25:12.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.386 7f650e8bc700 1 -- start start 2021-04-09T18:25:12.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f650e8bc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6508194cd0 0x7f6508183740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:12.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f650e8bc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6508183d60 0x7f6508182370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:12.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f650e8bc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6508182990 0x7f65080b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:12.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f650e8bc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6508180090 con 0x7f6508194cd0 2021-04-09T18:25:12.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f650e8bc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650817fbf0 con 0x7f6508183d60 2021-04-09T18:25:12.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f650e8bc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6508182d90 con 0x7f6508182990 2021-04-09T18:25:12.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f6507fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6508194cd0 0x7f6508183740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:12.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f64fffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6508183d60 0x7f6508182370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:12.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f650ced9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6508182990 0x7f65080b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:12.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f6507fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6508194cd0 0x7f6508183740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55820/0 (socket says 172.21.15.120:55820) 2021-04-09T18:25:12.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f6507fff700 1 -- 172.21.15.120:0/1391370633 learned_addr learned my addr 172.21.15.120:0/1391370633 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:12.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f64fffff700 1 -- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6508182990 msgr2=0x7f65080b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:12.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f64fffff700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6508182990 0x7f65080b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f64fffff700 1 -- 172.21.15.120:0/1391370633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6508194cd0 msgr2=0x7f6508183740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:12.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f64fffff700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6508194cd0 0x7f6508183740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f64fffff700 1 -- 172.21.15.120:0/1391370633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080b0ea0 con 0x7f6508183d60 2021-04-09T18:25:12.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f650ced9700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6508182990 0x7f65080b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:12.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f64fffff700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6508183d60 0x7f6508182370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f64f0000bd0 tx=0x7f64f000b890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:12.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.387 7f65057fa700 1 -- 172.21.15.120:0/1391370633 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64f0009090 con 0x7f6508183d60 2021-04-09T18:25:12.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.388 7f65057fa700 1 -- 172.21.15.120:0/1391370633 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0000940 con 0x7f6508183d60 2021-04-09T18:25:12.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.388 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65080b0ea0 con 0x7f6508183d60 2021-04-09T18:25:12.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.388 7f65057fa700 1 -- 172.21.15.120:0/1391370633 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f64f0002030 con 0x7f6508183d60 2021-04-09T18:25:12.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.388 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65080b0ea0 con 0x7f6508183d60 2021-04-09T18:25:12.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.388 7f65057fa700 1 -- 172.21.15.120:0/1391370633 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f64f000a000 con 0x7f6508183d60 2021-04-09T18:25:12.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.388 7f65057fa700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f64ec018930 0x7f64ec01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:12.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.388 7f65057fa700 1 -- 172.21.15.120:0/1391370633 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f64f0032ba0 con 0x7f6508183d60 2021-04-09T18:25:12.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.388 7f6507fff700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f64ec018930 0x7f64ec01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:12.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.389 7f6507fff700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f64ec018930 0x7f64ec01ae10 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:12.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.404 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6508179cb0 con 0x7f6508183d60 2021-04-09T18:25:12.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.408 7f65057fa700 1 -- 172.21.15.120:0/1391370633 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f64f0032db0 con 0x7f6508183d60 2021-04-09T18:25:12.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.614 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6508179cb0 con 0x7f6508183d60 2021-04-09T18:25:12.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.615 7f65057fa700 1 -- 172.21.15.120:0/1391370633 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1771 (secure 0 0 0) 0x7f64f000bc80 con 0x7f6508183d60 2021-04-09T18:25:12.609 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 23 2021-04-09T18:25:12.610 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:12.610 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:12.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f64ec018930 msgr2=0x7f64ec01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:12.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f64ec018930 0x7f64ec01ae10 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6508183d60 msgr2=0x7f6508182370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:12.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6508183d60 0x7f6508182370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f64f0000bd0 tx=0x7f64f000b890).stop 2021-04-09T18:25:12.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 shutdown_connections 2021-04-09T18:25:12.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f64ec018930 0x7f64ec01ae10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6508182990 0x7f65080b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6508183d60 0x7f6508182370 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 --2- 172.21.15.120:0/1391370633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6508194cd0 0x7f6508183740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:12.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.617 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 >> 172.21.15.120:0/1391370633 conn(0x7f6508186700 msgr2=0x7f650817e730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:12.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.618 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 shutdown_connections 2021-04-09T18:25:12.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:12.618 7f650e8bc700 1 -- 172.21.15.120:0/1391370633 wait complete. 2021-04-09T18:25:12.622 INFO:tasks.mds_thrash.fs.[None]:mds.a has gained rank=0, replacing gid=4759 2021-04-09T18:25:12.623 INFO:tasks.mds_thrash.fs.[None]:waiting for 5 secs before reviving mds.b 2021-04-09T18:25:17.624 INFO:tasks.mds_thrash.fs.[None]:reviving mds.b 2021-04-09T18:25:17.624 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:25:17.625 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:25:17.627 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:25:17.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:17.773 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2021-04-09T18:25:17.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.775 7ff4571b0700 1 Processor -- start 2021-04-09T18:25:17.793 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.775 7ff4571b0700 1 -- start start 2021-04-09T18:25:17.794 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.775 7ff4571b0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4500d6580 0x7ff4501ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:17.794 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.775 7ff4571b0700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4500d7960 con 0x7ff4500d7160 2021-04-09T18:25:17.794 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.775 7ff4571b0700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4500d6980 con 0x7ff4500d7560 2021-04-09T18:25:17.794 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.775 7ff4571b0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500d6be0 con 0x7ff4500d6580 2021-04-09T18:25:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.775 7ff454fcc700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff4500d7160 0x7ff4500d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50794/0 (socket says 172.21.15.120:50794) 2021-04-09T18:25:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.775 7ff454fcc700 1 -- 172.21.15.120:0/3635546059 learned_addr learned my addr 172.21.15.120:0/3635546059 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:25:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.775 7ff4557cd700 1 --2- 172.21.15.120:0/3635546059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4500d6580 0x7ff4501ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:17.795 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff44f7fe700 1 -- 172.21.15.120:0/3635546059 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052655392 0 0) 0x7ff438000ce0 con 0x7ff4500d7160 2021-04-09T18:25:17.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff44f7fe700 1 -- 172.21.15.120:0/3635546059 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff43c002fe0 con 0x7ff4500d7160 2021-04-09T18:25:17.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff44f7fe700 1 -- 172.21.15.120:0/3635546059 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796155706 0 0) 0x7ff440000c60 con 0x7ff4500d7560 2021-04-09T18:25:17.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff4557cd700 1 -- 172.21.15.120:0/3635546059 >> v1:172.21.15.134:6789/0 conn(0x7ff4500d7560 legacy=0x7ff4500d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:17.796 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff4557cd700 1 -- 172.21.15.120:0/3635546059 >> v1:172.21.15.120:6789/0 conn(0x7ff4500d7160 legacy=0x7ff4500d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:17.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff4557cd700 1 -- 172.21.15.120:0/3635546059 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4501a2ac0 con 0x7ff4500d6580 2021-04-09T18:25:17.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff4557cd700 1 --2- 172.21.15.120:0/3635546059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4500d6580 0x7ff4501ac1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff448006e50 tx=0x7ff448009e70).ready entity=mon.2 client_cookie=c9712f12a5d171f7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:17.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff44f7fe700 1 -- 172.21.15.120:0/3635546059 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff448006a20 con 0x7ff4500d6580 2021-04-09T18:25:17.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff44f7fe700 1 -- 172.21.15.120:0/3635546059 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448006790 con 0x7ff4500d6580 2021-04-09T18:25:17.797 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff44f7fe700 1 -- 172.21.15.120:0/3635546059 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff44800b700 con 0x7ff4500d6580 2021-04-09T18:25:17.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff4571b0700 1 -- 172.21.15.120:0/3635546059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4500d6580 msgr2=0x7ff4501ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:17.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.776 7ff4571b0700 1 --2- 172.21.15.120:0/3635546059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4500d6580 0x7ff4501ac1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff448006e50 tx=0x7ff448009e70).stop 2021-04-09T18:25:17.798 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.777 7ff4571b0700 1 -- 172.21.15.120:0/3635546059 shutdown_connections 2021-04-09T18:25:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.777 7ff4571b0700 1 --2- 172.21.15.120:0/3635546059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4500d6580 0x7ff4501ac1f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.777 7ff4571b0700 1 -- 172.21.15.120:0/3635546059 >> 172.21.15.120:0/3635546059 conn(0x7ff4500d1590 msgr2=0x7ff4500d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.777 7ff4571b0700 1 -- 172.21.15.120:0/3635546059 shutdown_connections 2021-04-09T18:25:17.799 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.777 7ff4571b0700 1 -- 172.21.15.120:0/3635546059 wait complete. 2021-04-09T18:25:17.800 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4571b0700 1 Processor -- start 2021-04-09T18:25:17.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4571b0700 1 -- start start 2021-04-09T18:25:17.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4571b0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff450191b80 0x7ff450195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:17.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4571b0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4501952c0 0x7ff4500902f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:17.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4571b0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4500b19b0 0x7ff4500b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4571b0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450195870 con 0x7ff4500b19b0 2021-04-09T18:25:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4571b0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450196410 con 0x7ff4501952c0 2021-04-09T18:25:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4571b0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff450090910 con 0x7ff450191b80 2021-04-09T18:25:17.804 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4557cd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4500b19b0 0x7ff4500b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4557cd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4500b19b0 0x7ff4500b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55892/0 (socket says 172.21.15.120:55892) 2021-04-09T18:25:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff4557cd700 1 -- 172.21.15.120:0/4292309386 learned_addr learned my addr 172.21.15.120:0/4292309386 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff454fcc700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff450191b80 0x7ff450195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.796 7ff44ffff700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4501952c0 0x7ff4500902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:17.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff4557cd700 1 -- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff450191b80 msgr2=0x7ff450195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff4557cd700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff450191b80 0x7ff450195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff4557cd700 1 -- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4501952c0 msgr2=0x7ff4500902f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff4557cd700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4501952c0 0x7ff4500902f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff4557cd700 1 -- 172.21.15.120:0/4292309386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4500b23d0 con 0x7ff4500b19b0 2021-04-09T18:25:17.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff4557cd700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4500b19b0 0x7ff4500b1db0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff448006e60 tx=0x7ff44800bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:17.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff44d7fa700 1 -- 172.21.15.120:0/4292309386 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff448009130 con 0x7ff4500b19b0 2021-04-09T18:25:17.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff44d7fa700 1 -- 172.21.15.120:0/4292309386 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448009430 con 0x7ff4500b19b0 2021-04-09T18:25:17.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4500b23d0 con 0x7ff4500b19b0 2021-04-09T18:25:17.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff44d7fa700 1 -- 172.21.15.120:0/4292309386 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff448001390 con 0x7ff4500b19b0 2021-04-09T18:25:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.797 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4500b23d0 con 0x7ff4500b19b0 2021-04-09T18:25:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.798 7ff44d7fa700 1 -- 172.21.15.120:0/4292309386 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff448009130 con 0x7ff4500b19b0 2021-04-09T18:25:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.798 7ff44d7fa700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff434018930 0x7ff43401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.798 7ff44d7fa700 1 -- 172.21.15.120:0/4292309386 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ff448032fd0 con 0x7ff4500b19b0 2021-04-09T18:25:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.798 7ff454fcc700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff434018930 0x7ff43401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:17.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.798 7ff454fcc700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff434018930 0x7ff43401ae10 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:17.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.820 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45017f6c0 con 0x7ff4500b19b0 2021-04-09T18:25:17.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:17.824 7ff44d7fa700 1 -- 172.21.15.120:0/4292309386 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff448009430 con 0x7ff4500b19b0 2021-04-09T18:25:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.002 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff45017f6c0 con 0x7ff4500b19b0 2021-04-09T18:25:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.003 7ff44d7fa700 1 -- 172.21.15.120:0/4292309386 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1771 (secure 0 0 0) 0x7ff448009430 con 0x7ff4500b19b0 2021-04-09T18:25:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 23 2021-04-09T18:25:17.997 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:17.997 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:17.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff434018930 msgr2=0x7ff43401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:17.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff434018930 0x7ff43401ae10 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:17.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4500b19b0 msgr2=0x7ff4500b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:17.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4500b19b0 0x7ff4500b1db0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff448006e60 tx=0x7ff44800bcf0).stop 2021-04-09T18:25:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 shutdown_connections 2021-04-09T18:25:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4500b19b0 0x7ff4500b1db0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:18.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4501952c0 0x7ff4500902f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:18.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff434018930 0x7ff43401ae10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:18.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 --2- 172.21.15.120:0/4292309386 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff450191b80 0x7ff450195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:18.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 >> 172.21.15.120:0/4292309386 conn(0x7ff45018a9d0 msgr2=0x7ff450198100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:18.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 shutdown_connections 2021-04-09T18:25:18.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:18.005 7ff4571b0700 1 -- 172.21.15.120:0/4292309386 wait complete. 2021-04-09T18:25:18.009 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-04-09T18:25:20.010 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:20.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.156 7f61c076d700 1 Processor -- start 2021-04-09T18:25:20.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.156 7f61c076d700 1 -- start start 2021-04-09T18:25:20.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.156 7f61c076d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80d7160 0x7f61b80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.156 7f61c076d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f61b80d7560 0x7f61b80d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61c076d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61b80d5bc0 0x7f61b80d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61c076d700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b80d80f0 con 0x7f61b80d7560 2021-04-09T18:25:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61c076d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b80d6be0 con 0x7f61b80d5bc0 2021-04-09T18:25:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61c076d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80e7f00 con 0x7f61b80d7160 2021-04-09T18:25:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bdd88700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f61b80d7560 0x7f61b80d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bdd88700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f61b80d7560 0x7f61b80d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55934/0 (socket says 172.21.15.120:55934) 2021-04-09T18:25:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bdd88700 1 -- 172.21.15.120:0/3064525618 learned_addr learned my addr 172.21.15.120:0/3064525618 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61be589700 1 --2- 172.21.15.120:0/3064525618 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80d7160 0x7f61b80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bed8a700 1 --2- 172.21.15.120:0/3064525618 >> v2:172.21.15.134:3300/0 conn(0x7f61b80d5bc0 0x7f61b80d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bdd88700 1 -- 172.21.15.120:0/3064525618 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80d7160 msgr2=0x7f61b80e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bdd88700 1 --2- 172.21.15.120:0/3064525618 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80d7160 0x7f61b80e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bdd88700 1 -- 172.21.15.120:0/3064525618 >> v2:172.21.15.134:3300/0 conn(0x7f61b80d5bc0 msgr2=0x7f61b80d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bdd88700 1 --2- 172.21.15.120:0/3064525618 >> v2:172.21.15.134:3300/0 conn(0x7f61b80d5bc0 0x7f61b80d5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bdd88700 1 -- 172.21.15.120:0/3064525618 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b81a2ac0 con 0x7f61b80d7560 2021-04-09T18:25:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61be589700 1 --2- 172.21.15.120:0/3064525618 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80d7160 0x7f61b80e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:25:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bed8a700 1 --2- 172.21.15.120:0/3064525618 >> v2:172.21.15.134:3300/0 conn(0x7f61b80d5bc0 0x7f61b80d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:25:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bdd88700 1 --2- 172.21.15.120:0/3064525618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80d7560 0x7f61b80d55a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f61b4006700 tx=0x7f61b4009b80).ready entity=mon.0 client_cookie=93b0803602a314a5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bd587700 1 -- 172.21.15.120:0/3064525618 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61b400c0c0 con 0x7f61b80d7560 2021-04-09T18:25:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bd587700 1 -- 172.21.15.120:0/3064525618 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b400c440 con 0x7f61b80d7560 2021-04-09T18:25:20.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61bd587700 1 -- 172.21.15.120:0/3064525618 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61b400c920 con 0x7f61b80d7560 2021-04-09T18:25:20.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61c076d700 1 -- 172.21.15.120:0/3064525618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80d7560 msgr2=0x7f61b80d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:20.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.157 7f61c076d700 1 --2- 172.21.15.120:0/3064525618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80d7560 0x7f61b80d55a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f61b4006700 tx=0x7f61b4009b80).stop 2021-04-09T18:25:20.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.158 7f61c076d700 1 -- 172.21.15.120:0/3064525618 shutdown_connections 2021-04-09T18:25:20.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.158 7f61c076d700 1 --2- 172.21.15.120:0/3064525618 >> v2:172.21.15.134:3300/0 conn(0x7f61b80d5bc0 0x7f61b80d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.158 7f61c076d700 1 --2- 172.21.15.120:0/3064525618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80d7560 0x7f61b80d55a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.158 7f61c076d700 1 --2- 172.21.15.120:0/3064525618 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80d7160 0x7f61b80e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.158 7f61c076d700 1 -- 172.21.15.120:0/3064525618 >> 172.21.15.120:0/3064525618 conn(0x7f61b80d1590 msgr2=0x7f61b80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:20.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.158 7f61c076d700 1 -- 172.21.15.120:0/3064525618 shutdown_connections 2021-04-09T18:25:20.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.158 7f61c076d700 1 -- 172.21.15.120:0/3064525618 wait complete. 2021-04-09T18:25:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.177 7f61c076d700 1 Processor -- start 2021-04-09T18:25:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.177 7f61c076d700 1 -- start start 2021-04-09T18:25:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61c076d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b8187670 0x7f61b80a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61c076d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80a5050 0x7f61b80b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:20.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61c076d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80b5710 0x7f61b81838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:20.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61c076d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80b5b10 con 0x7f61b80a5050 2021-04-09T18:25:20.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61c076d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80b5d30 con 0x7f61b8187670 2021-04-09T18:25:20.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61c076d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80b5f50 con 0x7f61b80b5710 2021-04-09T18:25:20.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bdd88700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80a5050 0x7f61b80b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:20.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bdd88700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80a5050 0x7f61b80b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55940/0 (socket says 172.21.15.120:55940) 2021-04-09T18:25:20.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bdd88700 1 -- 172.21.15.120:0/2021645472 learned_addr learned my addr 172.21.15.120:0/2021645472 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:20.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bed8a700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80b5710 0x7f61b81838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:20.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61be589700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b8187670 0x7f61b80a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:20.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bdd88700 1 -- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80b5710 msgr2=0x7f61b81838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:20.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bdd88700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80b5710 0x7f61b81838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bdd88700 1 -- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b8187670 msgr2=0x7f61b80a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:20.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bdd88700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b8187670 0x7f61b80a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bdd88700 1 -- 172.21.15.120:0/2021645472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8183ef0 con 0x7f61b80a5050 2021-04-09T18:25:20.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61bdd88700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80a5050 0x7f61b80b50f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f61b400b650 tx=0x7f61b400b9f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:20.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61aeffd700 1 -- 172.21.15.120:0/2021645472 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61b400bde0 con 0x7f61b80a5050 2021-04-09T18:25:20.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61aeffd700 1 -- 172.21.15.120:0/2021645472 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b4000c90 con 0x7f61b80a5050 2021-04-09T18:25:20.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61c076d700 1 -- 172.21.15.120:0/2021645472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b8183ef0 con 0x7f61b80a5050 2021-04-09T18:25:20.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61aeffd700 1 -- 172.21.15.120:0/2021645472 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61b4002220 con 0x7f61b80a5050 2021-04-09T18:25:20.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.178 7f61c076d700 1 -- 172.21.15.120:0/2021645472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b8183ef0 con 0x7f61b80a5050 2021-04-09T18:25:20.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.179 7f61aeffd700 1 -- 172.21.15.120:0/2021645472 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f61b4009f90 con 0x7f61b80a5050 2021-04-09T18:25:20.187 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.179 7f61aeffd700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61a0018930 0x7f61a001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:20.187 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.179 7f61aeffd700 1 -- 172.21.15.120:0/2021645472 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f61b4032c40 con 0x7f61b80a5050 2021-04-09T18:25:20.187 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.179 7f61be589700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61a0018930 0x7f61a001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:20.187 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.179 7f61be589700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61a0018930 0x7f61a001ae10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.203 7f61c076d700 1 -- 172.21.15.120:0/2021645472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b81829e0 con 0x7f61b80a5050 2021-04-09T18:25:20.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.207 7f61aeffd700 1 -- 172.21.15.120:0/2021645472 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f61b40091e0 con 0x7f61b80a5050 2021-04-09T18:25:20.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.440 7f61c076d700 1 -- 172.21.15.120:0/2021645472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61b81829e0 con 0x7f61b80a5050 2021-04-09T18:25:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.440 7f61aeffd700 1 -- 172.21.15.120:0/2021645472 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1771 (secure 0 0 0) 0x7f61b400bde0 con 0x7f61b80a5050 2021-04-09T18:25:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 23 2021-04-09T18:25:20.435 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:20.435 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:20.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 -- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61a0018930 msgr2=0x7f61a001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:20.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61a0018930 0x7f61a001ae10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 -- 172.21.15.120:0/2021645472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80a5050 msgr2=0x7f61b80b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:20.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80a5050 0x7f61b80b50f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f61b400b650 tx=0x7f61b400b9f0).stop 2021-04-09T18:25:20.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 -- 172.21.15.120:0/2021645472 shutdown_connections 2021-04-09T18:25:20.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f61a0018930 0x7f61a001ae10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b80b5710 0x7f61b81838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61b80a5050 0x7f61b80b50f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 --2- 172.21.15.120:0/2021645472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b8187670 0x7f61b80a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:20.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 -- 172.21.15.120:0/2021645472 >> 172.21.15.120:0/2021645472 conn(0x7f61b818dc90 msgr2=0x7f61b808fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:20.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 -- 172.21.15.120:0/2021645472 shutdown_connections 2021-04-09T18:25:20.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:20.443 7f61c076d700 1 -- 172.21.15.120:0/2021645472 wait complete. 2021-04-09T18:25:20.447 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-04-09T18:25:22.448 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:22.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.596 7f6dda4c9700 1 Processor -- start 2021-04-09T18:25:22.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.596 7f6dda4c9700 1 -- start start 2021-04-09T18:25:22.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dda4c9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6dd40d7160 0x7f6dd40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:22.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dda4c9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd40d6190 0x7f6dd40d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:22.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dda4c9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40d6be0 con 0x7f6dd40d55a0 2021-04-09T18:25:22.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dda4c9700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40d80f0 con 0x7f6dd40d7160 2021-04-09T18:25:22.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dda4c9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41a2ac0 con 0x7f6dd40d6190 2021-04-09T18:25:22.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dd3fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6dd40d7160 0x7f6dd40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:22.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dd3fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6dd40d7160 0x7f6dd40d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55988/0 (socket says 172.21.15.120:55988) 2021-04-09T18:25:22.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dd3fff700 1 -- 172.21.15.120:0/3776780053 learned_addr learned my addr 172.21.15.120:0/3776780053 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:22.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dd8ae6700 1 --2- 172.21.15.120:0/3776780053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd40d6190 0x7f6dd40d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:22.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dd3fff700 1 -- 172.21.15.120:0/3776780053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd40d6190 msgr2=0x7f6dd40d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:22.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dd3fff700 1 --2- 172.21.15.120:0/3776780053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd40d6190 0x7f6dd40d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.597 7f6dd3fff700 1 -- 172.21.15.120:0/3776780053 >> v1:172.21.15.134:6789/0 conn(0x7f6dd40d55a0 legacy=0x7f6dd40d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:22.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.598 7f6dd3fff700 1 -- 172.21.15.120:0/3776780053 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd41a2cb0 con 0x7f6dd40d7160 2021-04-09T18:25:22.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.598 7f6dd3fff700 1 --2- 172.21.15.120:0/3776780053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd40d7160 0x7f6dd40d7560 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f6dc4006700 tx=0x7f6dc4009b80).ready entity=mon.0 client_cookie=2c609ed2c534512a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:22.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.598 7f6dd37fe700 1 -- 172.21.15.120:0/3776780053 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6dc400c0c0 con 0x7f6dd40d7160 2021-04-09T18:25:22.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.598 7f6dd37fe700 1 -- 172.21.15.120:0/3776780053 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc400c440 con 0x7f6dd40d7160 2021-04-09T18:25:22.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.598 7f6dd37fe700 1 -- 172.21.15.120:0/3776780053 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6dc400c920 con 0x7f6dd40d7160 2021-04-09T18:25:22.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.598 7f6dda4c9700 1 -- 172.21.15.120:0/3776780053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd40d7160 msgr2=0x7f6dd40d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:22.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.598 7f6dda4c9700 1 --2- 172.21.15.120:0/3776780053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd40d7160 0x7f6dd40d7560 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f6dc4006700 tx=0x7f6dc4009b80).stop 2021-04-09T18:25:22.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.599 7f6dda4c9700 1 -- 172.21.15.120:0/3776780053 shutdown_connections 2021-04-09T18:25:22.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.599 7f6dda4c9700 1 --2- 172.21.15.120:0/3776780053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd40d6190 0x7f6dd40d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.599 7f6dda4c9700 1 --2- 172.21.15.120:0/3776780053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd40d7160 0x7f6dd40d7560 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.599 7f6dda4c9700 1 -- 172.21.15.120:0/3776780053 >> 172.21.15.120:0/3776780053 conn(0x7f6dd40d1590 msgr2=0x7f6dd40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:22.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.599 7f6dda4c9700 1 -- 172.21.15.120:0/3776780053 shutdown_connections 2021-04-09T18:25:22.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.599 7f6dda4c9700 1 -- 172.21.15.120:0/3776780053 wait complete. 2021-04-09T18:25:22.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dda4c9700 1 Processor -- start 2021-04-09T18:25:22.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dda4c9700 1 -- start start 2021-04-09T18:25:22.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dda4c9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd4187380 0x7f6dd4189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:22.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dda4c9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd4187780 0x7f6dd40987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:22.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dda4c9700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd4189c50 0x7f6dd40b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:22.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dda4c9700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd418ce60 con 0x7f6dd4187780 2021-04-09T18:25:22.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dda4c9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4098e10 con 0x7f6dd4187380 2021-04-09T18:25:22.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dda4c9700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4099030 con 0x7f6dd4189c50 2021-04-09T18:25:22.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dcbfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd4187780 0x7f6dd40987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:22.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dcbfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd4187780 0x7f6dd40987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55996/0 (socket says 172.21.15.120:55996) 2021-04-09T18:25:22.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dcbfff700 1 -- 172.21.15.120:0/2782342144 learned_addr learned my addr 172.21.15.120:0/2782342144 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:22.635 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dd8ae6700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd4189c50 0x7f6dd40b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:22.635 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.618 7f6dd3fff700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd4187380 0x7f6dd4189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:22.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dcbfff700 1 -- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd4189c50 msgr2=0x7f6dd40b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:22.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dcbfff700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd4189c50 0x7f6dd40b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dcbfff700 1 -- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd4187380 msgr2=0x7f6dd4189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:22.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dcbfff700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd4187380 0x7f6dd4189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dcbfff700 1 -- 172.21.15.120:0/2782342144 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40b8b30 con 0x7f6dd4187780 2021-04-09T18:25:22.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dcbfff700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd4187780 0x7f6dd40987f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f6dbc006ed0 tx=0x7f6dbc00b960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:22.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dd17fa700 1 -- 172.21.15.120:0/2782342144 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6dbc006020 con 0x7f6dd4187780 2021-04-09T18:25:22.639 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dd17fa700 1 -- 172.21.15.120:0/2782342144 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc006360 con 0x7f6dd4187780 2021-04-09T18:25:22.639 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd40b8b30 con 0x7f6dd4187780 2021-04-09T18:25:22.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dd17fa700 1 -- 172.21.15.120:0/2782342144 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6dbc005730 con 0x7f6dd4187780 2021-04-09T18:25:22.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.619 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd40b8b30 con 0x7f6dd4187780 2021-04-09T18:25:22.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.620 7f6dd17fa700 1 -- 172.21.15.120:0/2782342144 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6dbc0054b0 con 0x7f6dd4187780 2021-04-09T18:25:22.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.620 7f6dd17fa700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6db80188c0 0x7f6db801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:22.641 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.620 7f6dd17fa700 1 -- 172.21.15.120:0/2782342144 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f6dbc032a60 con 0x7f6dd4187780 2021-04-09T18:25:22.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.620 7f6dd3fff700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6db80188c0 0x7f6db801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:22.642 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.620 7f6dd3fff700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6db80188c0 0x7f6db801adc0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:22.643 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.643 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd4189100 con 0x7f6dd4187780 2021-04-09T18:25:22.644 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.646 7f6dd17fa700 1 -- 172.21.15.120:0/2782342144 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6dbc02efd0 con 0x7f6dd4187780 2021-04-09T18:25:22.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.828 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dd4189100 con 0x7f6dd4187780 2021-04-09T18:25:22.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.828 7f6dd17fa700 1 -- 172.21.15.120:0/2782342144 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f6dbc02efd0 con 0x7f6dd4187780 2021-04-09T18:25:22.823 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2021-04-09T18:25:22.824 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:22.824 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:22.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6db80188c0 msgr2=0x7f6db801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:22.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6db80188c0 0x7f6db801adc0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd4187780 msgr2=0x7f6dd40987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:22.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd4187780 0x7f6dd40987f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f6dbc006ed0 tx=0x7f6dbc00b960).stop 2021-04-09T18:25:22.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 shutdown_connections 2021-04-09T18:25:22.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6db80188c0 0x7f6db801adc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6dd4189c50 0x7f6dd40b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dd4187780 0x7f6dd40987f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 --2- 172.21.15.120:0/2782342144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dd4187380 0x7f6dd4189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:22.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 >> 172.21.15.120:0/2782342144 conn(0x7f6dd418dc90 msgr2=0x7f6dd408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:22.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 shutdown_connections 2021-04-09T18:25:22.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:22.832 7f6dda4c9700 1 -- 172.21.15.120:0/2782342144 wait complete. 2021-04-09T18:25:22.836 INFO:tasks.mds_thrash.fs.[None]:mds.b reported in up:standby state 2021-04-09T18:25:22.837 INFO:tasks.mds_thrash.fs.[None]:waiting for 29 secs before thrashing 2021-04-09T18:25:29.330 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:29.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:25:32.088 INFO:tasks.workunit.client.0.smithi120.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2021-04-09T18:25:32.098 INFO:tasks.workunit.client.0.smithi120.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2021-04-09T18:25:32.098 INFO:tasks.workunit.client.0.smithi120.stderr:+ make 2021-04-09T18:25:32.524 INFO:tasks.workunit.client.0.smithi120.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2021-04-09T18:25:35.318 INFO:tasks.workunit.client.0.smithi120.stderr:++ readlink -f fsstress 2021-04-09T18:25:35.320 INFO:tasks.workunit.client.0.smithi120.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2021-04-09T18:25:35.320 INFO:tasks.workunit.client.0.smithi120.stderr:+ popd 2021-04-09T18:25:35.321 INFO:tasks.workunit.client.0.smithi120.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2021-04-09T18:25:35.322 INFO:tasks.workunit.client.0.smithi120.stderr:+ popd 2021-04-09T18:25:35.322 INFO:tasks.workunit.client.0.smithi120.stdout:~/cephtest/mnt.0/client.0/tmp 2021-04-09T18:25:35.323 INFO:tasks.workunit.client.0.smithi120.stderr:++ mktemp -d -p . 2021-04-09T18:25:35.324 INFO:tasks.workunit.client.0.smithi120.stderr:+ T=./tmp.kNIFAW6UNL 2021-04-09T18:25:35.325 INFO:tasks.workunit.client.0.smithi120.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.kNIFAW6UNL -l 1 -n 1000 -p 10 -v 2021-04-09T18:25:35.328 INFO:tasks.workunit.client.0.smithi120.stdout:seed = 1618329168 2021-04-09T18:25:35.333 INFO:tasks.workunit.client.0.smithi120.stdout:1/0: write - no filename 2021-04-09T18:25:35.333 INFO:tasks.workunit.client.0.smithi120.stdout:1/1: dwrite - no filename 2021-04-09T18:25:35.334 INFO:tasks.workunit.client.0.smithi120.stdout:1/2: rename - no filename 2021-04-09T18:25:35.334 INFO:tasks.workunit.client.0.smithi120.stdout:0/0: mkdir d0 0 2021-04-09T18:25:35.336 INFO:tasks.workunit.client.0.smithi120.stdout:2/0: rmdir - no directory 2021-04-09T18:25:35.336 INFO:tasks.workunit.client.0.smithi120.stdout:2/1: write - no filename 2021-04-09T18:25:35.336 INFO:tasks.workunit.client.0.smithi120.stdout:2/2: truncate - no filename 2021-04-09T18:25:35.337 INFO:tasks.workunit.client.0.smithi120.stdout:3/0: stat - no entries 2021-04-09T18:25:35.338 INFO:tasks.workunit.client.0.smithi120.stdout:3/1: dread - no filename 2021-04-09T18:25:35.338 INFO:tasks.workunit.client.0.smithi120.stdout:3/2: chown . 3 1 2021-04-09T18:25:35.338 INFO:tasks.workunit.client.0.smithi120.stdout:3/3: write - no filename 2021-04-09T18:25:35.338 INFO:tasks.workunit.client.0.smithi120.stdout:3/4: link - no file 2021-04-09T18:25:35.338 INFO:tasks.workunit.client.0.smithi120.stdout:3/5: chown . 328013 1 2021-04-09T18:25:35.339 INFO:tasks.workunit.client.0.smithi120.stdout:3/6: dwrite - no filename 2021-04-09T18:25:35.339 INFO:tasks.workunit.client.0.smithi120.stdout:3/7: dread - no filename 2021-04-09T18:25:35.339 INFO:tasks.workunit.client.0.smithi120.stdout:3/8: dwrite - no filename 2021-04-09T18:25:35.341 INFO:tasks.workunit.client.0.smithi120.stdout:0/1: mkdir d0/d1 0 2021-04-09T18:25:35.341 INFO:tasks.workunit.client.0.smithi120.stdout:0/2: truncate - no filename 2021-04-09T18:25:35.341 INFO:tasks.workunit.client.0.smithi120.stdout:0/3: readlink - no filename 2021-04-09T18:25:35.341 INFO:tasks.workunit.client.0.smithi120.stdout:0/4: chown d0 8 1 2021-04-09T18:25:35.342 INFO:tasks.workunit.client.0.smithi120.stdout:2/3: mkdir d0 0 2021-04-09T18:25:35.342 INFO:tasks.workunit.client.0.smithi120.stdout:2/4: dwrite - no filename 2021-04-09T18:25:35.342 INFO:tasks.workunit.client.0.smithi120.stdout:0/5: chown d0 237941742 1 2021-04-09T18:25:35.342 INFO:tasks.workunit.client.0.smithi120.stdout:0/6: read - no filename 2021-04-09T18:25:35.342 INFO:tasks.workunit.client.0.smithi120.stdout:0/7: dread - no filename 2021-04-09T18:25:35.343 INFO:tasks.workunit.client.0.smithi120.stdout:0/8: link - no file 2021-04-09T18:25:35.343 INFO:tasks.workunit.client.0.smithi120.stdout:0/9: dwrite - no filename 2021-04-09T18:25:35.343 INFO:tasks.workunit.client.0.smithi120.stdout:0/10: unlink - no file 2021-04-09T18:25:35.343 INFO:tasks.workunit.client.0.smithi120.stdout:0/11: dwrite - no filename 2021-04-09T18:25:35.344 INFO:tasks.workunit.client.0.smithi120.stdout:4/0: dwrite - no filename 2021-04-09T18:25:35.344 INFO:tasks.workunit.client.0.smithi120.stdout:4/1: dread - no filename 2021-04-09T18:25:35.344 INFO:tasks.workunit.client.0.smithi120.stdout:0/12: mkdir d0/d2 0 2021-04-09T18:25:35.344 INFO:tasks.workunit.client.0.smithi120.stdout:0/13: write - no filename 2021-04-09T18:25:35.344 INFO:tasks.workunit.client.0.smithi120.stdout:3/9: getdents . 0 2021-04-09T18:25:35.345 INFO:tasks.workunit.client.0.smithi120.stdout:0/14: rename d0 to d0/d3 22 2021-04-09T18:25:35.345 INFO:tasks.workunit.client.0.smithi120.stdout:3/10: chown . 0 1 2021-04-09T18:25:35.345 INFO:tasks.workunit.client.0.smithi120.stdout:3/11: chown . 382561 1 2021-04-09T18:25:35.346 INFO:tasks.workunit.client.0.smithi120.stdout:5/0: truncate - no filename 2021-04-09T18:25:35.386 INFO:tasks.workunit.client.0.smithi120.stdout:4/2: symlink l0 0 2021-04-09T18:25:35.387 INFO:tasks.workunit.client.0.smithi120.stdout:3/12: creat f0 x:0 0 0 2021-04-09T18:25:35.387 INFO:tasks.workunit.client.0.smithi120.stdout:0/15: mkdir d0/d2/d4 0 2021-04-09T18:25:35.388 INFO:tasks.workunit.client.0.smithi120.stdout:6/0: fdatasync - no filename 2021-04-09T18:25:35.388 INFO:tasks.workunit.client.0.smithi120.stdout:4/3: creat f1 x:0 0 0 2021-04-09T18:25:35.389 INFO:tasks.workunit.client.0.smithi120.stdout:5/1: symlink l0 0 2021-04-09T18:25:35.389 INFO:tasks.workunit.client.0.smithi120.stdout:5/2: mknod c1 1 2021-04-09T18:25:35.389 INFO:tasks.workunit.client.0.smithi120.stdout:4/4: read - f1 zero size 2021-04-09T18:25:35.390 INFO:tasks.workunit.client.0.smithi120.stdout:7/0: rename - no filename 2021-04-09T18:25:35.390 INFO:tasks.workunit.client.0.smithi120.stdout:7/1: mknod c0 1 2021-04-09T18:25:35.391 INFO:tasks.workunit.client.0.smithi120.stdout:7/2: write - no filename 2021-04-09T18:25:35.391 INFO:tasks.workunit.client.0.smithi120.stdout:7/3: unlink - no file 2021-04-09T18:25:35.391 INFO:tasks.workunit.client.0.smithi120.stdout:7/4: chown . 58635082 1 2021-04-09T18:25:35.391 INFO:tasks.workunit.client.0.smithi120.stdout:7/5: fsync - no filename 2021-04-09T18:25:35.392 INFO:tasks.workunit.client.0.smithi120.stdout:7/6: dwrite - no filename 2021-04-09T18:25:35.392 INFO:tasks.workunit.client.0.smithi120.stdout:7/7: link - no file 2021-04-09T18:25:35.392 INFO:tasks.workunit.client.0.smithi120.stdout:7/8: write - no filename 2021-04-09T18:25:35.392 INFO:tasks.workunit.client.0.smithi120.stdout:3/13: rename f0 to f1 0 2021-04-09T18:25:35.405 INFO:tasks.workunit.client.0.smithi120.stdout:4/5: symlink l2 0 2021-04-09T18:25:35.405 INFO:tasks.workunit.client.0.smithi120.stdout:5/3: creat f2 x:0 0 0 2021-04-09T18:25:35.406 INFO:tasks.workunit.client.0.smithi120.stdout:4/6: dread - f1 zero size 2021-04-09T18:25:35.406 INFO:tasks.workunit.client.0.smithi120.stdout:8/0: mknod c0 1 2021-04-09T18:25:35.407 INFO:tasks.workunit.client.0.smithi120.stdout:8/1: fdatasync - no filename 2021-04-09T18:25:35.407 INFO:tasks.workunit.client.0.smithi120.stdout:8/2: write - no filename 2021-04-09T18:25:35.408 INFO:tasks.workunit.client.0.smithi120.stdout:6/1: mkdir d0 0 2021-04-09T18:25:35.408 INFO:tasks.workunit.client.0.smithi120.stdout:4/7: write f1 [277209,2249] 0 2021-04-09T18:25:35.408 INFO:tasks.workunit.client.0.smithi120.stdout:0/16: getdents d0/d2/d4 0 2021-04-09T18:25:35.409 INFO:tasks.workunit.client.0.smithi120.stdout:0/17: chown d0/d2 31133619 1 2021-04-09T18:25:35.409 INFO:tasks.workunit.client.0.smithi120.stdout:0/18: dwrite - no filename 2021-04-09T18:25:35.409 INFO:tasks.workunit.client.0.smithi120.stdout:0/19: fdatasync - no filename 2021-04-09T18:25:35.410 INFO:tasks.workunit.client.0.smithi120.stdout:5/4: mkdir d3 0 2021-04-09T18:25:35.410 INFO:tasks.workunit.client.0.smithi120.stdout:3/14: write f1 [974676,109492] 0 2021-04-09T18:25:35.411 INFO:tasks.workunit.client.0.smithi120.stdout:9/0: rmdir - no directory 2021-04-09T18:25:35.411 INFO:tasks.workunit.client.0.smithi120.stdout:9/1: rename - no filename 2021-04-09T18:25:35.413 INFO:tasks.workunit.client.0.smithi120.stdout:7/9: creat f1 x:0 0 0 2021-04-09T18:25:35.416 INFO:tasks.workunit.client.0.smithi120.stdout:3/15: creat f2 x:0 0 0 2021-04-09T18:25:35.416 INFO:tasks.workunit.client.0.smithi120.stdout:3/16: readlink - no filename 2021-04-09T18:25:35.417 INFO:tasks.workunit.client.0.smithi120.stdout:8/3: getdents . 0 2021-04-09T18:25:35.417 INFO:tasks.workunit.client.0.smithi120.stdout:0/20: creat d0/d2/d4/f5 x:0 0 0 2021-04-09T18:25:35.419 INFO:tasks.workunit.client.0.smithi120.stdout:9/2: symlink l0 0 2021-04-09T18:25:35.420 INFO:tasks.workunit.client.0.smithi120.stdout:9/3: dwrite - no filename 2021-04-09T18:25:35.420 INFO:tasks.workunit.client.0.smithi120.stdout:9/4: read - no filename 2021-04-09T18:25:35.420 INFO:tasks.workunit.client.0.smithi120.stdout:0/21: write d0/d2/d4/f5 [1004154,98852] 0 2021-04-09T18:25:35.421 INFO:tasks.workunit.client.0.smithi120.stdout:4/8: dread f1 [0,4194304] 0 2021-04-09T18:25:35.422 INFO:tasks.workunit.client.0.smithi120.stdout:4/9: mknod c3 1 2021-04-09T18:25:35.422 INFO:tasks.workunit.client.0.smithi120.stdout:9/5: chown l0 79 1 2021-04-09T18:25:35.423 INFO:tasks.workunit.client.0.smithi120.stdout:6/2: rmdir d0 0 2021-04-09T18:25:35.423 INFO:tasks.workunit.client.0.smithi120.stdout:6/3: dread - no filename 2021-04-09T18:25:35.423 INFO:tasks.workunit.client.0.smithi120.stdout:9/6: chown l0 8468 1 2021-04-09T18:25:35.424 INFO:tasks.workunit.client.0.smithi120.stdout:5/5: rmdir d3 0 2021-04-09T18:25:35.426 INFO:tasks.workunit.client.0.smithi120.stdout:3/17: dwrite f1 [0,4194304] 0 2021-04-09T18:25:35.428 INFO:tasks.workunit.client.0.smithi120.stdout:3/18: write f1 [3570916,103089] 0 2021-04-09T18:25:35.428 INFO:tasks.workunit.client.0.smithi120.stdout:5/6: symlink l4 0 2021-04-09T18:25:35.429 INFO:tasks.workunit.client.0.smithi120.stdout:8/4: symlink l1 0 2021-04-09T18:25:35.429 INFO:tasks.workunit.client.0.smithi120.stdout:8/5: read - no filename 2021-04-09T18:25:35.429 INFO:tasks.workunit.client.0.smithi120.stdout:6/4: symlink l1 0 2021-04-09T18:25:35.430 INFO:tasks.workunit.client.0.smithi120.stdout:9/7: rename l0 to l1 0 2021-04-09T18:25:35.431 INFO:tasks.workunit.client.0.smithi120.stdout:6/5: symlink l2 0 2021-04-09T18:25:35.437 INFO:tasks.workunit.client.0.smithi120.stdout:8/6: mkdir d2 0 2021-04-09T18:25:35.437 INFO:tasks.workunit.client.0.smithi120.stdout:8/7: dwrite - no filename 2021-04-09T18:25:35.438 INFO:tasks.workunit.client.0.smithi120.stdout:3/19: mkdir d3 0 2021-04-09T18:25:35.439 INFO:tasks.workunit.client.0.smithi120.stdout:9/8: creat f2 x:0 0 0 2021-04-09T18:25:35.439 INFO:tasks.workunit.client.0.smithi120.stdout:5/7: dwrite f2 [0,4194304] 0 2021-04-09T18:25:35.440 INFO:tasks.workunit.client.0.smithi120.stdout:5/8: chown f2 3263714 1 2021-04-09T18:25:35.441 INFO:tasks.workunit.client.0.smithi120.stdout:6/6: unlink l1 0 2021-04-09T18:25:35.442 INFO:tasks.workunit.client.0.smithi120.stdout:5/9: write f2 [771077,72134] 0 2021-04-09T18:25:35.444 INFO:tasks.workunit.client.0.smithi120.stdout:8/8: mkdir d2/d3 0 2021-04-09T18:25:35.452 INFO:tasks.workunit.client.0.smithi120.stdout:3/20: creat d3/f4 x:0 0 0 2021-04-09T18:25:35.465 INFO:tasks.workunit.client.0.smithi120.stdout:7/10: getdents . 0 2021-04-09T18:25:35.466 INFO:tasks.workunit.client.0.smithi120.stdout:7/11: dread - f1 zero size 2021-04-09T18:25:35.467 INFO:tasks.workunit.client.0.smithi120.stdout:3/21: mkdir d3/d5 0 2021-04-09T18:25:35.471 INFO:tasks.workunit.client.0.smithi120.stdout:8/9: creat d2/f4 x:0 0 0 2021-04-09T18:25:35.472 INFO:tasks.workunit.client.0.smithi120.stdout:8/10: write d2/f4 [573258,96328] 0 2021-04-09T18:25:35.473 INFO:tasks.workunit.client.0.smithi120.stdout:8/11: chown d2/d3 1319 1 2021-04-09T18:25:35.474 INFO:tasks.workunit.client.0.smithi120.stdout:7/12: creat f2 x:0 0 0 2021-04-09T18:25:35.474 INFO:tasks.workunit.client.0.smithi120.stdout:3/22: rmdir d3 39 2021-04-09T18:25:35.475 INFO:tasks.workunit.client.0.smithi120.stdout:9/9: stat l1 0 2021-04-09T18:25:35.475 INFO:tasks.workunit.client.0.smithi120.stdout:8/12: chown d2/f4 15 1 2021-04-09T18:25:35.476 INFO:tasks.workunit.client.0.smithi120.stdout:6/7: link l2 l3 0 2021-04-09T18:25:35.477 INFO:tasks.workunit.client.0.smithi120.stdout:8/13: write d2/f4 [199467,30339] 0 2021-04-09T18:25:35.479 INFO:tasks.workunit.client.0.smithi120.stdout:4/10: truncate f1 43572 0 2021-04-09T18:25:35.481 INFO:tasks.workunit.client.0.smithi120.stdout:6/8: rename l2 to l4 0 2021-04-09T18:25:35.481 INFO:tasks.workunit.client.0.smithi120.stdout:6/9: write - no filename 2021-04-09T18:25:35.483 INFO:tasks.workunit.client.0.smithi120.stdout:9/10: dwrite f2 [0,4194304] 0 2021-04-09T18:25:35.485 INFO:tasks.workunit.client.0.smithi120.stdout:4/11: stat f1 0 2021-04-09T18:25:35.489 INFO:tasks.workunit.client.0.smithi120.stdout:4/12: rename l2 to l4 0 2021-04-09T18:25:35.493 INFO:tasks.workunit.client.0.smithi120.stdout:9/11: dwrite f2 [0,4194304] 0 2021-04-09T18:25:35.495 INFO:tasks.workunit.client.0.smithi120.stdout:4/13: stat f1 0 2021-04-09T18:25:35.495 INFO:tasks.workunit.client.0.smithi120.stdout:4/14: rmdir - no directory 2021-04-09T18:25:35.495 INFO:tasks.workunit.client.0.smithi120.stdout:9/12: write f2 [1366020,93773] 0 2021-04-09T18:25:35.498 INFO:tasks.workunit.client.0.smithi120.stdout:3/23: fsync d3/f4 0 2021-04-09T18:25:35.500 INFO:tasks.workunit.client.0.smithi120.stdout:3/24: read f1 [197359,64164] 0 2021-04-09T18:25:35.504 INFO:tasks.workunit.client.0.smithi120.stdout:3/25: creat d3/f6 x:0 0 0 2021-04-09T18:25:35.504 INFO:tasks.workunit.client.0.smithi120.stdout:3/26: readlink - no filename 2021-04-09T18:25:35.504 INFO:tasks.workunit.client.0.smithi120.stdout:9/13: dwrite f2 [0,4194304] 0 2021-04-09T18:25:35.508 INFO:tasks.workunit.client.0.smithi120.stdout:9/14: unlink l1 0 2021-04-09T18:25:35.511 INFO:tasks.workunit.client.0.smithi120.stdout:9/15: dread f2 [0,4194304] 0 2021-04-09T18:25:35.512 INFO:tasks.workunit.client.0.smithi120.stdout:5/10: truncate f2 928705 0 2021-04-09T18:25:35.512 INFO:tasks.workunit.client.0.smithi120.stdout:3/27: symlink d3/d5/l7 0 2021-04-09T18:25:35.513 INFO:tasks.workunit.client.0.smithi120.stdout:3/28: fsync d3/f4 0 2021-04-09T18:25:35.513 INFO:tasks.workunit.client.0.smithi120.stdout:3/29: fsync d3/f4 0 2021-04-09T18:25:35.521 INFO:tasks.workunit.client.0.smithi120.stdout:3/30: dwrite f1 [0,4194304] 0 2021-04-09T18:25:35.524 INFO:tasks.workunit.client.0.smithi120.stdout:6/10: getdents . 0 2021-04-09T18:25:35.525 INFO:tasks.workunit.client.0.smithi120.stdout:3/31: creat d3/f8 x:0 0 0 2021-04-09T18:25:35.530 INFO:tasks.workunit.client.0.smithi120.stdout:6/11: unlink l4 0 2021-04-09T18:25:35.531 INFO:tasks.workunit.client.0.smithi120.stdout:8/14: truncate d2/f4 818860 0 2021-04-09T18:25:35.566 INFO:tasks.workunit.client.0.smithi120.stdout:3/32: fdatasync f1 0 2021-04-09T18:25:35.569 INFO:tasks.workunit.client.0.smithi120.stdout:3/33: mkdir d3/d9 0 2021-04-09T18:25:35.570 INFO:tasks.workunit.client.0.smithi120.stdout:3/34: stat f1 0 2021-04-09T18:25:35.571 INFO:tasks.workunit.client.0.smithi120.stdout:3/35: mknod d3/d5/ca 1 2021-04-09T18:25:35.573 INFO:tasks.workunit.client.0.smithi120.stdout:3/36: getdents d3/d9 0 2021-04-09T18:25:35.574 INFO:tasks.workunit.client.0.smithi120.stdout:3/37: creat d3/d5/fb x:0 0 0 2021-04-09T18:25:35.578 INFO:tasks.workunit.client.0.smithi120.stdout:3/38: rmdir d3/d9 0 2021-04-09T18:25:35.581 INFO:tasks.workunit.client.0.smithi120.stdout:5/11: read f2 [270754,55610] 0 2021-04-09T18:25:35.582 INFO:tasks.workunit.client.0.smithi120.stdout:5/12: readlink l0 0 2021-04-09T18:25:35.586 INFO:tasks.workunit.client.0.smithi120.stdout:5/13: write f2 [1669660,84075] 0 2021-04-09T18:25:35.587 INFO:tasks.workunit.client.0.smithi120.stdout:9/16: truncate f2 2098090 0 2021-04-09T18:25:35.682 INFO:tasks.workunit.client.0.smithi120.stdout:3/39: truncate f1 3816866 0 2021-04-09T18:25:35.685 INFO:tasks.workunit.client.0.smithi120.stdout:8/15: dread d2/f4 [0,4194304] 0 2021-04-09T18:25:35.687 INFO:tasks.workunit.client.0.smithi120.stdout:8/16: rename l1 to d2/l5 0 2021-04-09T18:25:35.691 INFO:tasks.workunit.client.0.smithi120.stdout:8/17: creat d2/d3/f6 x:0 0 0 2021-04-09T18:25:35.693 INFO:tasks.workunit.client.0.smithi120.stdout:8/18: unlink d2/f4 0 2021-04-09T18:25:35.697 INFO:tasks.workunit.client.0.smithi120.stdout:8/19: dwrite d2/d3/f6 [0,4194304] 0 2021-04-09T18:25:35.699 INFO:tasks.workunit.client.0.smithi120.stdout:9/17: fsync f2 0 2021-04-09T18:25:35.704 INFO:tasks.workunit.client.0.smithi120.stdout:9/18: dwrite f2 [0,4194304] 0 2021-04-09T18:25:35.708 INFO:tasks.workunit.client.0.smithi120.stdout:9/19: dread f2 [0,4194304] 0 2021-04-09T18:25:35.709 INFO:tasks.workunit.client.0.smithi120.stdout:9/20: chown f2 1 1 2021-04-09T18:25:35.709 INFO:tasks.workunit.client.0.smithi120.stdout:9/21: read f2 [2001264,93651] 0 2021-04-09T18:25:35.712 INFO:tasks.workunit.client.0.smithi120.stdout:9/22: symlink l3 0 2021-04-09T18:25:35.716 INFO:tasks.workunit.client.0.smithi120.stdout:9/23: mkdir d4 0 2021-04-09T18:25:35.722 INFO:tasks.workunit.client.0.smithi120.stdout:9/24: dread f2 [0,4194304] 0 2021-04-09T18:25:35.728 INFO:tasks.workunit.client.0.smithi120.stdout:9/25: rmdir d4 0 2021-04-09T18:25:35.731 INFO:tasks.workunit.client.0.smithi120.stdout:9/26: mknod c5 1 2021-04-09T18:25:35.731 INFO:tasks.workunit.client.0.smithi120.stdout:9/27: mknod c6 1 2021-04-09T18:25:35.732 INFO:tasks.workunit.client.0.smithi120.stdout:9/28: write f2 [1892763,55694] 0 2021-04-09T18:25:35.734 INFO:tasks.workunit.client.0.smithi120.stdout:9/29: creat f7 x:0 0 0 2021-04-09T18:25:35.735 INFO:tasks.workunit.client.0.smithi120.stdout:9/30: read f2 [106034,68774] 0 2021-04-09T18:25:35.740 INFO:tasks.workunit.client.0.smithi120.stdout:3/40: write f1 [3918102,84083] 0 2021-04-09T18:25:35.743 INFO:tasks.workunit.client.0.smithi120.stdout:3/41: symlink d3/d5/lc 0 2021-04-09T18:25:35.748 INFO:tasks.workunit.client.0.smithi120.stdout:3/42: dwrite d3/f6 [0,4194304] 0 2021-04-09T18:25:35.751 INFO:tasks.workunit.client.0.smithi120.stdout:8/20: unlink d2/l5 0 2021-04-09T18:25:35.752 INFO:tasks.workunit.client.0.smithi120.stdout:3/43: symlink d3/d5/ld 0 2021-04-09T18:25:35.753 INFO:tasks.workunit.client.0.smithi120.stdout:3/44: write d3/f8 [797432,48182] 0 2021-04-09T18:25:35.754 INFO:tasks.workunit.client.0.smithi120.stdout:3/45: chown d3/d5 33788 1 2021-04-09T18:25:35.759 INFO:tasks.workunit.client.0.smithi120.stdout:3/46: mkdir d3/de 0 2021-04-09T18:25:35.759 INFO:tasks.workunit.client.0.smithi120.stdout:8/21: getdents d2/d3 0 2021-04-09T18:25:35.760 INFO:tasks.workunit.client.0.smithi120.stdout:8/22: write d2/d3/f6 [986568,119557] 0 2021-04-09T18:25:35.762 INFO:tasks.workunit.client.0.smithi120.stdout:8/23: rmdir d2/d3 39 2021-04-09T18:25:35.767 INFO:tasks.workunit.client.0.smithi120.stdout:8/24: rmdir d2/d3 39 2021-04-09T18:25:35.767 INFO:tasks.workunit.client.0.smithi120.stdout:9/31: truncate f2 2790920 0 2021-04-09T18:25:35.768 INFO:tasks.workunit.client.0.smithi120.stdout:8/25: mknod d2/c7 1 2021-04-09T18:25:35.771 INFO:tasks.workunit.client.0.smithi120.stdout:8/26: write d2/d3/f6 [257715,11940] 0 2021-04-09T18:25:35.772 INFO:tasks.workunit.client.0.smithi120.stdout:3/47: dread d3/f8 [0,4194304] 0 2021-04-09T18:25:35.773 INFO:tasks.workunit.client.0.smithi120.stdout:8/27: write d2/d3/f6 [3321617,130219] 0 2021-04-09T18:25:35.774 INFO:tasks.workunit.client.0.smithi120.stdout:3/48: chown f2 18252 1 2021-04-09T18:25:35.778 INFO:tasks.workunit.client.0.smithi120.stdout:8/28: mkdir d2/d3/d8 0 2021-04-09T18:25:35.778 INFO:tasks.workunit.client.0.smithi120.stdout:3/49: mkdir d3/d5/df 0 2021-04-09T18:25:35.779 INFO:tasks.workunit.client.0.smithi120.stdout:3/50: dread - d3/d5/fb zero size 2021-04-09T18:25:35.783 INFO:tasks.workunit.client.0.smithi120.stdout:8/29: link d2/d3/f6 d2/d3/d8/f9 0 2021-04-09T18:25:35.786 INFO:tasks.workunit.client.0.smithi120.stdout:3/51: dread f1 [0,4194304] 0 2021-04-09T18:25:35.789 INFO:tasks.workunit.client.0.smithi120.stdout:3/52: creat d3/d5/df/f10 x:0 0 0 2021-04-09T18:25:35.789 INFO:tasks.workunit.client.0.smithi120.stdout:3/53: chown d3 3 1 2021-04-09T18:25:35.790 INFO:tasks.workunit.client.0.smithi120.stdout:8/30: dwrite d2/d3/f6 [0,4194304] 0 2021-04-09T18:25:35.792 INFO:tasks.workunit.client.0.smithi120.stdout:3/54: creat d3/d5/df/f11 x:0 0 0 2021-04-09T18:25:35.793 INFO:tasks.workunit.client.0.smithi120.stdout:3/55: fdatasync d3/f8 0 2021-04-09T18:25:35.794 INFO:tasks.workunit.client.0.smithi120.stdout:3/56: symlink d3/l12 0 2021-04-09T18:25:35.825 INFO:tasks.workunit.client.0.smithi120.stdout:3/57: write d3/d5/df/f10 [76526,1553] 0 2021-04-09T18:25:35.830 INFO:tasks.workunit.client.0.smithi120.stdout:3/58: mkdir d3/de/d13 0 2021-04-09T18:25:35.832 INFO:tasks.workunit.client.0.smithi120.stdout:3/59: rename d3/d5/df to d3/d5/df/d14 22 2021-04-09T18:25:35.839 INFO:tasks.workunit.client.0.smithi120.stdout:3/60: creat d3/de/d13/f15 x:0 0 0 2021-04-09T18:25:35.843 INFO:tasks.workunit.client.0.smithi120.stdout:8/31: fdatasync d2/d3/d8/f9 0 2021-04-09T18:25:35.844 INFO:tasks.workunit.client.0.smithi120.stdout:8/32: readlink - no filename 2021-04-09T18:25:35.846 INFO:tasks.workunit.client.0.smithi120.stdout:3/61: dwrite d3/f8 [0,4194304] 0 2021-04-09T18:25:35.849 INFO:tasks.workunit.client.0.smithi120.stdout:8/33: creat d2/fa x:0 0 0 2021-04-09T18:25:35.853 INFO:tasks.workunit.client.0.smithi120.stdout:3/62: dread d3/f8 [0,4194304] 0 2021-04-09T18:25:35.859 INFO:tasks.workunit.client.0.smithi120.stdout:8/34: truncate d2/fa 120573 0 2021-04-09T18:25:35.864 INFO:tasks.workunit.client.0.smithi120.stdout:1/3: sync 2021-04-09T18:25:35.864 INFO:tasks.workunit.client.0.smithi120.stdout:1/4: dread - no filename 2021-04-09T18:25:35.864 INFO:tasks.workunit.client.0.smithi120.stdout:1/5: dwrite - no filename 2021-04-09T18:25:35.864 INFO:tasks.workunit.client.0.smithi120.stdout:1/6: read - no filename 2021-04-09T18:25:35.865 INFO:tasks.workunit.client.0.smithi120.stdout:1/7: chown . 52749227 1 2021-04-09T18:25:35.866 INFO:tasks.workunit.client.0.smithi120.stdout:1/8: getdents . 0 2021-04-09T18:25:35.867 INFO:tasks.workunit.client.0.smithi120.stdout:1/9: dwrite - no filename 2021-04-09T18:25:35.867 INFO:tasks.workunit.client.0.smithi120.stdout:1/10: dwrite - no filename 2021-04-09T18:25:35.867 INFO:tasks.workunit.client.0.smithi120.stdout:1/11: dwrite - no filename 2021-04-09T18:25:35.868 INFO:tasks.workunit.client.0.smithi120.stdout:1/12: symlink l0 0 2021-04-09T18:25:35.868 INFO:tasks.workunit.client.0.smithi120.stdout:1/13: truncate - no filename 2021-04-09T18:25:35.869 INFO:tasks.workunit.client.0.smithi120.stdout:1/14: dwrite - no filename 2021-04-09T18:25:35.870 INFO:tasks.workunit.client.0.smithi120.stdout:1/15: creat f1 x:0 0 0 2021-04-09T18:25:35.871 INFO:tasks.workunit.client.0.smithi120.stdout:1/16: creat f2 x:0 0 0 2021-04-09T18:25:35.873 INFO:tasks.workunit.client.0.smithi120.stdout:1/17: rename f2 to f3 0 2021-04-09T18:25:35.875 INFO:tasks.workunit.client.0.smithi120.stdout:1/18: unlink l0 0 2021-04-09T18:25:35.875 INFO:tasks.workunit.client.0.smithi120.stdout:1/19: dread - f3 zero size 2021-04-09T18:25:35.877 INFO:tasks.workunit.client.0.smithi120.stdout:1/20: rename f1 to f4 0 2021-04-09T18:25:35.878 INFO:tasks.workunit.client.0.smithi120.stdout:1/21: mkdir d5 0 2021-04-09T18:25:35.879 INFO:tasks.workunit.client.0.smithi120.stdout:1/22: chown f3 659 1 2021-04-09T18:25:35.880 INFO:tasks.workunit.client.0.smithi120.stdout:1/23: fdatasync f3 0 2021-04-09T18:25:35.882 INFO:tasks.workunit.client.0.smithi120.stdout:1/24: creat d5/f6 x:0 0 0 2021-04-09T18:25:35.883 INFO:tasks.workunit.client.0.smithi120.stdout:1/25: write d5/f6 [698875,53234] 0 2021-04-09T18:25:35.888 INFO:tasks.workunit.client.0.smithi120.stdout:1/26: dwrite f4 [0,4194304] 0 2021-04-09T18:25:35.985 INFO:tasks.workunit.client.0.smithi120.stdout:9/32: dread f2 [0,4194304] 0 2021-04-09T18:25:35.986 INFO:tasks.workunit.client.0.smithi120.stdout:9/33: read f2 [2532904,129879] 0 2021-04-09T18:25:35.986 INFO:tasks.workunit.client.0.smithi120.stdout:9/34: chown f2 45 1 2021-04-09T18:25:35.987 INFO:tasks.workunit.client.0.smithi120.stdout:9/35: dread - f7 zero size 2021-04-09T18:25:35.991 INFO:tasks.workunit.client.0.smithi120.stdout:9/36: truncate f7 941139 0 2021-04-09T18:25:35.991 INFO:tasks.workunit.client.0.smithi120.stdout:9/37: chown l3 1156141462 1 2021-04-09T18:25:35.992 INFO:tasks.workunit.client.0.smithi120.stdout:9/38: symlink l8 0 2021-04-09T18:25:35.997 INFO:tasks.workunit.client.0.smithi120.stdout:9/39: dwrite f2 [0,4194304] 0 2021-04-09T18:25:36.023 INFO:tasks.workunit.client.0.smithi120.stdout:8/35: getdents d2/d3/d8 0 2021-04-09T18:25:36.289 INFO:tasks.workunit.client.0.smithi120.stdout:5/14: dread f2 [0,4194304] 0 2021-04-09T18:25:36.289 INFO:tasks.workunit.client.0.smithi120.stdout:5/15: mknod c5 1 2021-04-09T18:25:36.294 INFO:tasks.workunit.client.0.smithi120.stdout:0/22: sync 2021-04-09T18:25:36.294 INFO:tasks.workunit.client.0.smithi120.stdout:2/5: sync 2021-04-09T18:25:36.295 INFO:tasks.workunit.client.0.smithi120.stdout:5/16: write f2 [284587,69877] 0 2021-04-09T18:25:36.296 INFO:tasks.workunit.client.0.smithi120.stdout:0/23: rmdir d0/d2 39 2021-04-09T18:25:36.300 INFO:tasks.workunit.client.0.smithi120.stdout:2/6: rmdir d0 0 2021-04-09T18:25:36.303 INFO:tasks.workunit.client.0.smithi120.stdout:0/24: symlink d0/d2/l6 0 2021-04-09T18:25:36.303 INFO:tasks.workunit.client.0.smithi120.stdout:2/7: symlink l1 0 2021-04-09T18:25:36.304 INFO:tasks.workunit.client.0.smithi120.stdout:2/8: dwrite - no filename 2021-04-09T18:25:36.304 INFO:tasks.workunit.client.0.smithi120.stdout:2/9: fdatasync - no filename 2021-04-09T18:25:36.304 INFO:tasks.workunit.client.0.smithi120.stdout:2/10: dwrite - no filename 2021-04-09T18:25:36.304 INFO:tasks.workunit.client.0.smithi120.stdout:0/25: stat d0/d1 0 2021-04-09T18:25:36.305 INFO:tasks.workunit.client.0.smithi120.stdout:2/11: chown l1 299561515 1 2021-04-09T18:25:36.305 INFO:tasks.workunit.client.0.smithi120.stdout:2/12: dread - no filename 2021-04-09T18:25:36.305 INFO:tasks.workunit.client.0.smithi120.stdout:1/27: rename f3 to d5/f7 0 2021-04-09T18:25:36.306 INFO:tasks.workunit.client.0.smithi120.stdout:1/28: chown d5 26126 1 2021-04-09T18:25:36.308 INFO:tasks.workunit.client.0.smithi120.stdout:2/13: symlink l2 0 2021-04-09T18:25:36.312 INFO:tasks.workunit.client.0.smithi120.stdout:2/14: creat f3 x:0 0 0 2021-04-09T18:25:36.313 INFO:tasks.workunit.client.0.smithi120.stdout:1/29: unlink f4 0 2021-04-09T18:25:36.316 INFO:tasks.workunit.client.0.smithi120.stdout:0/26: dread d0/d2/d4/f5 [0,4194304] 0 2021-04-09T18:25:36.317 INFO:tasks.workunit.client.0.smithi120.stdout:1/30: creat d5/f8 x:0 0 0 2021-04-09T18:25:36.318 INFO:tasks.workunit.client.0.smithi120.stdout:9/40: dread f7 [0,4194304] 0 2021-04-09T18:25:36.319 INFO:tasks.workunit.client.0.smithi120.stdout:1/31: read - d5/f7 zero size 2021-04-09T18:25:36.320 INFO:tasks.workunit.client.0.smithi120.stdout:1/32: dread - d5/f7 zero size 2021-04-09T18:25:36.321 INFO:tasks.workunit.client.0.smithi120.stdout:2/15: dwrite f3 [0,4194304] 0 2021-04-09T18:25:36.322 INFO:tasks.workunit.client.0.smithi120.stdout:0/27: fsync d0/d2/d4/f5 0 2021-04-09T18:25:36.325 INFO:tasks.workunit.client.0.smithi120.stdout:0/28: write d0/d2/d4/f5 [728643,34044] 0 2021-04-09T18:25:36.326 INFO:tasks.workunit.client.0.smithi120.stdout:2/16: rename f3 to f4 0 2021-04-09T18:25:36.333 INFO:tasks.workunit.client.0.smithi120.stdout:6/12: sync 2021-04-09T18:25:36.333 INFO:tasks.workunit.client.0.smithi120.stdout:6/13: fdatasync - no filename 2021-04-09T18:25:36.334 INFO:tasks.workunit.client.0.smithi120.stdout:4/15: sync 2021-04-09T18:25:36.334 INFO:tasks.workunit.client.0.smithi120.stdout:5/17: truncate f2 1459318 0 2021-04-09T18:25:36.336 INFO:tasks.workunit.client.0.smithi120.stdout:7/13: sync 2021-04-09T18:25:36.336 INFO:tasks.workunit.client.0.smithi120.stdout:3/63: sync 2021-04-09T18:25:36.337 INFO:tasks.workunit.client.0.smithi120.stdout:7/14: dread - f2 zero size 2021-04-09T18:25:36.338 INFO:tasks.workunit.client.0.smithi120.stdout:2/17: link l1 l5 0 2021-04-09T18:25:36.339 INFO:tasks.workunit.client.0.smithi120.stdout:7/15: write f1 [658417,15677] 0 2021-04-09T18:25:36.340 INFO:tasks.workunit.client.0.smithi120.stdout:0/29: dwrite d0/d2/d4/f5 [0,4194304] 0 2021-04-09T18:25:36.342 INFO:tasks.workunit.client.0.smithi120.stdout:7/16: write f2 [38571,78682] 0 2021-04-09T18:25:36.344 INFO:tasks.workunit.client.0.smithi120.stdout:3/64: rename d3/d5/lc to d3/l16 0 2021-04-09T18:25:36.346 INFO:tasks.workunit.client.0.smithi120.stdout:3/65: mknod d3/d5/df/c17 1 2021-04-09T18:25:36.349 INFO:tasks.workunit.client.0.smithi120.stdout:9/41: dwrite f7 [0,4194304] 0 2021-04-09T18:25:36.352 INFO:tasks.workunit.client.0.smithi120.stdout:6/14: creat f5 x:0 0 0 2021-04-09T18:25:36.354 INFO:tasks.workunit.client.0.smithi120.stdout:6/15: dread - f5 zero size 2021-04-09T18:25:36.354 INFO:tasks.workunit.client.0.smithi120.stdout:0/30: symlink d0/d2/l7 0 2021-04-09T18:25:36.355 INFO:tasks.workunit.client.0.smithi120.stdout:3/66: symlink d3/d5/df/l18 0 2021-04-09T18:25:36.355 INFO:tasks.workunit.client.0.smithi120.stdout:7/17: creat f3 x:0 0 0 2021-04-09T18:25:36.355 INFO:tasks.workunit.client.0.smithi120.stdout:7/18: readlink - no filename 2021-04-09T18:25:36.358 INFO:tasks.workunit.client.0.smithi120.stdout:6/16: mkdir d6 0 2021-04-09T18:25:36.358 INFO:tasks.workunit.client.0.smithi120.stdout:5/18: dread f2 [0,4194304] 0 2021-04-09T18:25:36.359 INFO:tasks.workunit.client.0.smithi120.stdout:1/33: truncate d5/f6 1783572 0 2021-04-09T18:25:36.361 INFO:tasks.workunit.client.0.smithi120.stdout:7/19: rename f1 to f4 0 2021-04-09T18:25:36.361 INFO:tasks.workunit.client.0.smithi120.stdout:7/20: mknod c5 1 2021-04-09T18:25:36.362 INFO:tasks.workunit.client.0.smithi120.stdout:1/34: fsync d5/f8 0 2021-04-09T18:25:36.363 INFO:tasks.workunit.client.0.smithi120.stdout:6/17: dread - f5 zero size 2021-04-09T18:25:36.365 INFO:tasks.workunit.client.0.smithi120.stdout:5/19: readlink l4 0 2021-04-09T18:25:36.366 INFO:tasks.workunit.client.0.smithi120.stdout:6/18: dread - f5 zero size 2021-04-09T18:25:36.366 INFO:tasks.workunit.client.0.smithi120.stdout:2/18: dread f4 [0,4194304] 0 2021-04-09T18:25:36.367 INFO:tasks.workunit.client.0.smithi120.stdout:0/31: symlink d0/d1/l8 0 2021-04-09T18:25:36.367 INFO:tasks.workunit.client.0.smithi120.stdout:5/20: chown l0 3140326 1 2021-04-09T18:25:36.368 INFO:tasks.workunit.client.0.smithi120.stdout:6/19: stat f5 0 2021-04-09T18:25:36.369 INFO:tasks.workunit.client.0.smithi120.stdout:1/35: rmdir d5 39 2021-04-09T18:25:36.369 INFO:tasks.workunit.client.0.smithi120.stdout:6/20: stat d6 0 2021-04-09T18:25:36.370 INFO:tasks.workunit.client.0.smithi120.stdout:5/21: chown f2 16035526 1 2021-04-09T18:25:36.370 INFO:tasks.workunit.client.0.smithi120.stdout:6/21: mknod d6/c7 1 2021-04-09T18:25:36.371 INFO:tasks.workunit.client.0.smithi120.stdout:8/36: sync 2021-04-09T18:25:36.371 INFO:tasks.workunit.client.0.smithi120.stdout:0/32: readlink d0/d2/l7 0 2021-04-09T18:25:36.372 INFO:tasks.workunit.client.0.smithi120.stdout:0/33: chown d0/d2 37 1 2021-04-09T18:25:36.372 INFO:tasks.workunit.client.0.smithi120.stdout:2/19: unlink l2 0 2021-04-09T18:25:36.375 INFO:tasks.workunit.client.0.smithi120.stdout:5/22: symlink l6 0 2021-04-09T18:25:36.377 INFO:tasks.workunit.client.0.smithi120.stdout:5/23: chown f2 10 1 2021-04-09T18:25:36.379 INFO:tasks.workunit.client.0.smithi120.stdout:3/67: dread d3/f6 [0,4194304] 0 2021-04-09T18:25:36.383 INFO:tasks.workunit.client.0.smithi120.stdout:5/24: mkdir d7 0 2021-04-09T18:25:36.384 INFO:tasks.workunit.client.0.smithi120.stdout:3/68: readlink d3/d5/l7 0 2021-04-09T18:25:36.384 INFO:tasks.workunit.client.0.smithi120.stdout:7/21: dwrite f2 [0,4194304] 0 2021-04-09T18:25:36.387 INFO:tasks.workunit.client.0.smithi120.stdout:6/22: dwrite f5 [0,4194304] 0 2021-04-09T18:25:36.391 INFO:tasks.workunit.client.0.smithi120.stdout:7/22: creat f6 x:0 0 0 2021-04-09T18:25:36.398 INFO:tasks.workunit.client.0.smithi120.stdout:2/20: dwrite f4 [4194304,4194304] 0 2021-04-09T18:25:36.402 INFO:tasks.workunit.client.0.smithi120.stdout:4/16: dwrite f1 [0,4194304] 0 2021-04-09T18:25:36.404 INFO:tasks.workunit.client.0.smithi120.stdout:7/23: creat f7 x:0 0 0 2021-04-09T18:25:36.405 INFO:tasks.workunit.client.0.smithi120.stdout:6/23: mkdir d6/d8 0 2021-04-09T18:25:36.405 INFO:tasks.workunit.client.0.smithi120.stdout:5/25: rmdir d7 0 2021-04-09T18:25:36.406 INFO:tasks.workunit.client.0.smithi120.stdout:5/26: stat l4 0 2021-04-09T18:25:36.407 INFO:tasks.workunit.client.0.smithi120.stdout:7/24: chown f4 24613 1 2021-04-09T18:25:36.407 INFO:tasks.workunit.client.0.smithi120.stdout:7/25: mknod c8 1 2021-04-09T18:25:36.408 INFO:tasks.workunit.client.0.smithi120.stdout:7/26: dread - f6 zero size 2021-04-09T18:25:36.408 INFO:tasks.workunit.client.0.smithi120.stdout:3/69: dwrite f1 [0,4194304] 0 2021-04-09T18:25:36.409 INFO:tasks.workunit.client.0.smithi120.stdout:6/24: read f5 [306451,44331] 0 2021-04-09T18:25:36.410 INFO:tasks.workunit.client.0.smithi120.stdout:4/17: symlink l5 0 2021-04-09T18:25:36.411 INFO:tasks.workunit.client.0.smithi120.stdout:5/27: dread f2 [0,4194304] 0 2021-04-09T18:25:36.412 INFO:tasks.workunit.client.0.smithi120.stdout:6/25: write f5 [3752106,30789] 0 2021-04-09T18:25:36.413 INFO:tasks.workunit.client.0.smithi120.stdout:6/26: chown d6/d8 522858407 1 2021-04-09T18:25:36.414 INFO:tasks.workunit.client.0.smithi120.stdout:4/18: write f1 [876122,17083] 0 2021-04-09T18:25:36.414 INFO:tasks.workunit.client.0.smithi120.stdout:6/27: mknod d6/c9 1 2021-04-09T18:25:36.415 INFO:tasks.workunit.client.0.smithi120.stdout:4/19: write f1 [1216201,42919] 0 2021-04-09T18:25:36.417 INFO:tasks.workunit.client.0.smithi120.stdout:4/20: chown l5 778281879 1 2021-04-09T18:25:36.421 INFO:tasks.workunit.client.0.smithi120.stdout:6/28: dread f5 [0,4194304] 0 2021-04-09T18:25:36.429 INFO:tasks.workunit.client.0.smithi120.stdout:2/21: unlink l5 0 2021-04-09T18:25:36.436 INFO:tasks.workunit.client.0.smithi120.stdout:1/36: dread d5/f6 [0,4194304] 0 2021-04-09T18:25:36.438 INFO:tasks.workunit.client.0.smithi120.stdout:3/70: creat d3/d5/df/f19 x:0 0 0 2021-04-09T18:25:36.440 INFO:tasks.workunit.client.0.smithi120.stdout:3/71: read f1 [1556845,79667] 0 2021-04-09T18:25:36.440 INFO:tasks.workunit.client.0.smithi120.stdout:5/28: fdatasync f2 0 2021-04-09T18:25:36.441 INFO:tasks.workunit.client.0.smithi120.stdout:4/21: creat f6 x:0 0 0 2021-04-09T18:25:36.443 INFO:tasks.workunit.client.0.smithi120.stdout:4/22: stat f6 0 2021-04-09T18:25:36.448 INFO:tasks.workunit.client.0.smithi120.stdout:2/22: dwrite f4 [8388608,4194304] 0 2021-04-09T18:25:36.450 INFO:tasks.workunit.client.0.smithi120.stdout:5/29: symlink l8 0 2021-04-09T18:25:36.454 INFO:tasks.workunit.client.0.smithi120.stdout:8/37: dwrite d2/fa [0,4194304] 0 2021-04-09T18:25:36.455 INFO:tasks.workunit.client.0.smithi120.stdout:8/38: mknod d2/d3/d8/cb 1 2021-04-09T18:25:36.455 INFO:tasks.workunit.client.0.smithi120.stdout:9/42: fsync f7 0 2021-04-09T18:25:36.458 INFO:tasks.workunit.client.0.smithi120.stdout:5/30: symlink l9 0 2021-04-09T18:25:36.460 INFO:tasks.workunit.client.0.smithi120.stdout:9/43: creat f9 x:0 0 0 2021-04-09T18:25:36.461 INFO:tasks.workunit.client.0.smithi120.stdout:7/27: truncate f4 712930 0 2021-04-09T18:25:36.462 INFO:tasks.workunit.client.0.smithi120.stdout:8/39: write d2/d3/d8/f9 [1319811,60709] 0 2021-04-09T18:25:36.462 INFO:tasks.workunit.client.0.smithi120.stdout:0/34: truncate d0/d2/d4/f5 1262914 0 2021-04-09T18:25:36.463 INFO:tasks.workunit.client.0.smithi120.stdout:3/72: dwrite d3/d5/fb [0,4194304] 0 2021-04-09T18:25:36.469 INFO:tasks.workunit.client.0.smithi120.stdout:1/37: dwrite d5/f6 [0,4194304] 0 2021-04-09T18:25:36.472 INFO:tasks.workunit.client.0.smithi120.stdout:2/23: link f4 f6 0 2021-04-09T18:25:36.473 INFO:tasks.workunit.client.0.smithi120.stdout:1/38: chown d5/f6 3805 1 2021-04-09T18:25:36.475 INFO:tasks.workunit.client.0.smithi120.stdout:6/29: fdatasync f5 0 2021-04-09T18:25:36.478 INFO:tasks.workunit.client.0.smithi120.stdout:7/28: symlink l9 0 2021-04-09T18:25:36.483 INFO:tasks.workunit.client.0.smithi120.stdout:6/30: dread f5 [0,4194304] 0 2021-04-09T18:25:36.483 INFO:tasks.workunit.client.0.smithi120.stdout:2/24: symlink l7 0 2021-04-09T18:25:36.484 INFO:tasks.workunit.client.0.smithi120.stdout:9/44: creat fa x:0 0 0 2021-04-09T18:25:36.485 INFO:tasks.workunit.client.0.smithi120.stdout:1/39: rename d5/f8 to d5/f9 0 2021-04-09T18:25:36.486 INFO:tasks.workunit.client.0.smithi120.stdout:1/40: mknod d5/ca 1 2021-04-09T18:25:36.494 INFO:tasks.workunit.client.0.smithi120.stdout:7/29: creat fa x:0 0 0 2021-04-09T18:25:36.497 INFO:tasks.workunit.client.0.smithi120.stdout:9/45: dwrite f7 [0,4194304] 0 2021-04-09T18:25:36.498 INFO:tasks.workunit.client.0.smithi120.stdout:4/23: truncate f6 63957 0 2021-04-09T18:25:36.498 INFO:tasks.workunit.client.0.smithi120.stdout:6/31: dwrite f5 [0,4194304] 0 2021-04-09T18:25:36.499 INFO:tasks.workunit.client.0.smithi120.stdout:4/24: readlink l0 0 2021-04-09T18:25:36.499 INFO:tasks.workunit.client.0.smithi120.stdout:4/25: chown l0 317 1 2021-04-09T18:25:36.500 INFO:tasks.workunit.client.0.smithi120.stdout:2/25: link l7 l8 0 2021-04-09T18:25:36.502 INFO:tasks.workunit.client.0.smithi120.stdout:7/30: write f6 [999697,53263] 0 2021-04-09T18:25:36.503 INFO:tasks.workunit.client.0.smithi120.stdout:4/26: creat f7 x:0 0 0 2021-04-09T18:25:36.504 INFO:tasks.workunit.client.0.smithi120.stdout:7/31: chown l9 12313318 1 2021-04-09T18:25:36.505 INFO:tasks.workunit.client.0.smithi120.stdout:4/27: write f1 [88310,97642] 0 2021-04-09T18:25:36.506 INFO:tasks.workunit.client.0.smithi120.stdout:6/32: mknod d6/ca 1 2021-04-09T18:25:36.506 INFO:tasks.workunit.client.0.smithi120.stdout:2/26: write f6 [6527577,13840] 0 2021-04-09T18:25:36.508 INFO:tasks.workunit.client.0.smithi120.stdout:4/28: write f1 [4726571,117334] 0 2021-04-09T18:25:36.511 INFO:tasks.workunit.client.0.smithi120.stdout:2/27: read f4 [6652363,90311] 0 2021-04-09T18:25:36.512 INFO:tasks.workunit.client.0.smithi120.stdout:0/35: dwrite d0/d2/d4/f5 [0,4194304] 0 2021-04-09T18:25:36.514 INFO:tasks.workunit.client.0.smithi120.stdout:2/28: chown f4 336231770 1 2021-04-09T18:25:36.516 INFO:tasks.workunit.client.0.smithi120.stdout:6/33: dread f5 [0,4194304] 0 2021-04-09T18:25:36.523 INFO:tasks.workunit.client.0.smithi120.stdout:0/36: dwrite d0/d2/d4/f5 [4194304,4194304] 0 2021-04-09T18:25:36.524 INFO:tasks.workunit.client.0.smithi120.stdout:0/37: mknod d0/d2/c9 1 2021-04-09T18:25:36.524 INFO:tasks.workunit.client.0.smithi120.stdout:6/34: dread f5 [0,4194304] 0 2021-04-09T18:25:36.527 INFO:tasks.workunit.client.0.smithi120.stdout:6/35: unlink f5 0 2021-04-09T18:25:36.527 INFO:tasks.workunit.client.0.smithi120.stdout:6/36: dread - no filename 2021-04-09T18:25:36.528 INFO:tasks.workunit.client.0.smithi120.stdout:6/37: dwrite - no filename 2021-04-09T18:25:36.528 INFO:tasks.workunit.client.0.smithi120.stdout:0/38: mkdir d0/d2/da 0 2021-04-09T18:25:36.529 INFO:tasks.workunit.client.0.smithi120.stdout:2/29: dread f4 [8388608,4194304] 0 2021-04-09T18:25:36.531 INFO:tasks.workunit.client.0.smithi120.stdout:0/39: write d0/d2/d4/f5 [6638851,11157] 0 2021-04-09T18:25:36.532 INFO:tasks.workunit.client.0.smithi120.stdout:0/40: mknod d0/d2/cb 1 2021-04-09T18:25:36.534 INFO:tasks.workunit.client.0.smithi120.stdout:6/38: mkdir d6/d8/db 0 2021-04-09T18:25:36.535 INFO:tasks.workunit.client.0.smithi120.stdout:2/30: creat f9 x:0 0 0 2021-04-09T18:25:36.535 INFO:tasks.workunit.client.0.smithi120.stdout:2/31: mknod ca 1 2021-04-09T18:25:36.539 INFO:tasks.workunit.client.0.smithi120.stdout:6/39: creat d6/fc x:0 0 0 2021-04-09T18:25:36.540 INFO:tasks.workunit.client.0.smithi120.stdout:2/32: creat fb x:0 0 0 2021-04-09T18:25:36.543 INFO:tasks.workunit.client.0.smithi120.stdout:0/41: dwrite d0/d2/d4/f5 [4194304,4194304] 0 2021-04-09T18:25:36.549 INFO:tasks.workunit.client.0.smithi120.stdout:5/31: getdents . 0 2021-04-09T18:25:36.550 INFO:tasks.workunit.client.0.smithi120.stdout:6/40: creat d6/d8/fd x:0 0 0 2021-04-09T18:25:36.551 INFO:tasks.workunit.client.0.smithi120.stdout:5/32: fdatasync f2 0 2021-04-09T18:25:36.553 INFO:tasks.workunit.client.0.smithi120.stdout:5/33: write f2 [523477,14003] 0 2021-04-09T18:25:36.555 INFO:tasks.workunit.client.0.smithi120.stdout:2/33: dwrite fb [0,4194304] 0 2021-04-09T18:25:36.558 INFO:tasks.workunit.client.0.smithi120.stdout:1/41: unlink d5/f9 0 2021-04-09T18:25:36.564 INFO:tasks.workunit.client.0.smithi120.stdout:5/34: rename l9 to la 0 2021-04-09T18:25:36.565 INFO:tasks.workunit.client.0.smithi120.stdout:6/41: link d6/d8/fd d6/fe 0 2021-04-09T18:25:36.566 INFO:tasks.workunit.client.0.smithi120.stdout:2/34: readlink l8 0 2021-04-09T18:25:36.567 INFO:tasks.workunit.client.0.smithi120.stdout:5/35: creat fb x:0 0 0 2021-04-09T18:25:36.568 INFO:tasks.workunit.client.0.smithi120.stdout:1/42: fsync d5/f6 0 2021-04-09T18:25:36.568 INFO:tasks.workunit.client.0.smithi120.stdout:5/36: stat l8 0 2021-04-09T18:25:36.570 INFO:tasks.workunit.client.0.smithi120.stdout:1/43: chown d5/f6 1 1 2021-04-09T18:25:36.571 INFO:tasks.workunit.client.0.smithi120.stdout:5/37: write fb [429611,119669] 0 2021-04-09T18:25:36.571 INFO:tasks.workunit.client.0.smithi120.stdout:2/35: creat fc x:0 0 0 2021-04-09T18:25:36.578 INFO:tasks.workunit.client.0.smithi120.stdout:4/29: dread f6 [0,4194304] 0 2021-04-09T18:25:36.579 INFO:tasks.workunit.client.0.smithi120.stdout:4/30: rmdir - no directory 2021-04-09T18:25:36.580 INFO:tasks.workunit.client.0.smithi120.stdout:5/38: rename l0 to lc 0 2021-04-09T18:25:36.581 INFO:tasks.workunit.client.0.smithi120.stdout:4/31: read - f7 zero size 2021-04-09T18:25:36.582 INFO:tasks.workunit.client.0.smithi120.stdout:6/42: link d6/fe d6/d8/ff 0 2021-04-09T18:25:36.586 INFO:tasks.workunit.client.0.smithi120.stdout:2/36: rename l1 to ld 0 2021-04-09T18:25:36.587 INFO:tasks.workunit.client.0.smithi120.stdout:5/39: creat fd x:0 0 0 2021-04-09T18:25:36.588 INFO:tasks.workunit.client.0.smithi120.stdout:8/40: truncate d2/d3/f6 453985 0 2021-04-09T18:25:36.588 INFO:tasks.workunit.client.0.smithi120.stdout:5/40: stat fd 0 2021-04-09T18:25:36.588 INFO:tasks.workunit.client.0.smithi120.stdout:3/73: truncate d3/d5/df/f10 476026 0 2021-04-09T18:25:36.590 INFO:tasks.workunit.client.0.smithi120.stdout:4/32: dwrite f7 [0,4194304] 0 2021-04-09T18:25:36.591 INFO:tasks.workunit.client.0.smithi120.stdout:2/37: creat fe x:0 0 0 2021-04-09T18:25:36.591 INFO:tasks.workunit.client.0.smithi120.stdout:4/33: mknod c8 1 2021-04-09T18:25:36.592 INFO:tasks.workunit.client.0.smithi120.stdout:5/41: unlink fb 0 2021-04-09T18:25:36.594 INFO:tasks.workunit.client.0.smithi120.stdout:5/42: write fd [814106,59234] 0 2021-04-09T18:25:36.595 INFO:tasks.workunit.client.0.smithi120.stdout:7/32: dread f4 [0,4194304] 0 2021-04-09T18:25:36.596 INFO:tasks.workunit.client.0.smithi120.stdout:2/38: write f4 [3087838,58561] 0 2021-04-09T18:25:36.599 INFO:tasks.workunit.client.0.smithi120.stdout:8/41: dread d2/fa [0,4194304] 0 2021-04-09T18:25:36.602 INFO:tasks.workunit.client.0.smithi120.stdout:5/43: creat fe x:0 0 0 2021-04-09T18:25:36.603 INFO:tasks.workunit.client.0.smithi120.stdout:7/33: unlink f3 0 2021-04-09T18:25:36.603 INFO:tasks.workunit.client.0.smithi120.stdout:4/34: link f1 f9 0 2021-04-09T18:25:36.604 INFO:tasks.workunit.client.0.smithi120.stdout:2/39: creat ff x:0 0 0 2021-04-09T18:25:36.609 INFO:tasks.workunit.client.0.smithi120.stdout:5/44: rename l8 to lf 0 2021-04-09T18:25:36.611 INFO:tasks.workunit.client.0.smithi120.stdout:8/42: fdatasync d2/d3/f6 0 2021-04-09T18:25:36.615 INFO:tasks.workunit.client.0.smithi120.stdout:2/40: rename l7 to l10 0 2021-04-09T18:25:36.615 INFO:tasks.workunit.client.0.smithi120.stdout:2/41: chown f4 193846 1 2021-04-09T18:25:36.622 INFO:tasks.workunit.client.0.smithi120.stdout:2/42: dwrite fe [0,4194304] 0 2021-04-09T18:25:36.629 INFO:tasks.workunit.client.0.smithi120.stdout:2/43: mkdir d11 0 2021-04-09T18:25:36.636 INFO:tasks.workunit.client.0.smithi120.stdout:2/44: dread fb [0,4194304] 0 2021-04-09T18:25:36.642 INFO:tasks.workunit.client.0.smithi120.stdout:2/45: rmdir d11 0 2021-04-09T18:25:36.652 INFO:tasks.workunit.client.0.smithi120.stdout:2/46: dwrite fb [0,4194304] 0 2021-04-09T18:25:36.653 INFO:tasks.workunit.client.0.smithi120.stdout:2/47: symlink l12 0 2021-04-09T18:25:36.654 INFO:tasks.workunit.client.0.smithi120.stdout:2/48: read - ff zero size 2021-04-09T18:25:36.655 INFO:tasks.workunit.client.0.smithi120.stdout:2/49: stat fe 0 2021-04-09T18:25:36.659 INFO:tasks.workunit.client.0.smithi120.stdout:2/50: mkdir d13 0 2021-04-09T18:25:36.670 INFO:tasks.workunit.client.0.smithi120.stdout:2/51: dwrite f9 [0,4194304] 0 2021-04-09T18:25:36.676 INFO:tasks.workunit.client.0.smithi120.stdout:2/52: link f9 d13/f14 0 2021-04-09T18:25:36.679 INFO:tasks.workunit.client.0.smithi120.stdout:2/53: write fb [2931240,85954] 0 2021-04-09T18:25:36.688 INFO:tasks.workunit.client.0.smithi120.stdout:2/54: dwrite fe [0,4194304] 0 2021-04-09T18:25:36.690 INFO:tasks.workunit.client.0.smithi120.stdout:2/55: mkdir d13/d15 0 2021-04-09T18:25:36.691 INFO:tasks.workunit.client.0.smithi120.stdout:2/56: stat d13/f14 0 2021-04-09T18:25:36.692 INFO:tasks.workunit.client.0.smithi120.stdout:2/57: write fe [817278,128547] 0 2021-04-09T18:25:36.805 INFO:tasks.workunit.client.0.smithi120.stdout:9/46: sync 2021-04-09T18:25:36.807 INFO:tasks.workunit.client.0.smithi120.stdout:9/47: creat fb x:0 0 0 2021-04-09T18:25:36.807 INFO:tasks.workunit.client.0.smithi120.stdout:9/48: mknod cc 1 2021-04-09T18:25:36.808 INFO:tasks.workunit.client.0.smithi120.stdout:9/49: write f9 [20434,53392] 0 2021-04-09T18:25:36.810 INFO:tasks.workunit.client.0.smithi120.stdout:9/50: creat fd x:0 0 0 2021-04-09T18:25:37.245 INFO:tasks.workunit.client.0.smithi120.stdout:5/45: chown la 0 1 2021-04-09T18:25:37.248 INFO:tasks.workunit.client.0.smithi120.stdout:4/35: dwrite f6 [0,4194304] 0 2021-04-09T18:25:37.252 INFO:tasks.workunit.client.0.smithi120.stdout:8/43: rename d2/d3/f6 to d2/d3/fc 0 2021-04-09T18:25:37.252 INFO:tasks.workunit.client.0.smithi120.stdout:8/44: stat d2/fa 0 2021-04-09T18:25:37.258 INFO:tasks.workunit.client.0.smithi120.stdout:4/36: dread f6 [0,4194304] 0 2021-04-09T18:25:37.262 INFO:tasks.workunit.client.0.smithi120.stdout:3/74: dread d3/d5/df/f10 [0,4194304] 0 2021-04-09T18:25:37.263 INFO:tasks.workunit.client.0.smithi120.stdout:6/43: truncate d6/d8/fd 450782 0 2021-04-09T18:25:37.265 INFO:tasks.workunit.client.0.smithi120.stdout:7/34: getdents . 0 2021-04-09T18:25:37.267 INFO:tasks.workunit.client.0.smithi120.stdout:0/42: truncate d0/d2/d4/f5 7662513 0 2021-04-09T18:25:37.271 INFO:tasks.workunit.client.0.smithi120.stdout:1/44: truncate d5/f6 3382871 0 2021-04-09T18:25:37.271 INFO:tasks.workunit.client.0.smithi120.stdout:4/37: creat fa x:0 0 0 2021-04-09T18:25:37.272 INFO:tasks.workunit.client.0.smithi120.stdout:4/38: stat f9 0 2021-04-09T18:25:37.272 INFO:tasks.workunit.client.0.smithi120.stdout:4/39: mknod cb 1 2021-04-09T18:25:37.273 INFO:tasks.workunit.client.0.smithi120.stdout:4/40: write f7 [4677934,112679] 0 2021-04-09T18:25:37.275 INFO:tasks.workunit.client.0.smithi120.stdout:3/75: symlink d3/de/l1a 0 2021-04-09T18:25:37.279 INFO:tasks.workunit.client.0.smithi120.stdout:6/44: creat d6/d8/f10 x:0 0 0 2021-04-09T18:25:37.283 INFO:tasks.workunit.client.0.smithi120.stdout:7/35: mkdir db 0 2021-04-09T18:25:37.283 INFO:tasks.workunit.client.0.smithi120.stdout:9/51: fsync fb 0 2021-04-09T18:25:37.288 INFO:tasks.workunit.client.0.smithi120.stdout:2/58: link ld d13/l16 0 2021-04-09T18:25:37.289 INFO:tasks.workunit.client.0.smithi120.stdout:2/59: write fe [4341064,78336] 0 2021-04-09T18:25:37.290 INFO:tasks.workunit.client.0.smithi120.stdout:2/60: mknod d13/c17 1 2021-04-09T18:25:37.292 INFO:tasks.workunit.client.0.smithi120.stdout:4/41: symlink lc 0 2021-04-09T18:25:37.297 INFO:tasks.workunit.client.0.smithi120.stdout:3/76: creat d3/de/f1b x:0 0 0 2021-04-09T18:25:37.297 INFO:tasks.workunit.client.0.smithi120.stdout:2/61: dread fe [0,4194304] 0 2021-04-09T18:25:37.298 INFO:tasks.workunit.client.0.smithi120.stdout:6/45: symlink d6/d8/l11 0 2021-04-09T18:25:37.299 INFO:tasks.workunit.client.0.smithi120.stdout:1/45: write d5/f7 [887758,1907] 0 2021-04-09T18:25:37.300 INFO:tasks.workunit.client.0.smithi120.stdout:1/46: mknod d5/cb 1 2021-04-09T18:25:37.300 INFO:tasks.workunit.client.0.smithi120.stdout:9/52: mkdir de 0 2021-04-09T18:25:37.303 INFO:tasks.workunit.client.0.smithi120.stdout:4/42: creat fd x:0 0 0 2021-04-09T18:25:37.304 INFO:tasks.workunit.client.0.smithi120.stdout:2/62: fsync d13/f14 0 2021-04-09T18:25:37.305 INFO:tasks.workunit.client.0.smithi120.stdout:3/77: symlink d3/d5/l1c 0 2021-04-09T18:25:37.306 INFO:tasks.workunit.client.0.smithi120.stdout:3/78: readlink d3/l12 0 2021-04-09T18:25:37.306 INFO:tasks.workunit.client.0.smithi120.stdout:7/36: mkdir db/dc 0 2021-04-09T18:25:37.307 INFO:tasks.workunit.client.0.smithi120.stdout:3/79: mknod d3/de/d13/c1d 1 2021-04-09T18:25:37.309 INFO:tasks.workunit.client.0.smithi120.stdout:2/63: dread f6 [8388608,4194304] 0 2021-04-09T18:25:37.309 INFO:tasks.workunit.client.0.smithi120.stdout:2/64: dread - ff zero size 2021-04-09T18:25:37.310 INFO:tasks.workunit.client.0.smithi120.stdout:5/46: truncate f2 1709561 0 2021-04-09T18:25:37.312 INFO:tasks.workunit.client.0.smithi120.stdout:7/37: creat db/fd x:0 0 0 2021-04-09T18:25:37.314 INFO:tasks.workunit.client.0.smithi120.stdout:0/43: getdents d0/d2/d4 0 2021-04-09T18:25:37.315 INFO:tasks.workunit.client.0.smithi120.stdout:6/46: mkdir d6/d8/db/d12 0 2021-04-09T18:25:37.315 INFO:tasks.workunit.client.0.smithi120.stdout:6/47: dread - d6/fc zero size 2021-04-09T18:25:37.316 INFO:tasks.workunit.client.0.smithi120.stdout:5/47: mkdir d10 0 2021-04-09T18:25:37.317 INFO:tasks.workunit.client.0.smithi120.stdout:2/65: rename fe to d13/f18 0 2021-04-09T18:25:37.320 INFO:tasks.workunit.client.0.smithi120.stdout:9/53: rmdir de 0 2021-04-09T18:25:37.325 INFO:tasks.workunit.client.0.smithi120.stdout:1/47: dread d5/f6 [0,4194304] 0 2021-04-09T18:25:37.326 INFO:tasks.workunit.client.0.smithi120.stdout:5/48: rename fe to d10/f11 0 2021-04-09T18:25:37.326 INFO:tasks.workunit.client.0.smithi120.stdout:8/45: truncate d2/fa 396923 0 2021-04-09T18:25:37.328 INFO:tasks.workunit.client.0.smithi120.stdout:1/48: write d5/f7 [747544,19005] 0 2021-04-09T18:25:37.328 INFO:tasks.workunit.client.0.smithi120.stdout:9/54: dwrite fd [0,4194304] 0 2021-04-09T18:25:37.340 INFO:tasks.workunit.client.0.smithi120.stdout:2/66: rename fc to d13/f19 0 2021-04-09T18:25:37.341 INFO:tasks.workunit.client.0.smithi120.stdout:9/55: symlink lf 0 2021-04-09T18:25:37.342 INFO:tasks.workunit.client.0.smithi120.stdout:2/67: mknod d13/d15/c1a 1 2021-04-09T18:25:37.344 INFO:tasks.workunit.client.0.smithi120.stdout:1/49: rmdir d5 39 2021-04-09T18:25:37.346 INFO:tasks.workunit.client.0.smithi120.stdout:7/38: rmdir db/dc 0 2021-04-09T18:25:37.347 INFO:tasks.workunit.client.0.smithi120.stdout:7/39: mknod db/ce 1 2021-04-09T18:25:37.348 INFO:tasks.workunit.client.0.smithi120.stdout:9/56: dread fd [0,4194304] 0 2021-04-09T18:25:37.349 INFO:tasks.workunit.client.0.smithi120.stdout:0/44: creat d0/fc x:0 0 0 2021-04-09T18:25:37.356 INFO:tasks.workunit.client.0.smithi120.stdout:9/57: symlink l10 0 2021-04-09T18:25:37.357 INFO:tasks.workunit.client.0.smithi120.stdout:6/48: write d6/d8/ff [1194678,20027] 0 2021-04-09T18:25:37.358 INFO:tasks.workunit.client.0.smithi120.stdout:6/49: fdatasync d6/fc 0 2021-04-09T18:25:37.361 INFO:tasks.workunit.client.0.smithi120.stdout:7/40: dwrite f2 [0,4194304] 0 2021-04-09T18:25:37.361 INFO:tasks.workunit.client.0.smithi120.stdout:1/50: creat d5/fc x:0 0 0 2021-04-09T18:25:37.362 INFO:tasks.workunit.client.0.smithi120.stdout:7/41: dread - db/fd zero size 2021-04-09T18:25:37.363 INFO:tasks.workunit.client.0.smithi120.stdout:7/42: mknod db/cf 1 2021-04-09T18:25:37.367 INFO:tasks.workunit.client.0.smithi120.stdout:4/43: truncate f6 4920617 0 2021-04-09T18:25:37.375 INFO:tasks.workunit.client.0.smithi120.stdout:2/68: dwrite f4 [8388608,4194304] 0 2021-04-09T18:25:37.377 INFO:tasks.workunit.client.0.smithi120.stdout:3/80: truncate f1 1781637 0 2021-04-09T18:25:37.382 INFO:tasks.workunit.client.0.smithi120.stdout:1/51: creat d5/fd x:0 0 0 2021-04-09T18:25:37.383 INFO:tasks.workunit.client.0.smithi120.stdout:9/58: dwrite f9 [0,4194304] 0 2021-04-09T18:25:37.383 INFO:tasks.workunit.client.0.smithi120.stdout:3/81: fdatasync d3/de/f1b 0 2021-04-09T18:25:37.383 INFO:tasks.workunit.client.0.smithi120.stdout:7/43: fsync f4 0 2021-04-09T18:25:37.385 INFO:tasks.workunit.client.0.smithi120.stdout:6/50: creat d6/d8/f13 x:0 0 0 2021-04-09T18:25:37.385 INFO:tasks.workunit.client.0.smithi120.stdout:0/45: write d0/d2/d4/f5 [4415754,63665] 0 2021-04-09T18:25:37.385 INFO:tasks.workunit.client.0.smithi120.stdout:1/52: mknod d5/ce 1 2021-04-09T18:25:37.387 INFO:tasks.workunit.client.0.smithi120.stdout:8/46: truncate d2/d3/d8/f9 965429 0 2021-04-09T18:25:37.387 INFO:tasks.workunit.client.0.smithi120.stdout:2/69: mkdir d13/d1b 0 2021-04-09T18:25:37.387 INFO:tasks.workunit.client.0.smithi120.stdout:2/70: chown d13/f18 3885 1 2021-04-09T18:25:37.390 INFO:tasks.workunit.client.0.smithi120.stdout:8/47: mkdir d2/dd 0 2021-04-09T18:25:37.390 INFO:tasks.workunit.client.0.smithi120.stdout:1/53: chown d5/f6 12199404 1 2021-04-09T18:25:37.397 INFO:tasks.workunit.client.0.smithi120.stdout:0/46: dwrite d0/fc [0,4194304] 0 2021-04-09T18:25:37.397 INFO:tasks.workunit.client.0.smithi120.stdout:6/51: dwrite d6/d8/ff [0,4194304] 0 2021-04-09T18:25:37.399 INFO:tasks.workunit.client.0.smithi120.stdout:6/52: readlink d6/d8/l11 0 2021-04-09T18:25:37.405 INFO:tasks.workunit.client.0.smithi120.stdout:0/47: dwrite d0/d2/d4/f5 [0,4194304] 0 2021-04-09T18:25:37.414 INFO:tasks.workunit.client.0.smithi120.stdout:3/82: mkdir d3/d5/df/d1e 0 2021-04-09T18:25:37.414 INFO:tasks.workunit.client.0.smithi120.stdout:9/59: link l8 l11 0 2021-04-09T18:25:37.420 INFO:tasks.workunit.client.0.smithi120.stdout:5/49: dread fd [0,4194304] 0 2021-04-09T18:25:37.421 INFO:tasks.workunit.client.0.smithi120.stdout:6/53: rmdir d6 39 2021-04-09T18:25:37.425 INFO:tasks.workunit.client.0.smithi120.stdout:0/48: rename d0/d1 to d0/d2/dd 0 2021-04-09T18:25:37.426 INFO:tasks.workunit.client.0.smithi120.stdout:9/60: rename fa to f12 0 2021-04-09T18:25:37.428 INFO:tasks.workunit.client.0.smithi120.stdout:0/49: stat d0 0 2021-04-09T18:25:37.441 INFO:tasks.workunit.client.0.smithi120.stdout:1/54: write d5/f6 [2147060,108626] 0 2021-04-09T18:25:37.445 INFO:tasks.workunit.client.0.smithi120.stdout:5/50: dwrite fd [0,4194304] 0 2021-04-09T18:25:37.447 INFO:tasks.workunit.client.0.smithi120.stdout:1/55: dread - d5/fd zero size 2021-04-09T18:25:37.450 INFO:tasks.workunit.client.0.smithi120.stdout:3/83: rename f2 to d3/de/d13/f1f 0 2021-04-09T18:25:37.451 INFO:tasks.workunit.client.0.smithi120.stdout:9/61: creat f13 x:0 0 0 2021-04-09T18:25:37.451 INFO:tasks.workunit.client.0.smithi120.stdout:9/62: rmdir - no directory 2021-04-09T18:25:37.453 INFO:tasks.workunit.client.0.smithi120.stdout:0/50: dwrite d0/fc [0,4194304] 0 2021-04-09T18:25:37.453 INFO:tasks.workunit.client.0.smithi120.stdout:5/51: rmdir d10 39 2021-04-09T18:25:37.454 INFO:tasks.workunit.client.0.smithi120.stdout:1/56: mkdir d5/df 0 2021-04-09T18:25:37.460 INFO:tasks.workunit.client.0.smithi120.stdout:9/63: readlink l8 0 2021-04-09T18:25:37.461 INFO:tasks.workunit.client.0.smithi120.stdout:9/64: rmdir - no directory 2021-04-09T18:25:37.461 INFO:tasks.workunit.client.0.smithi120.stdout:2/71: truncate d13/f18 857158 0 2021-04-09T18:25:37.463 INFO:tasks.workunit.client.0.smithi120.stdout:3/84: creat d3/de/f20 x:0 0 0 2021-04-09T18:25:37.467 INFO:tasks.workunit.client.0.smithi120.stdout:5/52: dread fd [0,4194304] 0 2021-04-09T18:25:37.471 INFO:tasks.workunit.client.0.smithi120.stdout:0/51: dwrite d0/d2/d4/f5 [4194304,4194304] 0 2021-04-09T18:25:37.473 INFO:tasks.workunit.client.0.smithi120.stdout:7/44: truncate f6 1471965 0 2021-04-09T18:25:37.474 INFO:tasks.workunit.client.0.smithi120.stdout:2/72: readlink l8 0 2021-04-09T18:25:37.475 INFO:tasks.workunit.client.0.smithi120.stdout:3/85: symlink d3/de/l21 0 2021-04-09T18:25:37.476 INFO:tasks.workunit.client.0.smithi120.stdout:7/45: dread f4 [0,4194304] 0 2021-04-09T18:25:37.477 INFO:tasks.workunit.client.0.smithi120.stdout:7/46: mknod db/c10 1 2021-04-09T18:25:37.478 INFO:tasks.workunit.client.0.smithi120.stdout:7/47: fsync f7 0 2021-04-09T18:25:37.478 INFO:tasks.workunit.client.0.smithi120.stdout:0/52: dread d0/d2/d4/f5 [4194304,4194304] 0 2021-04-09T18:25:37.479 INFO:tasks.workunit.client.0.smithi120.stdout:9/65: link fb f14 0 2021-04-09T18:25:37.484 INFO:tasks.workunit.client.0.smithi120.stdout:3/86: write d3/de/d13/f1f [679720,57636] 0 2021-04-09T18:25:37.486 INFO:tasks.workunit.client.0.smithi120.stdout:0/53: write d0/d2/d4/f5 [2169943,58318] 0 2021-04-09T18:25:37.486 INFO:tasks.workunit.client.0.smithi120.stdout:5/53: mkdir d10/d12 0 2021-04-09T18:25:37.490 INFO:tasks.workunit.client.0.smithi120.stdout:2/73: link f4 d13/f1c 0 2021-04-09T18:25:37.494 INFO:tasks.workunit.client.0.smithi120.stdout:7/48: link fa db/f11 0 2021-04-09T18:25:37.494 INFO:tasks.workunit.client.0.smithi120.stdout:3/87: dread d3/f6 [0,4194304] 0 2021-04-09T18:25:37.495 INFO:tasks.workunit.client.0.smithi120.stdout:2/74: fsync d13/f19 0 2021-04-09T18:25:37.497 INFO:tasks.workunit.client.0.smithi120.stdout:7/49: creat db/f12 x:0 0 0 2021-04-09T18:25:37.502 INFO:tasks.workunit.client.0.smithi120.stdout:2/75: rename ff to d13/f1d 0 2021-04-09T18:25:37.503 INFO:tasks.workunit.client.0.smithi120.stdout:2/76: mknod d13/d15/c1e 1 2021-04-09T18:25:37.504 INFO:tasks.workunit.client.0.smithi120.stdout:8/48: dwrite d2/fa [0,4194304] 0 2021-04-09T18:25:37.506 INFO:tasks.workunit.client.0.smithi120.stdout:8/49: rename d2 to d2/d3/d8/de 22 2021-04-09T18:25:37.512 INFO:tasks.workunit.client.0.smithi120.stdout:2/77: fdatasync f4 0 2021-04-09T18:25:37.515 INFO:tasks.workunit.client.0.smithi120.stdout:8/50: rename d2/fa to d2/dd/ff 0 2021-04-09T18:25:37.518 INFO:tasks.workunit.client.0.smithi120.stdout:9/66: getdents . 0 2021-04-09T18:25:37.521 INFO:tasks.workunit.client.0.smithi120.stdout:4/44: dread f7 [4194304,4194304] 0 2021-04-09T18:25:37.526 INFO:tasks.workunit.client.0.smithi120.stdout:5/54: link lf d10/l13 0 2021-04-09T18:25:37.528 INFO:tasks.workunit.client.0.smithi120.stdout:2/78: symlink d13/l1f 0 2021-04-09T18:25:37.529 INFO:tasks.workunit.client.0.smithi120.stdout:9/67: fdatasync fd 0 2021-04-09T18:25:37.530 INFO:tasks.workunit.client.0.smithi120.stdout:9/68: write f9 [898174,49781] 0 2021-04-09T18:25:37.530 INFO:tasks.workunit.client.0.smithi120.stdout:9/69: mknod c15 1 2021-04-09T18:25:37.532 INFO:tasks.workunit.client.0.smithi120.stdout:9/70: read fd [84955,38295] 0 2021-04-09T18:25:37.532 INFO:tasks.workunit.client.0.smithi120.stdout:4/45: creat fe x:0 0 0 2021-04-09T18:25:37.533 INFO:tasks.workunit.client.0.smithi120.stdout:5/55: chown lf 15762 1 2021-04-09T18:25:37.536 INFO:tasks.workunit.client.0.smithi120.stdout:7/50: write f6 [1098230,92480] 0 2021-04-09T18:25:37.537 INFO:tasks.workunit.client.0.smithi120.stdout:7/51: mknod db/c13 1 2021-04-09T18:25:37.541 INFO:tasks.workunit.client.0.smithi120.stdout:2/79: symlink d13/l20 0 2021-04-09T18:25:37.541 INFO:tasks.workunit.client.0.smithi120.stdout:0/54: truncate d0/d2/d4/f5 2293355 0 2021-04-09T18:25:37.542 INFO:tasks.workunit.client.0.smithi120.stdout:7/52: symlink db/l14 0 2021-04-09T18:25:37.543 INFO:tasks.workunit.client.0.smithi120.stdout:4/46: creat ff x:0 0 0 2021-04-09T18:25:37.544 INFO:tasks.workunit.client.0.smithi120.stdout:9/71: write f12 [749645,69955] 0 2021-04-09T18:25:37.545 INFO:tasks.workunit.client.0.smithi120.stdout:8/51: write d2/d3/fc [859567,122479] 0 2021-04-09T18:25:37.548 INFO:tasks.workunit.client.0.smithi120.stdout:4/47: creat f10 x:0 0 0 2021-04-09T18:25:37.552 INFO:tasks.workunit.client.0.smithi120.stdout:2/80: dwrite f9 [4194304,4194304] 0 2021-04-09T18:25:37.552 INFO:tasks.workunit.client.0.smithi120.stdout:9/72: rename f2 to f16 0 2021-04-09T18:25:37.553 INFO:tasks.workunit.client.0.smithi120.stdout:2/81: chown f4 79 1 2021-04-09T18:25:37.553 INFO:tasks.workunit.client.0.smithi120.stdout:8/52: creat d2/d3/d8/f10 x:0 0 0 2021-04-09T18:25:37.554 INFO:tasks.workunit.client.0.smithi120.stdout:9/73: dread - f14 zero size 2021-04-09T18:25:37.556 INFO:tasks.workunit.client.0.smithi120.stdout:4/48: symlink l11 0 2021-04-09T18:25:37.560 INFO:tasks.workunit.client.0.smithi120.stdout:9/74: creat f17 x:0 0 0 2021-04-09T18:25:37.561 INFO:tasks.workunit.client.0.smithi120.stdout:8/53: rename d2/dd to d2/d3/d11 0 2021-04-09T18:25:37.564 INFO:tasks.workunit.client.0.smithi120.stdout:4/49: unlink f1 0 2021-04-09T18:25:37.568 INFO:tasks.workunit.client.0.smithi120.stdout:7/53: getdents db 0 2021-04-09T18:25:37.570 INFO:tasks.workunit.client.0.smithi120.stdout:9/75: dwrite f9 [0,4194304] 0 2021-04-09T18:25:37.571 INFO:tasks.workunit.client.0.smithi120.stdout:7/54: read f4 [284284,29321] 0 2021-04-09T18:25:37.573 INFO:tasks.workunit.client.0.smithi120.stdout:5/56: truncate f2 906135 0 2021-04-09T18:25:37.573 INFO:tasks.workunit.client.0.smithi120.stdout:8/54: dread d2/d3/fc [0,4194304] 0 2021-04-09T18:25:37.574 INFO:tasks.workunit.client.0.smithi120.stdout:5/57: readlink l4 0 2021-04-09T18:25:37.580 INFO:tasks.workunit.client.0.smithi120.stdout:5/58: read fd [3585367,90512] 0 2021-04-09T18:25:37.581 INFO:tasks.workunit.client.0.smithi120.stdout:4/50: dwrite ff [0,4194304] 0 2021-04-09T18:25:37.583 INFO:tasks.workunit.client.0.smithi120.stdout:4/51: read ff [2289288,72445] 0 2021-04-09T18:25:37.583 INFO:tasks.workunit.client.0.smithi120.stdout:8/55: chown d2/d3/d11/ff 42 1 2021-04-09T18:25:37.584 INFO:tasks.workunit.client.0.smithi120.stdout:2/82: dwrite d13/f1d [0,4194304] 0 2021-04-09T18:25:37.585 INFO:tasks.workunit.client.0.smithi120.stdout:2/83: mknod d13/d1b/c21 1 2021-04-09T18:25:37.586 INFO:tasks.workunit.client.0.smithi120.stdout:5/59: fsync fd 0 2021-04-09T18:25:37.590 INFO:tasks.workunit.client.0.smithi120.stdout:9/76: dread f16 [0,4194304] 0 2021-04-09T18:25:37.603 INFO:tasks.workunit.client.0.smithi120.stdout:8/56: dread d2/d3/d8/f9 [0,4194304] 0 2021-04-09T18:25:37.606 INFO:tasks.workunit.client.0.smithi120.stdout:5/60: rename lf to d10/l14 0 2021-04-09T18:25:37.608 INFO:tasks.workunit.client.0.smithi120.stdout:0/55: truncate d0/d2/d4/f5 1657191 0 2021-04-09T18:25:37.609 INFO:tasks.workunit.client.0.smithi120.stdout:7/55: link db/f11 db/f15 0 2021-04-09T18:25:37.610 INFO:tasks.workunit.client.0.smithi120.stdout:2/84: rename d13/l16 to d13/l22 0 2021-04-09T18:25:37.610 INFO:tasks.workunit.client.0.smithi120.stdout:9/77: dread f7 [0,4194304] 0 2021-04-09T18:25:37.610 INFO:tasks.workunit.client.0.smithi120.stdout:8/57: dread d2/d3/d11/ff [0,4194304] 0 2021-04-09T18:25:37.611 INFO:tasks.workunit.client.0.smithi120.stdout:9/78: stat f9 0 2021-04-09T18:25:37.612 INFO:tasks.workunit.client.0.smithi120.stdout:8/58: stat d2 0 2021-04-09T18:25:37.613 INFO:tasks.workunit.client.0.smithi120.stdout:4/52: rename f6 to f12 0 2021-04-09T18:25:37.615 INFO:tasks.workunit.client.0.smithi120.stdout:8/59: write d2/d3/d8/f10 [603903,3843] 0 2021-04-09T18:25:37.616 INFO:tasks.workunit.client.0.smithi120.stdout:8/60: chown d2/d3 201 1 2021-04-09T18:25:37.617 INFO:tasks.workunit.client.0.smithi120.stdout:7/56: dwrite db/f12 [0,4194304] 0 2021-04-09T18:25:37.620 INFO:tasks.workunit.client.0.smithi120.stdout:5/61: creat d10/f15 x:0 0 0 2021-04-09T18:25:37.630 INFO:tasks.workunit.client.0.smithi120.stdout:9/79: creat f18 x:0 0 0 2021-04-09T18:25:37.631 INFO:tasks.workunit.client.0.smithi120.stdout:8/61: unlink d2/d3/d8/f9 0 2021-04-09T18:25:37.631 INFO:tasks.workunit.client.0.smithi120.stdout:7/57: unlink db/f12 0 2021-04-09T18:25:37.638 INFO:tasks.workunit.client.0.smithi120.stdout:5/62: creat d10/f16 x:0 0 0 2021-04-09T18:25:37.640 INFO:tasks.workunit.client.0.smithi120.stdout:2/85: link l12 d13/d15/l23 0 2021-04-09T18:25:37.641 INFO:tasks.workunit.client.0.smithi120.stdout:9/80: fdatasync fb 0 2021-04-09T18:25:37.641 INFO:tasks.workunit.client.0.smithi120.stdout:8/62: creat d2/d3/f12 x:0 0 0 2021-04-09T18:25:37.642 INFO:tasks.workunit.client.0.smithi120.stdout:2/86: write d13/f14 [5331567,38476] 0 2021-04-09T18:25:37.646 INFO:tasks.workunit.client.0.smithi120.stdout:2/87: dread fb [0,4194304] 0 2021-04-09T18:25:37.648 INFO:tasks.workunit.client.0.smithi120.stdout:9/81: write f16 [3353828,19682] 0 2021-04-09T18:25:37.650 INFO:tasks.workunit.client.0.smithi120.stdout:4/53: rename l4 to l13 0 2021-04-09T18:25:37.650 INFO:tasks.workunit.client.0.smithi120.stdout:0/56: dwrite d0/d2/d4/f5 [0,4194304] 0 2021-04-09T18:25:37.652 INFO:tasks.workunit.client.0.smithi120.stdout:5/63: creat d10/d12/f17 x:0 0 0 2021-04-09T18:25:37.653 INFO:tasks.workunit.client.0.smithi120.stdout:5/64: chown d10/f16 865 1 2021-04-09T18:25:37.655 INFO:tasks.workunit.client.0.smithi120.stdout:9/82: mkdir d19 0 2021-04-09T18:25:37.656 INFO:tasks.workunit.client.0.smithi120.stdout:9/83: write f18 [1014819,91704] 0 2021-04-09T18:25:37.662 INFO:tasks.workunit.client.0.smithi120.stdout:0/57: unlink d0/d2/l6 0 2021-04-09T18:25:37.662 INFO:tasks.workunit.client.0.smithi120.stdout:4/54: dread f9 [0,4194304] 0 2021-04-09T18:25:37.663 INFO:tasks.workunit.client.0.smithi120.stdout:8/63: creat d2/f13 x:0 0 0 2021-04-09T18:25:37.667 INFO:tasks.workunit.client.0.smithi120.stdout:9/84: dread f9 [0,4194304] 0 2021-04-09T18:25:37.670 INFO:tasks.workunit.client.0.smithi120.stdout:2/88: link f9 d13/d15/f24 0 2021-04-09T18:25:37.670 INFO:tasks.workunit.client.0.smithi120.stdout:8/64: rename d2 to d2/d3/d11/d14 22 2021-04-09T18:25:37.671 INFO:tasks.workunit.client.0.smithi120.stdout:7/58: truncate f4 319472 0 2021-04-09T18:25:37.671 INFO:tasks.workunit.client.0.smithi120.stdout:2/89: stat d13 0 2021-04-09T18:25:37.672 INFO:tasks.workunit.client.0.smithi120.stdout:0/58: symlink d0/d2/d4/le 0 2021-04-09T18:25:37.672 INFO:tasks.workunit.client.0.smithi120.stdout:5/65: link d10/f11 d10/f18 0 2021-04-09T18:25:37.673 INFO:tasks.workunit.client.0.smithi120.stdout:8/65: write d2/d3/d8/f10 [882154,5891] 0 2021-04-09T18:25:37.674 INFO:tasks.workunit.client.0.smithi120.stdout:4/55: dread - fe zero size 2021-04-09T18:25:37.678 INFO:tasks.workunit.client.0.smithi120.stdout:9/85: unlink l3 0 2021-04-09T18:25:37.678 INFO:tasks.workunit.client.0.smithi120.stdout:7/59: creat db/f16 x:0 0 0 2021-04-09T18:25:37.679 INFO:tasks.workunit.client.0.smithi120.stdout:0/59: mkdir d0/d2/df 0 2021-04-09T18:25:37.679 INFO:tasks.workunit.client.0.smithi120.stdout:9/86: mknod d19/c1a 1 2021-04-09T18:25:37.681 INFO:tasks.workunit.client.0.smithi120.stdout:5/66: creat d10/d12/f19 x:0 0 0 2021-04-09T18:25:37.681 INFO:tasks.workunit.client.0.smithi120.stdout:2/90: creat d13/f25 x:0 0 0 2021-04-09T18:25:37.682 INFO:tasks.workunit.client.0.smithi120.stdout:0/60: write d0/d2/d4/f5 [4076552,81694] 0 2021-04-09T18:25:37.682 INFO:tasks.workunit.client.0.smithi120.stdout:2/91: chown d13/l1f 21889 1 2021-04-09T18:25:37.684 INFO:tasks.workunit.client.0.smithi120.stdout:7/60: symlink db/l17 0 2021-04-09T18:25:37.684 INFO:tasks.workunit.client.0.smithi120.stdout:2/92: mknod d13/c26 1 2021-04-09T18:25:37.691 INFO:tasks.workunit.client.0.smithi120.stdout:0/61: dread d0/d2/d4/f5 [0,4194304] 0 2021-04-09T18:25:37.693 INFO:tasks.workunit.client.0.smithi120.stdout:5/67: dread fd [0,4194304] 0 2021-04-09T18:25:37.698 INFO:tasks.workunit.client.0.smithi120.stdout:8/66: getdents d2/d3 0 2021-04-09T18:25:37.701 INFO:tasks.workunit.client.0.smithi120.stdout:9/87: dwrite f14 [0,4194304] 0 2021-04-09T18:25:37.701 INFO:tasks.workunit.client.0.smithi120.stdout:2/93: symlink d13/d1b/l27 0 2021-04-09T18:25:37.702 INFO:tasks.workunit.client.0.smithi120.stdout:4/56: truncate fe 35901 0 2021-04-09T18:25:37.706 INFO:tasks.workunit.client.0.smithi120.stdout:5/68: rename f2 to d10/d12/f1a 0 2021-04-09T18:25:37.708 INFO:tasks.workunit.client.0.smithi120.stdout:7/61: dwrite db/f15 [0,4194304] 0 2021-04-09T18:25:37.710 INFO:tasks.workunit.client.0.smithi120.stdout:0/62: link d0/d2/l7 d0/d2/da/l10 0 2021-04-09T18:25:37.719 INFO:tasks.workunit.client.0.smithi120.stdout:5/69: unlink lc 0 2021-04-09T18:25:37.719 INFO:tasks.workunit.client.0.smithi120.stdout:2/94: dwrite d13/d15/f24 [0,4194304] 0 2021-04-09T18:25:37.720 INFO:tasks.workunit.client.0.smithi120.stdout:0/63: dread d0/d2/d4/f5 [0,4194304] 0 2021-04-09T18:25:37.720 INFO:tasks.workunit.client.0.smithi120.stdout:0/64: mknod d0/d2/c11 1 2021-04-09T18:25:37.723 INFO:tasks.workunit.client.0.smithi120.stdout:4/57: dread ff [0,4194304] 0 2021-04-09T18:25:37.724 INFO:tasks.workunit.client.0.smithi120.stdout:8/67: link d2/d3/fc d2/d3/d8/f15 0 2021-04-09T18:25:37.726 INFO:tasks.workunit.client.0.smithi120.stdout:2/95: symlink d13/l28 0 2021-04-09T18:25:37.730 INFO:tasks.workunit.client.0.smithi120.stdout:5/70: mkdir d10/d12/d1b 0 2021-04-09T18:25:37.730 INFO:tasks.workunit.client.0.smithi120.stdout:8/68: mknod d2/c16 1 2021-04-09T18:25:37.732 INFO:tasks.workunit.client.0.smithi120.stdout:0/65: symlink d0/d2/l12 0 2021-04-09T18:25:37.733 INFO:tasks.workunit.client.0.smithi120.stdout:0/66: chown d0/d2/da 47273 1 2021-04-09T18:25:37.736 INFO:tasks.workunit.client.0.smithi120.stdout:2/96: dread d13/f18 [0,4194304] 0 2021-04-09T18:25:37.738 INFO:tasks.workunit.client.0.smithi120.stdout:4/58: symlink l14 0 2021-04-09T18:25:37.740 INFO:tasks.workunit.client.0.smithi120.stdout:0/67: write d0/d2/d4/f5 [5182625,101872] 0 2021-04-09T18:25:37.745 INFO:tasks.workunit.client.0.smithi120.stdout:8/69: creat d2/d3/f17 x:0 0 0 2021-04-09T18:25:37.752 INFO:tasks.workunit.client.0.smithi120.stdout:2/97: stat l12 0 2021-04-09T18:25:37.754 INFO:tasks.workunit.client.0.smithi120.stdout:4/59: mknod c15 1 2021-04-09T18:25:37.755 INFO:tasks.workunit.client.0.smithi120.stdout:9/88: truncate fb 408493 0 2021-04-09T18:25:37.756 INFO:tasks.workunit.client.0.smithi120.stdout:7/62: truncate db/f11 3365331 0 2021-04-09T18:25:37.756 INFO:tasks.workunit.client.0.smithi120.stdout:0/68: rmdir d0/d2/d4 39 2021-04-09T18:25:37.757 INFO:tasks.workunit.client.0.smithi120.stdout:9/89: write f16 [5107706,66130] 0 2021-04-09T18:25:37.757 INFO:tasks.workunit.client.0.smithi120.stdout:5/71: write d10/f18 [344040,43055] 0 2021-04-09T18:25:37.759 INFO:tasks.workunit.client.0.smithi120.stdout:8/70: write d2/d3/d11/ff [3555085,79523] 0 2021-04-09T18:25:37.760 INFO:tasks.workunit.client.0.smithi120.stdout:7/63: creat db/f18 x:0 0 0 2021-04-09T18:25:37.760 INFO:tasks.workunit.client.0.smithi120.stdout:8/71: chown d2/d3/d11 505841067 1 2021-04-09T18:25:37.761 INFO:tasks.workunit.client.0.smithi120.stdout:4/60: symlink l16 0 2021-04-09T18:25:37.763 INFO:tasks.workunit.client.0.smithi120.stdout:7/64: mknod db/c19 1 2021-04-09T18:25:37.766 INFO:tasks.workunit.client.0.smithi120.stdout:4/61: dread - fd zero size 2021-04-09T18:25:37.768 INFO:tasks.workunit.client.0.smithi120.stdout:5/72: rename d10/d12 to d10/d12/d1b/d1c 22 2021-04-09T18:25:37.773 INFO:tasks.workunit.client.0.smithi120.stdout:0/69: dwrite d0/fc [0,4194304] 0 2021-04-09T18:25:37.773 INFO:tasks.workunit.client.0.smithi120.stdout:4/62: rename l16 to l17 0 2021-04-09T18:25:37.774 INFO:tasks.workunit.client.0.smithi120.stdout:7/65: dread fa [0,4194304] 0 2021-04-09T18:25:37.775 INFO:tasks.workunit.client.0.smithi120.stdout:7/66: fsync db/f16 0 2021-04-09T18:25:37.778 INFO:tasks.workunit.client.0.smithi120.stdout:9/90: dwrite f13 [0,4194304] 0 2021-04-09T18:25:37.779 INFO:tasks.workunit.client.0.smithi120.stdout:7/67: chown l9 4698 1 2021-04-09T18:25:37.779 INFO:tasks.workunit.client.0.smithi120.stdout:0/70: stat d0/d2/df 0 2021-04-09T18:25:37.780 INFO:tasks.workunit.client.0.smithi120.stdout:4/63: write ff [2065394,47411] 0 2021-04-09T18:25:37.780 INFO:tasks.workunit.client.0.smithi120.stdout:7/68: stat f2 0 2021-04-09T18:25:37.781 INFO:tasks.workunit.client.0.smithi120.stdout:9/91: dread - f17 zero size 2021-04-09T18:25:37.782 INFO:tasks.workunit.client.0.smithi120.stdout:9/92: readlink l8 0 2021-04-09T18:25:37.783 INFO:tasks.workunit.client.0.smithi120.stdout:0/71: write d0/d2/d4/f5 [589267,23835] 0 2021-04-09T18:25:37.787 INFO:tasks.workunit.client.0.smithi120.stdout:4/64: unlink f9 0 2021-04-09T18:25:37.797 INFO:tasks.workunit.client.0.smithi120.stdout:9/93: write fb [139344,98746] 0 2021-04-09T18:25:37.798 INFO:tasks.workunit.client.0.smithi120.stdout:8/72: write d2/d3/fc [1878137,79729] 0 2021-04-09T18:25:37.809 INFO:tasks.workunit.client.0.smithi120.stdout:4/65: creat f18 x:0 0 0 2021-04-09T18:25:37.810 INFO:tasks.workunit.client.0.smithi120.stdout:9/94: creat d19/f1b x:0 0 0 2021-04-09T18:25:37.814 INFO:tasks.workunit.client.0.smithi120.stdout:0/72: truncate d0/fc 1038388 0 2021-04-09T18:25:37.815 INFO:tasks.workunit.client.0.smithi120.stdout:2/98: dwrite d13/f18 [0,4194304] 0 2021-04-09T18:25:37.815 INFO:tasks.workunit.client.0.smithi120.stdout:7/69: fdatasync fa 0 2021-04-09T18:25:37.817 INFO:tasks.workunit.client.0.smithi120.stdout:7/70: readlink db/l14 0 2021-04-09T18:25:37.817 INFO:tasks.workunit.client.0.smithi120.stdout:7/71: stat f6 0 2021-04-09T18:25:37.817 INFO:tasks.workunit.client.0.smithi120.stdout:2/99: mknod d13/c29 1 2021-04-09T18:25:37.818 INFO:tasks.workunit.client.0.smithi120.stdout:4/66: creat f19 x:0 0 0 2021-04-09T18:25:37.822 INFO:tasks.workunit.client.0.smithi120.stdout:7/72: creat db/f1a x:0 0 0 2021-04-09T18:25:37.823 INFO:tasks.workunit.client.0.smithi120.stdout:0/73: creat d0/d2/d4/f13 x:0 0 0 2021-04-09T18:25:37.826 INFO:tasks.workunit.client.0.smithi120.stdout:0/74: mknod d0/d2/da/c14 1 2021-04-09T18:25:37.832 INFO:tasks.workunit.client.0.smithi120.stdout:4/67: dwrite f19 [0,4194304] 0 2021-04-09T18:25:37.833 INFO:tasks.workunit.client.0.smithi120.stdout:7/73: rename db/f11 to db/f1b 0 2021-04-09T18:25:37.835 INFO:tasks.workunit.client.0.smithi120.stdout:7/74: mknod db/c1c 1 2021-04-09T18:25:37.837 INFO:tasks.workunit.client.0.smithi120.stdout:2/100: dwrite fb [0,4194304] 0 2021-04-09T18:25:37.837 INFO:tasks.workunit.client.0.smithi120.stdout:7/75: symlink db/l1d 0 2021-04-09T18:25:37.838 INFO:tasks.workunit.client.0.smithi120.stdout:7/76: chown db/l14 305801566 1 2021-04-09T18:25:37.841 INFO:tasks.workunit.client.0.smithi120.stdout:2/101: write f6 [7911064,129033] 0 2021-04-09T18:25:37.842 INFO:tasks.workunit.client.0.smithi120.stdout:7/77: rename db/l1d to db/l1e 0 2021-04-09T18:25:37.848 INFO:tasks.workunit.client.0.smithi120.stdout:7/78: creat db/f1f x:0 0 0 2021-04-09T18:25:37.854 INFO:tasks.workunit.client.0.smithi120.stdout:2/102: link f6 d13/d15/f2a 0 2021-04-09T18:25:37.857 INFO:tasks.workunit.client.0.smithi120.stdout:7/79: rename db/f18 to db/f20 0 2021-04-09T18:25:37.859 INFO:tasks.workunit.client.0.smithi120.stdout:7/80: rename db to db/d21 22 2021-04-09T18:25:37.865 INFO:tasks.workunit.client.0.smithi120.stdout:2/103: creat d13/d1b/f2b x:0 0 0 2021-04-09T18:25:37.866 INFO:tasks.workunit.client.0.smithi120.stdout:7/81: creat db/f22 x:0 0 0 2021-04-09T18:25:37.866 INFO:tasks.workunit.client.0.smithi120.stdout:2/104: readlink d13/d1b/l27 0 2021-04-09T18:25:37.867 INFO:tasks.workunit.client.0.smithi120.stdout:7/82: chown l9 3 1 2021-04-09T18:25:37.872 INFO:tasks.workunit.client.0.smithi120.stdout:8/73: dread d2/d3/d8/f10 [0,4194304] 0 2021-04-09T18:25:37.873 INFO:tasks.workunit.client.0.smithi120.stdout:8/74: mknod d2/d3/d11/c18 1 2021-04-09T18:25:37.875 INFO:tasks.workunit.client.0.smithi120.stdout:7/83: dwrite db/f16 [0,4194304] 0 2021-04-09T18:25:37.877 INFO:tasks.workunit.client.0.smithi120.stdout:2/105: getdents d13/d15 0 2021-04-09T18:25:37.881 INFO:tasks.workunit.client.0.smithi120.stdout:7/84: unlink fa 0 2021-04-09T18:25:37.886 INFO:tasks.workunit.client.0.smithi120.stdout:2/106: write d13/d15/f2a [12332723,11835] 0 2021-04-09T18:25:37.889 INFO:tasks.workunit.client.0.smithi120.stdout:8/75: dwrite d2/f13 [0,4194304] 0 2021-04-09T18:25:37.894 INFO:tasks.workunit.client.0.smithi120.stdout:2/107: dread d13/d15/f24 [0,4194304] 0 2021-04-09T18:25:37.896 INFO:tasks.workunit.client.0.smithi120.stdout:8/76: creat d2/f19 x:0 0 0 2021-04-09T18:25:37.900 INFO:tasks.workunit.client.0.smithi120.stdout:8/77: rmdir d2/d3 39 2021-04-09T18:25:37.904 INFO:tasks.workunit.client.0.smithi120.stdout:8/78: read d2/d3/d8/f10 [131540,66728] 0 2021-04-09T18:25:37.908 INFO:tasks.workunit.client.0.smithi120.stdout:8/79: creat d2/d3/f1a x:0 0 0 2021-04-09T18:25:37.911 INFO:tasks.workunit.client.0.smithi120.stdout:0/75: truncate d0/fc 335530 0 2021-04-09T18:25:37.914 INFO:tasks.workunit.client.0.smithi120.stdout:8/80: unlink d2/d3/d8/f10 0 2021-04-09T18:25:37.918 INFO:tasks.workunit.client.0.smithi120.stdout:0/76: dwrite d0/d2/d4/f13 [0,4194304] 0 2021-04-09T18:25:37.926 INFO:tasks.workunit.client.0.smithi120.stdout:8/81: symlink d2/d3/d8/l1b 0 2021-04-09T18:25:37.927 INFO:tasks.workunit.client.0.smithi120.stdout:7/85: write db/f1b [1898300,109768] 0 2021-04-09T18:25:37.927 INFO:tasks.workunit.client.0.smithi120.stdout:8/82: fdatasync d2/f13 0 2021-04-09T18:25:37.928 INFO:tasks.workunit.client.0.smithi120.stdout:2/108: truncate f9 2125627 0 2021-04-09T18:25:37.929 INFO:tasks.workunit.client.0.smithi120.stdout:0/77: symlink d0/l15 0 2021-04-09T18:25:37.933 INFO:tasks.workunit.client.0.smithi120.stdout:2/109: creat d13/f2c x:0 0 0 2021-04-09T18:25:37.933 INFO:tasks.workunit.client.0.smithi120.stdout:8/83: creat d2/d3/d11/f1c x:0 0 0 2021-04-09T18:25:37.941 INFO:tasks.workunit.client.0.smithi120.stdout:8/84: dwrite d2/d3/d8/f15 [0,4194304] 0 2021-04-09T18:25:37.954 INFO:tasks.workunit.client.0.smithi120.stdout:8/85: dwrite d2/d3/f12 [0,4194304] 0 2021-04-09T18:25:37.956 INFO:tasks.workunit.client.0.smithi120.stdout:8/86: chown d2/d3/f1a 136 1 2021-04-09T18:25:37.960 INFO:tasks.workunit.client.0.smithi120.stdout:8/87: creat d2/d3/d8/f1d x:0 0 0 2021-04-09T18:25:37.963 INFO:tasks.workunit.client.0.smithi120.stdout:8/88: creat d2/d3/f1e x:0 0 0 2021-04-09T18:25:37.965 INFO:tasks.workunit.client.0.smithi120.stdout:8/89: read - d2/d3/f1a zero size 2021-04-09T18:25:37.967 INFO:tasks.workunit.client.0.smithi120.stdout:0/78: write d0/fc [723379,7151] 0 2021-04-09T18:25:37.971 INFO:tasks.workunit.client.0.smithi120.stdout:8/90: dread d2/f13 [0,4194304] 0 2021-04-09T18:25:37.976 INFO:tasks.workunit.client.0.smithi120.stdout:0/79: read d0/fc [343784,76798] 0 2021-04-09T18:25:37.978 INFO:tasks.workunit.client.0.smithi120.stdout:0/80: write d0/fc [917320,84741] 0 2021-04-09T18:25:37.984 INFO:tasks.workunit.client.0.smithi120.stdout:0/81: rmdir d0/d2/df 0 2021-04-09T18:25:37.994 INFO:tasks.workunit.client.0.smithi120.stdout:0/82: dread d0/fc [0,4194304] 0 2021-04-09T18:25:37.998 INFO:tasks.workunit.client.0.smithi120.stdout:0/83: unlink d0/d2/l12 0 2021-04-09T18:25:37.999 INFO:tasks.workunit.client.0.smithi120.stdout:0/84: read d0/d2/d4/f5 [1540396,101371] 0 2021-04-09T18:25:38.001 INFO:tasks.workunit.client.0.smithi120.stdout:0/85: read d0/d2/d4/f13 [423858,68844] 0 2021-04-09T18:25:38.003 INFO:tasks.workunit.client.0.smithi120.stdout:0/86: write d0/d2/d4/f13 [4045721,27652] 0 2021-04-09T18:25:38.006 INFO:tasks.workunit.client.0.smithi120.stdout:0/87: mkdir d0/d2/d16 0 2021-04-09T18:25:38.011 INFO:tasks.workunit.client.0.smithi120.stdout:0/88: link d0/d2/da/l10 d0/d2/dd/l17 0 2021-04-09T18:25:38.017 INFO:tasks.workunit.client.0.smithi120.stdout:0/89: truncate d0/d2/d4/f5 5335864 0 2021-04-09T18:25:38.018 INFO:tasks.workunit.client.0.smithi120.stdout:0/90: read d0/fc [922620,69378] 0 2021-04-09T18:25:38.020 INFO:tasks.workunit.client.0.smithi120.stdout:0/91: unlink d0/d2/d4/le 0 2021-04-09T18:25:38.026 INFO:tasks.workunit.client.0.smithi120.stdout:0/92: dwrite d0/fc [0,4194304] 0 2021-04-09T18:25:38.028 INFO:tasks.workunit.client.0.smithi120.stdout:0/93: symlink d0/d2/d4/l18 0 2021-04-09T18:25:38.029 INFO:tasks.workunit.client.0.smithi120.stdout:0/94: read d0/d2/d4/f13 [1058363,14113] 0 2021-04-09T18:25:38.030 INFO:tasks.workunit.client.0.smithi120.stdout:0/95: rmdir d0/d2/dd 39 2021-04-09T18:25:38.040 INFO:tasks.workunit.client.0.smithi120.stdout:0/96: dwrite d0/d2/d4/f13 [4194304,4194304] 0 2021-04-09T18:25:38.041 INFO:tasks.workunit.client.0.smithi120.stdout:0/97: read d0/d2/d4/f13 [399510,14474] 0 2021-04-09T18:25:38.781 INFO:tasks.workunit.client.0.smithi120.stdout:6/54: sync 2021-04-09T18:25:38.865 INFO:tasks.workunit.client.0.smithi120.stdout:1/57: sync 2021-04-09T18:25:38.866 INFO:tasks.workunit.client.0.smithi120.stdout:3/88: sync 2021-04-09T18:25:38.866 INFO:tasks.workunit.client.0.smithi120.stdout:8/91: sync 2021-04-09T18:25:38.866 INFO:tasks.workunit.client.0.smithi120.stdout:0/98: sync 2021-04-09T18:25:38.866 INFO:tasks.workunit.client.0.smithi120.stdout:2/110: sync 2021-04-09T18:25:38.866 INFO:tasks.workunit.client.0.smithi120.stdout:7/86: sync 2021-04-09T18:25:38.867 INFO:tasks.workunit.client.0.smithi120.stdout:5/73: sync 2021-04-09T18:25:38.867 INFO:tasks.workunit.client.0.smithi120.stdout:4/68: sync 2021-04-09T18:25:38.867 INFO:tasks.workunit.client.0.smithi120.stdout:9/95: sync 2021-04-09T18:25:38.868 INFO:tasks.workunit.client.0.smithi120.stdout:5/74: mknod d10/d12/d1b/c1d 1 2021-04-09T18:25:38.868 INFO:tasks.workunit.client.0.smithi120.stdout:8/92: chown d2/d3/d11 787079 1 2021-04-09T18:25:38.869 INFO:tasks.workunit.client.0.smithi120.stdout:1/58: write d5/fc [441504,53312] 0 2021-04-09T18:25:38.869 INFO:tasks.workunit.client.0.smithi120.stdout:9/96: mkdir d19/d1c 0 2021-04-09T18:25:38.873 INFO:tasks.workunit.client.0.smithi120.stdout:2/111: creat d13/d15/f2d x:0 0 0 2021-04-09T18:25:38.875 INFO:tasks.workunit.client.0.smithi120.stdout:1/59: chown d5/f7 989819 1 2021-04-09T18:25:38.875 INFO:tasks.workunit.client.0.smithi120.stdout:9/97: creat d19/f1d x:0 0 0 2021-04-09T18:25:38.876 INFO:tasks.workunit.client.0.smithi120.stdout:5/75: creat d10/d12/f1e x:0 0 0 2021-04-09T18:25:38.876 INFO:tasks.workunit.client.0.smithi120.stdout:7/87: write db/f20 [825478,115572] 0 2021-04-09T18:25:38.878 INFO:tasks.workunit.client.0.smithi120.stdout:3/89: dwrite d3/de/d13/f15 [0,4194304] 0 2021-04-09T18:25:38.878 INFO:tasks.workunit.client.0.smithi120.stdout:0/99: link d0/fc d0/d2/da/f19 0 2021-04-09T18:25:38.878 INFO:tasks.workunit.client.0.smithi120.stdout:5/76: fdatasync d10/f18 0 2021-04-09T18:25:38.880 INFO:tasks.workunit.client.0.smithi120.stdout:0/100: readlink d0/l15 0 2021-04-09T18:25:38.880 INFO:tasks.workunit.client.0.smithi120.stdout:7/88: write db/f20 [409500,87584] 0 2021-04-09T18:25:38.883 INFO:tasks.workunit.client.0.smithi120.stdout:8/93: creat d2/d3/d11/f1f x:0 0 0 2021-04-09T18:25:38.884 INFO:tasks.workunit.client.0.smithi120.stdout:2/112: rmdir d13/d15 39 2021-04-09T18:25:38.885 INFO:tasks.workunit.client.0.smithi120.stdout:8/94: write d2/d3/d8/f15 [2599472,20642] 0 2021-04-09T18:25:38.891 INFO:tasks.workunit.client.0.smithi120.stdout:5/77: rmdir d10/d12 39 2021-04-09T18:25:38.893 INFO:tasks.workunit.client.0.smithi120.stdout:2/113: dwrite f6 [8388608,4194304] 0 2021-04-09T18:25:38.895 INFO:tasks.workunit.client.0.smithi120.stdout:8/95: dwrite d2/f19 [0,4194304] 0 2021-04-09T18:25:38.897 INFO:tasks.workunit.client.0.smithi120.stdout:3/90: rename d3/d5/fb to d3/de/d13/f22 0 2021-04-09T18:25:38.899 INFO:tasks.workunit.client.0.smithi120.stdout:3/91: write d3/d5/df/f19 [333585,87677] 0 2021-04-09T18:25:38.900 INFO:tasks.workunit.client.0.smithi120.stdout:1/60: symlink d5/df/l10 0 2021-04-09T18:25:38.900 INFO:tasks.workunit.client.0.smithi120.stdout:9/98: symlink d19/d1c/l1e 0 2021-04-09T18:25:38.902 INFO:tasks.workunit.client.0.smithi120.stdout:3/92: creat d3/d5/df/f23 x:0 0 0 2021-04-09T18:25:38.903 INFO:tasks.workunit.client.0.smithi120.stdout:9/99: write fb [37464,83363] 0 2021-04-09T18:25:38.917 INFO:tasks.workunit.client.0.smithi120.stdout:4/69: truncate f19 4982799 0 2021-04-09T18:25:38.918 INFO:tasks.workunit.client.0.smithi120.stdout:8/96: dread d2/d3/d11/ff [0,4194304] 0 2021-04-09T18:25:38.918 INFO:tasks.workunit.client.0.smithi120.stdout:1/61: unlink d5/fd 0 2021-04-09T18:25:38.919 INFO:tasks.workunit.client.0.smithi120.stdout:8/97: fsync d2/d3/f17 0 2021-04-09T18:25:38.920 INFO:tasks.workunit.client.0.smithi120.stdout:8/98: chown d2/f13 5765 1 2021-04-09T18:25:38.926 INFO:tasks.workunit.client.0.smithi120.stdout:3/93: symlink d3/de/l24 0 2021-04-09T18:25:38.927 INFO:tasks.workunit.client.0.smithi120.stdout:1/62: read d5/fc [49604,127313] 0 2021-04-09T18:25:38.928 INFO:tasks.workunit.client.0.smithi120.stdout:2/114: creat d13/f2e x:0 0 0 2021-04-09T18:25:38.928 INFO:tasks.workunit.client.0.smithi120.stdout:5/78: mkdir d10/d12/d1b/d1f 0 2021-04-09T18:25:38.930 INFO:tasks.workunit.client.0.smithi120.stdout:8/99: unlink d2/d3/d11/f1c 0 2021-04-09T18:25:38.931 INFO:tasks.workunit.client.0.smithi120.stdout:0/101: link d0/l15 d0/d2/l1a 0 2021-04-09T18:25:38.931 INFO:tasks.workunit.client.0.smithi120.stdout:8/100: read - d2/d3/f1a zero size 2021-04-09T18:25:38.932 INFO:tasks.workunit.client.0.smithi120.stdout:0/102: rmdir d0 39 2021-04-09T18:25:38.933 INFO:tasks.workunit.client.0.smithi120.stdout:3/94: write d3/f6 [3052530,36605] 0 2021-04-09T18:25:38.934 INFO:tasks.workunit.client.0.smithi120.stdout:4/70: rename f18 to f1a 0 2021-04-09T18:25:38.940 INFO:tasks.workunit.client.0.smithi120.stdout:8/101: write d2/d3/f1a [315702,25455] 0 2021-04-09T18:25:38.942 INFO:tasks.workunit.client.0.smithi120.stdout:8/102: write d2/d3/f1a [429546,58417] 0 2021-04-09T18:25:38.944 INFO:tasks.workunit.client.0.smithi120.stdout:5/79: dread d10/f18 [0,4194304] 0 2021-04-09T18:25:38.947 INFO:tasks.workunit.client.0.smithi120.stdout:0/103: getdents d0/d2/dd 0 2021-04-09T18:25:38.947 INFO:tasks.workunit.client.0.smithi120.stdout:5/80: fsync d10/f18 0 2021-04-09T18:25:38.948 INFO:tasks.workunit.client.0.smithi120.stdout:4/71: dwrite f1a [0,4194304] 0 2021-04-09T18:25:38.950 INFO:tasks.workunit.client.0.smithi120.stdout:2/115: fsync d13/f1c 0 2021-04-09T18:25:38.953 INFO:tasks.workunit.client.0.smithi120.stdout:8/103: dread d2/f13 [0,4194304] 0 2021-04-09T18:25:38.953 INFO:tasks.workunit.client.0.smithi120.stdout:2/116: write f6 [13425769,49453] 0 2021-04-09T18:25:38.954 INFO:tasks.workunit.client.0.smithi120.stdout:0/104: readlink d0/d2/dd/l17 0 2021-04-09T18:25:38.958 INFO:tasks.workunit.client.0.smithi120.stdout:8/104: unlink d2/f13 0 2021-04-09T18:25:38.960 INFO:tasks.workunit.client.0.smithi120.stdout:2/117: creat d13/d1b/f2f x:0 0 0 2021-04-09T18:25:38.961 INFO:tasks.workunit.client.0.smithi120.stdout:0/105: readlink d0/d2/l1a 0 2021-04-09T18:25:38.964 INFO:tasks.workunit.client.0.smithi120.stdout:3/95: write f1 [2692407,85580] 0 2021-04-09T18:25:38.965 INFO:tasks.workunit.client.0.smithi120.stdout:5/81: write d10/d12/f1a [152823,88418] 0 2021-04-09T18:25:38.967 INFO:tasks.workunit.client.0.smithi120.stdout:4/72: rename fa to f1b 0 2021-04-09T18:25:38.972 INFO:tasks.workunit.client.0.smithi120.stdout:3/96: rename d3/de/d13 to d3/de/d25 0 2021-04-09T18:25:38.973 INFO:tasks.workunit.client.0.smithi120.stdout:5/82: creat d10/d12/d1b/f20 x:0 0 0 2021-04-09T18:25:38.974 INFO:tasks.workunit.client.0.smithi120.stdout:3/97: rename d3 to d3/d5/df/d26 22 2021-04-09T18:25:38.975 INFO:tasks.workunit.client.0.smithi120.stdout:5/83: fsync d10/d12/f1e 0 2021-04-09T18:25:38.975 INFO:tasks.workunit.client.0.smithi120.stdout:9/100: dread f18 [0,4194304] 0 2021-04-09T18:25:38.977 INFO:tasks.workunit.client.0.smithi120.stdout:3/98: dread d3/d5/df/f10 [0,4194304] 0 2021-04-09T18:25:38.979 INFO:tasks.workunit.client.0.smithi120.stdout:4/73: symlink l1c 0 2021-04-09T18:25:38.980 INFO:tasks.workunit.client.0.smithi120.stdout:0/106: link d0/d2/l1a d0/l1b 0 2021-04-09T18:25:38.981 INFO:tasks.workunit.client.0.smithi120.stdout:0/107: mknod d0/d2/dd/c1c 1 2021-04-09T18:25:38.982 INFO:tasks.workunit.client.0.smithi120.stdout:3/99: creat d3/f27 x:0 0 0 2021-04-09T18:25:38.983 INFO:tasks.workunit.client.0.smithi120.stdout:0/108: stat d0/d2/d16 0 2021-04-09T18:25:38.983 INFO:tasks.workunit.client.0.smithi120.stdout:8/105: truncate d2/d3/f12 1420375 0 2021-04-09T18:25:38.984 INFO:tasks.workunit.client.0.smithi120.stdout:6/55: sync 2021-04-09T18:25:38.984 INFO:tasks.workunit.client.0.smithi120.stdout:5/84: symlink d10/d12/d1b/d1f/l21 0 2021-04-09T18:25:38.985 INFO:tasks.workunit.client.0.smithi120.stdout:8/106: chown d2/d3/d8/l1b 155 1 2021-04-09T18:25:38.986 INFO:tasks.workunit.client.0.smithi120.stdout:9/101: unlink d19/d1c/l1e 0 2021-04-09T18:25:38.986 INFO:tasks.workunit.client.0.smithi120.stdout:8/107: dread - d2/d3/d11/f1f zero size 2021-04-09T18:25:38.987 INFO:tasks.workunit.client.0.smithi120.stdout:5/85: dread d10/f18 [0,4194304] 0 2021-04-09T18:25:38.988 INFO:tasks.workunit.client.0.smithi120.stdout:3/100: creat d3/d5/f28 x:0 0 0 2021-04-09T18:25:38.988 INFO:tasks.workunit.client.0.smithi120.stdout:8/108: chown d2/d3/d8/f1d 13428 1 2021-04-09T18:25:38.989 INFO:tasks.workunit.client.0.smithi120.stdout:9/102: rename fd to d19/d1c/f1f 0 2021-04-09T18:25:38.990 INFO:tasks.workunit.client.0.smithi120.stdout:6/56: rename d6/d8/db to d6/d8/db/d12/d14 22 2021-04-09T18:25:38.990 INFO:tasks.workunit.client.0.smithi120.stdout:3/101: creat d3/f29 x:0 0 0 2021-04-09T18:25:38.991 INFO:tasks.workunit.client.0.smithi120.stdout:6/57: stat d6/d8 0 2021-04-09T18:25:38.992 INFO:tasks.workunit.client.0.smithi120.stdout:4/74: rename l5 to l1d 0 2021-04-09T18:25:38.993 INFO:tasks.workunit.client.0.smithi120.stdout:6/58: dread - d6/d8/f10 zero size 2021-04-09T18:25:38.995 INFO:tasks.workunit.client.0.smithi120.stdout:6/59: fdatasync d6/d8/f10 0 2021-04-09T18:25:38.998 INFO:tasks.workunit.client.0.smithi120.stdout:5/86: dwrite d10/d12/d1b/f20 [0,4194304] 0 2021-04-09T18:25:39.000 INFO:tasks.workunit.client.0.smithi120.stdout:9/103: dwrite f13 [0,4194304] 0 2021-04-09T18:25:39.002 INFO:tasks.workunit.client.0.smithi120.stdout:6/60: symlink d6/l15 0 2021-04-09T18:25:39.006 INFO:tasks.workunit.client.0.smithi120.stdout:8/109: getdents d2/d3/d11 0 2021-04-09T18:25:39.007 INFO:tasks.workunit.client.0.smithi120.stdout:9/104: creat d19/d1c/f20 x:0 0 0 2021-04-09T18:25:39.009 INFO:tasks.workunit.client.0.smithi120.stdout:6/61: unlink d6/d8/ff 0 2021-04-09T18:25:39.018 INFO:tasks.workunit.client.0.smithi120.stdout:5/87: link d10/d12/f17 d10/d12/d1b/f22 0 2021-04-09T18:25:39.019 INFO:tasks.workunit.client.0.smithi120.stdout:3/102: getdents d3/d5/df 0 2021-04-09T18:25:39.021 INFO:tasks.workunit.client.0.smithi120.stdout:8/110: rename d2/d3/f17 to d2/d3/d8/f20 0 2021-04-09T18:25:39.022 INFO:tasks.workunit.client.0.smithi120.stdout:8/111: mknod d2/d3/d8/c21 1 2021-04-09T18:25:39.023 INFO:tasks.workunit.client.0.smithi120.stdout:3/103: symlink d3/d5/l2a 0 2021-04-09T18:25:39.025 INFO:tasks.workunit.client.0.smithi120.stdout:3/104: dread - d3/f29 zero size 2021-04-09T18:25:39.027 INFO:tasks.workunit.client.0.smithi120.stdout:3/105: write d3/d5/f28 [207325,1190] 0 2021-04-09T18:25:39.028 INFO:tasks.workunit.client.0.smithi120.stdout:3/106: write d3/d5/df/f19 [1293943,18018] 0 2021-04-09T18:25:39.030 INFO:tasks.workunit.client.0.smithi120.stdout:5/88: creat d10/f23 x:0 0 0 2021-04-09T18:25:39.032 INFO:tasks.workunit.client.0.smithi120.stdout:3/107: write d3/f27 [584621,107755] 0 2021-04-09T18:25:39.032 INFO:tasks.workunit.client.0.smithi120.stdout:5/89: write d10/d12/f19 [845440,25862] 0 2021-04-09T18:25:39.033 INFO:tasks.workunit.client.0.smithi120.stdout:3/108: fdatasync d3/de/d25/f15 0 2021-04-09T18:25:39.038 INFO:tasks.workunit.client.0.smithi120.stdout:4/75: truncate ff 560433 0 2021-04-09T18:25:39.039 INFO:tasks.workunit.client.0.smithi120.stdout:3/109: chown d3/d5/df 153 1 2021-04-09T18:25:39.040 INFO:tasks.workunit.client.0.smithi120.stdout:3/110: dread - d3/de/f20 zero size 2021-04-09T18:25:39.044 INFO:tasks.workunit.client.0.smithi120.stdout:5/90: rename d10/f18 to d10/d12/f24 0 2021-04-09T18:25:39.045 INFO:tasks.workunit.client.0.smithi120.stdout:5/91: mknod d10/d12/d1b/c25 1 2021-04-09T18:25:39.045 INFO:tasks.workunit.client.0.smithi120.stdout:3/111: symlink d3/d5/l2b 0 2021-04-09T18:25:39.046 INFO:tasks.workunit.client.0.smithi120.stdout:3/112: dread - d3/f4 zero size 2021-04-09T18:25:39.061 INFO:tasks.workunit.client.0.smithi120.stdout:3/113: link d3/de/f20 d3/d5/f2c 0 2021-04-09T18:25:39.062 INFO:tasks.workunit.client.0.smithi120.stdout:4/76: dwrite f12 [0,4194304] 0 2021-04-09T18:25:39.063 INFO:tasks.workunit.client.0.smithi120.stdout:5/92: rename d10/l14 to d10/d12/d1b/d1f/l26 0 2021-04-09T18:25:39.068 INFO:tasks.workunit.client.0.smithi120.stdout:5/93: creat d10/d12/f27 x:0 0 0 2021-04-09T18:25:39.069 INFO:tasks.workunit.client.0.smithi120.stdout:5/94: read d10/f11 [5329,86643] 0 2021-04-09T18:25:39.075 INFO:tasks.workunit.client.0.smithi120.stdout:3/114: getdents d3/de 0 2021-04-09T18:25:39.078 INFO:tasks.workunit.client.0.smithi120.stdout:4/77: rename l17 to l1e 0 2021-04-09T18:25:39.080 INFO:tasks.workunit.client.0.smithi120.stdout:3/115: symlink d3/de/d25/l2d 0 2021-04-09T18:25:39.082 INFO:tasks.workunit.client.0.smithi120.stdout:4/78: write f10 [156586,28513] 0 2021-04-09T18:25:39.223 INFO:tasks.workunit.client.0.smithi120.stdout:3/116: rename d3/f27 to d3/de/d25/f2e 0 2021-04-09T18:25:39.224 INFO:tasks.workunit.client.0.smithi120.stdout:3/117: fdatasync d3/d5/f28 0 2021-04-09T18:25:39.226 INFO:tasks.workunit.client.0.smithi120.stdout:5/95: link la d10/d12/d1b/d1f/l28 0 2021-04-09T18:25:39.226 INFO:tasks.workunit.client.0.smithi120.stdout:5/96: stat d10/f11 0 2021-04-09T18:25:39.227 INFO:tasks.workunit.client.0.smithi120.stdout:5/97: chown d10/d12 8083 1 2021-04-09T18:25:39.229 INFO:tasks.workunit.client.0.smithi120.stdout:3/118: mkdir d3/de/d25/d2f 0 2021-04-09T18:25:39.229 INFO:tasks.workunit.client.0.smithi120.stdout:3/119: chown d3/de/d25/f1f 27 1 2021-04-09T18:25:39.231 INFO:tasks.workunit.client.0.smithi120.stdout:3/120: dread d3/d5/df/f10 [0,4194304] 0 2021-04-09T18:25:39.232 INFO:tasks.workunit.client.0.smithi120.stdout:3/121: write d3/de/d25/f15 [3659594,82087] 0 2021-04-09T18:25:39.233 INFO:tasks.workunit.client.0.smithi120.stdout:3/122: readlink d3/d5/l7 0 2021-04-09T18:25:39.233 INFO:tasks.workunit.client.0.smithi120.stdout:3/123: stat d3/d5 0 2021-04-09T18:25:39.238 INFO:tasks.workunit.client.0.smithi120.stdout:3/124: dwrite d3/de/f1b [0,4194304] 0 2021-04-09T18:25:39.239 INFO:tasks.workunit.client.0.smithi120.stdout:3/125: dread - d3/de/f20 zero size 2021-04-09T18:25:39.240 INFO:tasks.workunit.client.0.smithi120.stdout:5/98: creat d10/d12/d1b/d1f/f29 x:0 0 0 2021-04-09T18:25:39.240 INFO:tasks.workunit.client.0.smithi120.stdout:3/126: chown d3/d5/df/f11 117 1 2021-04-09T18:25:39.242 INFO:tasks.workunit.client.0.smithi120.stdout:3/127: write d3/de/d25/f15 [5057795,77955] 0 2021-04-09T18:25:39.250 INFO:tasks.workunit.client.0.smithi120.stdout:5/99: symlink d10/l2a 0 2021-04-09T18:25:39.251 INFO:tasks.workunit.client.0.smithi120.stdout:5/100: fdatasync d10/f15 0 2021-04-09T18:25:39.252 INFO:tasks.workunit.client.0.smithi120.stdout:5/101: chown d10/d12/f1a 848438 1 2021-04-09T18:25:39.252 INFO:tasks.workunit.client.0.smithi120.stdout:3/128: mkdir d3/d5/df/d1e/d30 0 2021-04-09T18:25:39.253 INFO:tasks.workunit.client.0.smithi120.stdout:3/129: chown d3/de/l21 139647 1 2021-04-09T18:25:39.254 INFO:tasks.workunit.client.0.smithi120.stdout:3/130: write d3/de/d25/f1f [1195921,108390] 0 2021-04-09T18:25:39.262 INFO:tasks.workunit.client.0.smithi120.stdout:3/131: creat d3/d5/f31 x:0 0 0 2021-04-09T18:25:39.268 INFO:tasks.workunit.client.0.smithi120.stdout:5/102: dwrite d10/d12/f17 [0,4194304] 0 2021-04-09T18:25:39.270 INFO:tasks.workunit.client.0.smithi120.stdout:5/103: write d10/d12/d1b/d1f/f29 [297973,67437] 0 2021-04-09T18:25:39.271 INFO:tasks.workunit.client.0.smithi120.stdout:5/104: write d10/d12/f19 [134976,45711] 0 2021-04-09T18:25:39.274 INFO:tasks.workunit.client.0.smithi120.stdout:3/132: truncate d3/de/d25/f2e 1290354 0 2021-04-09T18:25:39.278 INFO:tasks.workunit.client.0.smithi120.stdout:5/105: creat d10/f2b x:0 0 0 2021-04-09T18:25:39.278 INFO:tasks.workunit.client.0.smithi120.stdout:5/106: dread - d10/f15 zero size 2021-04-09T18:25:39.280 INFO:tasks.workunit.client.0.smithi120.stdout:3/133: rename d3/de/d25/l2d to d3/l32 0 2021-04-09T18:25:39.281 INFO:tasks.workunit.client.0.smithi120.stdout:3/134: readlink d3/l12 0 2021-04-09T18:25:39.284 INFO:tasks.workunit.client.0.smithi120.stdout:3/135: unlink d3/d5/l1c 0 2021-04-09T18:25:39.285 INFO:tasks.workunit.client.0.smithi120.stdout:3/136: read - d3/d5/df/f11 zero size 2021-04-09T18:25:39.286 INFO:tasks.workunit.client.0.smithi120.stdout:5/107: getdents d10/d12/d1b/d1f 0 2021-04-09T18:25:39.288 INFO:tasks.workunit.client.0.smithi120.stdout:3/137: symlink d3/d5/l33 0 2021-04-09T18:25:39.289 INFO:tasks.workunit.client.0.smithi120.stdout:5/108: creat d10/d12/d1b/d1f/f2c x:0 0 0 2021-04-09T18:25:39.290 INFO:tasks.workunit.client.0.smithi120.stdout:3/138: write d3/de/f20 [258915,114087] 0 2021-04-09T18:25:39.292 INFO:tasks.workunit.client.0.smithi120.stdout:3/139: symlink d3/de/l34 0 2021-04-09T18:25:39.295 INFO:tasks.workunit.client.0.smithi120.stdout:5/109: dwrite d10/f2b [0,4194304] 0 2021-04-09T18:25:39.305 INFO:tasks.workunit.client.0.smithi120.stdout:3/140: rename d3/f4 to d3/de/d25/d2f/f35 0 2021-04-09T18:25:39.310 INFO:tasks.workunit.client.0.smithi120.stdout:7/89: sync 2021-04-09T18:25:39.315 INFO:tasks.workunit.client.0.smithi120.stdout:5/110: dwrite d10/d12/d1b/f22 [4194304,4194304] 0 2021-04-09T18:25:39.318 INFO:tasks.workunit.client.0.smithi120.stdout:3/141: dwrite d3/de/d25/f22 [0,4194304] 0 2021-04-09T18:25:39.319 INFO:tasks.workunit.client.0.smithi120.stdout:3/142: read - d3/d5/df/f11 zero size 2021-04-09T18:25:39.322 INFO:tasks.workunit.client.0.smithi120.stdout:5/111: getdents d10/d12 0 2021-04-09T18:25:39.323 INFO:tasks.workunit.client.0.smithi120.stdout:5/112: write d10/f16 [196487,79691] 0 2021-04-09T18:25:39.333 INFO:tasks.workunit.client.0.smithi120.stdout:3/143: dwrite d3/de/f20 [0,4194304] 0 2021-04-09T18:25:39.333 INFO:tasks.workunit.client.0.smithi120.stdout:5/113: mknod d10/d12/d1b/c2d 1 2021-04-09T18:25:39.338 INFO:tasks.workunit.client.0.smithi120.stdout:3/144: rename d3/d5/df to d3/d5/d36 0 2021-04-09T18:25:39.344 INFO:tasks.workunit.client.0.smithi120.stdout:3/145: dread d3/de/f1b [0,4194304] 0 2021-04-09T18:25:39.345 INFO:tasks.workunit.client.0.smithi120.stdout:3/146: chown d3/d5/f2c 0 1 2021-04-09T18:25:39.348 INFO:tasks.workunit.client.0.smithi120.stdout:5/114: truncate d10/f15 1021054 0 2021-04-09T18:25:39.351 INFO:tasks.workunit.client.0.smithi120.stdout:3/147: creat d3/f37 x:0 0 0 2021-04-09T18:25:39.355 INFO:tasks.workunit.client.0.smithi120.stdout:3/148: mkdir d3/d5/d36/d1e/d38 0 2021-04-09T18:25:39.357 INFO:tasks.workunit.client.0.smithi120.stdout:5/115: dwrite d10/d12/f27 [0,4194304] 0 2021-04-09T18:25:39.362 INFO:tasks.workunit.client.0.smithi120.stdout:5/116: unlink d10/d12/d1b/f22 0 2021-04-09T18:25:39.363 INFO:tasks.workunit.client.0.smithi120.stdout:3/149: write d3/d5/d36/f10 [921443,114700] 0 2021-04-09T18:25:39.370 INFO:tasks.workunit.client.0.smithi120.stdout:5/117: rmdir d10 39 2021-04-09T18:25:39.371 INFO:tasks.workunit.client.0.smithi120.stdout:3/150: creat d3/d5/d36/d1e/f39 x:0 0 0 2021-04-09T18:25:39.377 INFO:tasks.workunit.client.0.smithi120.stdout:3/151: symlink d3/de/l3a 0 2021-04-09T18:25:39.379 INFO:tasks.workunit.client.0.smithi120.stdout:5/118: creat d10/d12/f2e x:0 0 0 2021-04-09T18:25:39.381 INFO:tasks.workunit.client.0.smithi120.stdout:3/152: creat d3/d5/d36/d1e/d38/f3b x:0 0 0 2021-04-09T18:25:39.385 INFO:tasks.workunit.client.0.smithi120.stdout:3/153: link d3/d5/ld d3/de/l3c 0 2021-04-09T18:25:39.396 INFO:tasks.workunit.client.0.smithi120.stdout:5/119: dread d10/d12/f19 [0,4194304] 0 2021-04-09T18:25:39.403 INFO:tasks.workunit.client.0.smithi120.stdout:5/120: dwrite d10/d12/f24 [0,4194304] 0 2021-04-09T18:25:39.405 INFO:tasks.workunit.client.0.smithi120.stdout:3/154: truncate d3/d5/d36/d1e/d38/f3b 606202 0 2021-04-09T18:25:39.408 INFO:tasks.workunit.client.0.smithi120.stdout:5/121: creat d10/f2f x:0 0 0 2021-04-09T18:25:39.415 INFO:tasks.workunit.client.0.smithi120.stdout:3/155: dwrite d3/d5/d36/f11 [0,4194304] 0 2021-04-09T18:25:39.418 INFO:tasks.workunit.client.0.smithi120.stdout:3/156: mkdir d3/d5/d36/d3d 0 2021-04-09T18:25:39.420 INFO:tasks.workunit.client.0.smithi120.stdout:3/157: write d3/d5/d36/d1e/f39 [112042,115517] 0 2021-04-09T18:25:39.421 INFO:tasks.workunit.client.0.smithi120.stdout:5/122: dread d10/f16 [0,4194304] 0 2021-04-09T18:25:39.421 INFO:tasks.workunit.client.0.smithi120.stdout:3/158: mknod d3/d5/d36/d1e/d38/c3e 1 2021-04-09T18:25:39.428 INFO:tasks.workunit.client.0.smithi120.stdout:3/159: dwrite f1 [0,4194304] 0 2021-04-09T18:25:39.432 INFO:tasks.workunit.client.0.smithi120.stdout:3/160: dread d3/d5/d36/f11 [0,4194304] 0 2021-04-09T18:25:39.473 INFO:tasks.workunit.client.0.smithi120.stdout:3/161: creat d3/de/d25/d2f/f3f x:0 0 0 2021-04-09T18:25:39.474 INFO:tasks.workunit.client.0.smithi120.stdout:3/162: dread - d3/de/d25/d2f/f35 zero size 2021-04-09T18:25:39.483 INFO:tasks.workunit.client.0.smithi120.stdout:3/163: dwrite d3/d5/d36/f10 [0,4194304] 0 2021-04-09T18:25:39.578 INFO:tasks.workunit.client.0.smithi120.stdout:1/63: sync 2021-04-09T18:25:39.580 INFO:tasks.workunit.client.0.smithi120.stdout:3/164: rename d3/d5/d36/f19 to d3/d5/d36/d1e/f40 0 2021-04-09T18:25:39.581 INFO:tasks.workunit.client.0.smithi120.stdout:1/64: symlink d5/l11 0 2021-04-09T18:25:39.584 INFO:tasks.workunit.client.0.smithi120.stdout:1/65: fsync d5/fc 0 2021-04-09T18:25:39.585 INFO:tasks.workunit.client.0.smithi120.stdout:3/165: unlink d3/de/d25/f2e 0 2021-04-09T18:25:39.590 INFO:tasks.workunit.client.0.smithi120.stdout:3/166: dread d3/d5/d36/f10 [0,4194304] 0 2021-04-09T18:25:39.711 INFO:tasks.workunit.client.0.smithi120.stdout:6/62: sync 2021-04-09T18:25:39.712 INFO:tasks.workunit.client.0.smithi120.stdout:2/118: sync 2021-04-09T18:25:39.712 INFO:tasks.workunit.client.0.smithi120.stdout:0/109: sync 2021-04-09T18:25:39.712 INFO:tasks.workunit.client.0.smithi120.stdout:8/112: sync 2021-04-09T18:25:39.713 INFO:tasks.workunit.client.0.smithi120.stdout:4/79: sync 2021-04-09T18:25:39.713 INFO:tasks.workunit.client.0.smithi120.stdout:7/90: sync 2021-04-09T18:25:39.713 INFO:tasks.workunit.client.0.smithi120.stdout:9/105: sync 2021-04-09T18:25:39.714 INFO:tasks.workunit.client.0.smithi120.stdout:2/119: dread - d13/d1b/f2f zero size 2021-04-09T18:25:39.714 INFO:tasks.workunit.client.0.smithi120.stdout:6/63: rename d6 to d6/d8/db/d12/d16 22 2021-04-09T18:25:39.714 INFO:tasks.workunit.client.0.smithi120.stdout:2/120: write f4 [9806925,118154] 0 2021-04-09T18:25:39.715 INFO:tasks.workunit.client.0.smithi120.stdout:4/80: dread fe [0,4194304] 0 2021-04-09T18:25:39.718 INFO:tasks.workunit.client.0.smithi120.stdout:9/106: dread f9 [0,4194304] 0 2021-04-09T18:25:39.719 INFO:tasks.workunit.client.0.smithi120.stdout:8/113: symlink d2/d3/d8/l22 0 2021-04-09T18:25:39.720 INFO:tasks.workunit.client.0.smithi120.stdout:3/167: creat d3/d5/d36/d1e/d30/f41 x:0 0 0 2021-04-09T18:25:39.721 INFO:tasks.workunit.client.0.smithi120.stdout:8/114: stat d2/d3/f1a 0 2021-04-09T18:25:39.722 INFO:tasks.workunit.client.0.smithi120.stdout:3/168: chown d3/de/f1b 88 1 2021-04-09T18:25:39.723 INFO:tasks.workunit.client.0.smithi120.stdout:3/169: fsync d3/de/d25/d2f/f3f 0 2021-04-09T18:25:39.725 INFO:tasks.workunit.client.0.smithi120.stdout:4/81: mkdir d1f 0 2021-04-09T18:25:39.726 INFO:tasks.workunit.client.0.smithi120.stdout:2/121: creat d13/d15/f30 x:0 0 0 2021-04-09T18:25:39.728 INFO:tasks.workunit.client.0.smithi120.stdout:9/107: dwrite f16 [4194304,4194304] 0 2021-04-09T18:25:39.731 INFO:tasks.workunit.client.0.smithi120.stdout:7/91: rename db/f20 to db/f23 0 2021-04-09T18:25:39.733 INFO:tasks.workunit.client.0.smithi120.stdout:8/115: rename d2/f19 to d2/d3/f23 0 2021-04-09T18:25:39.734 INFO:tasks.workunit.client.0.smithi120.stdout:6/64: dwrite d6/fe [4194304,4194304] 0 2021-04-09T18:25:39.735 INFO:tasks.workunit.client.0.smithi120.stdout:3/170: write d3/d5/d36/d1e/f40 [1607236,106408] 0 2021-04-09T18:25:39.737 INFO:tasks.workunit.client.0.smithi120.stdout:2/122: creat d13/d1b/f31 x:0 0 0 2021-04-09T18:25:39.737 INFO:tasks.workunit.client.0.smithi120.stdout:4/82: chown lc 38 1 2021-04-09T18:25:39.738 INFO:tasks.workunit.client.0.smithi120.stdout:9/108: creat d19/d1c/f21 x:0 0 0 2021-04-09T18:25:39.741 INFO:tasks.workunit.client.0.smithi120.stdout:3/171: write d3/f8 [4743822,115490] 0 2021-04-09T18:25:39.745 INFO:tasks.workunit.client.0.smithi120.stdout:6/65: dread d6/fe [4194304,4194304] 0 2021-04-09T18:25:39.750 INFO:tasks.workunit.client.0.smithi120.stdout:9/109: dread f16 [0,4194304] 0 2021-04-09T18:25:39.752 INFO:tasks.workunit.client.0.smithi120.stdout:7/92: symlink db/l24 0 2021-04-09T18:25:39.752 INFO:tasks.workunit.client.0.smithi120.stdout:2/123: dread d13/d15/f24 [0,4194304] 0 2021-04-09T18:25:39.756 INFO:tasks.workunit.client.0.smithi120.stdout:6/66: mkdir d6/d8/db/d17 0 2021-04-09T18:25:39.759 INFO:tasks.workunit.client.0.smithi120.stdout:4/83: getdents d1f 0 2021-04-09T18:25:39.759 INFO:tasks.workunit.client.0.smithi120.stdout:4/84: chown d1f 368 1 2021-04-09T18:25:39.764 INFO:tasks.workunit.client.0.smithi120.stdout:8/116: dread d2/d3/d11/ff [0,4194304] 0 2021-04-09T18:25:39.764 INFO:tasks.workunit.client.0.smithi120.stdout:8/117: chown d2/d3/d8 92953 1 2021-04-09T18:25:39.764 INFO:tasks.workunit.client.0.smithi120.stdout:8/118: chown d2/d3/d8 776154980 1 2021-04-09T18:25:39.766 INFO:tasks.workunit.client.0.smithi120.stdout:2/124: dwrite d13/f1d [0,4194304] 0 2021-04-09T18:25:39.773 INFO:tasks.workunit.client.0.smithi120.stdout:3/172: read d3/d5/d36/d1e/f40 [1330528,121120] 0 2021-04-09T18:25:39.774 INFO:tasks.workunit.client.0.smithi120.stdout:3/173: chown d3/d5/l33 53602631 1 2021-04-09T18:25:39.775 INFO:tasks.workunit.client.0.smithi120.stdout:2/125: dwrite d13/f1d [0,4194304] 0 2021-04-09T18:25:39.776 INFO:tasks.workunit.client.0.smithi120.stdout:2/126: stat d13/d1b/f2f 0 2021-04-09T18:25:39.780 INFO:tasks.workunit.client.0.smithi120.stdout:2/127: dread d13/f1c [0,4194304] 0 2021-04-09T18:25:39.781 INFO:tasks.workunit.client.0.smithi120.stdout:5/123: sync 2021-04-09T18:25:39.785 INFO:tasks.workunit.client.0.smithi120.stdout:2/128: dwrite d13/f1c [4194304,4194304] 0 2021-04-09T18:25:39.786 INFO:tasks.workunit.client.0.smithi120.stdout:2/129: fdatasync d13/f2e 0 2021-04-09T18:25:39.788 INFO:tasks.workunit.client.0.smithi120.stdout:2/130: dread f9 [0,4194304] 0 2021-04-09T18:25:39.875 INFO:tasks.workunit.client.0.smithi120.stdout:1/66: sync 2021-04-09T18:25:39.915 INFO:tasks.workunit.client.0.smithi120.stdout:0/110: sync 2021-04-09T18:25:39.968 INFO:tasks.workunit.client.0.smithi120.stdout:6/67: creat d6/d8/db/d12/f18 x:0 0 0 2021-04-09T18:25:39.971 INFO:tasks.workunit.client.0.smithi120.stdout:5/124: symlink d10/d12/d1b/d1f/l30 0 2021-04-09T18:25:39.973 INFO:tasks.workunit.client.0.smithi120.stdout:8/119: getdents d2/d3/d11 0 2021-04-09T18:25:39.974 INFO:tasks.workunit.client.0.smithi120.stdout:8/120: write d2/d3/f1e [887445,38100] 0 2021-04-09T18:25:39.976 INFO:tasks.workunit.client.0.smithi120.stdout:8/121: mknod d2/d3/d8/c24 1 2021-04-09T18:25:39.979 INFO:tasks.workunit.client.0.smithi120.stdout:2/131: symlink d13/l32 0 2021-04-09T18:25:39.980 INFO:tasks.workunit.client.0.smithi120.stdout:5/125: mknod d10/c31 1 2021-04-09T18:25:39.981 INFO:tasks.workunit.client.0.smithi120.stdout:5/126: write d10/d12/f1a [905714,1159] 0 2021-04-09T18:25:39.982 INFO:tasks.workunit.client.0.smithi120.stdout:1/67: write d5/fc [1336371,63584] 0 2021-04-09T18:25:39.983 INFO:tasks.workunit.client.0.smithi120.stdout:1/68: stat d5/fc 0 2021-04-09T18:25:39.984 INFO:tasks.workunit.client.0.smithi120.stdout:9/110: truncate fb 1098419 0 2021-04-09T18:25:39.984 INFO:tasks.workunit.client.0.smithi120.stdout:1/69: write d5/f6 [1091722,68716] 0 2021-04-09T18:25:39.988 INFO:tasks.workunit.client.0.smithi120.stdout:7/93: truncate f7 605081 0 2021-04-09T18:25:39.988 INFO:tasks.workunit.client.0.smithi120.stdout:4/85: link l11 d1f/l20 0 2021-04-09T18:25:39.989 INFO:tasks.workunit.client.0.smithi120.stdout:5/127: dwrite d10/d12/d1b/d1f/f29 [0,4194304] 0 2021-04-09T18:25:39.993 INFO:tasks.workunit.client.0.smithi120.stdout:2/132: creat d13/d1b/f33 x:0 0 0 2021-04-09T18:25:39.994 INFO:tasks.workunit.client.0.smithi120.stdout:9/111: creat d19/f22 x:0 0 0 2021-04-09T18:25:39.995 INFO:tasks.workunit.client.0.smithi120.stdout:1/70: symlink d5/df/l12 0 2021-04-09T18:25:39.995 INFO:tasks.workunit.client.0.smithi120.stdout:7/94: rmdir db 39 2021-04-09T18:25:39.997 INFO:tasks.workunit.client.0.smithi120.stdout:4/86: dread f1a [0,4194304] 0 2021-04-09T18:25:40.003 INFO:tasks.workunit.client.0.smithi120.stdout:5/128: dwrite d10/d12/d1b/d1f/f29 [0,4194304] 0 2021-04-09T18:25:40.005 INFO:tasks.workunit.client.0.smithi120.stdout:2/133: creat d13/d15/f34 x:0 0 0 2021-04-09T18:25:40.008 INFO:tasks.workunit.client.0.smithi120.stdout:2/134: chown d13/f18 2 1 2021-04-09T18:25:40.009 INFO:tasks.workunit.client.0.smithi120.stdout:3/174: truncate d3/d5/f31 82783 0 2021-04-09T18:25:40.010 INFO:tasks.workunit.client.0.smithi120.stdout:1/71: dwrite d5/f6 [0,4194304] 0 2021-04-09T18:25:40.013 INFO:tasks.workunit.client.0.smithi120.stdout:0/111: truncate d0/fc 319460 0 2021-04-09T18:25:40.014 INFO:tasks.workunit.client.0.smithi120.stdout:0/112: mknod d0/d2/dd/c1d 1 2021-04-09T18:25:40.015 INFO:tasks.workunit.client.0.smithi120.stdout:0/113: mknod d0/d2/d16/c1e 1 2021-04-09T18:25:40.016 INFO:tasks.workunit.client.0.smithi120.stdout:2/135: mkdir d13/d15/d35 0 2021-04-09T18:25:40.018 INFO:tasks.workunit.client.0.smithi120.stdout:1/72: rmdir d5/df 39 2021-04-09T18:25:40.021 INFO:tasks.workunit.client.0.smithi120.stdout:7/95: write db/f16 [763956,49941] 0 2021-04-09T18:25:40.024 INFO:tasks.workunit.client.0.smithi120.stdout:9/112: dwrite f7 [0,4194304] 0 2021-04-09T18:25:40.024 INFO:tasks.workunit.client.0.smithi120.stdout:3/175: rename d3/d5/d36/d1e/d38/f3b to d3/f42 0 2021-04-09T18:25:40.025 INFO:tasks.workunit.client.0.smithi120.stdout:8/122: truncate d2/d3/fc 2707186 0 2021-04-09T18:25:40.026 INFO:tasks.workunit.client.0.smithi120.stdout:9/113: chown f9 32 1 2021-04-09T18:25:40.026 INFO:tasks.workunit.client.0.smithi120.stdout:2/136: symlink d13/l36 0 2021-04-09T18:25:40.028 INFO:tasks.workunit.client.0.smithi120.stdout:1/73: dread d5/f6 [0,4194304] 0 2021-04-09T18:25:40.029 INFO:tasks.workunit.client.0.smithi120.stdout:9/114: readlink lf 0 2021-04-09T18:25:40.032 INFO:tasks.workunit.client.0.smithi120.stdout:0/114: rmdir d0/d2/d16 0 2021-04-09T18:25:40.032 INFO:tasks.workunit.client.0.smithi120.stdout:7/96: read db/f15 [2332075,59091] 0 2021-04-09T18:25:40.033 INFO:tasks.workunit.client.0.smithi120.stdout:1/74: write d5/f7 [1523044,39445] 0 2021-04-09T18:25:40.034 INFO:tasks.workunit.client.0.smithi120.stdout:3/176: symlink d3/d5/d36/d1e/d30/l43 0 2021-04-09T18:25:40.034 INFO:tasks.workunit.client.0.smithi120.stdout:8/123: symlink d2/d3/d8/l25 0 2021-04-09T18:25:40.035 INFO:tasks.workunit.client.0.smithi120.stdout:1/75: chown d5/fc 1076585703 1 2021-04-09T18:25:40.041 INFO:tasks.workunit.client.0.smithi120.stdout:0/115: fsync d0/d2/d4/f13 0 2021-04-09T18:25:40.042 INFO:tasks.workunit.client.0.smithi120.stdout:7/97: dread f7 [0,4194304] 0 2021-04-09T18:25:40.043 INFO:tasks.workunit.client.0.smithi120.stdout:3/177: dread f1 [0,4194304] 0 2021-04-09T18:25:40.047 INFO:tasks.workunit.client.0.smithi120.stdout:8/124: creat d2/d3/d11/f26 x:0 0 0 2021-04-09T18:25:40.049 INFO:tasks.workunit.client.0.smithi120.stdout:1/76: symlink d5/l13 0 2021-04-09T18:25:40.052 INFO:tasks.workunit.client.0.smithi120.stdout:0/116: symlink d0/d2/dd/l1f 0 2021-04-09T18:25:40.053 INFO:tasks.workunit.client.0.smithi120.stdout:3/178: read d3/d5/f31 [12423,16317] 0 2021-04-09T18:25:40.057 INFO:tasks.workunit.client.0.smithi120.stdout:8/125: mkdir d2/d27 0 2021-04-09T18:25:40.057 INFO:tasks.workunit.client.0.smithi120.stdout:2/137: truncate d13/d1b/f2f 901759 0 2021-04-09T18:25:40.060 INFO:tasks.workunit.client.0.smithi120.stdout:7/98: rename db/f23 to db/f25 0 2021-04-09T18:25:40.068 INFO:tasks.workunit.client.0.smithi120.stdout:3/179: dread - d3/de/d25/d2f/f35 zero size 2021-04-09T18:25:40.069 INFO:tasks.workunit.client.0.smithi120.stdout:5/129: fdatasync d10/d12/d1b/d1f/f29 0 2021-04-09T18:25:40.070 INFO:tasks.workunit.client.0.smithi120.stdout:9/115: dread fb [0,4194304] 0 2021-04-09T18:25:40.070 INFO:tasks.workunit.client.0.smithi120.stdout:9/116: readlink l8 0 2021-04-09T18:25:40.071 INFO:tasks.workunit.client.0.smithi120.stdout:5/130: mknod d10/d12/c32 1 2021-04-09T18:25:40.071 INFO:tasks.workunit.client.0.smithi120.stdout:8/126: creat d2/d3/f28 x:0 0 0 2021-04-09T18:25:40.071 INFO:tasks.workunit.client.0.smithi120.stdout:0/117: creat d0/f20 x:0 0 0 2021-04-09T18:25:40.072 INFO:tasks.workunit.client.0.smithi120.stdout:8/127: stat d2/d3/d11/ff 0 2021-04-09T18:25:40.075 INFO:tasks.workunit.client.0.smithi120.stdout:2/138: write f6 [9909550,53436] 0 2021-04-09T18:25:40.076 INFO:tasks.workunit.client.0.smithi120.stdout:7/99: mkdir db/d26 0 2021-04-09T18:25:40.077 INFO:tasks.workunit.client.0.smithi120.stdout:9/117: creat d19/d1c/f23 x:0 0 0 2021-04-09T18:25:40.080 INFO:tasks.workunit.client.0.smithi120.stdout:5/131: rmdir d10 39 2021-04-09T18:25:40.081 INFO:tasks.workunit.client.0.smithi120.stdout:8/128: rename d2/d3/fc to d2/d27/f29 0 2021-04-09T18:25:40.084 INFO:tasks.workunit.client.0.smithi120.stdout:5/132: dread - d10/d12/f1e zero size 2021-04-09T18:25:40.086 INFO:tasks.workunit.client.0.smithi120.stdout:5/133: chown d10/d12/f24 123149674 1 2021-04-09T18:25:40.087 INFO:tasks.workunit.client.0.smithi120.stdout:5/134: write fd [573912,40642] 0 2021-04-09T18:25:40.088 INFO:tasks.workunit.client.0.smithi120.stdout:9/118: dwrite d19/d1c/f21 [0,4194304] 0 2021-04-09T18:25:40.091 INFO:tasks.workunit.client.0.smithi120.stdout:9/119: chown d19/d1c/f21 42445 1 2021-04-09T18:25:40.092 INFO:tasks.workunit.client.0.smithi120.stdout:9/120: write d19/d1c/f23 [25322,18510] 0 2021-04-09T18:25:40.093 INFO:tasks.workunit.client.0.smithi120.stdout:9/121: dread - d19/f1b zero size 2021-04-09T18:25:40.094 INFO:tasks.workunit.client.0.smithi120.stdout:7/100: creat db/f27 x:0 0 0 2021-04-09T18:25:40.094 INFO:tasks.workunit.client.0.smithi120.stdout:5/135: mkdir d10/d12/d1b/d1f/d33 0 2021-04-09T18:25:40.099 INFO:tasks.workunit.client.0.smithi120.stdout:8/129: getdents d2 0 2021-04-09T18:25:40.099 INFO:tasks.workunit.client.0.smithi120.stdout:2/139: truncate d13/d1b/f2b 292912 0 2021-04-09T18:25:40.102 INFO:tasks.workunit.client.0.smithi120.stdout:1/77: dread d5/fc [0,4194304] 0 2021-04-09T18:25:40.104 INFO:tasks.workunit.client.0.smithi120.stdout:5/136: creat d10/d12/d1b/f34 x:0 0 0 2021-04-09T18:25:40.107 INFO:tasks.workunit.client.0.smithi120.stdout:9/122: dwrite d19/d1c/f1f [0,4194304] 0 2021-04-09T18:25:40.113 INFO:tasks.workunit.client.0.smithi120.stdout:8/130: mkdir d2/d3/d11/d2a 0 2021-04-09T18:25:40.113 INFO:tasks.workunit.client.0.smithi120.stdout:2/140: rmdir d13 39 2021-04-09T18:25:40.114 INFO:tasks.workunit.client.0.smithi120.stdout:3/180: truncate d3/d5/d36/d1e/d30/f41 846816 0 2021-04-09T18:25:40.114 INFO:tasks.workunit.client.0.smithi120.stdout:5/137: dwrite fd [0,4194304] 0 2021-04-09T18:25:40.115 INFO:tasks.workunit.client.0.smithi120.stdout:8/131: read - d2/d3/d11/f1f zero size 2021-04-09T18:25:40.119 INFO:tasks.workunit.client.0.smithi120.stdout:9/123: mkdir d19/d24 0 2021-04-09T18:25:40.120 INFO:tasks.workunit.client.0.smithi120.stdout:7/101: creat db/f28 x:0 0 0 2021-04-09T18:25:40.120 INFO:tasks.workunit.client.0.smithi120.stdout:5/138: mkdir d10/d12/d35 0 2021-04-09T18:25:40.122 INFO:tasks.workunit.client.0.smithi120.stdout:9/124: dread - d19/f1b zero size 2021-04-09T18:25:40.123 INFO:tasks.workunit.client.0.smithi120.stdout:1/78: write d5/f6 [4163732,113864] 0 2021-04-09T18:25:40.124 INFO:tasks.workunit.client.0.smithi120.stdout:7/102: dread f4 [0,4194304] 0 2021-04-09T18:25:40.124 INFO:tasks.workunit.client.0.smithi120.stdout:1/79: chown d5 6228 1 2021-04-09T18:25:40.127 INFO:tasks.workunit.client.0.smithi120.stdout:9/125: chown d19/f22 0 1 2021-04-09T18:25:40.131 INFO:tasks.workunit.client.0.smithi120.stdout:5/139: rename d10/d12/d1b/d1f/l26 to d10/d12/d35/l36 0 2021-04-09T18:25:40.132 INFO:tasks.workunit.client.0.smithi120.stdout:2/141: getdents d13 0 2021-04-09T18:25:40.132 INFO:tasks.workunit.client.0.smithi120.stdout:9/126: symlink d19/l25 0 2021-04-09T18:25:40.133 INFO:tasks.workunit.client.0.smithi120.stdout:9/127: chown f12 29918 1 2021-04-09T18:25:40.134 INFO:tasks.workunit.client.0.smithi120.stdout:2/142: mknod d13/d15/c37 1 2021-04-09T18:25:40.134 INFO:tasks.workunit.client.0.smithi120.stdout:3/181: truncate d3/f29 1001673 0 2021-04-09T18:25:40.135 INFO:tasks.workunit.client.0.smithi120.stdout:9/128: chown f9 28 1 2021-04-09T18:25:40.138 INFO:tasks.workunit.client.0.smithi120.stdout:9/129: read d19/d1c/f1f [3704642,25274] 0 2021-04-09T18:25:40.139 INFO:tasks.workunit.client.0.smithi120.stdout:3/182: fdatasync d3/d5/d36/f11 0 2021-04-09T18:25:40.140 INFO:tasks.workunit.client.0.smithi120.stdout:1/80: dwrite d5/fc [0,4194304] 0 2021-04-09T18:25:40.141 INFO:tasks.workunit.client.0.smithi120.stdout:1/81: read d5/f6 [1709823,34787] 0 2021-04-09T18:25:40.143 INFO:tasks.workunit.client.0.smithi120.stdout:5/140: symlink d10/d12/d1b/d1f/l37 0 2021-04-09T18:25:40.144 INFO:tasks.workunit.client.0.smithi120.stdout:2/143: dread d13/f1c [8388608,4194304] 0 2021-04-09T18:25:40.145 INFO:tasks.workunit.client.0.smithi120.stdout:9/130: rename l8 to d19/l26 0 2021-04-09T18:25:40.149 INFO:tasks.workunit.client.0.smithi120.stdout:2/144: symlink d13/d1b/l38 0 2021-04-09T18:25:40.151 INFO:tasks.workunit.client.0.smithi120.stdout:2/145: dread - d13/d1b/f31 zero size 2021-04-09T18:25:40.152 INFO:tasks.workunit.client.0.smithi120.stdout:5/141: rename l4 to d10/d12/d1b/d1f/d33/l38 0 2021-04-09T18:25:40.152 INFO:tasks.workunit.client.0.smithi120.stdout:2/146: mknod d13/d15/d35/c39 1 2021-04-09T18:25:40.154 INFO:tasks.workunit.client.0.smithi120.stdout:1/82: dwrite d5/f7 [0,4194304] 0 2021-04-09T18:25:40.155 INFO:tasks.workunit.client.0.smithi120.stdout:5/142: write d10/d12/f1a [229783,117158] 0 2021-04-09T18:25:40.156 INFO:tasks.workunit.client.0.smithi120.stdout:5/143: readlink l6 0 2021-04-09T18:25:40.164 INFO:tasks.workunit.client.0.smithi120.stdout:2/147: dwrite d13/f2e [0,4194304] 0 2021-04-09T18:25:40.167 INFO:tasks.workunit.client.0.smithi120.stdout:2/148: write d13/f25 [683584,40931] 0 2021-04-09T18:25:40.169 INFO:tasks.workunit.client.0.smithi120.stdout:2/149: dread - d13/d15/f34 zero size 2021-04-09T18:25:40.171 INFO:tasks.workunit.client.0.smithi120.stdout:2/150: readlink d13/l32 0 2021-04-09T18:25:40.172 INFO:tasks.workunit.client.0.smithi120.stdout:2/151: fdatasync d13/f18 0 2021-04-09T18:25:40.174 INFO:tasks.workunit.client.0.smithi120.stdout:1/83: dread d5/f7 [0,4194304] 0 2021-04-09T18:25:40.177 INFO:tasks.workunit.client.0.smithi120.stdout:3/183: link d3/de/d25/f22 d3/d5/d36/d1e/d38/f44 0 2021-04-09T18:25:40.179 INFO:tasks.workunit.client.0.smithi120.stdout:2/152: dread d13/f1c [0,4194304] 0 2021-04-09T18:25:40.185 INFO:tasks.workunit.client.0.smithi120.stdout:5/144: dwrite d10/d12/f17 [4194304,4194304] 0 2021-04-09T18:25:40.190 INFO:tasks.workunit.client.0.smithi120.stdout:5/145: write d10/d12/f24 [609408,124551] 0 2021-04-09T18:25:40.192 INFO:tasks.workunit.client.0.smithi120.stdout:5/146: chown d10/d12/f2e 265707780 1 2021-04-09T18:25:40.194 INFO:tasks.workunit.client.0.smithi120.stdout:1/84: truncate d5/f6 2326045 0 2021-04-09T18:25:40.195 INFO:tasks.workunit.client.0.smithi120.stdout:5/147: write d10/f16 [281997,102418] 0 2021-04-09T18:25:40.198 INFO:tasks.workunit.client.0.smithi120.stdout:3/184: truncate d3/f6 3272137 0 2021-04-09T18:25:40.199 INFO:tasks.workunit.client.0.smithi120.stdout:5/148: mkdir d10/d12/d1b/d1f/d39 0 2021-04-09T18:25:40.204 INFO:tasks.workunit.client.0.smithi120.stdout:5/149: mkdir d10/d12/d1b/d3a 0 2021-04-09T18:25:40.205 INFO:tasks.workunit.client.0.smithi120.stdout:3/185: creat d3/d5/d36/d1e/f45 x:0 0 0 2021-04-09T18:25:40.207 INFO:tasks.workunit.client.0.smithi120.stdout:1/85: link d5/l13 d5/l14 0 2021-04-09T18:25:40.207 INFO:tasks.workunit.client.0.smithi120.stdout:5/150: write d10/d12/d1b/f20 [4450554,124010] 0 2021-04-09T18:25:40.210 INFO:tasks.workunit.client.0.smithi120.stdout:5/151: mkdir d10/d12/d3b 0 2021-04-09T18:25:40.213 INFO:tasks.workunit.client.0.smithi120.stdout:5/152: readlink d10/d12/d35/l36 0 2021-04-09T18:25:40.214 INFO:tasks.workunit.client.0.smithi120.stdout:1/86: dread d5/fc [0,4194304] 0 2021-04-09T18:25:40.218 INFO:tasks.workunit.client.0.smithi120.stdout:1/87: rmdir d5/df 39 2021-04-09T18:25:40.219 INFO:tasks.workunit.client.0.smithi120.stdout:1/88: chown d5/fc 87492213 1 2021-04-09T18:25:40.222 INFO:tasks.workunit.client.0.smithi120.stdout:1/89: creat d5/df/f15 x:0 0 0 2021-04-09T18:25:40.223 INFO:tasks.workunit.client.0.smithi120.stdout:5/153: truncate d10/d12/f2e 406914 0 2021-04-09T18:25:40.226 INFO:tasks.workunit.client.0.smithi120.stdout:5/154: link d10/d12/d1b/d1f/f2c d10/d12/f3c 0 2021-04-09T18:25:40.228 INFO:tasks.workunit.client.0.smithi120.stdout:1/90: getdents d5 0 2021-04-09T18:25:40.230 INFO:tasks.workunit.client.0.smithi120.stdout:1/91: symlink d5/l16 0 2021-04-09T18:25:40.231 INFO:tasks.workunit.client.0.smithi120.stdout:5/155: dread d10/d12/f27 [0,4194304] 0 2021-04-09T18:25:40.235 INFO:tasks.workunit.client.0.smithi120.stdout:5/156: mkdir d10/d12/d1b/d1f/d33/d3d 0 2021-04-09T18:25:40.238 INFO:tasks.workunit.client.0.smithi120.stdout:1/92: fdatasync d5/f6 0 2021-04-09T18:25:40.240 INFO:tasks.workunit.client.0.smithi120.stdout:5/157: getdents d10/d12/d35 0 2021-04-09T18:25:40.242 INFO:tasks.workunit.client.0.smithi120.stdout:1/93: creat d5/f17 x:0 0 0 2021-04-09T18:25:40.245 INFO:tasks.workunit.client.0.smithi120.stdout:1/94: write d5/f6 [2752068,89446] 0 2021-04-09T18:25:40.247 INFO:tasks.workunit.client.0.smithi120.stdout:6/68: sync 2021-04-09T18:25:40.248 INFO:tasks.workunit.client.0.smithi120.stdout:1/95: rename d5 to d5/df/d18 22 2021-04-09T18:25:40.252 INFO:tasks.workunit.client.0.smithi120.stdout:6/69: dwrite d6/d8/f10 [0,4194304] 0 2021-04-09T18:25:40.259 INFO:tasks.workunit.client.0.smithi120.stdout:5/158: truncate d10/d12/f24 1371340 0 2021-04-09T18:25:40.260 INFO:tasks.workunit.client.0.smithi120.stdout:6/70: creat d6/f19 x:0 0 0 2021-04-09T18:25:40.262 INFO:tasks.workunit.client.0.smithi120.stdout:6/71: unlink d6/fe 0 2021-04-09T18:25:40.269 INFO:tasks.workunit.client.0.smithi120.stdout:6/72: dread d6/d8/fd [4194304,4194304] 0 2021-04-09T18:25:40.271 INFO:tasks.workunit.client.0.smithi120.stdout:6/73: chown d6/d8/db/d12/f18 492983139 1 2021-04-09T18:25:40.275 INFO:tasks.workunit.client.0.smithi120.stdout:6/74: rename d6/d8/db/d17 to d6/d8/d1a 0 2021-04-09T18:25:40.336 INFO:tasks.workunit.client.0.smithi120.stdout:5/159: truncate d10/f2f 70592 0 2021-04-09T18:25:40.339 INFO:tasks.workunit.client.0.smithi120.stdout:5/160: creat d10/d12/d1b/d1f/d33/f3e x:0 0 0 2021-04-09T18:25:40.341 INFO:tasks.workunit.client.0.smithi120.stdout:5/161: write d10/d12/d1b/d1f/f29 [1552830,78899] 0 2021-04-09T18:25:40.345 INFO:tasks.workunit.client.0.smithi120.stdout:6/75: truncate d6/fc 970898 0 2021-04-09T18:25:40.347 INFO:tasks.workunit.client.0.smithi120.stdout:6/76: rmdir d6/d8/db 39 2021-04-09T18:25:40.354 INFO:tasks.workunit.client.0.smithi120.stdout:5/162: truncate d10/d12/d1b/f34 757055 0 2021-04-09T18:25:40.354 INFO:tasks.workunit.client.0.smithi120.stdout:5/163: chown d10/d12/f24 4517615 1 2021-04-09T18:25:40.356 INFO:tasks.workunit.client.0.smithi120.stdout:6/77: link d6/d8/f10 d6/d8/db/f1b 0 2021-04-09T18:25:40.357 INFO:tasks.workunit.client.0.smithi120.stdout:6/78: chown d6/d8 26 1 2021-04-09T18:25:40.361 INFO:tasks.workunit.client.0.smithi120.stdout:6/79: creat d6/d8/db/f1c x:0 0 0 2021-04-09T18:25:40.362 INFO:tasks.workunit.client.0.smithi120.stdout:5/164: creat d10/d12/d1b/d1f/d33/d3d/f3f x:0 0 0 2021-04-09T18:25:40.363 INFO:tasks.workunit.client.0.smithi120.stdout:5/165: stat d10/f16 0 2021-04-09T18:25:40.363 INFO:tasks.workunit.client.0.smithi120.stdout:5/166: chown d10/d12/d35/l36 3868 1 2021-04-09T18:25:40.365 INFO:tasks.workunit.client.0.smithi120.stdout:6/80: mknod d6/d8/c1d 1 2021-04-09T18:25:40.366 INFO:tasks.workunit.client.0.smithi120.stdout:6/81: rename d6 to d6/d1e 22 2021-04-09T18:25:40.369 INFO:tasks.workunit.client.0.smithi120.stdout:6/82: creat d6/d8/db/d12/f1f x:0 0 0 2021-04-09T18:25:40.370 INFO:tasks.workunit.client.0.smithi120.stdout:6/83: stat d6/d8/db/d12/f18 0 2021-04-09T18:25:40.372 INFO:tasks.workunit.client.0.smithi120.stdout:5/167: symlink d10/d12/d1b/d1f/d39/l40 0 2021-04-09T18:25:40.373 INFO:tasks.workunit.client.0.smithi120.stdout:6/84: symlink d6/d8/d1a/l20 0 2021-04-09T18:25:40.378 INFO:tasks.workunit.client.0.smithi120.stdout:6/85: symlink d6/d8/l21 0 2021-04-09T18:25:40.379 INFO:tasks.workunit.client.0.smithi120.stdout:6/86: chown d6/d8/f10 178180798 1 2021-04-09T18:25:40.380 INFO:tasks.workunit.client.0.smithi120.stdout:6/87: dread - d6/d8/db/d12/f18 zero size 2021-04-09T18:25:40.382 INFO:tasks.workunit.client.0.smithi120.stdout:6/88: chown d6/fc 215077265 1 2021-04-09T18:25:40.383 INFO:tasks.workunit.client.0.smithi120.stdout:5/168: link d10/f15 d10/d12/d1b/d1f/d33/d3d/f41 0 2021-04-09T18:25:40.384 INFO:tasks.workunit.client.0.smithi120.stdout:5/169: mknod d10/d12/d1b/d1f/d33/c42 1 2021-04-09T18:25:40.385 INFO:tasks.workunit.client.0.smithi120.stdout:5/170: chown d10/d12/d1b/d1f/d33/f3e 110 1 2021-04-09T18:25:40.388 INFO:tasks.workunit.client.0.smithi120.stdout:5/171: symlink d10/d12/d3b/l43 0 2021-04-09T18:25:40.392 INFO:tasks.workunit.client.0.smithi120.stdout:5/172: dwrite d10/d12/f1a [0,4194304] 0 2021-04-09T18:25:40.398 INFO:tasks.workunit.client.0.smithi120.stdout:6/89: getdents d6/d8 0 2021-04-09T18:25:40.400 INFO:tasks.workunit.client.0.smithi120.stdout:5/173: mkdir d10/d12/d1b/d1f/d33/d44 0 2021-04-09T18:25:40.404 INFO:tasks.workunit.client.0.smithi120.stdout:5/174: write fd [918347,55930] 0 2021-04-09T18:25:40.405 INFO:tasks.workunit.client.0.smithi120.stdout:5/175: mknod d10/d12/d3b/c45 1 2021-04-09T18:25:40.410 INFO:tasks.workunit.client.0.smithi120.stdout:5/176: fdatasync fd 0 2021-04-09T18:25:40.412 INFO:tasks.workunit.client.0.smithi120.stdout:6/90: write d6/d8/f10 [3821256,94929] 0 2021-04-09T18:25:40.413 INFO:tasks.workunit.client.0.smithi120.stdout:6/91: write d6/d8/f13 [427750,11144] 0 2021-04-09T18:25:40.419 INFO:tasks.workunit.client.0.smithi120.stdout:6/92: dread d6/d8/f10 [0,4194304] 0 2021-04-09T18:25:40.423 INFO:tasks.workunit.client.0.smithi120.stdout:5/177: dwrite d10/d12/f3c [0,4194304] 0 2021-04-09T18:25:40.430 INFO:tasks.workunit.client.0.smithi120.stdout:5/178: symlink d10/l46 0 2021-04-09T18:25:40.433 INFO:tasks.workunit.client.0.smithi120.stdout:6/93: truncate d6/d8/db/f1b 4624627 0 2021-04-09T18:25:40.434 INFO:tasks.workunit.client.0.smithi120.stdout:5/179: symlink d10/d12/d35/l47 0 2021-04-09T18:25:40.437 INFO:tasks.workunit.client.0.smithi120.stdout:6/94: mkdir d6/d8/db/d12/d22 0 2021-04-09T18:25:40.440 INFO:tasks.workunit.client.0.smithi120.stdout:1/96: truncate d5/f6 1011819 0 2021-04-09T18:25:40.445 INFO:tasks.workunit.client.0.smithi120.stdout:1/97: write d5/f7 [3109145,33891] 0 2021-04-09T18:25:40.447 INFO:tasks.workunit.client.0.smithi120.stdout:1/98: rename d5 to d5/d19 22 2021-04-09T18:25:40.448 INFO:tasks.workunit.client.0.smithi120.stdout:6/95: truncate d6/d8/db/d12/f1f 367366 0 2021-04-09T18:25:40.449 INFO:tasks.workunit.client.0.smithi120.stdout:5/180: truncate d10/d12/f1a 553347 0 2021-04-09T18:25:40.450 INFO:tasks.workunit.client.0.smithi120.stdout:1/99: symlink d5/df/l1a 0 2021-04-09T18:25:40.451 INFO:tasks.workunit.client.0.smithi120.stdout:1/100: write d5/f7 [3819620,28942] 0 2021-04-09T18:25:40.451 INFO:tasks.workunit.client.0.smithi120.stdout:6/96: write d6/d8/fd [547562,17752] 0 2021-04-09T18:25:40.464 INFO:tasks.workunit.client.0.smithi120.stdout:6/97: write d6/fc [330358,52202] 0 2021-04-09T18:25:40.468 INFO:tasks.workunit.client.0.smithi120.stdout:6/98: rmdir d6/d8/db/d12 39 2021-04-09T18:25:40.469 INFO:tasks.workunit.client.0.smithi120.stdout:5/181: dwrite d10/f2f [0,4194304] 0 2021-04-09T18:25:40.470 INFO:tasks.workunit.client.0.smithi120.stdout:5/182: write fd [1891840,12826] 0 2021-04-09T18:25:40.471 INFO:tasks.workunit.client.0.smithi120.stdout:1/101: truncate d5/f6 91880 0 2021-04-09T18:25:40.472 INFO:tasks.workunit.client.0.smithi120.stdout:6/99: fsync d6/fc 0 2021-04-09T18:25:40.477 INFO:tasks.workunit.client.0.smithi120.stdout:1/102: dwrite d5/f7 [4194304,4194304] 0 2021-04-09T18:25:40.481 INFO:tasks.workunit.client.0.smithi120.stdout:5/183: creat d10/f48 x:0 0 0 2021-04-09T18:25:40.487 INFO:tasks.workunit.client.0.smithi120.stdout:5/184: dread d10/d12/f17 [0,4194304] 0 2021-04-09T18:25:40.699 INFO:tasks.workunit.client.0.smithi120.stdout:4/87: sync 2021-04-09T18:25:40.701 INFO:tasks.workunit.client.0.smithi120.stdout:4/88: write f1a [3307854,128546] 0 2021-04-09T18:25:40.702 INFO:tasks.workunit.client.0.smithi120.stdout:6/100: truncate d6/d8/db/d12/f1f 195919 0 2021-04-09T18:25:40.704 INFO:tasks.workunit.client.0.smithi120.stdout:4/89: chown l13 2783137 1 2021-04-09T18:25:40.710 INFO:tasks.workunit.client.0.smithi120.stdout:4/90: dwrite fd [0,4194304] 0 2021-04-09T18:25:40.712 INFO:tasks.workunit.client.0.smithi120.stdout:1/103: dread d5/f6 [0,4194304] 0 2021-04-09T18:25:40.713 INFO:tasks.workunit.client.0.smithi120.stdout:4/91: write f1b [829975,2745] 0 2021-04-09T18:25:40.717 INFO:tasks.workunit.client.0.smithi120.stdout:6/101: write d6/d8/db/f1b [482960,124740] 0 2021-04-09T18:25:40.722 INFO:tasks.workunit.client.0.smithi120.stdout:6/102: unlink d6/f19 0 2021-04-09T18:25:40.725 INFO:tasks.workunit.client.0.smithi120.stdout:1/104: dwrite d5/fc [0,4194304] 0 2021-04-09T18:25:40.732 INFO:tasks.workunit.client.0.smithi120.stdout:4/92: symlink d1f/l21 0 2021-04-09T18:25:40.733 INFO:tasks.workunit.client.0.smithi120.stdout:6/103: link d6/d8/f13 d6/d8/db/d12/d22/f23 0 2021-04-09T18:25:40.747 INFO:tasks.workunit.client.0.smithi120.stdout:6/104: rmdir d6/d8 39 2021-04-09T18:25:40.748 INFO:tasks.workunit.client.0.smithi120.stdout:1/105: write d5/f6 [99958,84043] 0 2021-04-09T18:25:40.847 INFO:tasks.workunit.client.0.smithi120.stdout:6/105: creat d6/d8/db/f24 x:0 0 0 2021-04-09T18:25:40.848 INFO:tasks.workunit.client.0.smithi120.stdout:6/106: chown d6/d8/db/d12/d22/f23 191406590 1 2021-04-09T18:25:40.852 INFO:tasks.workunit.client.0.smithi120.stdout:4/93: dwrite f19 [4194304,4194304] 0 2021-04-09T18:25:40.856 INFO:tasks.workunit.client.0.smithi120.stdout:6/107: dwrite d6/fc [0,4194304] 0 2021-04-09T18:25:40.856 INFO:tasks.workunit.client.0.smithi120.stdout:4/94: write f7 [524247,59495] 0 2021-04-09T18:25:40.857 INFO:tasks.workunit.client.0.smithi120.stdout:6/108: write d6/d8/db/f1c [562660,106882] 0 2021-04-09T18:25:40.863 INFO:tasks.workunit.client.0.smithi120.stdout:6/109: creat d6/d8/f25 x:0 0 0 2021-04-09T18:25:40.868 INFO:tasks.workunit.client.0.smithi120.stdout:4/95: dread f12 [0,4194304] 0 2021-04-09T18:25:40.869 INFO:tasks.workunit.client.0.smithi120.stdout:4/96: write f1a [5103572,93919] 0 2021-04-09T18:25:40.870 INFO:tasks.workunit.client.0.smithi120.stdout:7/103: sync 2021-04-09T18:25:40.871 INFO:tasks.workunit.client.0.smithi120.stdout:2/153: sync 2021-04-09T18:25:40.871 INFO:tasks.workunit.client.0.smithi120.stdout:8/132: sync 2021-04-09T18:25:40.872 INFO:tasks.workunit.client.0.smithi120.stdout:3/186: sync 2021-04-09T18:25:40.873 INFO:tasks.workunit.client.0.smithi120.stdout:9/131: sync 2021-04-09T18:25:40.874 INFO:tasks.workunit.client.0.smithi120.stdout:9/132: stat d19/d1c/f1f 0 2021-04-09T18:25:40.876 INFO:tasks.workunit.client.0.smithi120.stdout:0/118: sync 2021-04-09T18:25:40.877 INFO:tasks.workunit.client.0.smithi120.stdout:3/187: rmdir d3/d5/d36/d1e/d30 39 2021-04-09T18:25:40.878 INFO:tasks.workunit.client.0.smithi120.stdout:7/104: write db/f25 [753980,7158] 0 2021-04-09T18:25:40.879 INFO:tasks.workunit.client.0.smithi120.stdout:2/154: dread d13/d1b/f2b [0,4194304] 0 2021-04-09T18:25:40.880 INFO:tasks.workunit.client.0.smithi120.stdout:7/105: readlink db/l24 0 2021-04-09T18:25:40.880 INFO:tasks.workunit.client.0.smithi120.stdout:8/133: creat d2/d3/d11/d2a/f2b x:0 0 0 2021-04-09T18:25:40.881 INFO:tasks.workunit.client.0.smithi120.stdout:3/188: chown d3/d5/f2c 143588952 1 2021-04-09T18:25:40.882 INFO:tasks.workunit.client.0.smithi120.stdout:3/189: mknod d3/de/c46 1 2021-04-09T18:25:40.884 INFO:tasks.workunit.client.0.smithi120.stdout:3/190: dread - d3/d5/d36/f23 zero size 2021-04-09T18:25:40.885 INFO:tasks.workunit.client.0.smithi120.stdout:8/134: mkdir d2/d3/d11/d2c 0 2021-04-09T18:25:40.888 INFO:tasks.workunit.client.0.smithi120.stdout:3/191: read - d3/de/d25/d2f/f3f zero size 2021-04-09T18:25:40.888 INFO:tasks.workunit.client.0.smithi120.stdout:0/119: unlink d0/d2/d4/f5 0 2021-04-09T18:25:40.889 INFO:tasks.workunit.client.0.smithi120.stdout:9/133: truncate f9 4308845 0 2021-04-09T18:25:40.891 INFO:tasks.workunit.client.0.smithi120.stdout:9/134: stat f18 0 2021-04-09T18:25:40.891 INFO:tasks.workunit.client.0.smithi120.stdout:8/135: rename d2/d3/f1e to d2/f2d 0 2021-04-09T18:25:40.894 INFO:tasks.workunit.client.0.smithi120.stdout:4/97: dwrite f12 [0,4194304] 0 2021-04-09T18:25:40.896 INFO:tasks.workunit.client.0.smithi120.stdout:9/135: write f7 [2263052,109803] 0 2021-04-09T18:25:40.896 INFO:tasks.workunit.client.0.smithi120.stdout:4/98: readlink l14 0 2021-04-09T18:25:40.897 INFO:tasks.workunit.client.0.smithi120.stdout:4/99: write f10 [881314,52375] 0 2021-04-09T18:25:40.898 INFO:tasks.workunit.client.0.smithi120.stdout:2/155: dwrite d13/f18 [4194304,4194304] 0 2021-04-09T18:25:40.898 INFO:tasks.workunit.client.0.smithi120.stdout:0/120: symlink d0/d2/d4/l21 0 2021-04-09T18:25:40.900 INFO:tasks.workunit.client.0.smithi120.stdout:9/136: dread fb [0,4194304] 0 2021-04-09T18:25:40.902 INFO:tasks.workunit.client.0.smithi120.stdout:4/100: write f19 [5713874,122757] 0 2021-04-09T18:25:40.907 INFO:tasks.workunit.client.0.smithi120.stdout:0/121: creat d0/d2/dd/f22 x:0 0 0 2021-04-09T18:25:40.908 INFO:tasks.workunit.client.0.smithi120.stdout:2/156: rename l8 to d13/d15/l3a 0 2021-04-09T18:25:40.910 INFO:tasks.workunit.client.0.smithi120.stdout:7/106: rename db/f1f to db/f29 0 2021-04-09T18:25:40.911 INFO:tasks.workunit.client.0.smithi120.stdout:0/122: chown d0/d2/d4/f13 42893572 1 2021-04-09T18:25:40.912 INFO:tasks.workunit.client.0.smithi120.stdout:7/107: write f2 [4096038,109500] 0 2021-04-09T18:25:40.912 INFO:tasks.workunit.client.0.smithi120.stdout:2/157: read d13/f25 [191795,18893] 0 2021-04-09T18:25:40.913 INFO:tasks.workunit.client.0.smithi120.stdout:9/137: creat d19/d1c/f27 x:0 0 0 2021-04-09T18:25:40.914 INFO:tasks.workunit.client.0.smithi120.stdout:4/101: symlink d1f/l22 0 2021-04-09T18:25:40.917 INFO:tasks.workunit.client.0.smithi120.stdout:9/138: write d19/f22 [227635,81849] 0 2021-04-09T18:25:40.919 INFO:tasks.workunit.client.0.smithi120.stdout:2/158: dread f4 [4194304,4194304] 0 2021-04-09T18:25:40.921 INFO:tasks.workunit.client.0.smithi120.stdout:2/159: write d13/f2c [973030,87733] 0 2021-04-09T18:25:40.922 INFO:tasks.workunit.client.0.smithi120.stdout:2/160: chown d13/d15/f34 6069088 1 2021-04-09T18:25:40.926 INFO:tasks.workunit.client.0.smithi120.stdout:5/185: sync 2021-04-09T18:25:40.928 INFO:tasks.workunit.client.0.smithi120.stdout:4/102: creat d1f/f23 x:0 0 0 2021-04-09T18:25:40.928 INFO:tasks.workunit.client.0.smithi120.stdout:9/139: rmdir d19 39 2021-04-09T18:25:40.929 INFO:tasks.workunit.client.0.smithi120.stdout:2/161: symlink d13/d1b/l3b 0 2021-04-09T18:25:40.930 INFO:tasks.workunit.client.0.smithi120.stdout:2/162: dread - d13/d15/f34 zero size 2021-04-09T18:25:40.931 INFO:tasks.workunit.client.0.smithi120.stdout:0/123: mkdir d0/d2/da/d23 0 2021-04-09T18:25:40.932 INFO:tasks.workunit.client.0.smithi120.stdout:6/110: creat d6/d8/f26 x:0 0 0 2021-04-09T18:25:40.933 INFO:tasks.workunit.client.0.smithi120.stdout:4/103: mkdir d1f/d24 0 2021-04-09T18:25:40.934 INFO:tasks.workunit.client.0.smithi120.stdout:5/186: chown d10/d12/d1b/d1f/d33/d44 6960881 1 2021-04-09T18:25:40.934 INFO:tasks.workunit.client.0.smithi120.stdout:0/124: rename d0/d2/d4 to d0/d2/d4/d24 22 2021-04-09T18:25:40.935 INFO:tasks.workunit.client.0.smithi120.stdout:3/192: truncate d3/d5/d36/d1e/d30/f41 1252237 0 2021-04-09T18:25:40.935 INFO:tasks.workunit.client.0.smithi120.stdout:8/136: chown d2/d3/f1a 76 1 2021-04-09T18:25:40.939 INFO:tasks.workunit.client.0.smithi120.stdout:0/125: write d0/f20 [475767,9375] 0 2021-04-09T18:25:40.940 INFO:tasks.workunit.client.0.smithi120.stdout:2/163: unlink d13/d15/f30 0 2021-04-09T18:25:40.942 INFO:tasks.workunit.client.0.smithi120.stdout:2/164: mknod d13/d1b/c3c 1 2021-04-09T18:25:40.942 INFO:tasks.workunit.client.0.smithi120.stdout:6/111: write d6/d8/db/f24 [679370,90036] 0 2021-04-09T18:25:40.943 INFO:tasks.workunit.client.0.smithi120.stdout:9/140: rename f13 to d19/d24/f28 0 2021-04-09T18:25:40.945 INFO:tasks.workunit.client.0.smithi120.stdout:3/193: read d3/f42 [16281,36232] 0 2021-04-09T18:25:40.946 INFO:tasks.workunit.client.0.smithi120.stdout:9/141: write d19/f1d [141421,77273] 0 2021-04-09T18:25:40.947 INFO:tasks.workunit.client.0.smithi120.stdout:0/126: read d0/f20 [213917,12240] 0 2021-04-09T18:25:40.950 INFO:tasks.workunit.client.0.smithi120.stdout:8/137: mkdir d2/d3/d11/d2c/d2e 0 2021-04-09T18:25:40.951 INFO:tasks.workunit.client.0.smithi120.stdout:5/187: dwrite d10/d12/d1b/d1f/f29 [4194304,4194304] 0 2021-04-09T18:25:40.953 INFO:tasks.workunit.client.0.smithi120.stdout:6/112: dread - d6/d8/db/d12/f18 zero size 2021-04-09T18:25:40.953 INFO:tasks.workunit.client.0.smithi120.stdout:5/188: stat d10/d12/d35 0 2021-04-09T18:25:40.953 INFO:tasks.workunit.client.0.smithi120.stdout:9/142: mkdir d19/d1c/d29 0 2021-04-09T18:25:40.955 INFO:tasks.workunit.client.0.smithi120.stdout:3/194: symlink d3/d5/d36/d1e/d38/l47 0 2021-04-09T18:25:40.955 INFO:tasks.workunit.client.0.smithi120.stdout:7/108: truncate db/f1a 900463 0 2021-04-09T18:25:40.957 INFO:tasks.workunit.client.0.smithi120.stdout:3/195: write d3/d5/f2c [1593152,114128] 0 2021-04-09T18:25:40.958 INFO:tasks.workunit.client.0.smithi120.stdout:9/143: symlink d19/l2a 0 2021-04-09T18:25:40.958 INFO:tasks.workunit.client.0.smithi120.stdout:0/127: symlink d0/d2/d4/l25 0 2021-04-09T18:25:40.959 INFO:tasks.workunit.client.0.smithi120.stdout:3/196: mknod d3/d5/c48 1 2021-04-09T18:25:40.962 INFO:tasks.workunit.client.0.smithi120.stdout:3/197: dread d3/f42 [0,4194304] 0 2021-04-09T18:25:40.964 INFO:tasks.workunit.client.0.smithi120.stdout:6/113: creat d6/d8/db/d12/d22/f27 x:0 0 0 2021-04-09T18:25:40.965 INFO:tasks.workunit.client.0.smithi120.stdout:8/138: dwrite d2/d3/f1a [0,4194304] 0 2021-04-09T18:25:40.970 INFO:tasks.workunit.client.0.smithi120.stdout:7/109: symlink db/l2a 0 2021-04-09T18:25:40.973 INFO:tasks.workunit.client.0.smithi120.stdout:7/110: write f2 [3226673,124016] 0 2021-04-09T18:25:40.974 INFO:tasks.workunit.client.0.smithi120.stdout:8/139: chown d2/d3/d11/f1f 177 1 2021-04-09T18:25:40.975 INFO:tasks.workunit.client.0.smithi120.stdout:3/198: dwrite d3/f8 [0,4194304] 0 2021-04-09T18:25:40.981 INFO:tasks.workunit.client.0.smithi120.stdout:7/111: dread f4 [0,4194304] 0 2021-04-09T18:25:40.988 INFO:tasks.workunit.client.0.smithi120.stdout:0/128: dwrite d0/f20 [0,4194304] 0 2021-04-09T18:25:40.989 INFO:tasks.workunit.client.0.smithi120.stdout:7/112: readlink l9 0 2021-04-09T18:25:40.994 INFO:tasks.workunit.client.0.smithi120.stdout:6/114: creat d6/d8/db/d12/f28 x:0 0 0 2021-04-09T18:25:40.994 INFO:tasks.workunit.client.0.smithi120.stdout:0/129: chown d0/d2/da/f19 87061 1 2021-04-09T18:25:40.994 INFO:tasks.workunit.client.0.smithi120.stdout:3/199: mkdir d3/de/d25/d2f/d49 0 2021-04-09T18:25:40.995 INFO:tasks.workunit.client.0.smithi120.stdout:2/165: truncate d13/f2e 511980 0 2021-04-09T18:25:41.003 INFO:tasks.workunit.client.0.smithi120.stdout:2/166: dread - d13/f19 zero size 2021-04-09T18:25:41.006 INFO:tasks.workunit.client.0.smithi120.stdout:6/115: dwrite d6/d8/db/f1b [0,4194304] 0 2021-04-09T18:25:41.008 INFO:tasks.workunit.client.0.smithi120.stdout:6/116: dread - d6/d8/f25 zero size 2021-04-09T18:25:41.009 INFO:tasks.workunit.client.0.smithi120.stdout:8/140: dwrite d2/d3/d8/f1d [0,4194304] 0 2021-04-09T18:25:41.009 INFO:tasks.workunit.client.0.smithi120.stdout:0/130: creat d0/d2/f26 x:0 0 0 2021-04-09T18:25:41.012 INFO:tasks.workunit.client.0.smithi120.stdout:3/200: creat d3/de/d25/d2f/d49/f4a x:0 0 0 2021-04-09T18:25:41.013 INFO:tasks.workunit.client.0.smithi120.stdout:8/141: chown d2/d3/d11/d2c 851930449 1 2021-04-09T18:25:41.013 INFO:tasks.workunit.client.0.smithi120.stdout:2/167: dread - d13/d15/f34 zero size 2021-04-09T18:25:41.013 INFO:tasks.workunit.client.0.smithi120.stdout:5/189: write d10/d12/f1a [1102392,98178] 0 2021-04-09T18:25:41.014 INFO:tasks.workunit.client.0.smithi120.stdout:6/117: read - d6/d8/db/d12/f28 zero size 2021-04-09T18:25:41.014 INFO:tasks.workunit.client.0.smithi120.stdout:7/113: write db/f22 [205411,873] 0 2021-04-09T18:25:41.021 INFO:tasks.workunit.client.0.smithi120.stdout:7/114: write f2 [3515415,81672] 0 2021-04-09T18:25:41.022 INFO:tasks.workunit.client.0.smithi120.stdout:2/168: dread d13/d15/f24 [0,4194304] 0 2021-04-09T18:25:41.032 INFO:tasks.workunit.client.0.smithi120.stdout:2/169: mknod d13/d15/d35/c3d 1 2021-04-09T18:25:41.034 INFO:tasks.workunit.client.0.smithi120.stdout:3/201: fsync d3/f42 0 2021-04-09T18:25:41.036 INFO:tasks.workunit.client.0.smithi120.stdout:6/118: dread d6/d8/db/d12/f1f [0,4194304] 0 2021-04-09T18:25:41.043 INFO:tasks.workunit.client.0.smithi120.stdout:9/144: dwrite f14 [0,4194304] 0 2021-04-09T18:25:41.046 INFO:tasks.workunit.client.0.smithi120.stdout:5/190: creat d10/d12/d1b/d1f/d33/d44/f49 x:0 0 0 2021-04-09T18:25:41.053 INFO:tasks.workunit.client.0.smithi120.stdout:0/131: truncate d0/fc 539390 0 2021-04-09T18:25:41.054 INFO:tasks.workunit.client.0.smithi120.stdout:9/145: write d19/d1c/f27 [892570,93707] 0 2021-04-09T18:25:41.065 INFO:tasks.workunit.client.0.smithi120.stdout:0/132: fdatasync d0/d2/da/f19 0 2021-04-09T18:25:41.065 INFO:tasks.workunit.client.0.smithi120.stdout:0/133: stat d0 0 2021-04-09T18:25:41.073 INFO:tasks.workunit.client.0.smithi120.stdout:8/142: dread d2/f2d [0,4194304] 0 2021-04-09T18:25:41.073 INFO:tasks.workunit.client.0.smithi120.stdout:9/146: creat d19/d1c/d29/f2b x:0 0 0 2021-04-09T18:25:41.075 INFO:tasks.workunit.client.0.smithi120.stdout:1/106: sync 2021-04-09T18:25:41.078 INFO:tasks.workunit.client.0.smithi120.stdout:3/202: dread d3/d5/d36/d1e/f39 [0,4194304] 0 2021-04-09T18:25:41.079 INFO:tasks.workunit.client.0.smithi120.stdout:9/147: mkdir d19/d2c 0 2021-04-09T18:25:41.080 INFO:tasks.workunit.client.0.smithi120.stdout:2/170: dwrite d13/f14 [0,4194304] 0 2021-04-09T18:25:41.082 INFO:tasks.workunit.client.0.smithi120.stdout:8/143: rmdir d2/d3 39 2021-04-09T18:25:41.085 INFO:tasks.workunit.client.0.smithi120.stdout:5/191: getdents d10/d12/d1b/d1f/d33/d44 0 2021-04-09T18:25:41.086 INFO:tasks.workunit.client.0.smithi120.stdout:2/171: read d13/d1b/f2b [39709,24769] 0 2021-04-09T18:25:41.088 INFO:tasks.workunit.client.0.smithi120.stdout:7/115: truncate db/f22 36488 0 2021-04-09T18:25:41.093 INFO:tasks.workunit.client.0.smithi120.stdout:9/148: dread f7 [0,4194304] 0 2021-04-09T18:25:41.095 INFO:tasks.workunit.client.0.smithi120.stdout:8/144: rmdir d2/d3/d11 39 2021-04-09T18:25:41.097 INFO:tasks.workunit.client.0.smithi120.stdout:9/149: write d19/d1c/f20 [615719,2407] 0 2021-04-09T18:25:41.098 INFO:tasks.workunit.client.0.smithi120.stdout:3/203: dwrite d3/f8 [0,4194304] 0 2021-04-09T18:25:41.098 INFO:tasks.workunit.client.0.smithi120.stdout:2/172: creat d13/d15/d35/f3e x:0 0 0 2021-04-09T18:25:41.101 INFO:tasks.workunit.client.0.smithi120.stdout:1/107: link d5/df/l10 d5/l1b 0 2021-04-09T18:25:41.101 INFO:tasks.workunit.client.0.smithi120.stdout:5/192: dwrite d10/d12/f3c [0,4194304] 0 2021-04-09T18:25:41.102 INFO:tasks.workunit.client.0.smithi120.stdout:1/108: chown d5/df/l1a 283352577 1 2021-04-09T18:25:41.103 INFO:tasks.workunit.client.0.smithi120.stdout:6/119: dread d6/d8/db/f24 [0,4194304] 0 2021-04-09T18:25:41.105 INFO:tasks.workunit.client.0.smithi120.stdout:1/109: readlink d5/l16 0 2021-04-09T18:25:41.115 INFO:tasks.workunit.client.0.smithi120.stdout:0/134: dwrite d0/fc [0,4194304] 0 2021-04-09T18:25:41.115 INFO:tasks.workunit.client.0.smithi120.stdout:6/120: readlink d6/d8/d1a/l20 0 2021-04-09T18:25:41.115 INFO:tasks.workunit.client.0.smithi120.stdout:0/135: read d0/fc [3680118,109237] 0 2021-04-09T18:25:41.116 INFO:tasks.workunit.client.0.smithi120.stdout:6/121: dread d6/d8/db/d12/f1f [0,4194304] 0 2021-04-09T18:25:41.118 INFO:tasks.workunit.client.0.smithi120.stdout:8/145: dwrite d2/f2d [0,4194304] 0 2021-04-09T18:25:41.124 INFO:tasks.workunit.client.0.smithi120.stdout:6/122: mkdir d6/d8/db/d12/d29 0 2021-04-09T18:25:41.125 INFO:tasks.workunit.client.0.smithi120.stdout:8/146: dread d2/d3/f23 [0,4194304] 0 2021-04-09T18:25:41.126 INFO:tasks.workunit.client.0.smithi120.stdout:6/123: dread - d6/d8/f26 zero size 2021-04-09T18:25:41.130 INFO:tasks.workunit.client.0.smithi120.stdout:6/124: dread - d6/d8/f26 zero size 2021-04-09T18:25:41.130 INFO:tasks.workunit.client.0.smithi120.stdout:9/150: getdents d19/d1c 0 2021-04-09T18:25:41.133 INFO:tasks.workunit.client.0.smithi120.stdout:0/136: creat d0/d2/f27 x:0 0 0 2021-04-09T18:25:41.137 INFO:tasks.workunit.client.0.smithi120.stdout:6/125: readlink d6/d8/l11 0 2021-04-09T18:25:41.141 INFO:tasks.workunit.client.0.smithi120.stdout:8/147: creat d2/d27/f2f x:0 0 0 2021-04-09T18:25:41.141 INFO:tasks.workunit.client.0.smithi120.stdout:0/137: unlink d0/d2/dd/f22 0 2021-04-09T18:25:41.142 INFO:tasks.workunit.client.0.smithi120.stdout:8/148: chown d2/d3/d8/l22 457303 1 2021-04-09T18:25:41.142 INFO:tasks.workunit.client.0.smithi120.stdout:8/149: read - d2/d3/d8/f20 zero size 2021-04-09T18:25:41.144 INFO:tasks.workunit.client.0.smithi120.stdout:3/204: write d3/d5/d36/d1e/d30/f41 [1593067,113708] 0 2021-04-09T18:25:41.144 INFO:tasks.workunit.client.0.smithi120.stdout:2/173: getdents d13/d15/d35 0 2021-04-09T18:25:41.150 INFO:tasks.workunit.client.0.smithi120.stdout:5/193: write d10/d12/d1b/f34 [40537,33157] 0 2021-04-09T18:25:41.151 INFO:tasks.workunit.client.0.smithi120.stdout:5/194: mknod d10/d12/d35/c4a 1 2021-04-09T18:25:41.154 INFO:tasks.workunit.client.0.smithi120.stdout:9/151: rename l11 to d19/l2d 0 2021-04-09T18:25:41.155 INFO:tasks.workunit.client.0.smithi120.stdout:6/126: creat d6/d8/db/d12/d22/f2a x:0 0 0 2021-04-09T18:25:41.157 INFO:tasks.workunit.client.0.smithi120.stdout:7/116: dwrite db/f15 [0,4194304] 0 2021-04-09T18:25:41.157 INFO:tasks.workunit.client.0.smithi120.stdout:3/205: rmdir d3/d5/d36/d1e 39 2021-04-09T18:25:41.165 INFO:tasks.workunit.client.0.smithi120.stdout:2/174: rmdir d13/d15/d35 39 2021-04-09T18:25:41.166 INFO:tasks.workunit.client.0.smithi120.stdout:9/152: mkdir d19/d24/d2e 0 2021-04-09T18:25:41.170 INFO:tasks.workunit.client.0.smithi120.stdout:0/138: symlink d0/l28 0 2021-04-09T18:25:41.178 INFO:tasks.workunit.client.0.smithi120.stdout:3/206: dwrite d3/d5/d36/d1e/f45 [0,4194304] 0 2021-04-09T18:25:41.180 INFO:tasks.workunit.client.0.smithi120.stdout:2/175: unlink l10 0 2021-04-09T18:25:41.180 INFO:tasks.workunit.client.0.smithi120.stdout:9/153: dread d19/d1c/f1f [0,4194304] 0 2021-04-09T18:25:41.182 INFO:tasks.workunit.client.0.smithi120.stdout:5/195: getdents d10/d12/d1b 0 2021-04-09T18:25:41.185 INFO:tasks.workunit.client.0.smithi120.stdout:7/117: rename db/f22 to db/f2b 0 2021-04-09T18:25:41.187 INFO:tasks.workunit.client.0.smithi120.stdout:5/196: write d10/d12/d1b/d1f/d33/d3d/f3f [942758,128789] 0 2021-04-09T18:25:41.188 INFO:tasks.workunit.client.0.smithi120.stdout:3/207: dread d3/f8 [0,4194304] 0 2021-04-09T18:25:41.188 INFO:tasks.workunit.client.0.smithi120.stdout:2/176: creat d13/d1b/f3f x:0 0 0 2021-04-09T18:25:41.188 INFO:tasks.workunit.client.0.smithi120.stdout:5/197: mknod d10/d12/d35/c4b 1 2021-04-09T18:25:41.194 INFO:tasks.workunit.client.0.smithi120.stdout:6/127: truncate d6/d8/db/d12/d22/f27 836125 0 2021-04-09T18:25:41.195 INFO:tasks.workunit.client.0.smithi120.stdout:5/198: write d10/f11 [2177120,13066] 0 2021-04-09T18:25:41.197 INFO:tasks.workunit.client.0.smithi120.stdout:3/208: dwrite d3/de/d25/f15 [4194304,4194304] 0 2021-04-09T18:25:41.198 INFO:tasks.workunit.client.0.smithi120.stdout:7/118: mkdir db/d2c 0 2021-04-09T18:25:41.201 INFO:tasks.workunit.client.0.smithi120.stdout:7/119: chown db/d26 0 1 2021-04-09T18:25:41.201 INFO:tasks.workunit.client.0.smithi120.stdout:3/209: write d3/d5/d36/d1e/d30/f41 [2055902,47695] 0 2021-04-09T18:25:41.203 INFO:tasks.workunit.client.0.smithi120.stdout:3/210: read - d3/f37 zero size 2021-04-09T18:25:41.204 INFO:tasks.workunit.client.0.smithi120.stdout:0/139: truncate d0/d2/f26 506407 0 2021-04-09T18:25:41.211 INFO:tasks.workunit.client.0.smithi120.stdout:5/199: rmdir d10/d12/d1b/d1f/d33/d3d 39 2021-04-09T18:25:41.216 INFO:tasks.workunit.client.0.smithi120.stdout:0/140: creat d0/d2/d4/f29 x:0 0 0 2021-04-09T18:25:41.216 INFO:tasks.workunit.client.0.smithi120.stdout:3/211: rmdir d3/d5/d36/d1e 39 2021-04-09T18:25:41.217 INFO:tasks.workunit.client.0.smithi120.stdout:8/150: dread d2/d3/f12 [0,4194304] 0 2021-04-09T18:25:41.218 INFO:tasks.workunit.client.0.smithi120.stdout:5/200: creat d10/d12/d1b/d1f/f4c x:0 0 0 2021-04-09T18:25:41.220 INFO:tasks.workunit.client.0.smithi120.stdout:2/177: dwrite d13/d15/f2a [4194304,4194304] 0 2021-04-09T18:25:41.224 INFO:tasks.workunit.client.0.smithi120.stdout:3/212: rename d3/de/l1a to d3/de/l4b 0 2021-04-09T18:25:41.231 INFO:tasks.workunit.client.0.smithi120.stdout:8/151: dwrite d2/f2d [0,4194304] 0 2021-04-09T18:25:41.233 INFO:tasks.workunit.client.0.smithi120.stdout:3/213: write d3/de/f1b [1053506,91149] 0 2021-04-09T18:25:41.234 INFO:tasks.workunit.client.0.smithi120.stdout:0/141: link d0/d2/d4/f29 d0/d2/da/f2a 0 2021-04-09T18:25:41.240 INFO:tasks.workunit.client.0.smithi120.stdout:2/178: creat d13/d15/f40 x:0 0 0 2021-04-09T18:25:41.241 INFO:tasks.workunit.client.0.smithi120.stdout:2/179: dread - d13/d15/f40 zero size 2021-04-09T18:25:41.248 INFO:tasks.workunit.client.0.smithi120.stdout:0/142: rename d0/d2/da/f2a to d0/d2/dd/f2b 0 2021-04-09T18:25:41.251 INFO:tasks.workunit.client.0.smithi120.stdout:2/180: symlink d13/d15/l41 0 2021-04-09T18:25:41.252 INFO:tasks.workunit.client.0.smithi120.stdout:2/181: stat d13/d1b 0 2021-04-09T18:25:41.253 INFO:tasks.workunit.client.0.smithi120.stdout:5/201: dread d10/d12/d1b/f34 [0,4194304] 0 2021-04-09T18:25:41.254 INFO:tasks.workunit.client.0.smithi120.stdout:3/214: dwrite d3/d5/d36/d1e/f39 [0,4194304] 0 2021-04-09T18:25:41.259 INFO:tasks.workunit.client.0.smithi120.stdout:5/202: creat d10/d12/d1b/d1f/f4d x:0 0 0 2021-04-09T18:25:41.259 INFO:tasks.workunit.client.0.smithi120.stdout:0/143: creat d0/d2/da/f2c x:0 0 0 2021-04-09T18:25:41.260 INFO:tasks.workunit.client.0.smithi120.stdout:3/215: fsync d3/d5/f31 0 2021-04-09T18:25:41.264 INFO:tasks.workunit.client.0.smithi120.stdout:3/216: chown d3/de/d25/d2f/d49 22748 1 2021-04-09T18:25:41.272 INFO:tasks.workunit.client.0.smithi120.stdout:9/154: write f9 [4439207,23274] 0 2021-04-09T18:25:41.273 INFO:tasks.workunit.client.0.smithi120.stdout:5/203: creat d10/d12/d1b/d1f/f4e x:0 0 0 2021-04-09T18:25:41.274 INFO:tasks.workunit.client.0.smithi120.stdout:5/204: mknod d10/d12/d3b/c4f 1 2021-04-09T18:25:41.275 INFO:tasks.workunit.client.0.smithi120.stdout:9/155: symlink d19/d24/l2f 0 2021-04-09T18:25:41.277 INFO:tasks.workunit.client.0.smithi120.stdout:7/120: dread db/f2b [0,4194304] 0 2021-04-09T18:25:41.280 INFO:tasks.workunit.client.0.smithi120.stdout:2/182: truncate d13/d15/f34 286630 0 2021-04-09T18:25:41.288 INFO:tasks.workunit.client.0.smithi120.stdout:5/205: fdatasync d10/d12/f2e 0 2021-04-09T18:25:41.291 INFO:tasks.workunit.client.0.smithi120.stdout:9/156: creat d19/d2c/f30 x:0 0 0 2021-04-09T18:25:41.293 INFO:tasks.workunit.client.0.smithi120.stdout:9/157: rename d19 to d19/d24/d31 22 2021-04-09T18:25:41.294 INFO:tasks.workunit.client.0.smithi120.stdout:8/152: read d2/d3/d8/f15 [1322500,81952] 0 2021-04-09T18:25:41.295 INFO:tasks.workunit.client.0.smithi120.stdout:8/153: mknod d2/d3/d8/c30 1 2021-04-09T18:25:41.296 INFO:tasks.workunit.client.0.smithi120.stdout:7/121: write db/f2b [76371,27241] 0 2021-04-09T18:25:41.298 INFO:tasks.workunit.client.0.smithi120.stdout:0/144: truncate d0/d2/d4/f13 806603 0 2021-04-09T18:25:41.300 INFO:tasks.workunit.client.0.smithi120.stdout:8/154: unlink d2/d3/d8/l1b 0 2021-04-09T18:25:41.305 INFO:tasks.workunit.client.0.smithi120.stdout:3/217: dwrite d3/f29 [0,4194304] 0 2021-04-09T18:25:41.307 INFO:tasks.workunit.client.0.smithi120.stdout:5/206: mkdir d10/d12/d1b/d1f/d33/d3d/d50 0 2021-04-09T18:25:41.308 INFO:tasks.workunit.client.0.smithi120.stdout:7/122: creat db/d26/f2d x:0 0 0 2021-04-09T18:25:41.309 INFO:tasks.workunit.client.0.smithi120.stdout:3/218: rmdir d3/de/d25/d2f 39 2021-04-09T18:25:41.313 INFO:tasks.workunit.client.0.smithi120.stdout:5/207: readlink d10/d12/d1b/d1f/d39/l40 0 2021-04-09T18:25:41.316 INFO:tasks.workunit.client.0.smithi120.stdout:2/183: creat d13/d15/f42 x:0 0 0 2021-04-09T18:25:41.317 INFO:tasks.workunit.client.0.smithi120.stdout:7/123: rename db/f28 to db/d26/f2e 0 2021-04-09T18:25:41.318 INFO:tasks.workunit.client.0.smithi120.stdout:3/219: dwrite d3/d5/f2c [4194304,4194304] 0 2021-04-09T18:25:41.321 INFO:tasks.workunit.client.0.smithi120.stdout:8/155: creat d2/d3/d11/d2c/f31 x:0 0 0 2021-04-09T18:25:41.331 INFO:tasks.workunit.client.0.smithi120.stdout:5/208: creat d10/f51 x:0 0 0 2021-04-09T18:25:41.332 INFO:tasks.workunit.client.0.smithi120.stdout:3/220: write f1 [4397167,110162] 0 2021-04-09T18:25:41.332 INFO:tasks.workunit.client.0.smithi120.stdout:0/145: write d0/d2/d4/f29 [540807,38518] 0 2021-04-09T18:25:41.332 INFO:tasks.workunit.client.0.smithi120.stdout:8/156: creat d2/d3/d11/d2c/f32 x:0 0 0 2021-04-09T18:25:41.341 INFO:tasks.workunit.client.0.smithi120.stdout:5/209: rename d10/d12/d1b/f20 to d10/d12/d1b/d1f/d33/d3d/f52 0 2021-04-09T18:25:41.341 INFO:tasks.workunit.client.0.smithi120.stdout:5/210: mknod d10/d12/d35/c53 1 2021-04-09T18:25:41.341 INFO:tasks.workunit.client.0.smithi120.stdout:3/221: rmdir d3/d5/d36/d1e/d30 39 2021-04-09T18:25:41.342 INFO:tasks.workunit.client.0.smithi120.stdout:9/158: truncate d19/d1c/f23 170290 0 2021-04-09T18:25:41.342 INFO:tasks.workunit.client.0.smithi120.stdout:8/157: dwrite d2/d3/d11/d2a/f2b [0,4194304] 0 2021-04-09T18:25:41.344 INFO:tasks.workunit.client.0.smithi120.stdout:8/158: write d2/d3/d11/d2c/f31 [801220,16758] 0 2021-04-09T18:25:41.347 INFO:tasks.workunit.client.0.smithi120.stdout:5/211: creat d10/d12/d1b/d1f/d33/d44/f54 x:0 0 0 2021-04-09T18:25:41.347 INFO:tasks.workunit.client.0.smithi120.stdout:9/159: creat d19/f32 x:0 0 0 2021-04-09T18:25:41.348 INFO:tasks.workunit.client.0.smithi120.stdout:5/212: readlink d10/l13 0 2021-04-09T18:25:41.350 INFO:tasks.workunit.client.0.smithi120.stdout:3/222: dread d3/d5/d36/f11 [0,4194304] 0 2021-04-09T18:25:41.353 INFO:tasks.workunit.client.0.smithi120.stdout:9/160: unlink d19/f22 0 2021-04-09T18:25:41.358 INFO:tasks.workunit.client.0.smithi120.stdout:5/213: mknod d10/d12/d1b/d1f/d33/c55 1 2021-04-09T18:25:41.360 INFO:tasks.workunit.client.0.smithi120.stdout:0/146: getdents d0/d2/d4 0 2021-04-09T18:25:41.361 INFO:tasks.workunit.client.0.smithi120.stdout:0/147: write d0/d2/f27 [831983,35232] 0 2021-04-09T18:25:41.363 INFO:tasks.workunit.client.0.smithi120.stdout:0/148: chown d0/d2/da/l10 123828 1 2021-04-09T18:25:41.365 INFO:tasks.workunit.client.0.smithi120.stdout:0/149: mknod d0/d2/dd/c2d 1 2021-04-09T18:25:41.366 INFO:tasks.workunit.client.0.smithi120.stdout:9/161: symlink d19/d1c/d29/l33 0 2021-04-09T18:25:41.367 INFO:tasks.workunit.client.0.smithi120.stdout:8/159: rename d2/d3/d8/f15 to d2/d3/d11/d2a/f33 0 2021-04-09T18:25:41.367 INFO:tasks.workunit.client.0.smithi120.stdout:5/214: rename d10/d12/d1b/d1f/f4c to d10/d12/d1b/d1f/f56 0 2021-04-09T18:25:41.367 INFO:tasks.workunit.client.0.smithi120.stdout:0/150: rmdir d0/d2/dd 39 2021-04-09T18:25:41.369 INFO:tasks.workunit.client.0.smithi120.stdout:8/160: rmdir d2/d3/d11 39 2021-04-09T18:25:41.369 INFO:tasks.workunit.client.0.smithi120.stdout:3/223: getdents d3/d5/d36 0 2021-04-09T18:25:41.372 INFO:tasks.workunit.client.0.smithi120.stdout:5/215: rename d10/f23 to d10/d12/d1b/d1f/f57 0 2021-04-09T18:25:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:3/224: mkdir d3/de/d25/d4c 0 2021-04-09T18:25:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:8/161: creat d2/d3/d11/f34 x:0 0 0 2021-04-09T18:25:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:8/162: write d2/f2d [555433,46791] 0 2021-04-09T18:25:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:8/163: symlink d2/d3/d11/d2a/l35 0 2021-04-09T18:25:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:3/225: dwrite d3/d5/f28 [0,4194304] 0 2021-04-09T18:25:41.389 INFO:tasks.workunit.client.0.smithi120.stdout:8/164: dwrite d2/d3/f23 [0,4194304] 0 2021-04-09T18:25:41.391 INFO:tasks.workunit.client.0.smithi120.stdout:3/226: link d3/d5/f28 d3/d5/f4d 0 2021-04-09T18:25:41.392 INFO:tasks.workunit.client.0.smithi120.stdout:8/165: dread - d2/d3/d8/f20 zero size 2021-04-09T18:25:41.403 INFO:tasks.workunit.client.0.smithi120.stdout:3/227: unlink d3/d5/l33 0 2021-04-09T18:25:41.406 INFO:tasks.workunit.client.0.smithi120.stdout:0/151: dwrite d0/d2/d4/f13 [0,4194304] 0 2021-04-09T18:25:41.408 INFO:tasks.workunit.client.0.smithi120.stdout:8/166: dwrite d2/d3/d11/d2a/f2b [0,4194304] 0 2021-04-09T18:25:41.415 INFO:tasks.workunit.client.0.smithi120.stdout:8/167: fsync d2/d3/d11/d2c/f32 0 2021-04-09T18:25:41.420 INFO:tasks.workunit.client.0.smithi120.stdout:0/152: mkdir d0/d2/da/d2e 0 2021-04-09T18:25:41.425 INFO:tasks.workunit.client.0.smithi120.stdout:0/153: creat d0/d2/da/d23/f2f x:0 0 0 2021-04-09T18:25:41.427 INFO:tasks.workunit.client.0.smithi120.stdout:9/162: dwrite d19/d1c/f23 [0,4194304] 0 2021-04-09T18:25:41.427 INFO:tasks.workunit.client.0.smithi120.stdout:3/228: write d3/f42 [521445,304] 0 2021-04-09T18:25:41.430 INFO:tasks.workunit.client.0.smithi120.stdout:9/163: fdatasync f18 0 2021-04-09T18:25:41.431 INFO:tasks.workunit.client.0.smithi120.stdout:8/168: dread d2/d3/f23 [0,4194304] 0 2021-04-09T18:25:41.436 INFO:tasks.workunit.client.0.smithi120.stdout:9/164: symlink d19/d24/l34 0 2021-04-09T18:25:41.442 INFO:tasks.workunit.client.0.smithi120.stdout:9/165: mknod d19/d24/d2e/c35 1 2021-04-09T18:25:41.446 INFO:tasks.workunit.client.0.smithi120.stdout:8/169: rename d2/d3/d8/f20 to d2/d3/d11/f36 0 2021-04-09T18:25:41.450 INFO:tasks.workunit.client.0.smithi120.stdout:0/154: getdents d0/d2/da/d23 0 2021-04-09T18:25:41.451 INFO:tasks.workunit.client.0.smithi120.stdout:3/229: mkdir d3/de/d25/d2f/d49/d4e 0 2021-04-09T18:25:41.451 INFO:tasks.workunit.client.0.smithi120.stdout:3/230: creat d3/de/f4f x:0 0 0 2021-04-09T18:25:41.452 INFO:tasks.workunit.client.0.smithi120.stdout:9/166: read f18 [730236,75965] 0 2021-04-09T18:25:41.455 INFO:tasks.workunit.client.0.smithi120.stdout:9/167: mkdir d19/d24/d36 0 2021-04-09T18:25:41.457 INFO:tasks.workunit.client.0.smithi120.stdout:9/168: mkdir d19/d24/d37 0 2021-04-09T18:25:41.459 INFO:tasks.workunit.client.0.smithi120.stdout:9/169: link f17 d19/f38 0 2021-04-09T18:25:41.462 INFO:tasks.workunit.client.0.smithi120.stdout:4/104: sync 2021-04-09T18:25:41.463 INFO:tasks.workunit.client.0.smithi120.stdout:4/105: read f1a [146862,119196] 0 2021-04-09T18:25:41.464 INFO:tasks.workunit.client.0.smithi120.stdout:4/106: chown lc 203 1 2021-04-09T18:25:41.465 INFO:tasks.workunit.client.0.smithi120.stdout:9/170: dwrite d19/d2c/f30 [0,4194304] 0 2021-04-09T18:25:41.465 INFO:tasks.workunit.client.0.smithi120.stdout:4/107: chown f1b 199104533 1 2021-04-09T18:25:41.469 INFO:tasks.workunit.client.0.smithi120.stdout:9/171: link d19/l2a d19/d1c/d29/l39 0 2021-04-09T18:25:41.472 INFO:tasks.workunit.client.0.smithi120.stdout:9/172: unlink f18 0 2021-04-09T18:25:41.475 INFO:tasks.workunit.client.0.smithi120.stdout:3/231: fdatasync f1 0 2021-04-09T18:25:41.478 INFO:tasks.workunit.client.0.smithi120.stdout:3/232: symlink d3/de/d25/d2f/d49/l50 0 2021-04-09T18:25:41.480 INFO:tasks.workunit.client.0.smithi120.stdout:3/233: rmdir d3/de/d25/d2f/d49 39 2021-04-09T18:25:41.489 INFO:tasks.workunit.client.0.smithi120.stdout:3/234: truncate d3/de/d25/d2f/d49/f4a 755498 0 2021-04-09T18:25:41.490 INFO:tasks.workunit.client.0.smithi120.stdout:3/235: chown d3/d5/f28 1937 1 2021-04-09T18:25:41.491 INFO:tasks.workunit.client.0.smithi120.stdout:3/236: mknod d3/de/d25/d4c/c51 1 2021-04-09T18:25:41.492 INFO:tasks.workunit.client.0.smithi120.stdout:3/237: mknod d3/d5/d36/c52 1 2021-04-09T18:25:41.497 INFO:tasks.workunit.client.0.smithi120.stdout:3/238: mkdir d3/de/d25/d53 0 2021-04-09T18:25:41.498 INFO:tasks.workunit.client.0.smithi120.stdout:4/108: dread f7 [0,4194304] 0 2021-04-09T18:25:41.499 INFO:tasks.workunit.client.0.smithi120.stdout:4/109: stat f12 0 2021-04-09T18:25:41.501 INFO:tasks.workunit.client.0.smithi120.stdout:3/239: mkdir d3/de/d25/d2f/d49/d4e/d54 0 2021-04-09T18:25:41.502 INFO:tasks.workunit.client.0.smithi120.stdout:4/110: read ff [510975,87629] 0 2021-04-09T18:25:41.502 INFO:tasks.workunit.client.0.smithi120.stdout:3/240: chown d3/de/d25/d2f/f35 16178 1 2021-04-09T18:25:41.506 INFO:tasks.workunit.client.0.smithi120.stdout:4/111: creat d1f/d24/f25 x:0 0 0 2021-04-09T18:25:41.506 INFO:tasks.workunit.client.0.smithi120.stdout:4/112: chown fd 23347 1 2021-04-09T18:25:41.507 INFO:tasks.workunit.client.0.smithi120.stdout:4/113: fdatasync f19 0 2021-04-09T18:25:41.508 INFO:tasks.workunit.client.0.smithi120.stdout:4/114: creat d1f/d24/f26 x:0 0 0 2021-04-09T18:25:41.509 INFO:tasks.workunit.client.0.smithi120.stdout:4/115: rename d1f/d24 to d1f/d24/d27 22 2021-04-09T18:25:41.831 INFO:tasks.workunit.client.0.smithi120.stdout:3/241: write d3/de/d25/f22 [349484,79344] 0 2021-04-09T18:25:41.832 INFO:tasks.workunit.client.0.smithi120.stdout:4/116: write f1a [2335983,96858] 0 2021-04-09T18:25:41.839 INFO:tasks.workunit.client.0.smithi120.stdout:3/242: dwrite d3/d5/d36/d1e/f45 [0,4194304] 0 2021-04-09T18:25:41.843 INFO:tasks.workunit.client.0.smithi120.stdout:4/117: dwrite fe [0,4194304] 0 2021-04-09T18:25:41.844 INFO:tasks.workunit.client.0.smithi120.stdout:4/118: chown l1c 23367 1 2021-04-09T18:25:41.845 INFO:tasks.workunit.client.0.smithi120.stdout:4/119: write fd [2107419,48276] 0 2021-04-09T18:25:41.850 INFO:tasks.workunit.client.0.smithi120.stdout:4/120: unlink d1f/l20 0 2021-04-09T18:25:41.851 INFO:tasks.workunit.client.0.smithi120.stdout:3/243: getdents d3/de/d25/d2f/d49/d4e 0 2021-04-09T18:25:41.853 INFO:tasks.workunit.client.0.smithi120.stdout:3/244: rmdir d3/de/d25/d2f 39 2021-04-09T18:25:41.853 INFO:tasks.workunit.client.0.smithi120.stdout:4/121: creat d1f/f28 x:0 0 0 2021-04-09T18:25:41.859 INFO:tasks.workunit.client.0.smithi120.stdout:4/122: dwrite f19 [0,4194304] 0 2021-04-09T18:25:41.861 INFO:tasks.workunit.client.0.smithi120.stdout:4/123: chown d1f/l21 140679 1 2021-04-09T18:25:41.864 INFO:tasks.workunit.client.0.smithi120.stdout:4/124: unlink f10 0 2021-04-09T18:25:41.865 INFO:tasks.workunit.client.0.smithi120.stdout:4/125: rmdir d1f 39 2021-04-09T18:25:41.869 INFO:tasks.workunit.client.0.smithi120.stdout:4/126: dwrite f19 [0,4194304] 0 2021-04-09T18:25:41.876 INFO:tasks.workunit.client.0.smithi120.stdout:4/127: getdents d1f/d24 0 2021-04-09T18:25:41.884 INFO:tasks.workunit.client.0.smithi120.stdout:4/128: truncate d1f/d24/f25 974208 0 2021-04-09T18:25:41.939 INFO:tasks.workunit.client.0.smithi120.stdout:9/173: fsync d19/d2c/f30 0 2021-04-09T18:25:41.940 INFO:tasks.workunit.client.0.smithi120.stdout:9/174: mknod d19/d24/d37/c3a 1 2021-04-09T18:25:41.943 INFO:tasks.workunit.client.0.smithi120.stdout:9/175: link d19/d24/l34 d19/d24/d2e/l3b 0 2021-04-09T18:25:41.944 INFO:tasks.workunit.client.0.smithi120.stdout:9/176: chown d19/d24/l34 9163 1 2021-04-09T18:25:41.947 INFO:tasks.workunit.client.0.smithi120.stdout:9/177: creat d19/d24/d2e/f3c x:0 0 0 2021-04-09T18:25:41.948 INFO:tasks.workunit.client.0.smithi120.stdout:1/110: sync 2021-04-09T18:25:41.948 INFO:tasks.workunit.client.0.smithi120.stdout:9/178: write d19/d1c/d29/f2b [574815,117929] 0 2021-04-09T18:25:41.949 INFO:tasks.workunit.client.0.smithi120.stdout:9/179: fdatasync f16 0 2021-04-09T18:25:41.951 INFO:tasks.workunit.client.0.smithi120.stdout:1/111: rename d5/f6 to d5/df/f1c 0 2021-04-09T18:25:41.954 INFO:tasks.workunit.client.0.smithi120.stdout:1/112: write d5/df/f1c [555060,111599] 0 2021-04-09T18:25:41.957 INFO:tasks.workunit.client.0.smithi120.stdout:3/245: write d3/f6 [1757201,31773] 0 2021-04-09T18:25:41.960 INFO:tasks.workunit.client.0.smithi120.stdout:1/113: dwrite d5/df/f1c [0,4194304] 0 2021-04-09T18:25:41.963 INFO:tasks.workunit.client.0.smithi120.stdout:1/114: chown d5/l14 31023646 1 2021-04-09T18:25:41.965 INFO:tasks.workunit.client.0.smithi120.stdout:3/246: dwrite d3/de/f4f [0,4194304] 0 2021-04-09T18:25:41.971 INFO:tasks.workunit.client.0.smithi120.stdout:3/247: dwrite d3/de/d25/f22 [0,4194304] 0 2021-04-09T18:25:41.973 INFO:tasks.workunit.client.0.smithi120.stdout:4/129: truncate f1a 4798720 0 2021-04-09T18:25:41.973 INFO:tasks.workunit.client.0.smithi120.stdout:4/130: mknod d1f/d24/c29 1 2021-04-09T18:25:41.979 INFO:tasks.workunit.client.0.smithi120.stdout:9/180: getdents d19/d24/d2e 0 2021-04-09T18:25:41.985 INFO:tasks.workunit.client.0.smithi120.stdout:9/181: chown d19/l26 0 1 2021-04-09T18:25:41.987 INFO:tasks.workunit.client.0.smithi120.stdout:9/182: chown d19/d24/l34 1717491 1 2021-04-09T18:25:41.990 INFO:tasks.workunit.client.0.smithi120.stdout:4/131: dwrite f12 [0,4194304] 0 2021-04-09T18:25:41.991 INFO:tasks.workunit.client.0.smithi120.stdout:3/248: mkdir d3/de/d25/d2f/d49/d4e/d54/d55 0 2021-04-09T18:25:42.000 INFO:tasks.workunit.client.0.smithi120.stdout:4/132: dread fe [0,4194304] 0 2021-04-09T18:25:42.001 INFO:tasks.workunit.client.0.smithi120.stdout:9/183: creat d19/f3d x:0 0 0 2021-04-09T18:25:42.006 INFO:tasks.workunit.client.0.smithi120.stdout:9/184: mknod d19/c3e 1 2021-04-09T18:25:42.007 INFO:tasks.workunit.client.0.smithi120.stdout:4/133: chown d1f/l21 53 1 2021-04-09T18:25:42.007 INFO:tasks.workunit.client.0.smithi120.stdout:4/134: mknod d1f/d24/c2a 1 2021-04-09T18:25:42.008 INFO:tasks.workunit.client.0.smithi120.stdout:9/185: write f12 [1269524,31897] 0 2021-04-09T18:25:42.008 INFO:tasks.workunit.client.0.smithi120.stdout:4/135: mknod d1f/d24/c2b 1 2021-04-09T18:25:42.009 INFO:tasks.workunit.client.0.smithi120.stdout:4/136: dread d1f/d24/f25 [0,4194304] 0 2021-04-09T18:25:42.015 INFO:tasks.workunit.client.0.smithi120.stdout:4/137: dread f19 [0,4194304] 0 2021-04-09T18:25:42.018 INFO:tasks.workunit.client.0.smithi120.stdout:4/138: dread fe [0,4194304] 0 2021-04-09T18:25:42.019 INFO:tasks.workunit.client.0.smithi120.stdout:4/139: chown l0 1896805152 1 2021-04-09T18:25:42.021 INFO:tasks.workunit.client.0.smithi120.stdout:4/140: mkdir d1f/d2c 0 2021-04-09T18:25:42.022 INFO:tasks.workunit.client.0.smithi120.stdout:4/141: mknod d1f/d24/c2d 1 2021-04-09T18:25:42.024 INFO:tasks.workunit.client.0.smithi120.stdout:4/142: creat d1f/d2c/f2e x:0 0 0 2021-04-09T18:25:42.026 INFO:tasks.workunit.client.0.smithi120.stdout:4/143: mkdir d1f/d2f 0 2021-04-09T18:25:42.027 INFO:tasks.workunit.client.0.smithi120.stdout:4/144: fdatasync fe 0 2021-04-09T18:25:42.029 INFO:tasks.workunit.client.0.smithi120.stdout:4/145: mkdir d1f/d2c/d30 0 2021-04-09T18:25:42.029 INFO:tasks.workunit.client.0.smithi120.stdout:4/146: fsync d1f/f23 0 2021-04-09T18:25:42.032 INFO:tasks.workunit.client.0.smithi120.stdout:1/115: truncate d5/fc 1580962 0 2021-04-09T18:25:42.033 INFO:tasks.workunit.client.0.smithi120.stdout:4/147: symlink d1f/d2f/l31 0 2021-04-09T18:25:42.036 INFO:tasks.workunit.client.0.smithi120.stdout:4/148: rename ff to d1f/f32 0 2021-04-09T18:25:42.037 INFO:tasks.workunit.client.0.smithi120.stdout:1/116: creat d5/f1d x:0 0 0 2021-04-09T18:25:42.039 INFO:tasks.workunit.client.0.smithi120.stdout:1/117: symlink d5/df/l1e 0 2021-04-09T18:25:42.040 INFO:tasks.workunit.client.0.smithi120.stdout:4/149: dread f19 [4194304,4194304] 0 2021-04-09T18:25:42.040 INFO:tasks.workunit.client.0.smithi120.stdout:4/150: write d1f/f23 [357334,47231] 0 2021-04-09T18:25:42.045 INFO:tasks.workunit.client.0.smithi120.stdout:4/151: creat d1f/d24/f33 x:0 0 0 2021-04-09T18:25:42.046 INFO:tasks.workunit.client.0.smithi120.stdout:4/152: read - d1f/d24/f26 zero size 2021-04-09T18:25:42.048 INFO:tasks.workunit.client.0.smithi120.stdout:4/153: mkdir d1f/d2c/d34 0 2021-04-09T18:25:42.059 INFO:tasks.workunit.client.0.smithi120.stdout:1/118: dread d5/fc [0,4194304] 0 2021-04-09T18:25:42.060 INFO:tasks.workunit.client.0.smithi120.stdout:1/119: read - d5/df/f15 zero size 2021-04-09T18:25:42.061 INFO:tasks.workunit.client.0.smithi120.stdout:1/120: chown d5/df/l1e 93953 1 2021-04-09T18:25:42.062 INFO:tasks.workunit.client.0.smithi120.stdout:1/121: fsync d5/df/f1c 0 2021-04-09T18:25:42.063 INFO:tasks.workunit.client.0.smithi120.stdout:1/122: write d5/df/f1c [188488,84387] 0 2021-04-09T18:25:42.071 INFO:tasks.workunit.client.0.smithi120.stdout:1/123: rename d5/df to d5/d1f 0 2021-04-09T18:25:42.073 INFO:tasks.workunit.client.0.smithi120.stdout:1/124: write d5/fc [2410391,25653] 0 2021-04-09T18:25:42.078 INFO:tasks.workunit.client.0.smithi120.stdout:1/125: dwrite d5/fc [0,4194304] 0 2021-04-09T18:25:42.080 INFO:tasks.workunit.client.0.smithi120.stdout:1/126: chown d5/d1f/l1e 177650 1 2021-04-09T18:25:42.080 INFO:tasks.workunit.client.0.smithi120.stdout:1/127: dread - d5/f1d zero size 2021-04-09T18:25:42.081 INFO:tasks.workunit.client.0.smithi120.stdout:4/154: write d1f/f32 [928254,84821] 0 2021-04-09T18:25:42.085 INFO:tasks.workunit.client.0.smithi120.stdout:8/170: sync 2021-04-09T18:25:42.085 INFO:tasks.workunit.client.0.smithi120.stdout:5/216: sync 2021-04-09T18:25:42.086 INFO:tasks.workunit.client.0.smithi120.stdout:6/128: sync 2021-04-09T18:25:42.087 INFO:tasks.workunit.client.0.smithi120.stdout:5/217: write d10/f16 [465934,24745] 0 2021-04-09T18:25:42.087 INFO:tasks.workunit.client.0.smithi120.stdout:2/184: sync 2021-04-09T18:25:42.089 INFO:tasks.workunit.client.0.smithi120.stdout:2/185: write d13/f18 [1944153,82768] 0 2021-04-09T18:25:42.089 INFO:tasks.workunit.client.0.smithi120.stdout:0/155: sync 2021-04-09T18:25:42.090 INFO:tasks.workunit.client.0.smithi120.stdout:7/124: sync 2021-04-09T18:25:42.093 INFO:tasks.workunit.client.0.smithi120.stdout:2/186: mknod d13/d15/c43 1 2021-04-09T18:25:42.095 INFO:tasks.workunit.client.0.smithi120.stdout:0/156: chown d0/d2/dd/l1f 0 1 2021-04-09T18:25:42.097 INFO:tasks.workunit.client.0.smithi120.stdout:8/171: mkdir d2/d37 0 2021-04-09T18:25:42.098 INFO:tasks.workunit.client.0.smithi120.stdout:5/218: rename d10/l46 to d10/l58 0 2021-04-09T18:25:42.099 INFO:tasks.workunit.client.0.smithi120.stdout:0/157: write d0/d2/d4/f13 [833104,66488] 0 2021-04-09T18:25:42.100 INFO:tasks.workunit.client.0.smithi120.stdout:6/129: dwrite d6/d8/db/d12/d22/f2a [0,4194304] 0 2021-04-09T18:25:42.102 INFO:tasks.workunit.client.0.smithi120.stdout:5/219: dread - d10/f48 zero size 2021-04-09T18:25:42.103 INFO:tasks.workunit.client.0.smithi120.stdout:1/128: getdents d5 0 2021-04-09T18:25:42.107 INFO:tasks.workunit.client.0.smithi120.stdout:4/155: dread d1f/f32 [0,4194304] 0 2021-04-09T18:25:42.108 INFO:tasks.workunit.client.0.smithi120.stdout:4/156: mknod d1f/d2c/c35 1 2021-04-09T18:25:42.108 INFO:tasks.workunit.client.0.smithi120.stdout:2/187: unlink d13/d1b/f3f 0 2021-04-09T18:25:42.110 INFO:tasks.workunit.client.0.smithi120.stdout:5/220: creat d10/d12/d1b/d1f/f59 x:0 0 0 2021-04-09T18:25:42.111 INFO:tasks.workunit.client.0.smithi120.stdout:7/125: dwrite db/fd [0,4194304] 0 2021-04-09T18:25:42.116 INFO:tasks.workunit.client.0.smithi120.stdout:6/130: mkdir d6/d8/db/d2b 0 2021-04-09T18:25:42.117 INFO:tasks.workunit.client.0.smithi120.stdout:5/221: dread - d10/d12/d1b/d1f/f4e zero size 2021-04-09T18:25:42.117 INFO:tasks.workunit.client.0.smithi120.stdout:1/129: link d5/f17 d5/f20 0 2021-04-09T18:25:42.119 INFO:tasks.workunit.client.0.smithi120.stdout:4/157: dread f1a [0,4194304] 0 2021-04-09T18:25:42.122 INFO:tasks.workunit.client.0.smithi120.stdout:1/130: readlink d5/l1b 0 2021-04-09T18:25:42.124 INFO:tasks.workunit.client.0.smithi120.stdout:4/158: mkdir d1f/d2f/d36 0 2021-04-09T18:25:42.129 INFO:tasks.workunit.client.0.smithi120.stdout:6/131: creat d6/d8/db/f2c x:0 0 0 2021-04-09T18:25:42.132 INFO:tasks.workunit.client.0.smithi120.stdout:4/159: read - d1f/d2c/f2e zero size 2021-04-09T18:25:42.132 INFO:tasks.workunit.client.0.smithi120.stdout:7/126: dwrite db/f25 [0,4194304] 0 2021-04-09T18:25:42.133 INFO:tasks.workunit.client.0.smithi120.stdout:2/188: truncate d13/d15/f42 670624 0 2021-04-09T18:25:42.136 INFO:tasks.workunit.client.0.smithi120.stdout:2/189: rmdir d13 39 2021-04-09T18:25:42.137 INFO:tasks.workunit.client.0.smithi120.stdout:6/132: write d6/d8/f10 [3191182,121616] 0 2021-04-09T18:25:42.138 INFO:tasks.workunit.client.0.smithi120.stdout:6/133: chown d6/d8/db/f1b 992464 1 2021-04-09T18:25:42.141 INFO:tasks.workunit.client.0.smithi120.stdout:2/190: read - d13/d1b/f33 zero size 2021-04-09T18:25:42.145 INFO:tasks.workunit.client.0.smithi120.stdout:7/127: creat db/f2f x:0 0 0 2021-04-09T18:25:42.148 INFO:tasks.workunit.client.0.smithi120.stdout:4/160: dread f7 [0,4194304] 0 2021-04-09T18:25:42.149 INFO:tasks.workunit.client.0.smithi120.stdout:6/134: dwrite d6/d8/f25 [0,4194304] 0 2021-04-09T18:25:42.151 INFO:tasks.workunit.client.0.smithi120.stdout:4/161: fsync d1f/d24/f26 0 2021-04-09T18:25:42.153 INFO:tasks.workunit.client.0.smithi120.stdout:7/128: chown db/f1a 62 1 2021-04-09T18:25:42.157 INFO:tasks.workunit.client.0.smithi120.stdout:4/162: rename f19 to d1f/d2c/f37 0 2021-04-09T18:25:42.163 INFO:tasks.workunit.client.0.smithi120.stdout:0/158: truncate d0/f20 4205036 0 2021-04-09T18:25:42.165 INFO:tasks.workunit.client.0.smithi120.stdout:7/129: mkdir db/d2c/d30 0 2021-04-09T18:25:42.166 INFO:tasks.workunit.client.0.smithi120.stdout:7/130: mknod db/d26/c31 1 2021-04-09T18:25:42.166 INFO:tasks.workunit.client.0.smithi120.stdout:2/191: truncate d13/d1b/f2f 1812304 0 2021-04-09T18:25:42.169 INFO:tasks.workunit.client.0.smithi120.stdout:6/135: getdents d6/d8/d1a 0 2021-04-09T18:25:42.171 INFO:tasks.workunit.client.0.smithi120.stdout:4/163: dwrite d1f/f32 [0,4194304] 0 2021-04-09T18:25:42.171 INFO:tasks.workunit.client.0.smithi120.stdout:7/131: symlink db/d26/l32 0 2021-04-09T18:25:42.172 INFO:tasks.workunit.client.0.smithi120.stdout:6/136: mknod d6/d8/db/d12/c2d 1 2021-04-09T18:25:42.173 INFO:tasks.workunit.client.0.smithi120.stdout:2/192: creat d13/d1b/f44 x:0 0 0 2021-04-09T18:25:42.174 INFO:tasks.workunit.client.0.smithi120.stdout:4/164: read - d1f/d2c/f2e zero size 2021-04-09T18:25:42.176 INFO:tasks.workunit.client.0.smithi120.stdout:0/159: rename d0/d2/dd/f2b to d0/f30 0 2021-04-09T18:25:42.176 INFO:tasks.workunit.client.0.smithi120.stdout:6/137: fsync d6/d8/db/d12/f18 0 2021-04-09T18:25:42.179 INFO:tasks.workunit.client.0.smithi120.stdout:2/193: dread d13/d1b/f2b [0,4194304] 0 2021-04-09T18:25:42.187 INFO:tasks.workunit.client.0.smithi120.stdout:2/194: chown d13/d15/f34 6983671 1 2021-04-09T18:25:42.188 INFO:tasks.workunit.client.0.smithi120.stdout:0/160: dwrite d0/d2/f27 [0,4194304] 0 2021-04-09T18:25:42.188 INFO:tasks.workunit.client.0.smithi120.stdout:4/165: rmdir d1f/d2f/d36 0 2021-04-09T18:25:42.189 INFO:tasks.workunit.client.0.smithi120.stdout:0/161: read d0/d2/da/f19 [3982744,28274] 0 2021-04-09T18:25:42.190 INFO:tasks.workunit.client.0.smithi120.stdout:4/166: mknod d1f/d2c/d34/c38 1 2021-04-09T18:25:42.190 INFO:tasks.workunit.client.0.smithi120.stdout:7/132: truncate db/f27 585090 0 2021-04-09T18:25:42.191 INFO:tasks.workunit.client.0.smithi120.stdout:2/195: read - d13/d1b/f44 zero size 2021-04-09T18:25:42.191 INFO:tasks.workunit.client.0.smithi120.stdout:7/133: chown f2 49694 1 2021-04-09T18:25:42.194 INFO:tasks.workunit.client.0.smithi120.stdout:7/134: dread db/f1a [0,4194304] 0 2021-04-09T18:25:42.194 INFO:tasks.workunit.client.0.smithi120.stdout:0/162: read d0/f30 [330959,9255] 0 2021-04-09T18:25:42.194 INFO:tasks.workunit.client.0.smithi120.stdout:2/196: creat d13/d1b/f45 x:0 0 0 2021-04-09T18:25:42.196 INFO:tasks.workunit.client.0.smithi120.stdout:2/197: stat d13/d15 0 2021-04-09T18:25:42.197 INFO:tasks.workunit.client.0.smithi120.stdout:5/222: dread d10/d12/d1b/d1f/f29 [0,4194304] 0 2021-04-09T18:25:42.197 INFO:tasks.workunit.client.0.smithi120.stdout:7/135: write db/f25 [2746141,31806] 0 2021-04-09T18:25:42.200 INFO:tasks.workunit.client.0.smithi120.stdout:2/198: write d13/d1b/f31 [72002,8078] 0 2021-04-09T18:25:42.203 INFO:tasks.workunit.client.0.smithi120.stdout:4/167: dwrite f1a [0,4194304] 0 2021-04-09T18:25:42.206 INFO:tasks.workunit.client.0.smithi120.stdout:7/136: creat db/d2c/d30/f33 x:0 0 0 2021-04-09T18:25:42.207 INFO:tasks.workunit.client.0.smithi120.stdout:2/199: mknod d13/c46 1 2021-04-09T18:25:42.211 INFO:tasks.workunit.client.0.smithi120.stdout:7/137: mkdir db/d2c/d34 0 2021-04-09T18:25:42.219 INFO:tasks.workunit.client.0.smithi120.stdout:4/168: rename l1e to d1f/d2c/l39 0 2021-04-09T18:25:42.219 INFO:tasks.workunit.client.0.smithi120.stdout:5/223: link d10/d12/d1b/d1f/l30 d10/d12/d1b/d1f/d39/l5a 0 2021-04-09T18:25:42.219 INFO:tasks.workunit.client.0.smithi120.stdout:7/138: symlink db/d2c/l35 0 2021-04-09T18:25:42.221 INFO:tasks.workunit.client.0.smithi120.stdout:7/139: mknod db/d2c/d34/c36 1 2021-04-09T18:25:42.221 INFO:tasks.workunit.client.0.smithi120.stdout:4/169: write d1f/d24/f33 [539651,114238] 0 2021-04-09T18:25:42.222 INFO:tasks.workunit.client.0.smithi120.stdout:5/224: write d10/f2b [4063299,116863] 0 2021-04-09T18:25:42.225 INFO:tasks.workunit.client.0.smithi120.stdout:2/200: rename d13/d1b/f31 to d13/f47 0 2021-04-09T18:25:42.227 INFO:tasks.workunit.client.0.smithi120.stdout:4/170: rename d1f/d2c to d1f/d2c/d30/d3a 22 2021-04-09T18:25:42.228 INFO:tasks.workunit.client.0.smithi120.stdout:0/163: dwrite d0/fc [0,4194304] 0 2021-04-09T18:25:42.228 INFO:tasks.workunit.client.0.smithi120.stdout:0/164: chown d0/d2/l7 0 1 2021-04-09T18:25:42.229 INFO:tasks.workunit.client.0.smithi120.stdout:2/201: mkdir d13/d1b/d48 0 2021-04-09T18:25:42.230 INFO:tasks.workunit.client.0.smithi120.stdout:4/171: stat d1f/d2c/f2e 0 2021-04-09T18:25:42.230 INFO:tasks.workunit.client.0.smithi120.stdout:0/165: chown d0/d2/da/f2c 253 1 2021-04-09T18:25:42.240 INFO:tasks.workunit.client.0.smithi120.stdout:5/225: mkdir d10/d12/d1b/d3a/d5b 0 2021-04-09T18:25:42.243 INFO:tasks.workunit.client.0.smithi120.stdout:2/202: mkdir d13/d1b/d48/d49 0 2021-04-09T18:25:42.244 INFO:tasks.workunit.client.0.smithi120.stdout:4/172: dwrite fd [0,4194304] 0 2021-04-09T18:25:42.246 INFO:tasks.workunit.client.0.smithi120.stdout:0/166: dwrite d0/fc [4194304,4194304] 0 2021-04-09T18:25:42.247 INFO:tasks.workunit.client.0.smithi120.stdout:5/226: fsync d10/d12/d1b/d1f/f56 0 2021-04-09T18:25:42.253 INFO:tasks.workunit.client.0.smithi120.stdout:4/173: mkdir d1f/d2c/d3b 0 2021-04-09T18:25:42.261 INFO:tasks.workunit.client.0.smithi120.stdout:2/203: dwrite d13/d1b/f44 [0,4194304] 0 2021-04-09T18:25:42.269 INFO:tasks.workunit.client.0.smithi120.stdout:5/227: read d10/d12/f1a [189508,20189] 0 2021-04-09T18:25:42.275 INFO:tasks.workunit.client.0.smithi120.stdout:4/174: dread fe [0,4194304] 0 2021-04-09T18:25:42.279 INFO:tasks.workunit.client.0.smithi120.stdout:0/167: dwrite d0/d2/d4/f13 [0,4194304] 0 2021-04-09T18:25:42.280 INFO:tasks.workunit.client.0.smithi120.stdout:0/168: readlink d0/d2/da/l10 0 2021-04-09T18:25:42.288 INFO:tasks.workunit.client.0.smithi120.stdout:5/228: write d10/d12/d1b/d1f/d33/d3d/f52 [1937648,64941] 0 2021-04-09T18:25:42.289 INFO:tasks.workunit.client.0.smithi120.stdout:7/140: dwrite db/f27 [0,4194304] 0 2021-04-09T18:25:42.293 INFO:tasks.workunit.client.0.smithi120.stdout:4/175: creat d1f/d24/f3c x:0 0 0 2021-04-09T18:25:42.294 INFO:tasks.workunit.client.0.smithi120.stdout:2/204: unlink d13/d15/f40 0 2021-04-09T18:25:42.300 INFO:tasks.workunit.client.0.smithi120.stdout:5/229: symlink d10/d12/d35/l5c 0 2021-04-09T18:25:42.306 INFO:tasks.workunit.client.0.smithi120.stdout:2/205: mknod d13/d15/c4a 1 2021-04-09T18:25:42.306 INFO:tasks.workunit.client.0.smithi120.stdout:4/176: rename d1f/d2c/f37 to d1f/d2c/d30/f3d 0 2021-04-09T18:25:42.308 INFO:tasks.workunit.client.0.smithi120.stdout:2/206: chown d13/d1b/d48/d49 4567 1 2021-04-09T18:25:42.308 INFO:tasks.workunit.client.0.smithi120.stdout:5/230: write d10/d12/d1b/d1f/d33/d44/f54 [905252,5488] 0 2021-04-09T18:25:42.309 INFO:tasks.workunit.client.0.smithi120.stdout:2/207: chown d13/d15 70524 1 2021-04-09T18:25:42.310 INFO:tasks.workunit.client.0.smithi120.stdout:0/169: getdents d0/d2 0 2021-04-09T18:25:42.314 INFO:tasks.workunit.client.0.smithi120.stdout:0/170: mknod d0/d2/da/d2e/c31 1 2021-04-09T18:25:42.318 INFO:tasks.workunit.client.0.smithi120.stdout:4/177: dwrite fd [0,4194304] 0 2021-04-09T18:25:42.321 INFO:tasks.workunit.client.0.smithi120.stdout:4/178: chown d1f/d2c 185 1 2021-04-09T18:25:42.322 INFO:tasks.workunit.client.0.smithi120.stdout:5/231: rename d10/l2a to d10/d12/d1b/d1f/d33/d3d/d50/l5d 0 2021-04-09T18:25:42.323 INFO:tasks.workunit.client.0.smithi120.stdout:4/179: write f1b [848664,15830] 0 2021-04-09T18:25:42.327 INFO:tasks.workunit.client.0.smithi120.stdout:0/171: dwrite d0/d2/da/f19 [0,4194304] 0 2021-04-09T18:25:42.337 INFO:tasks.workunit.client.0.smithi120.stdout:5/232: creat d10/d12/d1b/d1f/d33/d3d/f5e x:0 0 0 2021-04-09T18:25:42.341 INFO:tasks.workunit.client.0.smithi120.stdout:5/233: dread - d10/d12/d1b/d1f/d33/d44/f49 zero size 2021-04-09T18:25:42.344 INFO:tasks.workunit.client.0.smithi120.stdout:5/234: symlink d10/d12/d35/l5f 0 2021-04-09T18:25:42.344 INFO:tasks.workunit.client.0.smithi120.stdout:7/141: truncate db/f15 2788364 0 2021-04-09T18:25:42.353 INFO:tasks.workunit.client.0.smithi120.stdout:5/235: fdatasync d10/d12/f17 0 2021-04-09T18:25:42.356 INFO:tasks.workunit.client.0.smithi120.stdout:4/180: truncate d1f/d2c/f2e 942116 0 2021-04-09T18:25:42.362 INFO:tasks.workunit.client.0.smithi120.stdout:4/181: mkdir d1f/d2c/d3b/d3e 0 2021-04-09T18:25:42.363 INFO:tasks.workunit.client.0.smithi120.stdout:4/182: chown l0 398 1 2021-04-09T18:25:42.364 INFO:tasks.workunit.client.0.smithi120.stdout:7/142: dwrite f7 [0,4194304] 0 2021-04-09T18:25:42.365 INFO:tasks.workunit.client.0.smithi120.stdout:4/183: rename fd to d1f/f3f 0 2021-04-09T18:25:42.367 INFO:tasks.workunit.client.0.smithi120.stdout:7/143: dread f4 [0,4194304] 0 2021-04-09T18:25:42.368 INFO:tasks.workunit.client.0.smithi120.stdout:7/144: fsync f6 0 2021-04-09T18:25:42.369 INFO:tasks.workunit.client.0.smithi120.stdout:5/236: truncate d10/d12/d1b/d1f/d33/d3d/f41 1980674 0 2021-04-09T18:25:42.374 INFO:tasks.workunit.client.0.smithi120.stdout:5/237: chown d10/d12/d1b/d3a/d5b 2 1 2021-04-09T18:25:42.378 INFO:tasks.workunit.client.0.smithi120.stdout:4/184: rename f1b to d1f/f40 0 2021-04-09T18:25:42.378 INFO:tasks.workunit.client.0.smithi120.stdout:5/238: rename d10 to d10/d12/d60 22 2021-04-09T18:25:42.379 INFO:tasks.workunit.client.0.smithi120.stdout:4/185: chown d1f/d2f/l31 1826 1 2021-04-09T18:25:42.379 INFO:tasks.workunit.client.0.smithi120.stdout:5/239: fdatasync fd 0 2021-04-09T18:25:42.379 INFO:tasks.workunit.client.0.smithi120.stdout:5/240: chown d10/d12/f1a 11494 1 2021-04-09T18:25:42.387 INFO:tasks.workunit.client.0.smithi120.stdout:7/145: truncate db/f15 3008965 0 2021-04-09T18:25:42.392 INFO:tasks.workunit.client.0.smithi120.stdout:4/186: getdents d1f 0 2021-04-09T18:25:42.393 INFO:tasks.workunit.client.0.smithi120.stdout:4/187: readlink d1f/l21 0 2021-04-09T18:25:42.393 INFO:tasks.workunit.client.0.smithi120.stdout:4/188: chown d1f/d2c/d34 291055702 1 2021-04-09T18:25:42.394 INFO:tasks.workunit.client.0.smithi120.stdout:5/241: write d10/d12/d1b/d1f/d33/d3d/f41 [22957,130421] 0 2021-04-09T18:25:42.398 INFO:tasks.workunit.client.0.smithi120.stdout:4/189: link lc d1f/d2f/l41 0 2021-04-09T18:25:42.398 INFO:tasks.workunit.client.0.smithi120.stdout:7/146: dread db/f15 [0,4194304] 0 2021-04-09T18:25:42.399 INFO:tasks.workunit.client.0.smithi120.stdout:4/190: chown d1f/d2c 27878 1 2021-04-09T18:25:42.401 INFO:tasks.workunit.client.0.smithi120.stdout:4/191: mkdir d1f/d24/d42 0 2021-04-09T18:25:42.401 INFO:tasks.workunit.client.0.smithi120.stdout:4/192: chown f1a 536367503 1 2021-04-09T18:25:42.402 INFO:tasks.workunit.client.0.smithi120.stdout:7/147: dread f7 [0,4194304] 0 2021-04-09T18:25:42.402 INFO:tasks.workunit.client.0.smithi120.stdout:4/193: readlink l1d 0 2021-04-09T18:25:42.403 INFO:tasks.workunit.client.0.smithi120.stdout:4/194: dread - d1f/d24/f3c zero size 2021-04-09T18:25:42.407 INFO:tasks.workunit.client.0.smithi120.stdout:7/148: link l9 db/d2c/d30/l37 0 2021-04-09T18:25:42.413 INFO:tasks.workunit.client.0.smithi120.stdout:4/195: dwrite d1f/d24/f26 [0,4194304] 0 2021-04-09T18:25:42.413 INFO:tasks.workunit.client.0.smithi120.stdout:4/196: readlink l13 0 2021-04-09T18:25:42.415 INFO:tasks.workunit.client.0.smithi120.stdout:7/149: truncate db/d2c/d30/f33 1037444 0 2021-04-09T18:25:42.421 INFO:tasks.workunit.client.0.smithi120.stdout:7/150: dwrite f6 [0,4194304] 0 2021-04-09T18:25:42.425 INFO:tasks.workunit.client.0.smithi120.stdout:7/151: dread db/f1a [0,4194304] 0 2021-04-09T18:25:42.427 INFO:tasks.workunit.client.0.smithi120.stdout:7/152: mkdir db/d38 0 2021-04-09T18:25:42.428 INFO:tasks.workunit.client.0.smithi120.stdout:7/153: read - db/f29 zero size 2021-04-09T18:25:42.432 INFO:tasks.workunit.client.0.smithi120.stdout:7/154: truncate f4 1023992 0 2021-04-09T18:25:42.433 INFO:tasks.workunit.client.0.smithi120.stdout:7/155: fsync db/f16 0 2021-04-09T18:25:42.434 INFO:tasks.workunit.client.0.smithi120.stdout:7/156: stat db/d26/f2e 0 2021-04-09T18:25:42.637 INFO:tasks.workunit.client.0.smithi120.stdout:2/208: dread fb [0,4194304] 0 2021-04-09T18:25:42.639 INFO:tasks.workunit.client.0.smithi120.stdout:2/209: chown d13/d15/f24 764345 1 2021-04-09T18:25:42.643 INFO:tasks.workunit.client.0.smithi120.stdout:2/210: link d13/d15/f2a d13/d1b/d48/d49/f4b 0 2021-04-09T18:25:42.643 INFO:tasks.workunit.client.0.smithi120.stdout:2/211: chown d13/f2c 5 1 2021-04-09T18:25:42.647 INFO:tasks.workunit.client.0.smithi120.stdout:2/212: getdents d13/d15 0 2021-04-09T18:25:42.649 INFO:tasks.workunit.client.0.smithi120.stdout:2/213: dread d13/f47 [0,4194304] 0 2021-04-09T18:25:42.651 INFO:tasks.workunit.client.0.smithi120.stdout:2/214: symlink d13/d15/d35/l4c 0 2021-04-09T18:25:42.651 INFO:tasks.workunit.client.0.smithi120.stdout:2/215: stat d13/d1b/f45 0 2021-04-09T18:25:42.655 INFO:tasks.workunit.client.0.smithi120.stdout:2/216: dread d13/d1b/f44 [0,4194304] 0 2021-04-09T18:25:42.655 INFO:tasks.workunit.client.0.smithi120.stdout:2/217: readlink d13/l1f 0 2021-04-09T18:25:42.657 INFO:tasks.workunit.client.0.smithi120.stdout:2/218: symlink d13/d15/d35/l4d 0 2021-04-09T18:25:42.666 INFO:tasks.workunit.client.0.smithi120.stdout:2/219: fsync d13/d15/f2a 0 2021-04-09T18:25:42.764 INFO:tasks.workunit.client.0.smithi120.stdout:3/249: sync 2021-04-09T18:25:42.765 INFO:tasks.workunit.client.0.smithi120.stdout:3/250: symlink d3/l56 0 2021-04-09T18:25:42.766 INFO:tasks.workunit.client.0.smithi120.stdout:3/251: chown d3/de/l21 5218702 1 2021-04-09T18:25:42.770 INFO:tasks.workunit.client.0.smithi120.stdout:3/252: link d3/l16 d3/l57 0 2021-04-09T18:25:42.772 INFO:tasks.workunit.client.0.smithi120.stdout:3/253: unlink d3/d5/l2a 0 2021-04-09T18:25:42.775 INFO:tasks.workunit.client.0.smithi120.stdout:3/254: dread d3/de/d25/f22 [0,4194304] 0 2021-04-09T18:25:42.777 INFO:tasks.workunit.client.0.smithi120.stdout:3/255: write d3/f8 [183805,108961] 0 2021-04-09T18:25:42.779 INFO:tasks.workunit.client.0.smithi120.stdout:3/256: write d3/d5/d36/f10 [1927050,113517] 0 2021-04-09T18:25:42.780 INFO:tasks.workunit.client.0.smithi120.stdout:3/257: chown d3/de/f1b 0 1 2021-04-09T18:25:42.782 INFO:tasks.workunit.client.0.smithi120.stdout:3/258: symlink d3/l58 0 2021-04-09T18:25:42.786 INFO:tasks.workunit.client.0.smithi120.stdout:3/259: mkdir d3/de/d25/d2f/d59 0 2021-04-09T18:25:42.787 INFO:tasks.workunit.client.0.smithi120.stdout:2/220: dwrite d13/d15/f34 [0,4194304] 0 2021-04-09T18:25:42.789 INFO:tasks.workunit.client.0.smithi120.stdout:3/260: symlink d3/de/d25/d2f/d49/d4e/l5a 0 2021-04-09T18:25:42.801 INFO:tasks.workunit.client.0.smithi120.stdout:3/261: getdents d3/de/d25 0 2021-04-09T18:25:42.959 INFO:tasks.workunit.client.0.smithi120.stdout:8/172: sync 2021-04-09T18:25:42.959 INFO:tasks.workunit.client.0.smithi120.stdout:6/138: sync 2021-04-09T18:25:42.959 INFO:tasks.workunit.client.0.smithi120.stdout:9/186: sync 2021-04-09T18:25:42.960 INFO:tasks.workunit.client.0.smithi120.stdout:1/131: sync 2021-04-09T18:25:42.960 INFO:tasks.workunit.client.0.smithi120.stdout:3/262: rmdir d3/d5/d36/d1e 39 2021-04-09T18:25:42.961 INFO:tasks.workunit.client.0.smithi120.stdout:3/263: fsync d3/f37 0 2021-04-09T18:25:42.963 INFO:tasks.workunit.client.0.smithi120.stdout:3/264: mknod d3/de/d25/d2f/d49/d4e/d54/d55/c5b 1 2021-04-09T18:25:42.964 INFO:tasks.workunit.client.0.smithi120.stdout:1/132: symlink d5/d1f/l21 0 2021-04-09T18:25:42.965 INFO:tasks.workunit.client.0.smithi120.stdout:3/265: mknod d3/d5/c5c 1 2021-04-09T18:25:42.965 INFO:tasks.workunit.client.0.smithi120.stdout:3/266: chown f1 31329863 1 2021-04-09T18:25:42.967 INFO:tasks.workunit.client.0.smithi120.stdout:6/139: rename d6/d8/fd to d6/d8/db/d2b/f2e 0 2021-04-09T18:25:42.970 INFO:tasks.workunit.client.0.smithi120.stdout:6/140: readlink d6/d8/l21 0 2021-04-09T18:25:42.974 INFO:tasks.workunit.client.0.smithi120.stdout:6/141: dwrite d6/fc [0,4194304] 0 2021-04-09T18:25:42.979 INFO:tasks.workunit.client.0.smithi120.stdout:8/173: truncate d2/d3/d11/f26 198313 0 2021-04-09T18:25:42.982 INFO:tasks.workunit.client.0.smithi120.stdout:8/174: read d2/d3/f23 [1013445,35218] 0 2021-04-09T18:25:42.982 INFO:tasks.workunit.client.0.smithi120.stdout:8/175: readlink d2/d3/d11/d2a/l35 0 2021-04-09T18:25:42.983 INFO:tasks.workunit.client.0.smithi120.stdout:8/176: fsync d2/d27/f2f 0 2021-04-09T18:25:42.989 INFO:tasks.workunit.client.0.smithi120.stdout:9/187: dwrite f17 [0,4194304] 0 2021-04-09T18:25:42.993 INFO:tasks.workunit.client.0.smithi120.stdout:8/177: fsync d2/d3/d11/f36 0 2021-04-09T18:25:42.995 INFO:tasks.workunit.client.0.smithi120.stdout:1/133: getdents d5/d1f 0 2021-04-09T18:25:42.995 INFO:tasks.workunit.client.0.smithi120.stdout:8/178: chown d2/d3/f12 76587839 1 2021-04-09T18:25:42.996 INFO:tasks.workunit.client.0.smithi120.stdout:1/134: stat d5/d1f/l21 0 2021-04-09T18:25:42.996 INFO:tasks.workunit.client.0.smithi120.stdout:1/135: chown d5/l16 14716 1 2021-04-09T18:25:43.000 INFO:tasks.workunit.client.0.smithi120.stdout:8/179: write d2/d3/d11/f34 [378987,29131] 0 2021-04-09T18:25:43.001 INFO:tasks.workunit.client.0.smithi120.stdout:8/180: chown d2/d27/f2f 29 1 2021-04-09T18:25:43.001 INFO:tasks.workunit.client.0.smithi120.stdout:6/142: truncate d6/d8/f26 934267 0 2021-04-09T18:25:43.002 INFO:tasks.workunit.client.0.smithi120.stdout:8/181: dread - d2/d3/f28 zero size 2021-04-09T18:25:43.004 INFO:tasks.workunit.client.0.smithi120.stdout:3/267: truncate d3/de/d25/f22 597459 0 2021-04-09T18:25:43.006 INFO:tasks.workunit.client.0.smithi120.stdout:6/143: dread d6/fc [0,4194304] 0 2021-04-09T18:25:43.013 INFO:tasks.workunit.client.0.smithi120.stdout:6/144: rmdir d6/d8/db 39 2021-04-09T18:25:43.015 INFO:tasks.workunit.client.0.smithi120.stdout:2/221: dread d13/f25 [0,4194304] 0 2021-04-09T18:25:43.020 INFO:tasks.workunit.client.0.smithi120.stdout:6/145: fdatasync d6/d8/db/f24 0 2021-04-09T18:25:43.023 INFO:tasks.workunit.client.0.smithi120.stdout:2/222: dread d13/d15/f34 [0,4194304] 0 2021-04-09T18:25:43.023 INFO:tasks.workunit.client.0.smithi120.stdout:3/268: write d3/de/d25/d2f/d49/f4a [1722805,23076] 0 2021-04-09T18:25:43.026 INFO:tasks.workunit.client.0.smithi120.stdout:9/188: truncate d19/d1c/d29/f2b 1595336 0 2021-04-09T18:25:43.027 INFO:tasks.workunit.client.0.smithi120.stdout:1/136: write d5/f17 [240211,14951] 0 2021-04-09T18:25:43.029 INFO:tasks.workunit.client.0.smithi120.stdout:9/189: write fb [1825089,49631] 0 2021-04-09T18:25:43.033 INFO:tasks.workunit.client.0.smithi120.stdout:3/269: chown d3/d5/d36/d1e/d38/l47 3045087 1 2021-04-09T18:25:43.034 INFO:tasks.workunit.client.0.smithi120.stdout:6/146: rename d6/d8/db/f1c to d6/f2f 0 2021-04-09T18:25:43.034 INFO:tasks.workunit.client.0.smithi120.stdout:1/137: mkdir d5/d1f/d22 0 2021-04-09T18:25:43.036 INFO:tasks.workunit.client.0.smithi120.stdout:0/172: sync 2021-04-09T18:25:43.036 INFO:tasks.workunit.client.0.smithi120.stdout:9/190: rmdir d19/d1c 39 2021-04-09T18:25:43.037 INFO:tasks.workunit.client.0.smithi120.stdout:2/223: dread f4 [4194304,4194304] 0 2021-04-09T18:25:43.038 INFO:tasks.workunit.client.0.smithi120.stdout:1/138: readlink d5/l11 0 2021-04-09T18:25:43.041 INFO:tasks.workunit.client.0.smithi120.stdout:9/191: read - d19/f32 zero size 2021-04-09T18:25:43.041 INFO:tasks.workunit.client.0.smithi120.stdout:0/173: chown d0/d2/da/d23 59503 1 2021-04-09T18:25:43.042 INFO:tasks.workunit.client.0.smithi120.stdout:6/147: rename d6/d8/db/d12/d29 to d6/d8/db/d12/d22/d30 0 2021-04-09T18:25:43.047 INFO:tasks.workunit.client.0.smithi120.stdout:0/174: symlink d0/d2/da/l32 0 2021-04-09T18:25:43.049 INFO:tasks.workunit.client.0.smithi120.stdout:3/270: dread d3/d5/d36/d1e/f45 [0,4194304] 0 2021-04-09T18:25:43.049 INFO:tasks.workunit.client.0.smithi120.stdout:0/175: chown d0/d2/f26 11081172 1 2021-04-09T18:25:43.051 INFO:tasks.workunit.client.0.smithi120.stdout:0/176: mknod d0/d2/c33 1 2021-04-09T18:25:43.051 INFO:tasks.workunit.client.0.smithi120.stdout:9/192: unlink d19/d1c/f21 0 2021-04-09T18:25:43.052 INFO:tasks.workunit.client.0.smithi120.stdout:6/148: dread d6/d8/db/d12/d22/f2a [0,4194304] 0 2021-04-09T18:25:43.055 INFO:tasks.workunit.client.0.smithi120.stdout:2/224: dwrite d13/f14 [0,4194304] 0 2021-04-09T18:25:43.056 INFO:tasks.workunit.client.0.smithi120.stdout:9/193: creat d19/d2c/f3f x:0 0 0 2021-04-09T18:25:43.059 INFO:tasks.workunit.client.0.smithi120.stdout:0/177: dread d0/d2/da/f19 [0,4194304] 0 2021-04-09T18:25:43.060 INFO:tasks.workunit.client.0.smithi120.stdout:0/178: readlink d0/d2/dd/l8 0 2021-04-09T18:25:43.069 INFO:tasks.workunit.client.0.smithi120.stdout:3/271: creat d3/de/d25/d2f/d59/f5d x:0 0 0 2021-04-09T18:25:43.073 INFO:tasks.workunit.client.0.smithi120.stdout:9/194: mkdir d19/d24/d37/d40 0 2021-04-09T18:25:43.073 INFO:tasks.workunit.client.0.smithi120.stdout:1/139: truncate d5/f7 1303973 0 2021-04-09T18:25:43.074 INFO:tasks.workunit.client.0.smithi120.stdout:3/272: mkdir d3/de/d25/d2f/d49/d5e 0 2021-04-09T18:25:43.075 INFO:tasks.workunit.client.0.smithi120.stdout:0/179: creat d0/d2/d4/f34 x:0 0 0 2021-04-09T18:25:43.077 INFO:tasks.workunit.client.0.smithi120.stdout:2/225: write d13/f2e [1353094,114358] 0 2021-04-09T18:25:43.079 INFO:tasks.workunit.client.0.smithi120.stdout:0/180: readlink d0/d2/da/l32 0 2021-04-09T18:25:43.083 INFO:tasks.workunit.client.0.smithi120.stdout:1/140: chown d5/l14 7059503 1 2021-04-09T18:25:43.084 INFO:tasks.workunit.client.0.smithi120.stdout:9/195: write d19/d24/f28 [127464,119736] 0 2021-04-09T18:25:43.086 INFO:tasks.workunit.client.0.smithi120.stdout:9/196: read - d19/f1b zero size 2021-04-09T18:25:43.086 INFO:tasks.workunit.client.0.smithi120.stdout:2/226: link d13/f2e d13/f4e 0 2021-04-09T18:25:43.093 INFO:tasks.workunit.client.0.smithi120.stdout:6/149: dwrite d6/d8/db/d12/d22/f27 [0,4194304] 0 2021-04-09T18:25:43.094 INFO:tasks.workunit.client.0.smithi120.stdout:1/141: symlink d5/l23 0 2021-04-09T18:25:43.098 INFO:tasks.workunit.client.0.smithi120.stdout:9/197: symlink d19/d24/d37/d40/l41 0 2021-04-09T18:25:43.098 INFO:tasks.workunit.client.0.smithi120.stdout:6/150: mkdir d6/d8/db/d12/d22/d30/d31 0 2021-04-09T18:25:43.099 INFO:tasks.workunit.client.0.smithi120.stdout:9/198: stat f16 0 2021-04-09T18:25:43.104 INFO:tasks.workunit.client.0.smithi120.stdout:6/151: symlink d6/d8/db/d12/d22/l32 0 2021-04-09T18:25:43.105 INFO:tasks.workunit.client.0.smithi120.stdout:1/142: mkdir d5/d1f/d22/d24 0 2021-04-09T18:25:43.106 INFO:tasks.workunit.client.0.smithi120.stdout:9/199: chown d19/d1c/d29/l39 45879 1 2021-04-09T18:25:43.112 INFO:tasks.workunit.client.0.smithi120.stdout:3/273: truncate d3/de/d25/d2f/d59/f5d 700155 0 2021-04-09T18:25:43.112 INFO:tasks.workunit.client.0.smithi120.stdout:0/181: truncate d0/d2/f26 361732 0 2021-04-09T18:25:43.115 INFO:tasks.workunit.client.0.smithi120.stdout:1/143: rename d5/d1f/l1a to d5/d1f/d22/l25 0 2021-04-09T18:25:43.117 INFO:tasks.workunit.client.0.smithi120.stdout:6/152: write d6/d8/db/d12/f1f [419398,11560] 0 2021-04-09T18:25:43.118 INFO:tasks.workunit.client.0.smithi120.stdout:1/144: fdatasync d5/d1f/f15 0 2021-04-09T18:25:43.118 INFO:tasks.workunit.client.0.smithi120.stdout:5/242: sync 2021-04-09T18:25:43.118 INFO:tasks.workunit.client.0.smithi120.stdout:4/197: sync 2021-04-09T18:25:43.119 INFO:tasks.workunit.client.0.smithi120.stdout:7/157: sync 2021-04-09T18:25:43.121 INFO:tasks.workunit.client.0.smithi120.stdout:7/158: dread - db/d26/f2d zero size 2021-04-09T18:25:43.122 INFO:tasks.workunit.client.0.smithi120.stdout:2/227: dwrite d13/d1b/f2f [0,4194304] 0 2021-04-09T18:25:43.126 INFO:tasks.workunit.client.0.smithi120.stdout:3/274: rename d3/d5/d36/d1e/f45 to d3/de/d25/d2f/d49/d4e/d54/f5f 0 2021-04-09T18:25:43.129 INFO:tasks.workunit.client.0.smithi120.stdout:6/153: read d6/d8/f26 [792106,49781] 0 2021-04-09T18:25:43.130 INFO:tasks.workunit.client.0.smithi120.stdout:7/159: creat db/d2c/d30/f39 x:0 0 0 2021-04-09T18:25:43.132 INFO:tasks.workunit.client.0.smithi120.stdout:7/160: stat db/d26/f2e 0 2021-04-09T18:25:43.138 INFO:tasks.workunit.client.0.smithi120.stdout:1/145: creat d5/d1f/d22/d24/f26 x:0 0 0 2021-04-09T18:25:43.141 INFO:tasks.workunit.client.0.smithi120.stdout:6/154: dread d6/d8/db/d12/d22/f23 [0,4194304] 0 2021-04-09T18:25:43.142 INFO:tasks.workunit.client.0.smithi120.stdout:9/200: getdents d19/d2c 0 2021-04-09T18:25:43.143 INFO:tasks.workunit.client.0.smithi120.stdout:7/161: symlink db/d26/l3a 0 2021-04-09T18:25:43.144 INFO:tasks.workunit.client.0.smithi120.stdout:2/228: symlink d13/d1b/d48/d49/l4f 0 2021-04-09T18:25:43.146 INFO:tasks.workunit.client.0.smithi120.stdout:6/155: write d6/d8/db/d12/f1f [139105,57157] 0 2021-04-09T18:25:43.146 INFO:tasks.workunit.client.0.smithi120.stdout:0/182: truncate d0/d2/d4/f13 4498301 0 2021-04-09T18:25:43.150 INFO:tasks.workunit.client.0.smithi120.stdout:7/162: readlink db/l14 0 2021-04-09T18:25:43.150 INFO:tasks.workunit.client.0.smithi120.stdout:9/201: rmdir d19/d24 39 2021-04-09T18:25:43.151 INFO:tasks.workunit.client.0.smithi120.stdout:2/229: rmdir d13/d1b 39 2021-04-09T18:25:43.153 INFO:tasks.workunit.client.0.smithi120.stdout:5/243: truncate d10/d12/f2e 783912 0 2021-04-09T18:25:43.154 INFO:tasks.workunit.client.0.smithi120.stdout:1/146: rename d5/f1d to d5/d1f/d22/f27 0 2021-04-09T18:25:43.155 INFO:tasks.workunit.client.0.smithi120.stdout:3/275: dwrite d3/d5/d36/f23 [0,4194304] 0 2021-04-09T18:25:43.156 INFO:tasks.workunit.client.0.smithi120.stdout:0/183: rmdir d0 39 2021-04-09T18:25:43.156 INFO:tasks.workunit.client.0.smithi120.stdout:7/163: chown db/d2c/d30/l37 10 1 2021-04-09T18:25:43.158 INFO:tasks.workunit.client.0.smithi120.stdout:4/198: dwrite d1f/d2c/f2e [0,4194304] 0 2021-04-09T18:25:43.160 INFO:tasks.workunit.client.0.smithi120.stdout:3/276: chown d3/de/d25/d2f/d49/d4e/d54/f5f 44 1 2021-04-09T18:25:43.162 INFO:tasks.workunit.client.0.smithi120.stdout:3/277: chown d3/f42 5857 1 2021-04-09T18:25:43.162 INFO:tasks.workunit.client.0.smithi120.stdout:5/244: chown d10/d12/d1b/d1f/l28 7824 1 2021-04-09T18:25:43.162 INFO:tasks.workunit.client.0.smithi120.stdout:9/202: symlink d19/d24/d37/l42 0 2021-04-09T18:25:43.163 INFO:tasks.workunit.client.0.smithi120.stdout:4/199: chown lc 404738 1 2021-04-09T18:25:43.167 INFO:tasks.workunit.client.0.smithi120.stdout:1/147: mkdir d5/d1f/d22/d24/d28 0 2021-04-09T18:25:43.171 INFO:tasks.workunit.client.0.smithi120.stdout:1/148: chown d5/l14 188559978 1 2021-04-09T18:25:43.171 INFO:tasks.workunit.client.0.smithi120.stdout:7/164: symlink db/d2c/d30/l3b 0 2021-04-09T18:25:43.171 INFO:tasks.workunit.client.0.smithi120.stdout:6/156: dread d6/d8/f13 [0,4194304] 0 2021-04-09T18:25:43.177 INFO:tasks.workunit.client.0.smithi120.stdout:3/278: creat d3/de/d25/d2f/d49/d4e/f60 x:0 0 0 2021-04-09T18:25:43.177 INFO:tasks.workunit.client.0.smithi120.stdout:9/203: creat d19/d24/d37/f43 x:0 0 0 2021-04-09T18:25:43.178 INFO:tasks.workunit.client.0.smithi120.stdout:4/200: unlink d1f/d2c/d30/f3d 0 2021-04-09T18:25:43.178 INFO:tasks.workunit.client.0.smithi120.stdout:7/165: rmdir db/d2c/d30 39 2021-04-09T18:25:43.179 INFO:tasks.workunit.client.0.smithi120.stdout:9/204: chown f12 1976317 1 2021-04-09T18:25:43.179 INFO:tasks.workunit.client.0.smithi120.stdout:1/149: creat d5/d1f/d22/d24/f29 x:0 0 0 2021-04-09T18:25:43.179 INFO:tasks.workunit.client.0.smithi120.stdout:9/205: mknod d19/d2c/c44 1 2021-04-09T18:25:43.183 INFO:tasks.workunit.client.0.smithi120.stdout:6/157: creat d6/d8/db/d12/d22/d30/f33 x:0 0 0 2021-04-09T18:25:43.185 INFO:tasks.workunit.client.0.smithi120.stdout:6/158: write d6/d8/f25 [4592815,91760] 0 2021-04-09T18:25:43.187 INFO:tasks.workunit.client.0.smithi120.stdout:7/166: dread f7 [0,4194304] 0 2021-04-09T18:25:43.190 INFO:tasks.workunit.client.0.smithi120.stdout:1/150: dwrite d5/d1f/f15 [0,4194304] 0 2021-04-09T18:25:43.193 INFO:tasks.workunit.client.0.smithi120.stdout:1/151: mknod d5/d1f/c2a 1 2021-04-09T18:25:43.193 INFO:tasks.workunit.client.0.smithi120.stdout:9/206: dwrite d19/d1c/f27 [0,4194304] 0 2021-04-09T18:25:43.197 INFO:tasks.workunit.client.0.smithi120.stdout:4/201: creat d1f/d2c/d3b/d3e/f43 x:0 0 0 2021-04-09T18:25:43.198 INFO:tasks.workunit.client.0.smithi120.stdout:4/202: mknod d1f/d2c/d30/c44 1 2021-04-09T18:25:43.198 INFO:tasks.workunit.client.0.smithi120.stdout:6/159: dread d6/d8/db/d12/f1f [0,4194304] 0 2021-04-09T18:25:43.199 INFO:tasks.workunit.client.0.smithi120.stdout:9/207: rmdir d19/d1c 39 2021-04-09T18:25:43.200 INFO:tasks.workunit.client.0.smithi120.stdout:9/208: chown d19/f38 26054710 1 2021-04-09T18:25:43.200 INFO:tasks.workunit.client.0.smithi120.stdout:6/160: readlink d6/d8/l21 0 2021-04-09T18:25:43.201 INFO:tasks.workunit.client.0.smithi120.stdout:7/167: mkdir db/d38/d3c 0 2021-04-09T18:25:43.201 INFO:tasks.workunit.client.0.smithi120.stdout:7/168: readlink l9 0 2021-04-09T18:25:43.202 INFO:tasks.workunit.client.0.smithi120.stdout:2/230: truncate d13/d1b/f33 456833 0 2021-04-09T18:25:43.202 INFO:tasks.workunit.client.0.smithi120.stdout:7/169: chown db/f1a 1147744 1 2021-04-09T18:25:43.203 INFO:tasks.workunit.client.0.smithi120.stdout:4/203: symlink d1f/d2f/l45 0 2021-04-09T18:25:43.205 INFO:tasks.workunit.client.0.smithi120.stdout:6/161: creat d6/d8/d1a/f34 x:0 0 0 2021-04-09T18:25:43.207 INFO:tasks.workunit.client.0.smithi120.stdout:6/162: dread - d6/d8/db/d12/f18 zero size 2021-04-09T18:25:43.207 INFO:tasks.workunit.client.0.smithi120.stdout:2/231: dread d13/d1b/f44 [0,4194304] 0 2021-04-09T18:25:43.208 INFO:tasks.workunit.client.0.smithi120.stdout:7/170: dread db/fd [0,4194304] 0 2021-04-09T18:25:43.208 INFO:tasks.workunit.client.0.smithi120.stdout:9/209: getdents d19/d2c 0 2021-04-09T18:25:43.209 INFO:tasks.workunit.client.0.smithi120.stdout:2/232: mknod d13/d1b/d48/d49/c50 1 2021-04-09T18:25:43.209 INFO:tasks.workunit.client.0.smithi120.stdout:7/171: dread - db/f2f zero size 2021-04-09T18:25:43.210 INFO:tasks.workunit.client.0.smithi120.stdout:9/210: chown d19/d24/d37/d40 1865 1 2021-04-09T18:25:43.210 INFO:tasks.workunit.client.0.smithi120.stdout:2/233: mknod d13/d1b/d48/d49/c51 1 2021-04-09T18:25:43.211 INFO:tasks.workunit.client.0.smithi120.stdout:9/211: chown d19/d24/d37/d40 193 1 2021-04-09T18:25:43.214 INFO:tasks.workunit.client.0.smithi120.stdout:4/204: creat d1f/d24/f46 x:0 0 0 2021-04-09T18:25:43.222 INFO:tasks.workunit.client.0.smithi120.stdout:4/205: read d1f/f40 [849578,62429] 0 2021-04-09T18:25:43.223 INFO:tasks.workunit.client.0.smithi120.stdout:9/212: rename f9 to d19/d24/d36/f45 0 2021-04-09T18:25:43.227 INFO:tasks.workunit.client.0.smithi120.stdout:7/172: creat db/d38/d3c/f3d x:0 0 0 2021-04-09T18:25:43.228 INFO:tasks.workunit.client.0.smithi120.stdout:7/173: write db/f27 [4769320,91376] 0 2021-04-09T18:25:43.230 INFO:tasks.workunit.client.0.smithi120.stdout:7/174: chown db/d38/d3c 34929890 1 2021-04-09T18:25:43.232 INFO:tasks.workunit.client.0.smithi120.stdout:6/163: creat d6/d8/f35 x:0 0 0 2021-04-09T18:25:43.232 INFO:tasks.workunit.client.0.smithi120.stdout:2/234: link d13/d15/d35/l4c d13/d1b/l52 0 2021-04-09T18:25:43.233 INFO:tasks.workunit.client.0.smithi120.stdout:7/175: mknod db/c3e 1 2021-04-09T18:25:43.233 INFO:tasks.workunit.client.0.smithi120.stdout:7/176: mknod db/d38/c3f 1 2021-04-09T18:25:43.235 INFO:tasks.workunit.client.0.smithi120.stdout:4/206: dwrite d1f/f3f [4194304,4194304] 0 2021-04-09T18:25:43.241 INFO:tasks.workunit.client.0.smithi120.stdout:6/164: mkdir d6/d8/d1a/d36 0 2021-04-09T18:25:43.242 INFO:tasks.workunit.client.0.smithi120.stdout:4/207: creat d1f/f47 x:0 0 0 2021-04-09T18:25:43.242 INFO:tasks.workunit.client.0.smithi120.stdout:6/165: fdatasync d6/d8/f25 0 2021-04-09T18:25:43.243 INFO:tasks.workunit.client.0.smithi120.stdout:2/235: write d13/d1b/d48/d49/f4b [9622289,63888] 0 2021-04-09T18:25:43.244 INFO:tasks.workunit.client.0.smithi120.stdout:2/236: chown d13/l36 0 1 2021-04-09T18:25:43.250 INFO:tasks.workunit.client.0.smithi120.stdout:2/237: dread f9 [0,4194304] 0 2021-04-09T18:25:43.259 INFO:tasks.workunit.client.0.smithi120.stdout:6/166: dwrite d6/fc [4194304,4194304] 0 2021-04-09T18:25:43.262 INFO:tasks.workunit.client.0.smithi120.stdout:4/208: write d1f/d24/f25 [1361000,16941] 0 2021-04-09T18:25:43.263 INFO:tasks.workunit.client.0.smithi120.stdout:9/213: truncate d19/d1c/f27 2117631 0 2021-04-09T18:25:43.263 INFO:tasks.workunit.client.0.smithi120.stdout:4/209: write d1f/d24/f46 [997126,57171] 0 2021-04-09T18:25:43.264 INFO:tasks.workunit.client.0.smithi120.stdout:2/238: rename d13/f4e to d13/d15/d35/f53 0 2021-04-09T18:25:43.267 INFO:tasks.workunit.client.0.smithi120.stdout:9/214: creat d19/d2c/f46 x:0 0 0 2021-04-09T18:25:43.273 INFO:tasks.workunit.client.0.smithi120.stdout:8/182: dread d2/d27/f29 [0,4194304] 0 2021-04-09T18:25:43.284 INFO:tasks.workunit.client.0.smithi120.stdout:2/239: dread d13/d1b/d48/d49/f4b [12582912,4194304] 0 2021-04-09T18:25:43.285 INFO:tasks.workunit.client.0.smithi120.stdout:2/240: write d13/f19 [540593,4991] 0 2021-04-09T18:25:43.290 INFO:tasks.workunit.client.0.smithi120.stdout:2/241: dwrite d13/d15/f2a [0,4194304] 0 2021-04-09T18:25:43.292 INFO:tasks.workunit.client.0.smithi120.stdout:2/242: write d13/d15/d35/f3e [526196,43867] 0 2021-04-09T18:25:43.292 INFO:tasks.workunit.client.0.smithi120.stdout:2/243: stat f9 0 2021-04-09T18:25:43.295 INFO:tasks.workunit.client.0.smithi120.stdout:6/167: getdents d6/d8/db/d12/d22/d30/d31 0 2021-04-09T18:25:43.299 INFO:tasks.workunit.client.0.smithi120.stdout:6/168: chown d6/d8/db/d12/f1f 6 1 2021-04-09T18:25:43.299 INFO:tasks.workunit.client.0.smithi120.stdout:4/210: dwrite f7 [0,4194304] 0 2021-04-09T18:25:43.311 INFO:tasks.workunit.client.0.smithi120.stdout:4/211: read d1f/f23 [233825,83116] 0 2021-04-09T18:25:43.311 INFO:tasks.workunit.client.0.smithi120.stdout:6/169: read d6/d8/db/d2b/f2e [6569511,37661] 0 2021-04-09T18:25:43.325 INFO:tasks.workunit.client.0.smithi120.stdout:2/244: mkdir d13/d1b/d54 0 2021-04-09T18:25:43.328 INFO:tasks.workunit.client.0.smithi120.stdout:2/245: chown d13/l28 1 1 2021-04-09T18:25:43.328 INFO:tasks.workunit.client.0.smithi120.stdout:4/212: dwrite d1f/f3f [0,4194304] 0 2021-04-09T18:25:43.329 INFO:tasks.workunit.client.0.smithi120.stdout:2/246: stat d13/d15/l41 0 2021-04-09T18:25:43.329 INFO:tasks.workunit.client.0.smithi120.stdout:4/213: fsync d1f/d24/f33 0 2021-04-09T18:25:43.332 INFO:tasks.workunit.client.0.smithi120.stdout:6/170: rmdir d6/d8/db 39 2021-04-09T18:25:43.333 INFO:tasks.workunit.client.0.smithi120.stdout:8/183: link d2/d3/d11/ff d2/d3/d11/d2a/f38 0 2021-04-09T18:25:43.336 INFO:tasks.workunit.client.0.smithi120.stdout:4/214: creat d1f/d2c/d3b/d3e/f48 x:0 0 0 2021-04-09T18:25:43.341 INFO:tasks.workunit.client.0.smithi120.stdout:8/184: rmdir d2/d27 39 2021-04-09T18:25:43.342 INFO:tasks.workunit.client.0.smithi120.stdout:2/247: symlink d13/l55 0 2021-04-09T18:25:43.343 INFO:tasks.workunit.client.0.smithi120.stdout:2/248: stat d13/d15/f2d 0 2021-04-09T18:25:43.344 INFO:tasks.workunit.client.0.smithi120.stdout:2/249: fdatasync d13/f2c 0 2021-04-09T18:25:43.546 INFO:tasks.workunit.client.0.smithi120.stdout:0/184: sync 2021-04-09T18:25:43.546 INFO:tasks.workunit.client.0.smithi120.stdout:1/152: sync 2021-04-09T18:25:43.547 INFO:tasks.workunit.client.0.smithi120.stdout:1/153: readlink d5/l23 0 2021-04-09T18:25:43.549 INFO:tasks.workunit.client.0.smithi120.stdout:2/250: symlink d13/d1b/d48/d49/l56 0 2021-04-09T18:25:43.549 INFO:tasks.workunit.client.0.smithi120.stdout:4/215: mkdir d1f/d24/d42/d49 0 2021-04-09T18:25:43.552 INFO:tasks.workunit.client.0.smithi120.stdout:6/171: mkdir d6/d8/db/d12/d22/d30/d31/d37 0 2021-04-09T18:25:43.553 INFO:tasks.workunit.client.0.smithi120.stdout:1/154: mkdir d5/d1f/d22/d2b 0 2021-04-09T18:25:43.555 INFO:tasks.workunit.client.0.smithi120.stdout:4/216: mkdir d1f/d4a 0 2021-04-09T18:25:43.557 INFO:tasks.workunit.client.0.smithi120.stdout:0/185: rename d0/d2/d4/f34 to d0/d2/da/d23/f35 0 2021-04-09T18:25:43.557 INFO:tasks.workunit.client.0.smithi120.stdout:0/186: mknod d0/d2/d4/c36 1 2021-04-09T18:25:43.559 INFO:tasks.workunit.client.0.smithi120.stdout:8/185: creat d2/f39 x:0 0 0 2021-04-09T18:25:43.560 INFO:tasks.workunit.client.0.smithi120.stdout:8/186: mknod d2/d37/c3a 1 2021-04-09T18:25:43.561 INFO:tasks.workunit.client.0.smithi120.stdout:4/217: mkdir d1f/d2f/d4b 0 2021-04-09T18:25:43.562 INFO:tasks.workunit.client.0.smithi120.stdout:4/218: chown d1f/d24/f25 14180550 1 2021-04-09T18:25:43.562 INFO:tasks.workunit.client.0.smithi120.stdout:4/219: write d1f/f32 [3400894,94549] 0 2021-04-09T18:25:43.565 INFO:tasks.workunit.client.0.smithi120.stdout:0/187: creat d0/d2/da/f37 x:0 0 0 2021-04-09T18:25:43.568 INFO:tasks.workunit.client.0.smithi120.stdout:1/155: rename d5/fc to d5/d1f/d22/f2c 0 2021-04-09T18:25:43.571 INFO:tasks.workunit.client.0.smithi120.stdout:2/251: truncate d13/d15/f42 155985 0 2021-04-09T18:25:43.577 INFO:tasks.workunit.client.0.smithi120.stdout:8/187: rename d2/d3/d11/d2a to d2/d3/d11/d2c/d2e/d3b 0 2021-04-09T18:25:43.584 INFO:tasks.workunit.client.0.smithi120.stdout:6/172: truncate d6/d8/db/f2c 852408 0 2021-04-09T18:25:43.585 INFO:tasks.workunit.client.0.smithi120.stdout:8/188: dwrite d2/d3/d11/f1f [0,4194304] 0 2021-04-09T18:25:43.586 INFO:tasks.workunit.client.0.smithi120.stdout:2/252: link d13/d15/f34 d13/d1b/d48/f57 0 2021-04-09T18:25:43.587 INFO:tasks.workunit.client.0.smithi120.stdout:2/253: chown d13/d15/d35/f53 6046123 1 2021-04-09T18:25:43.588 INFO:tasks.workunit.client.0.smithi120.stdout:8/189: chown d2/d3/d11/f34 18899523 1 2021-04-09T18:25:43.593 INFO:tasks.workunit.client.0.smithi120.stdout:6/173: symlink d6/d8/db/d12/d22/l38 0 2021-04-09T18:25:43.600 INFO:tasks.workunit.client.0.smithi120.stdout:0/188: dread d0/f20 [0,4194304] 0 2021-04-09T18:25:43.606 INFO:tasks.workunit.client.0.smithi120.stdout:6/174: dwrite d6/f2f [0,4194304] 0 2021-04-09T18:25:43.608 INFO:tasks.workunit.client.0.smithi120.stdout:4/220: truncate d1f/d24/f26 3112139 0 2021-04-09T18:25:43.612 INFO:tasks.workunit.client.0.smithi120.stdout:6/175: dwrite d6/f2f [0,4194304] 0 2021-04-09T18:25:43.613 INFO:tasks.workunit.client.0.smithi120.stdout:6/176: stat d6/d8/f26 0 2021-04-09T18:25:43.614 INFO:tasks.workunit.client.0.smithi120.stdout:4/221: rename d1f/f47 to d1f/d2c/d3b/f4c 0 2021-04-09T18:25:43.615 INFO:tasks.workunit.client.0.smithi120.stdout:4/222: rmdir d1f/d24/d42 39 2021-04-09T18:25:43.617 INFO:tasks.workunit.client.0.smithi120.stdout:4/223: write d1f/f32 [3425012,74243] 0 2021-04-09T18:25:43.619 INFO:tasks.workunit.client.0.smithi120.stdout:4/224: fsync d1f/d24/f33 0 2021-04-09T18:25:43.620 INFO:tasks.workunit.client.0.smithi120.stdout:6/177: creat d6/d8/db/f39 x:0 0 0 2021-04-09T18:25:43.621 INFO:tasks.workunit.client.0.smithi120.stdout:4/225: stat d1f/d24/f46 0 2021-04-09T18:25:43.621 INFO:tasks.workunit.client.0.smithi120.stdout:0/189: dwrite d0/fc [4194304,4194304] 0 2021-04-09T18:25:43.624 INFO:tasks.workunit.client.0.smithi120.stdout:6/178: rmdir d6 39 2021-04-09T18:25:43.624 INFO:tasks.workunit.client.0.smithi120.stdout:0/190: fsync d0/d2/da/d23/f2f 0 2021-04-09T18:25:43.625 INFO:tasks.workunit.client.0.smithi120.stdout:4/226: creat d1f/d2c/d30/f4d x:0 0 0 2021-04-09T18:25:43.629 INFO:tasks.workunit.client.0.smithi120.stdout:4/227: creat d1f/d2c/d3b/d3e/f4e x:0 0 0 2021-04-09T18:25:43.630 INFO:tasks.workunit.client.0.smithi120.stdout:6/179: mkdir d6/d8/d3a 0 2021-04-09T18:25:43.636 INFO:tasks.workunit.client.0.smithi120.stdout:0/191: dread d0/f20 [0,4194304] 0 2021-04-09T18:25:43.639 INFO:tasks.workunit.client.0.smithi120.stdout:4/228: write d1f/d2c/d30/f4d [153506,11278] 0 2021-04-09T18:25:43.641 INFO:tasks.workunit.client.0.smithi120.stdout:6/180: dwrite d6/d8/db/d12/d22/f27 [0,4194304] 0 2021-04-09T18:25:43.643 INFO:tasks.workunit.client.0.smithi120.stdout:0/192: fdatasync d0/f30 0 2021-04-09T18:25:43.647 INFO:tasks.workunit.client.0.smithi120.stdout:4/229: rename d1f/d4a to d1f/d2f/d4f 0 2021-04-09T18:25:43.653 INFO:tasks.workunit.client.0.smithi120.stdout:0/193: dwrite d0/f30 [0,4194304] 0 2021-04-09T18:25:43.658 INFO:tasks.workunit.client.0.smithi120.stdout:4/230: dwrite d1f/d2c/d30/f4d [0,4194304] 0 2021-04-09T18:25:43.662 INFO:tasks.workunit.client.0.smithi120.stdout:6/181: write d6/d8/db/f2c [1318519,66226] 0 2021-04-09T18:25:43.679 INFO:tasks.workunit.client.0.smithi120.stdout:4/231: getdents d1f/d24 0 2021-04-09T18:25:43.679 INFO:tasks.workunit.client.0.smithi120.stdout:6/182: dread d6/d8/f25 [0,4194304] 0 2021-04-09T18:25:43.682 INFO:tasks.workunit.client.0.smithi120.stdout:6/183: stat d6/d8/db/f1b 0 2021-04-09T18:25:43.684 INFO:tasks.workunit.client.0.smithi120.stdout:7/177: sync 2021-04-09T18:25:43.685 INFO:tasks.workunit.client.0.smithi120.stdout:5/245: sync 2021-04-09T18:25:43.685 INFO:tasks.workunit.client.0.smithi120.stdout:9/215: sync 2021-04-09T18:25:43.686 INFO:tasks.workunit.client.0.smithi120.stdout:3/279: sync 2021-04-09T18:25:43.687 INFO:tasks.workunit.client.0.smithi120.stdout:5/246: write d10/f11 [1231195,24612] 0 2021-04-09T18:25:43.689 INFO:tasks.workunit.client.0.smithi120.stdout:0/194: truncate d0/d2/d4/f13 3384120 0 2021-04-09T18:25:43.689 INFO:tasks.workunit.client.0.smithi120.stdout:4/232: symlink d1f/d24/d42/l50 0 2021-04-09T18:25:43.693 INFO:tasks.workunit.client.0.smithi120.stdout:9/216: rmdir d19/d24/d37 39 2021-04-09T18:25:43.699 INFO:tasks.workunit.client.0.smithi120.stdout:3/280: mkdir d3/d5/d36/d1e/d38/d61 0 2021-04-09T18:25:43.699 INFO:tasks.workunit.client.0.smithi120.stdout:0/195: unlink d0/f20 0 2021-04-09T18:25:43.703 INFO:tasks.workunit.client.0.smithi120.stdout:9/217: rmdir d19/d24/d36 39 2021-04-09T18:25:43.704 INFO:tasks.workunit.client.0.smithi120.stdout:4/233: rename d1f/d2c/d3b/d3e/f4e to d1f/d2c/d34/f51 0 2021-04-09T18:25:43.705 INFO:tasks.workunit.client.0.smithi120.stdout:7/178: write db/f1b [3895224,37844] 0 2021-04-09T18:25:43.708 INFO:tasks.workunit.client.0.smithi120.stdout:0/196: creat d0/d2/dd/f38 x:0 0 0 2021-04-09T18:25:43.708 INFO:tasks.workunit.client.0.smithi120.stdout:0/197: fsync d0/d2/da/d23/f2f 0 2021-04-09T18:25:43.712 INFO:tasks.workunit.client.0.smithi120.stdout:0/198: write d0/d2/da/f19 [8623879,26095] 0 2021-04-09T18:25:43.713 INFO:tasks.workunit.client.0.smithi120.stdout:4/234: rmdir d1f/d2f 39 2021-04-09T18:25:43.715 INFO:tasks.workunit.client.0.smithi120.stdout:4/235: rename d1f/d24 to d1f/d24/d52 22 2021-04-09T18:25:43.717 INFO:tasks.workunit.client.0.smithi120.stdout:5/247: link d10/l58 d10/d12/d3b/l61 0 2021-04-09T18:25:43.718 INFO:tasks.workunit.client.0.smithi120.stdout:6/184: dwrite d6/d8/f26 [0,4194304] 0 2021-04-09T18:25:43.721 INFO:tasks.workunit.client.0.smithi120.stdout:0/199: getdents d0/d2/da/d2e 0 2021-04-09T18:25:43.723 INFO:tasks.workunit.client.0.smithi120.stdout:3/281: dread d3/de/d25/d2f/d49/d4e/d54/f5f [0,4194304] 0 2021-04-09T18:25:43.724 INFO:tasks.workunit.client.0.smithi120.stdout:6/185: mknod d6/d8/db/d12/d22/d30/d31/d37/c3b 1 2021-04-09T18:25:43.726 INFO:tasks.workunit.client.0.smithi120.stdout:9/218: unlink d19/d24/d37/f43 0 2021-04-09T18:25:43.727 INFO:tasks.workunit.client.0.smithi120.stdout:5/248: mknod d10/d12/d35/c62 1 2021-04-09T18:25:43.732 INFO:tasks.workunit.client.0.smithi120.stdout:7/179: dwrite db/f1b [0,4194304] 0 2021-04-09T18:25:43.736 INFO:tasks.workunit.client.0.smithi120.stdout:4/236: dread f7 [0,4194304] 0 2021-04-09T18:25:43.742 INFO:tasks.workunit.client.0.smithi120.stdout:7/180: creat db/d38/f40 x:0 0 0 2021-04-09T18:25:43.745 INFO:tasks.workunit.client.0.smithi120.stdout:0/200: dwrite d0/d2/f27 [4194304,4194304] 0 2021-04-09T18:25:43.746 INFO:tasks.workunit.client.0.smithi120.stdout:9/219: mkdir d19/d24/d36/d47 0 2021-04-09T18:25:43.748 INFO:tasks.workunit.client.0.smithi120.stdout:7/181: write db/d26/f2d [529109,72690] 0 2021-04-09T18:25:43.753 INFO:tasks.workunit.client.0.smithi120.stdout:0/201: chown d0/d2/da/d23/f35 10472 1 2021-04-09T18:25:43.753 INFO:tasks.workunit.client.0.smithi120.stdout:0/202: write d0/f30 [199930,98765] 0 2021-04-09T18:25:43.755 INFO:tasks.workunit.client.0.smithi120.stdout:4/237: dwrite d1f/d2c/d30/f4d [0,4194304] 0 2021-04-09T18:25:43.768 INFO:tasks.workunit.client.0.smithi120.stdout:9/220: unlink d19/d1c/d29/l39 0 2021-04-09T18:25:43.769 INFO:tasks.workunit.client.0.smithi120.stdout:5/249: dwrite d10/f16 [0,4194304] 0 2021-04-09T18:25:43.770 INFO:tasks.workunit.client.0.smithi120.stdout:7/182: fdatasync db/d26/f2e 0 2021-04-09T18:25:43.770 INFO:tasks.workunit.client.0.smithi120.stdout:6/186: truncate d6/d8/db/d12/d22/f23 1242658 0 2021-04-09T18:25:43.770 INFO:tasks.workunit.client.0.smithi120.stdout:0/203: rmdir d0/d2 39 2021-04-09T18:25:43.771 INFO:tasks.workunit.client.0.smithi120.stdout:4/238: rename d1f/f3f to d1f/d2c/d3b/f53 0 2021-04-09T18:25:43.771 INFO:tasks.workunit.client.0.smithi120.stdout:9/221: write f12 [1389663,126213] 0 2021-04-09T18:25:43.772 INFO:tasks.workunit.client.0.smithi120.stdout:5/250: chown d10/l13 558 1 2021-04-09T18:25:43.774 INFO:tasks.workunit.client.0.smithi120.stdout:5/251: fsync d10/f51 0 2021-04-09T18:25:43.776 INFO:tasks.workunit.client.0.smithi120.stdout:5/252: dread - d10/f48 zero size 2021-04-09T18:25:43.777 INFO:tasks.workunit.client.0.smithi120.stdout:4/239: write d1f/f28 [918705,6910] 0 2021-04-09T18:25:43.777 INFO:tasks.workunit.client.0.smithi120.stdout:7/183: write db/d26/f2d [97901,70753] 0 2021-04-09T18:25:43.779 INFO:tasks.workunit.client.0.smithi120.stdout:4/240: write fe [1115891,83493] 0 2021-04-09T18:25:43.780 INFO:tasks.workunit.client.0.smithi120.stdout:5/253: dread - d10/d12/d1b/d1f/f4e zero size 2021-04-09T18:25:43.784 INFO:tasks.workunit.client.0.smithi120.stdout:5/254: write d10/d12/d1b/d1f/d33/d3d/f41 [1213327,118674] 0 2021-04-09T18:25:43.787 INFO:tasks.workunit.client.0.smithi120.stdout:7/184: dwrite db/f25 [0,4194304] 0 2021-04-09T18:25:43.795 INFO:tasks.workunit.client.0.smithi120.stdout:9/222: creat d19/d2c/f48 x:0 0 0 2021-04-09T18:25:43.805 INFO:tasks.workunit.client.0.smithi120.stdout:4/241: dwrite d1f/d2c/d34/f51 [0,4194304] 0 2021-04-09T18:25:43.806 INFO:tasks.workunit.client.0.smithi120.stdout:5/255: creat d10/d12/d1b/d1f/f63 x:0 0 0 2021-04-09T18:25:43.807 INFO:tasks.workunit.client.0.smithi120.stdout:0/204: rename d0/l1b to d0/d2/d4/l39 0 2021-04-09T18:25:43.808 INFO:tasks.workunit.client.0.smithi120.stdout:9/223: rename d19 to d19/d1c/d49 22 2021-04-09T18:25:43.810 INFO:tasks.workunit.client.0.smithi120.stdout:5/256: fsync d10/d12/d1b/d1f/f59 0 2021-04-09T18:25:43.810 INFO:tasks.workunit.client.0.smithi120.stdout:0/205: stat d0/d2/da 0 2021-04-09T18:25:43.812 INFO:tasks.workunit.client.0.smithi120.stdout:5/257: fsync d10/f48 0 2021-04-09T18:25:43.813 INFO:tasks.workunit.client.0.smithi120.stdout:4/242: chown d1f/d24/d42/d49 5 1 2021-04-09T18:25:43.821 INFO:tasks.workunit.client.0.smithi120.stdout:9/224: dwrite d19/d2c/f30 [4194304,4194304] 0 2021-04-09T18:25:43.822 INFO:tasks.workunit.client.0.smithi120.stdout:9/225: chown l10 109 1 2021-04-09T18:25:43.827 INFO:tasks.workunit.client.0.smithi120.stdout:7/185: rename db/d2c/d30/f33 to db/d2c/d34/f41 0 2021-04-09T18:25:43.827 INFO:tasks.workunit.client.0.smithi120.stdout:5/258: creat d10/d12/d1b/d1f/f64 x:0 0 0 2021-04-09T18:25:43.828 INFO:tasks.workunit.client.0.smithi120.stdout:4/243: creat d1f/d2c/d3b/d3e/f54 x:0 0 0 2021-04-09T18:25:43.829 INFO:tasks.workunit.client.0.smithi120.stdout:6/187: truncate d6/d8/db/d12/d22/d30/f33 787199 0 2021-04-09T18:25:43.829 INFO:tasks.workunit.client.0.smithi120.stdout:4/244: chown d1f/d24/d42 3 1 2021-04-09T18:25:43.834 INFO:tasks.workunit.client.0.smithi120.stdout:6/188: creat d6/d8/db/d12/d22/f3c x:0 0 0 2021-04-09T18:25:43.835 INFO:tasks.workunit.client.0.smithi120.stdout:6/189: stat d6/d8/db/d12/d22 0 2021-04-09T18:25:43.840 INFO:tasks.workunit.client.0.smithi120.stdout:6/190: creat d6/d8/db/d12/d22/d30/d31/d37/f3d x:0 0 0 2021-04-09T18:25:43.843 INFO:tasks.workunit.client.0.smithi120.stdout:9/226: read f7 [2146470,73301] 0 2021-04-09T18:25:43.853 INFO:tasks.workunit.client.0.smithi120.stdout:6/191: dwrite d6/d8/db/d12/d22/f3c [0,4194304] 0 2021-04-09T18:25:43.859 INFO:tasks.workunit.client.0.smithi120.stdout:6/192: creat d6/d8/d1a/d36/f3e x:0 0 0 2021-04-09T18:25:43.860 INFO:tasks.workunit.client.0.smithi120.stdout:3/282: dread d3/d5/d36/d1e/f39 [0,4194304] 0 2021-04-09T18:25:43.863 INFO:tasks.workunit.client.0.smithi120.stdout:0/206: dwrite d0/d2/f26 [0,4194304] 0 2021-04-09T18:25:43.872 INFO:tasks.workunit.client.0.smithi120.stdout:3/283: symlink d3/d5/d36/d1e/d30/l62 0 2021-04-09T18:25:43.873 INFO:tasks.workunit.client.0.smithi120.stdout:0/207: rename d0/d2/d4/l25 to d0/d2/l3a 0 2021-04-09T18:25:43.874 INFO:tasks.workunit.client.0.smithi120.stdout:3/284: dread - d3/de/d25/d2f/f3f zero size 2021-04-09T18:25:43.876 INFO:tasks.workunit.client.0.smithi120.stdout:0/208: creat d0/d2/f3b x:0 0 0 2021-04-09T18:25:43.879 INFO:tasks.workunit.client.0.smithi120.stdout:3/285: creat d3/d5/d36/d1e/d38/f63 x:0 0 0 2021-04-09T18:25:43.885 INFO:tasks.workunit.client.0.smithi120.stdout:9/227: dwrite d19/d1c/d29/f2b [0,4194304] 0 2021-04-09T18:25:43.887 INFO:tasks.workunit.client.0.smithi120.stdout:9/228: fsync d19/f3d 0 2021-04-09T18:25:43.890 INFO:tasks.workunit.client.0.smithi120.stdout:3/286: mknod d3/de/d25/d2f/c64 1 2021-04-09T18:25:43.890 INFO:tasks.workunit.client.0.smithi120.stdout:6/193: truncate d6/d8/f26 2907070 0 2021-04-09T18:25:43.894 INFO:tasks.workunit.client.0.smithi120.stdout:0/209: dwrite d0/d2/da/f19 [4194304,4194304] 0 2021-04-09T18:25:43.898 INFO:tasks.workunit.client.0.smithi120.stdout:3/287: getdents d3/de/d25/d4c 0 2021-04-09T18:25:43.900 INFO:tasks.workunit.client.0.smithi120.stdout:3/288: stat d3/d5/d36/d1e 0 2021-04-09T18:25:43.902 INFO:tasks.workunit.client.0.smithi120.stdout:3/289: write d3/f6 [2532549,41533] 0 2021-04-09T18:25:43.906 INFO:tasks.workunit.client.0.smithi120.stdout:0/210: dwrite d0/d2/da/f19 [4194304,4194304] 0 2021-04-09T18:25:43.907 INFO:tasks.workunit.client.0.smithi120.stdout:6/194: rename l3 to d6/d8/db/d12/d22/d30/d31/l3f 0 2021-04-09T18:25:43.909 INFO:tasks.workunit.client.0.smithi120.stdout:4/245: fdatasync d1f/f28 0 2021-04-09T18:25:43.910 INFO:tasks.workunit.client.0.smithi120.stdout:3/290: creat d3/de/d25/f65 x:0 0 0 2021-04-09T18:25:43.911 INFO:tasks.workunit.client.0.smithi120.stdout:0/211: stat d0/d2/da/f19 0 2021-04-09T18:25:43.914 INFO:tasks.workunit.client.0.smithi120.stdout:6/195: getdents d6/d8/d3a 0 2021-04-09T18:25:43.916 INFO:tasks.workunit.client.0.smithi120.stdout:6/196: dread - d6/d8/db/f39 zero size 2021-04-09T18:25:43.919 INFO:tasks.workunit.client.0.smithi120.stdout:0/212: creat d0/f3c x:0 0 0 2021-04-09T18:25:43.922 INFO:tasks.workunit.client.0.smithi120.stdout:0/213: mknod d0/d2/d4/c3d 1 2021-04-09T18:25:43.924 INFO:tasks.workunit.client.0.smithi120.stdout:0/214: mknod d0/d2/d4/c3e 1 2021-04-09T18:25:43.930 INFO:tasks.workunit.client.0.smithi120.stdout:6/197: rename d6/d8/f35 to d6/d8/db/d12/d22/f40 0 2021-04-09T18:25:43.940 INFO:tasks.workunit.client.0.smithi120.stdout:6/198: mkdir d6/d8/db/d12/d22/d30/d41 0 2021-04-09T18:25:43.943 INFO:tasks.workunit.client.0.smithi120.stdout:4/246: truncate f12 593277 0 2021-04-09T18:25:43.943 INFO:tasks.workunit.client.0.smithi120.stdout:0/215: rename d0/d2/l3a to d0/d2/da/d2e/l3f 0 2021-04-09T18:25:43.945 INFO:tasks.workunit.client.0.smithi120.stdout:9/229: dread fb [0,4194304] 0 2021-04-09T18:25:43.946 INFO:tasks.workunit.client.0.smithi120.stdout:6/199: chown d6/d8/db/d12/d22/d30/d31/l3f 1686924 1 2021-04-09T18:25:43.946 INFO:tasks.workunit.client.0.smithi120.stdout:4/247: symlink d1f/d2c/d30/l55 0 2021-04-09T18:25:43.947 INFO:tasks.workunit.client.0.smithi120.stdout:4/248: stat d1f/d24/f25 0 2021-04-09T18:25:43.956 INFO:tasks.workunit.client.0.smithi120.stdout:3/291: dwrite d3/de/d25/f22 [0,4194304] 0 2021-04-09T18:25:43.957 INFO:tasks.workunit.client.0.smithi120.stdout:4/249: dwrite d1f/d2c/d3b/d3e/f54 [0,4194304] 0 2021-04-09T18:25:43.958 INFO:tasks.workunit.client.0.smithi120.stdout:0/216: rename d0/d2/da/d23/f35 to d0/d2/dd/f40 0 2021-04-09T18:25:43.966 INFO:tasks.workunit.client.0.smithi120.stdout:4/250: mkdir d1f/d2c/d56 0 2021-04-09T18:25:43.974 INFO:tasks.workunit.client.0.smithi120.stdout:0/217: readlink d0/d2/l1a 0 2021-04-09T18:25:43.979 INFO:tasks.workunit.client.0.smithi120.stdout:4/251: write d1f/d2c/d34/f51 [3663326,98476] 0 2021-04-09T18:25:43.982 INFO:tasks.workunit.client.0.smithi120.stdout:9/230: creat d19/f4a x:0 0 0 2021-04-09T18:25:43.985 INFO:tasks.workunit.client.0.smithi120.stdout:3/292: write d3/d5/d36/f11 [1512327,107940] 0 2021-04-09T18:25:43.985 INFO:tasks.workunit.client.0.smithi120.stdout:0/218: unlink d0/d2/d4/l18 0 2021-04-09T18:25:43.986 INFO:tasks.workunit.client.0.smithi120.stdout:3/293: write d3/d5/f2c [2237341,99574] 0 2021-04-09T18:25:43.990 INFO:tasks.workunit.client.0.smithi120.stdout:9/231: unlink d19/f4a 0 2021-04-09T18:25:43.990 INFO:tasks.workunit.client.0.smithi120.stdout:4/252: link f7 d1f/d24/d42/d49/f57 0 2021-04-09T18:25:43.990 INFO:tasks.workunit.client.0.smithi120.stdout:9/232: dread - d19/f1b zero size 2021-04-09T18:25:43.994 INFO:tasks.workunit.client.0.smithi120.stdout:4/253: dread f1a [0,4194304] 0 2021-04-09T18:25:44.000 INFO:tasks.workunit.client.0.smithi120.stdout:3/294: creat d3/de/d25/d53/f66 x:0 0 0 2021-04-09T18:25:44.000 INFO:tasks.workunit.client.0.smithi120.stdout:9/233: mkdir d19/d24/d36/d47/d4b 0 2021-04-09T18:25:44.001 INFO:tasks.workunit.client.0.smithi120.stdout:0/219: creat d0/f41 x:0 0 0 2021-04-09T18:25:44.001 INFO:tasks.workunit.client.0.smithi120.stdout:0/220: mknod d0/d2/d4/c42 1 2021-04-09T18:25:44.002 INFO:tasks.workunit.client.0.smithi120.stdout:9/234: symlink d19/d1c/l4c 0 2021-04-09T18:25:44.004 INFO:tasks.workunit.client.0.smithi120.stdout:3/295: unlink d3/d5/d36/f11 0 2021-04-09T18:25:44.006 INFO:tasks.workunit.client.0.smithi120.stdout:3/296: chown d3/de/d25/f65 87 1 2021-04-09T18:25:44.007 INFO:tasks.workunit.client.0.smithi120.stdout:0/221: mkdir d0/d43 0 2021-04-09T18:25:44.012 INFO:tasks.workunit.client.0.smithi120.stdout:0/222: rename d0/l28 to d0/d2/da/d2e/l44 0 2021-04-09T18:25:44.014 INFO:tasks.workunit.client.0.smithi120.stdout:4/254: link d1f/d2c/l39 d1f/d2c/d30/l58 0 2021-04-09T18:25:44.015 INFO:tasks.workunit.client.0.smithi120.stdout:3/297: rmdir d3/de/d25/d4c 0 2021-04-09T18:25:44.016 INFO:tasks.workunit.client.0.smithi120.stdout:3/298: chown d3/de/d25/f65 1868 1 2021-04-09T18:25:44.017 INFO:tasks.workunit.client.0.smithi120.stdout:4/255: dread d1f/d24/f26 [0,4194304] 0 2021-04-09T18:25:44.020 INFO:tasks.workunit.client.0.smithi120.stdout:9/235: truncate d19/d2c/f3f 785905 0 2021-04-09T18:25:44.022 INFO:tasks.workunit.client.0.smithi120.stdout:3/299: dwrite d3/de/d25/d2f/f3f [0,4194304] 0 2021-04-09T18:25:44.026 INFO:tasks.workunit.client.0.smithi120.stdout:4/256: rmdir d1f/d2c/d3b 39 2021-04-09T18:25:44.028 INFO:tasks.workunit.client.0.smithi120.stdout:9/236: dwrite d19/d1c/d29/f2b [0,4194304] 0 2021-04-09T18:25:44.029 INFO:tasks.workunit.client.0.smithi120.stdout:9/237: chown d19/d2c/f30 1 1 2021-04-09T18:25:44.030 INFO:tasks.workunit.client.0.smithi120.stdout:4/257: unlink l14 0 2021-04-09T18:25:44.031 INFO:tasks.workunit.client.0.smithi120.stdout:9/238: mknod d19/d24/d37/c4d 1 2021-04-09T18:25:44.032 INFO:tasks.workunit.client.0.smithi120.stdout:4/258: dread f1a [4194304,4194304] 0 2021-04-09T18:25:44.034 INFO:tasks.workunit.client.0.smithi120.stdout:0/223: link d0/d2/dd/l17 d0/d43/l45 0 2021-04-09T18:25:44.038 INFO:tasks.workunit.client.0.smithi120.stdout:4/259: fsync d1f/f40 0 2021-04-09T18:25:44.039 INFO:tasks.workunit.client.0.smithi120.stdout:0/224: write d0/d2/da/f19 [1740454,82797] 0 2021-04-09T18:25:44.041 INFO:tasks.workunit.client.0.smithi120.stdout:0/225: read - d0/d2/da/f37 zero size 2021-04-09T18:25:44.043 INFO:tasks.workunit.client.0.smithi120.stdout:0/226: fdatasync d0/f30 0 2021-04-09T18:25:44.045 INFO:tasks.workunit.client.0.smithi120.stdout:9/239: link f17 d19/d24/d36/d47/f4e 0 2021-04-09T18:25:44.055 INFO:tasks.workunit.client.0.smithi120.stdout:9/240: creat d19/d1c/f4f x:0 0 0 2021-04-09T18:25:44.057 INFO:tasks.workunit.client.0.smithi120.stdout:3/300: rename d3/de/d25/d2f/d59/f5d to d3/d5/d36/d1e/f67 0 2021-04-09T18:25:44.059 INFO:tasks.workunit.client.0.smithi120.stdout:3/301: write d3/de/d25/d53/f66 [171138,107476] 0 2021-04-09T18:25:44.065 INFO:tasks.workunit.client.0.smithi120.stdout:9/241: creat d19/d24/f50 x:0 0 0 2021-04-09T18:25:44.067 INFO:tasks.workunit.client.0.smithi120.stdout:4/260: truncate d1f/d24/d42/d49/f57 3669726 0 2021-04-09T18:25:44.068 INFO:tasks.workunit.client.0.smithi120.stdout:0/227: truncate d0/d2/d4/f13 660904 0 2021-04-09T18:25:44.069 INFO:tasks.workunit.client.0.smithi120.stdout:9/242: mkdir d19/d1c/d51 0 2021-04-09T18:25:44.073 INFO:tasks.workunit.client.0.smithi120.stdout:9/243: dwrite f12 [0,4194304] 0 2021-04-09T18:25:44.076 INFO:tasks.workunit.client.0.smithi120.stdout:4/261: write d1f/d2c/d3b/d3e/f43 [866399,8089] 0 2021-04-09T18:25:44.077 INFO:tasks.workunit.client.0.smithi120.stdout:4/262: dread - d1f/d2c/d3b/d3e/f48 zero size 2021-04-09T18:25:44.083 INFO:tasks.workunit.client.0.smithi120.stdout:9/244: rename d19/d1c/d51 to d19/d1c/d52 0 2021-04-09T18:25:44.085 INFO:tasks.workunit.client.0.smithi120.stdout:9/245: creat d19/d1c/f53 x:0 0 0 2021-04-09T18:25:44.088 INFO:tasks.workunit.client.0.smithi120.stdout:4/263: rename d1f/d2c/d30/l58 to d1f/d24/d42/d49/l59 0 2021-04-09T18:25:44.168 INFO:tasks.workunit.client.0.smithi120.stdout:1/156: sync 2021-04-09T18:25:44.169 INFO:tasks.workunit.client.0.smithi120.stdout:1/157: fsync d5/f17 0 2021-04-09T18:25:44.169 INFO:tasks.workunit.client.0.smithi120.stdout:1/158: readlink d5/l16 0 2021-04-09T18:25:44.171 INFO:tasks.workunit.client.0.smithi120.stdout:1/159: read d5/f17 [418,114265] 0 2021-04-09T18:25:44.174 INFO:tasks.workunit.client.0.smithi120.stdout:4/264: symlink d1f/d24/l5a 0 2021-04-09T18:25:44.179 INFO:tasks.workunit.client.0.smithi120.stdout:1/160: mkdir d5/d1f/d22/d24/d28/d2d 0 2021-04-09T18:25:44.180 INFO:tasks.workunit.client.0.smithi120.stdout:1/161: mknod d5/d1f/d22/d24/c2e 1 2021-04-09T18:25:44.318 INFO:tasks.workunit.client.0.smithi120.stdout:9/246: rename d19/d2c/f30 to d19/f54 0 2021-04-09T18:25:44.319 INFO:tasks.workunit.client.0.smithi120.stdout:1/162: creat d5/d1f/d22/d24/f2f x:0 0 0 2021-04-09T18:25:44.323 INFO:tasks.workunit.client.0.smithi120.stdout:9/247: dwrite d19/d2c/f48 [0,4194304] 0 2021-04-09T18:25:44.324 INFO:tasks.workunit.client.0.smithi120.stdout:1/163: symlink d5/d1f/l30 0 2021-04-09T18:25:44.329 INFO:tasks.workunit.client.0.smithi120.stdout:9/248: dread - d19/d1c/f53 zero size 2021-04-09T18:25:44.347 INFO:tasks.workunit.client.0.smithi120.stdout:1/164: dwrite d5/d1f/d22/f27 [0,4194304] 0 2021-04-09T18:25:44.348 INFO:tasks.workunit.client.0.smithi120.stdout:9/249: write d19/f38 [3879316,45454] 0 2021-04-09T18:25:44.348 INFO:tasks.workunit.client.0.smithi120.stdout:4/265: fdatasync d1f/d24/f33 0 2021-04-09T18:25:44.350 INFO:tasks.workunit.client.0.smithi120.stdout:1/165: dread - d5/d1f/d22/d24/f26 zero size 2021-04-09T18:25:44.350 INFO:tasks.workunit.client.0.smithi120.stdout:0/228: dread d0/d2/d4/f13 [0,4194304] 0 2021-04-09T18:25:44.351 INFO:tasks.workunit.client.0.smithi120.stdout:9/250: readlink d19/d1c/d29/l33 0 2021-04-09T18:25:44.352 INFO:tasks.workunit.client.0.smithi120.stdout:1/166: dread - d5/d1f/d22/d24/f26 zero size 2021-04-09T18:25:44.353 INFO:tasks.workunit.client.0.smithi120.stdout:1/167: chown d5/d1f/f15 45872958 1 2021-04-09T18:25:44.355 INFO:tasks.workunit.client.0.smithi120.stdout:1/168: chown d5/d1f/d22/f2c 183381 1 2021-04-09T18:25:44.357 INFO:tasks.workunit.client.0.smithi120.stdout:0/229: dwrite d0/f30 [4194304,4194304] 0 2021-04-09T18:25:44.357 INFO:tasks.workunit.client.0.smithi120.stdout:1/169: dread d5/f17 [0,4194304] 0 2021-04-09T18:25:44.365 INFO:tasks.workunit.client.0.smithi120.stdout:0/230: dread d0/d2/d4/f29 [0,4194304] 0 2021-04-09T18:25:44.367 INFO:tasks.workunit.client.0.smithi120.stdout:1/170: symlink d5/d1f/d22/d2b/l31 0 2021-04-09T18:25:44.370 INFO:tasks.workunit.client.0.smithi120.stdout:1/171: mknod d5/d1f/d22/d24/c32 1 2021-04-09T18:25:44.372 INFO:tasks.workunit.client.0.smithi120.stdout:0/231: dwrite d0/f41 [0,4194304] 0 2021-04-09T18:25:44.374 INFO:tasks.workunit.client.0.smithi120.stdout:9/251: creat d19/d24/f55 x:0 0 0 2021-04-09T18:25:44.375 INFO:tasks.workunit.client.0.smithi120.stdout:9/252: fdatasync f12 0 2021-04-09T18:25:44.376 INFO:tasks.workunit.client.0.smithi120.stdout:0/232: write d0/d2/f3b [346224,41357] 0 2021-04-09T18:25:44.380 INFO:tasks.workunit.client.0.smithi120.stdout:1/172: fsync d5/f7 0 2021-04-09T18:25:44.382 INFO:tasks.workunit.client.0.smithi120.stdout:4/266: dwrite f7 [0,4194304] 0 2021-04-09T18:25:44.387 INFO:tasks.workunit.client.0.smithi120.stdout:9/253: rename d19/d24/f50 to d19/d24/d37/d40/f56 0 2021-04-09T18:25:44.391 INFO:tasks.workunit.client.0.smithi120.stdout:4/267: rename f12 to d1f/d2c/d56/f5b 0 2021-04-09T18:25:44.395 INFO:tasks.workunit.client.0.smithi120.stdout:1/173: chown d5/d1f/d22/d24/f2f 6845457 1 2021-04-09T18:25:44.396 INFO:tasks.workunit.client.0.smithi120.stdout:0/233: truncate d0/d2/dd/f38 852117 0 2021-04-09T18:25:44.396 INFO:tasks.workunit.client.0.smithi120.stdout:1/174: rmdir d5 39 2021-04-09T18:25:44.397 INFO:tasks.workunit.client.0.smithi120.stdout:9/254: dwrite d19/f3d [0,4194304] 0 2021-04-09T18:25:44.401 INFO:tasks.workunit.client.0.smithi120.stdout:9/255: chown d19/d2c/f48 13992 1 2021-04-09T18:25:44.402 INFO:tasks.workunit.client.0.smithi120.stdout:1/175: dread d5/f17 [0,4194304] 0 2021-04-09T18:25:44.405 INFO:tasks.workunit.client.0.smithi120.stdout:4/268: mkdir d1f/d2c/d3b/d3e/d5c 0 2021-04-09T18:25:44.410 INFO:tasks.workunit.client.0.smithi120.stdout:9/256: dwrite d19/d2c/f48 [0,4194304] 0 2021-04-09T18:25:44.413 INFO:tasks.workunit.client.0.smithi120.stdout:0/234: creat d0/d2/f46 x:0 0 0 2021-04-09T18:25:44.419 INFO:tasks.workunit.client.0.smithi120.stdout:9/257: dwrite d19/d24/d36/f45 [0,4194304] 0 2021-04-09T18:25:44.425 INFO:tasks.workunit.client.0.smithi120.stdout:4/269: getdents d1f/d2c/d3b 0 2021-04-09T18:25:44.426 INFO:tasks.workunit.client.0.smithi120.stdout:9/258: readlink d19/d24/l34 0 2021-04-09T18:25:44.429 INFO:tasks.workunit.client.0.smithi120.stdout:1/176: rename d5/d1f/d22/l25 to d5/l33 0 2021-04-09T18:25:44.432 INFO:tasks.workunit.client.0.smithi120.stdout:4/270: dwrite d1f/d2c/d3b/d3e/f48 [0,4194304] 0 2021-04-09T18:25:44.433 INFO:tasks.workunit.client.0.smithi120.stdout:1/177: rmdir d5/d1f 39 2021-04-09T18:25:44.433 INFO:tasks.workunit.client.0.smithi120.stdout:0/235: getdents d0/d2/da/d23 0 2021-04-09T18:25:44.439 INFO:tasks.workunit.client.0.smithi120.stdout:9/259: creat d19/d24/d36/d47/f57 x:0 0 0 2021-04-09T18:25:44.444 INFO:tasks.workunit.client.0.smithi120.stdout:0/236: rmdir d0/d2 39 2021-04-09T18:25:44.444 INFO:tasks.workunit.client.0.smithi120.stdout:1/178: write d5/d1f/d22/d24/f26 [863425,14160] 0 2021-04-09T18:25:44.446 INFO:tasks.workunit.client.0.smithi120.stdout:4/271: dwrite d1f/d2c/d3b/d3e/f54 [0,4194304] 0 2021-04-09T18:25:44.450 INFO:tasks.workunit.client.0.smithi120.stdout:9/260: creat d19/d24/f58 x:0 0 0 2021-04-09T18:25:44.451 INFO:tasks.workunit.client.0.smithi120.stdout:9/261: readlink d19/d1c/d29/l33 0 2021-04-09T18:25:44.454 INFO:tasks.workunit.client.0.smithi120.stdout:1/179: symlink d5/d1f/d22/d24/l34 0 2021-04-09T18:25:44.455 INFO:tasks.workunit.client.0.smithi120.stdout:0/237: read - d0/d2/da/f37 zero size 2021-04-09T18:25:44.460 INFO:tasks.workunit.client.0.smithi120.stdout:9/262: creat d19/d1c/d52/f59 x:0 0 0 2021-04-09T18:25:44.461 INFO:tasks.workunit.client.0.smithi120.stdout:9/263: chown d19/d2c 401 1 2021-04-09T18:25:44.468 INFO:tasks.workunit.client.0.smithi120.stdout:0/238: symlink d0/d2/l47 0 2021-04-09T18:25:44.477 INFO:tasks.workunit.client.0.smithi120.stdout:9/264: read d19/d1c/f27 [607235,112222] 0 2021-04-09T18:25:44.481 INFO:tasks.workunit.client.0.smithi120.stdout:0/239: dread d0/d2/f27 [4194304,4194304] 0 2021-04-09T18:25:44.486 INFO:tasks.workunit.client.0.smithi120.stdout:0/240: creat d0/d2/da/f48 x:0 0 0 2021-04-09T18:25:44.486 INFO:tasks.workunit.client.0.smithi120.stdout:4/272: truncate d1f/d2c/d3b/f4c 433484 0 2021-04-09T18:25:44.486 INFO:tasks.workunit.client.0.smithi120.stdout:9/265: dwrite d19/d1c/d29/f2b [0,4194304] 0 2021-04-09T18:25:44.488 INFO:tasks.workunit.client.0.smithi120.stdout:4/273: mknod d1f/d2c/d56/c5d 1 2021-04-09T18:25:44.489 INFO:tasks.workunit.client.0.smithi120.stdout:4/274: write d1f/d2c/d34/f51 [2011880,32855] 0 2021-04-09T18:25:44.491 INFO:tasks.workunit.client.0.smithi120.stdout:0/241: mkdir d0/d43/d49 0 2021-04-09T18:25:44.492 INFO:tasks.workunit.client.0.smithi120.stdout:0/242: chown d0/d2/dd/l1f 8330426 1 2021-04-09T18:25:44.494 INFO:tasks.workunit.client.0.smithi120.stdout:0/243: read - d0/d2/da/f2c zero size 2021-04-09T18:25:44.496 INFO:tasks.workunit.client.0.smithi120.stdout:0/244: write d0/d2/f3b [858137,20447] 0 2021-04-09T18:25:44.504 INFO:tasks.workunit.client.0.smithi120.stdout:0/245: symlink d0/d2/dd/l4a 0 2021-04-09T18:25:44.505 INFO:tasks.workunit.client.0.smithi120.stdout:0/246: chown d0/f41 4140932 1 2021-04-09T18:25:44.509 INFO:tasks.workunit.client.0.smithi120.stdout:0/247: chown d0/d2/da/d2e/l44 211 1 2021-04-09T18:25:44.510 INFO:tasks.workunit.client.0.smithi120.stdout:9/266: truncate d19/d2c/f46 227195 0 2021-04-09T18:25:44.511 INFO:tasks.workunit.client.0.smithi120.stdout:0/248: chown d0/d2/f46 2072 1 2021-04-09T18:25:44.516 INFO:tasks.workunit.client.0.smithi120.stdout:9/267: write d19/d24/d37/d40/f56 [718262,51812] 0 2021-04-09T18:25:44.518 INFO:tasks.workunit.client.0.smithi120.stdout:0/249: creat d0/d2/dd/f4b x:0 0 0 2021-04-09T18:25:44.521 INFO:tasks.workunit.client.0.smithi120.stdout:9/268: rmdir d19/d1c/d52 39 2021-04-09T18:25:44.523 INFO:tasks.workunit.client.0.smithi120.stdout:1/180: dread d5/d1f/d22/f2c [0,4194304] 0 2021-04-09T18:25:44.524 INFO:tasks.workunit.client.0.smithi120.stdout:1/181: mknod d5/d1f/d22/d24/c35 1 2021-04-09T18:25:44.527 INFO:tasks.workunit.client.0.smithi120.stdout:2/254: sync 2021-04-09T18:25:44.528 INFO:tasks.workunit.client.0.smithi120.stdout:8/190: sync 2021-04-09T18:25:44.528 INFO:tasks.workunit.client.0.smithi120.stdout:9/269: dwrite f7 [0,4194304] 0 2021-04-09T18:25:44.535 INFO:tasks.workunit.client.0.smithi120.stdout:8/191: chown d2/d3/d11/d2c/f31 91 1 2021-04-09T18:25:44.536 INFO:tasks.workunit.client.0.smithi120.stdout:2/255: mkdir d13/d1b/d48/d58 0 2021-04-09T18:25:44.537 INFO:tasks.workunit.client.0.smithi120.stdout:9/270: creat d19/d1c/d29/f5a x:0 0 0 2021-04-09T18:25:44.540 INFO:tasks.workunit.client.0.smithi120.stdout:2/256: fsync d13/f19 0 2021-04-09T18:25:44.544 INFO:tasks.workunit.client.0.smithi120.stdout:2/257: unlink d13/d15/d35/l4c 0 2021-04-09T18:25:44.544 INFO:tasks.workunit.client.0.smithi120.stdout:2/258: chown d13 83 1 2021-04-09T18:25:44.546 INFO:tasks.workunit.client.0.smithi120.stdout:8/192: mkdir d2/d3/d3c 0 2021-04-09T18:25:44.547 INFO:tasks.workunit.client.0.smithi120.stdout:4/275: dread d1f/f32 [0,4194304] 0 2021-04-09T18:25:44.548 INFO:tasks.workunit.client.0.smithi120.stdout:8/193: mknod d2/d3/d11/d2c/d2e/c3d 1 2021-04-09T18:25:44.550 INFO:tasks.workunit.client.0.smithi120.stdout:2/259: rename d13/d1b/l52 to d13/d1b/d48/d49/l59 0 2021-04-09T18:25:44.551 INFO:tasks.workunit.client.0.smithi120.stdout:4/276: chown d1f/d2f/l31 0 1 2021-04-09T18:25:44.552 INFO:tasks.workunit.client.0.smithi120.stdout:2/260: symlink d13/d15/l5a 0 2021-04-09T18:25:44.553 INFO:tasks.workunit.client.0.smithi120.stdout:8/194: mkdir d2/d37/d3e 0 2021-04-09T18:25:44.554 INFO:tasks.workunit.client.0.smithi120.stdout:4/277: fdatasync d1f/d2c/d3b/f53 0 2021-04-09T18:25:44.559 INFO:tasks.workunit.client.0.smithi120.stdout:4/278: creat d1f/d2c/d3b/f5e x:0 0 0 2021-04-09T18:25:44.562 INFO:tasks.workunit.client.0.smithi120.stdout:8/195: mkdir d2/d27/d3f 0 2021-04-09T18:25:44.562 INFO:tasks.workunit.client.0.smithi120.stdout:1/182: write d5/f7 [747854,33442] 0 2021-04-09T18:25:44.563 INFO:tasks.workunit.client.0.smithi120.stdout:4/279: unlink f7 0 2021-04-09T18:25:44.564 INFO:tasks.workunit.client.0.smithi120.stdout:4/280: fdatasync d1f/f28 0 2021-04-09T18:25:44.565 INFO:tasks.workunit.client.0.smithi120.stdout:0/250: truncate d0/d2/f26 672404 0 2021-04-09T18:25:44.566 INFO:tasks.workunit.client.0.smithi120.stdout:0/251: dread - d0/d2/da/f2c zero size 2021-04-09T18:25:44.568 INFO:tasks.workunit.client.0.smithi120.stdout:8/196: creat d2/f40 x:0 0 0 2021-04-09T18:25:44.576 INFO:tasks.workunit.client.0.smithi120.stdout:0/252: dwrite d0/d2/f3b [0,4194304] 0 2021-04-09T18:25:44.576 INFO:tasks.workunit.client.0.smithi120.stdout:8/197: dread d2/d3/d11/f1f [0,4194304] 0 2021-04-09T18:25:44.577 INFO:tasks.workunit.client.0.smithi120.stdout:0/253: dread - d0/d2/da/f2c zero size 2021-04-09T18:25:44.589 INFO:tasks.workunit.client.0.smithi120.stdout:5/259: sync 2021-04-09T18:25:44.589 INFO:tasks.workunit.client.0.smithi120.stdout:3/302: sync 2021-04-09T18:25:44.590 INFO:tasks.workunit.client.0.smithi120.stdout:7/186: sync 2021-04-09T18:25:44.590 INFO:tasks.workunit.client.0.smithi120.stdout:6/200: sync 2021-04-09T18:25:44.590 INFO:tasks.workunit.client.0.smithi120.stdout:0/254: creat d0/d2/d4/f4c x:0 0 0 2021-04-09T18:25:44.599 INFO:tasks.workunit.client.0.smithi120.stdout:0/255: dread d0/f41 [0,4194304] 0 2021-04-09T18:25:44.600 INFO:tasks.workunit.client.0.smithi120.stdout:8/198: dwrite d2/d3/f12 [0,4194304] 0 2021-04-09T18:25:44.603 INFO:tasks.workunit.client.0.smithi120.stdout:5/260: unlink d10/d12/d1b/d1f/f2c 0 2021-04-09T18:25:44.610 INFO:tasks.workunit.client.0.smithi120.stdout:8/199: unlink d2/d3/d8/l25 0 2021-04-09T18:25:44.610 INFO:tasks.workunit.client.0.smithi120.stdout:6/201: dwrite d6/d8/db/d12/d22/f2a [0,4194304] 0 2021-04-09T18:25:44.611 INFO:tasks.workunit.client.0.smithi120.stdout:4/281: truncate d1f/d24/f46 552133 0 2021-04-09T18:25:44.613 INFO:tasks.workunit.client.0.smithi120.stdout:8/200: write d2/d3/d8/f1d [2205053,95088] 0 2021-04-09T18:25:44.614 INFO:tasks.workunit.client.0.smithi120.stdout:2/261: rename d13/d15/f34 to d13/d15/d35/f5b 0 2021-04-09T18:25:44.615 INFO:tasks.workunit.client.0.smithi120.stdout:6/202: chown d6/l15 4213 1 2021-04-09T18:25:44.617 INFO:tasks.workunit.client.0.smithi120.stdout:6/203: mknod d6/d8/db/d2b/c42 1 2021-04-09T18:25:44.618 INFO:tasks.workunit.client.0.smithi120.stdout:1/183: dread d5/d1f/d22/d24/f26 [0,4194304] 0 2021-04-09T18:25:44.620 INFO:tasks.workunit.client.0.smithi120.stdout:0/256: symlink d0/l4d 0 2021-04-09T18:25:44.622 INFO:tasks.workunit.client.0.smithi120.stdout:5/261: creat d10/d12/d1b/d1f/d33/d44/f65 x:0 0 0 2021-04-09T18:25:44.628 INFO:tasks.workunit.client.0.smithi120.stdout:5/262: stat d10/d12/d1b/d1f/f4e 0 2021-04-09T18:25:44.630 INFO:tasks.workunit.client.0.smithi120.stdout:9/271: dread d19/d1c/f1f [0,4194304] 0 2021-04-09T18:25:44.631 INFO:tasks.workunit.client.0.smithi120.stdout:9/272: stat d19/d24/d36 0 2021-04-09T18:25:44.633 INFO:tasks.workunit.client.0.smithi120.stdout:4/282: rename d1f/d2c/d30/l55 to d1f/d2c/d3b/d3e/l5f 0 2021-04-09T18:25:44.634 INFO:tasks.workunit.client.0.smithi120.stdout:8/201: write d2/d3/f23 [3265589,112339] 0 2021-04-09T18:25:44.635 INFO:tasks.workunit.client.0.smithi120.stdout:7/187: getdents db/d26 0 2021-04-09T18:25:44.636 INFO:tasks.workunit.client.0.smithi120.stdout:5/263: rmdir d10/d12/d1b/d1f 39 2021-04-09T18:25:44.636 INFO:tasks.workunit.client.0.smithi120.stdout:9/273: fsync fb 0 2021-04-09T18:25:44.636 INFO:tasks.workunit.client.0.smithi120.stdout:1/184: write d5/d1f/d22/f2c [152337,93933] 0 2021-04-09T18:25:44.646 INFO:tasks.workunit.client.0.smithi120.stdout:9/274: mkdir d19/d2c/d5b 0 2021-04-09T18:25:44.647 INFO:tasks.workunit.client.0.smithi120.stdout:6/204: getdents d6/d8/d1a 0 2021-04-09T18:25:44.649 INFO:tasks.workunit.client.0.smithi120.stdout:1/185: dread d5/d1f/f15 [0,4194304] 0 2021-04-09T18:25:44.650 INFO:tasks.workunit.client.0.smithi120.stdout:2/262: readlink d13/d15/l5a 0 2021-04-09T18:25:44.651 INFO:tasks.workunit.client.0.smithi120.stdout:9/275: symlink d19/d1c/d29/l5c 0 2021-04-09T18:25:44.651 INFO:tasks.workunit.client.0.smithi120.stdout:8/202: dwrite d2/d3/d11/d2c/d2e/d3b/f2b [4194304,4194304] 0 2021-04-09T18:25:44.656 INFO:tasks.workunit.client.0.smithi120.stdout:8/203: readlink d2/d3/d11/d2c/d2e/d3b/l35 0 2021-04-09T18:25:44.657 INFO:tasks.workunit.client.0.smithi120.stdout:8/204: dread - d2/d3/d11/d2c/f32 zero size 2021-04-09T18:25:44.660 INFO:tasks.workunit.client.0.smithi120.stdout:6/205: mkdir d6/d8/db/d43 0 2021-04-09T18:25:44.660 INFO:tasks.workunit.client.0.smithi120.stdout:9/276: dwrite d19/d24/d36/f45 [0,4194304] 0 2021-04-09T18:25:44.662 INFO:tasks.workunit.client.0.smithi120.stdout:8/205: chown d2/d3/d11/d2c/f32 225 1 2021-04-09T18:25:44.663 INFO:tasks.workunit.client.0.smithi120.stdout:6/206: dread - d6/d8/d1a/f34 zero size 2021-04-09T18:25:44.664 INFO:tasks.workunit.client.0.smithi120.stdout:6/207: readlink d6/l15 0 2021-04-09T18:25:44.664 INFO:tasks.workunit.client.0.smithi120.stdout:2/263: symlink d13/d15/d35/l5c 0 2021-04-09T18:25:44.673 INFO:tasks.workunit.client.0.smithi120.stdout:1/186: rename d5/d1f/f1c to d5/d1f/d22/d24/d28/f36 0 2021-04-09T18:25:44.673 INFO:tasks.workunit.client.0.smithi120.stdout:4/283: write d1f/f23 [254798,120907] 0 2021-04-09T18:25:44.673 INFO:tasks.workunit.client.0.smithi120.stdout:8/206: creat d2/d27/f41 x:0 0 0 2021-04-09T18:25:44.674 INFO:tasks.workunit.client.0.smithi120.stdout:4/284: write d1f/d2c/d3b/f5e [757550,100540] 0 2021-04-09T18:25:44.675 INFO:tasks.workunit.client.0.smithi120.stdout:2/264: creat d13/d15/d35/f5d x:0 0 0 2021-04-09T18:25:44.681 INFO:tasks.workunit.client.0.smithi120.stdout:9/277: dread d19/d2c/f46 [0,4194304] 0 2021-04-09T18:25:44.682 INFO:tasks.workunit.client.0.smithi120.stdout:4/285: chown l1c 285 1 2021-04-09T18:25:44.682 INFO:tasks.workunit.client.0.smithi120.stdout:6/208: write d6/d8/db/d12/d22/f40 [663790,103895] 0 2021-04-09T18:25:44.682 INFO:tasks.workunit.client.0.smithi120.stdout:6/209: chown d6/d8/d1a/f34 245656 1 2021-04-09T18:25:44.683 INFO:tasks.workunit.client.0.smithi120.stdout:3/303: truncate d3/de/d25/d2f/d49/d4e/d54/f5f 723168 0 2021-04-09T18:25:44.691 INFO:tasks.workunit.client.0.smithi120.stdout:4/286: mkdir d1f/d2c/d34/d60 0 2021-04-09T18:25:44.691 INFO:tasks.workunit.client.0.smithi120.stdout:9/278: creat d19/d24/d36/d47/f5d x:0 0 0 2021-04-09T18:25:44.693 INFO:tasks.workunit.client.0.smithi120.stdout:1/187: rename d5/l13 to d5/d1f/d22/d24/d28/l37 0 2021-04-09T18:25:44.694 INFO:tasks.workunit.client.0.smithi120.stdout:9/279: dread - d19/d24/d36/d47/f57 zero size 2021-04-09T18:25:44.694 INFO:tasks.workunit.client.0.smithi120.stdout:6/210: dwrite d6/fc [4194304,4194304] 0 2021-04-09T18:25:44.697 INFO:tasks.workunit.client.0.smithi120.stdout:5/264: creat d10/d12/d1b/f66 x:0 0 0 2021-04-09T18:25:44.700 INFO:tasks.workunit.client.0.smithi120.stdout:8/207: mkdir d2/d37/d3e/d42 0 2021-04-09T18:25:44.700 INFO:tasks.workunit.client.0.smithi120.stdout:4/287: mknod d1f/d24/d42/c61 1 2021-04-09T18:25:44.701 INFO:tasks.workunit.client.0.smithi120.stdout:3/304: rename d3/d5/d36/d1e/d30 to d3/de/d25/d2f/d59/d68 0 2021-04-09T18:25:44.702 INFO:tasks.workunit.client.0.smithi120.stdout:1/188: chown d5/l14 11865 1 2021-04-09T18:25:44.704 INFO:tasks.workunit.client.0.smithi120.stdout:6/211: symlink d6/d8/db/d12/d22/d30/d31/d37/l44 0 2021-04-09T18:25:44.705 INFO:tasks.workunit.client.0.smithi120.stdout:4/288: write d1f/d2c/d30/f4d [1642952,17659] 0 2021-04-09T18:25:44.707 INFO:tasks.workunit.client.0.smithi120.stdout:9/280: creat d19/d24/f5e x:0 0 0 2021-04-09T18:25:44.708 INFO:tasks.workunit.client.0.smithi120.stdout:6/212: mknod d6/d8/db/d43/c45 1 2021-04-09T18:25:44.708 INFO:tasks.workunit.client.0.smithi120.stdout:2/265: dwrite d13/f14 [0,4194304] 0 2021-04-09T18:25:44.710 INFO:tasks.workunit.client.0.smithi120.stdout:6/213: mknod d6/d8/db/d2b/c46 1 2021-04-09T18:25:44.716 INFO:tasks.workunit.client.0.smithi120.stdout:4/289: symlink d1f/d2c/d56/l62 0 2021-04-09T18:25:44.718 INFO:tasks.workunit.client.0.smithi120.stdout:2/266: dread - d13/d15/f2d zero size 2021-04-09T18:25:44.719 INFO:tasks.workunit.client.0.smithi120.stdout:6/214: write d6/d8/db/d12/f1f [675671,114229] 0 2021-04-09T18:25:44.719 INFO:tasks.workunit.client.0.smithi120.stdout:3/305: stat d3/d5/d36/d1e/d38/f44 0 2021-04-09T18:25:44.721 INFO:tasks.workunit.client.0.smithi120.stdout:2/267: chown d13/d1b 0 1 2021-04-09T18:25:44.722 INFO:tasks.workunit.client.0.smithi120.stdout:6/215: write d6/d8/db/d12/f1f [104879,15921] 0 2021-04-09T18:25:44.723 INFO:tasks.workunit.client.0.smithi120.stdout:0/257: truncate d0/d2/dd/f40 535730 0 2021-04-09T18:25:44.724 INFO:tasks.workunit.client.0.smithi120.stdout:2/268: mknod d13/c5e 1 2021-04-09T18:25:44.728 INFO:tasks.workunit.client.0.smithi120.stdout:9/281: dread f12 [0,4194304] 0 2021-04-09T18:25:44.731 INFO:tasks.workunit.client.0.smithi120.stdout:0/258: write d0/f30 [1770296,102509] 0 2021-04-09T18:25:44.736 INFO:tasks.workunit.client.0.smithi120.stdout:3/306: dwrite d3/de/d25/f15 [4194304,4194304] 0 2021-04-09T18:25:44.736 INFO:tasks.workunit.client.0.smithi120.stdout:1/189: getdents d5/d1f 0 2021-04-09T18:25:44.737 INFO:tasks.workunit.client.0.smithi120.stdout:1/190: fdatasync d5/d1f/d22/d24/f29 0 2021-04-09T18:25:44.738 INFO:tasks.workunit.client.0.smithi120.stdout:3/307: mknod d3/de/d25/d2f/d59/c69 1 2021-04-09T18:25:44.739 INFO:tasks.workunit.client.0.smithi120.stdout:6/216: read d6/d8/f10 [3528121,122849] 0 2021-04-09T18:25:44.743 INFO:tasks.workunit.client.0.smithi120.stdout:4/290: dwrite d1f/d2c/d3b/d3e/f43 [0,4194304] 0 2021-04-09T18:25:44.746 INFO:tasks.workunit.client.0.smithi120.stdout:4/291: mknod d1f/d2c/d3b/d3e/c63 1 2021-04-09T18:25:44.748 INFO:tasks.workunit.client.0.smithi120.stdout:7/188: dread db/d26/f2d [0,4194304] 0 2021-04-09T18:25:44.758 INFO:tasks.workunit.client.0.smithi120.stdout:2/269: fsync d13/d15/d35/f53 0 2021-04-09T18:25:44.758 INFO:tasks.workunit.client.0.smithi120.stdout:9/282: creat d19/d24/d37/f5f x:0 0 0 2021-04-09T18:25:44.761 INFO:tasks.workunit.client.0.smithi120.stdout:5/265: dread d10/d12/d1b/d1f/d33/d44/f54 [0,4194304] 0 2021-04-09T18:25:44.763 INFO:tasks.workunit.client.0.smithi120.stdout:8/208: dwrite d2/d27/f29 [0,4194304] 0 2021-04-09T18:25:44.763 INFO:tasks.workunit.client.0.smithi120.stdout:4/292: rename d1f/d2f to d1f/d2c/d3b/d3e/d64 0 2021-04-09T18:25:44.764 INFO:tasks.workunit.client.0.smithi120.stdout:9/283: mknod d19/d24/d36/d47/c60 1 2021-04-09T18:25:44.768 INFO:tasks.workunit.client.0.smithi120.stdout:1/191: write d5/d1f/d22/d24/d28/f36 [3550555,26791] 0 2021-04-09T18:25:44.774 INFO:tasks.workunit.client.0.smithi120.stdout:0/259: creat d0/f4e x:0 0 0 2021-04-09T18:25:44.776 INFO:tasks.workunit.client.0.smithi120.stdout:5/266: chown d10/d12/f3c 9 1 2021-04-09T18:25:44.783 INFO:tasks.workunit.client.0.smithi120.stdout:3/308: dwrite d3/d5/f31 [0,4194304] 0 2021-04-09T18:25:44.783 INFO:tasks.workunit.client.0.smithi120.stdout:7/189: mkdir db/d42 0 2021-04-09T18:25:44.785 INFO:tasks.workunit.client.0.smithi120.stdout:0/260: readlink d0/d2/dd/l1f 0 2021-04-09T18:25:44.793 INFO:tasks.workunit.client.0.smithi120.stdout:2/270: rename d13/d15/l3a to d13/d1b/d54/l5f 0 2021-04-09T18:25:44.794 INFO:tasks.workunit.client.0.smithi120.stdout:1/192: symlink d5/d1f/d22/l38 0 2021-04-09T18:25:44.800 INFO:tasks.workunit.client.0.smithi120.stdout:6/217: getdents d6/d8 0 2021-04-09T18:25:44.801 INFO:tasks.workunit.client.0.smithi120.stdout:3/309: mkdir d3/de/d25/d2f/d6a 0 2021-04-09T18:25:44.803 INFO:tasks.workunit.client.0.smithi120.stdout:9/284: dwrite d19/f3d [0,4194304] 0 2021-04-09T18:25:44.804 INFO:tasks.workunit.client.0.smithi120.stdout:2/271: creat d13/d1b/d54/f60 x:0 0 0 2021-04-09T18:25:44.808 INFO:tasks.workunit.client.0.smithi120.stdout:3/310: read - d3/de/d25/f65 zero size 2021-04-09T18:25:44.815 INFO:tasks.workunit.client.0.smithi120.stdout:3/311: chown d3/d5/d36/d1e/d38/l47 7846900 1 2021-04-09T18:25:44.815 INFO:tasks.workunit.client.0.smithi120.stdout:5/267: dwrite d10/f51 [0,4194304] 0 2021-04-09T18:25:44.816 INFO:tasks.workunit.client.0.smithi120.stdout:1/193: dwrite d5/f17 [0,4194304] 0 2021-04-09T18:25:44.822 INFO:tasks.workunit.client.0.smithi120.stdout:0/261: dwrite d0/d2/dd/f4b [0,4194304] 0 2021-04-09T18:25:44.826 INFO:tasks.workunit.client.0.smithi120.stdout:1/194: dread - d5/d1f/d22/d24/f29 zero size 2021-04-09T18:25:44.827 INFO:tasks.workunit.client.0.smithi120.stdout:9/285: dwrite d19/d24/f28 [0,4194304] 0 2021-04-09T18:25:44.829 INFO:tasks.workunit.client.0.smithi120.stdout:5/268: creat d10/d12/d3b/f67 x:0 0 0 2021-04-09T18:25:44.830 INFO:tasks.workunit.client.0.smithi120.stdout:0/262: symlink d0/d2/l4f 0 2021-04-09T18:25:44.835 INFO:tasks.workunit.client.0.smithi120.stdout:3/312: dread d3/de/d25/d2f/f3f [0,4194304] 0 2021-04-09T18:25:44.839 INFO:tasks.workunit.client.0.smithi120.stdout:2/272: dwrite f9 [4194304,4194304] 0 2021-04-09T18:25:44.839 INFO:tasks.workunit.client.0.smithi120.stdout:1/195: rename d5/d1f/d22/d2b/l31 to d5/d1f/d22/d2b/l39 0 2021-04-09T18:25:44.840 INFO:tasks.workunit.client.0.smithi120.stdout:5/269: write d10/d12/d1b/f66 [863179,632] 0 2021-04-09T18:25:44.842 INFO:tasks.workunit.client.0.smithi120.stdout:1/196: dread - d5/d1f/d22/d24/f2f zero size 2021-04-09T18:25:44.847 INFO:tasks.workunit.client.0.smithi120.stdout:9/286: dread d19/f54 [4194304,4194304] 0 2021-04-09T18:25:44.848 INFO:tasks.workunit.client.0.smithi120.stdout:9/287: chown d19/d24/f58 3 1 2021-04-09T18:25:44.848 INFO:tasks.workunit.client.0.smithi120.stdout:0/263: truncate d0/d2/f26 423257 0 2021-04-09T18:25:44.848 INFO:tasks.workunit.client.0.smithi120.stdout:5/270: mknod d10/d12/d1b/d3a/c68 1 2021-04-09T18:25:44.850 INFO:tasks.workunit.client.0.smithi120.stdout:9/288: dread d19/d1c/f27 [0,4194304] 0 2021-04-09T18:25:44.853 INFO:tasks.workunit.client.0.smithi120.stdout:9/289: write d19/d24/d2e/f3c [222815,126156] 0 2021-04-09T18:25:44.862 INFO:tasks.workunit.client.0.smithi120.stdout:0/264: chown d0/d2/da/l10 215 1 2021-04-09T18:25:44.863 INFO:tasks.workunit.client.0.smithi120.stdout:9/290: rmdir d19 39 2021-04-09T18:25:44.863 INFO:tasks.workunit.client.0.smithi120.stdout:1/197: creat d5/d1f/d22/d24/d28/d2d/f3a x:0 0 0 2021-04-09T18:25:44.863 INFO:tasks.workunit.client.0.smithi120.stdout:5/271: rmdir d10/d12/d3b 39 2021-04-09T18:25:44.864 INFO:tasks.workunit.client.0.smithi120.stdout:5/272: write d10/f16 [1374881,116040] 0 2021-04-09T18:25:44.866 INFO:tasks.workunit.client.0.smithi120.stdout:9/291: fsync d19/d24/d37/d40/f56 0 2021-04-09T18:25:44.867 INFO:tasks.workunit.client.0.smithi120.stdout:0/265: dread d0/d2/dd/f40 [0,4194304] 0 2021-04-09T18:25:44.867 INFO:tasks.workunit.client.0.smithi120.stdout:9/292: fdatasync f16 0 2021-04-09T18:25:44.870 INFO:tasks.workunit.client.0.smithi120.stdout:9/293: write d19/f3d [2299694,73423] 0 2021-04-09T18:25:44.871 INFO:tasks.workunit.client.0.smithi120.stdout:1/198: unlink d5/d1f/d22/d24/d28/l37 0 2021-04-09T18:25:44.876 INFO:tasks.workunit.client.0.smithi120.stdout:9/294: rename d19/d24/f58 to d19/d1c/d52/f61 0 2021-04-09T18:25:44.879 INFO:tasks.workunit.client.0.smithi120.stdout:1/199: write d5/d1f/d22/d24/f26 [37935,70496] 0 2021-04-09T18:25:44.881 INFO:tasks.workunit.client.0.smithi120.stdout:5/273: dwrite d10/d12/d1b/d1f/d33/d44/f65 [0,4194304] 0 2021-04-09T18:25:44.885 INFO:tasks.workunit.client.0.smithi120.stdout:5/274: readlink d10/d12/d1b/d1f/l37 0 2021-04-09T18:25:44.886 INFO:tasks.workunit.client.0.smithi120.stdout:1/200: fdatasync d5/d1f/d22/d24/d28/d2d/f3a 0 2021-04-09T18:25:44.889 INFO:tasks.workunit.client.0.smithi120.stdout:9/295: dwrite d19/d24/f55 [0,4194304] 0 2021-04-09T18:25:44.891 INFO:tasks.workunit.client.0.smithi120.stdout:1/201: symlink d5/d1f/d22/d24/d28/l3b 0 2021-04-09T18:25:44.893 INFO:tasks.workunit.client.0.smithi120.stdout:5/275: rename d10/d12/d1b/d1f/d33/d3d/f52 to d10/d12/d1b/d1f/d39/f69 0 2021-04-09T18:25:44.895 INFO:tasks.workunit.client.0.smithi120.stdout:1/202: symlink d5/d1f/d22/d2b/l3c 0 2021-04-09T18:25:44.895 INFO:tasks.workunit.client.0.smithi120.stdout:5/276: rename d10/d12 to d10/d12/d1b/d3a/d5b/d6a 22 2021-04-09T18:25:44.896 INFO:tasks.workunit.client.0.smithi120.stdout:9/296: symlink d19/d24/d36/d47/d4b/l62 0 2021-04-09T18:25:44.897 INFO:tasks.workunit.client.0.smithi120.stdout:1/203: write d5/d1f/d22/f27 [4961803,17342] 0 2021-04-09T18:25:44.901 INFO:tasks.workunit.client.0.smithi120.stdout:5/277: creat d10/d12/d35/f6b x:0 0 0 2021-04-09T18:25:44.903 INFO:tasks.workunit.client.0.smithi120.stdout:1/204: unlink d5/d1f/d22/d24/f26 0 2021-04-09T18:25:44.907 INFO:tasks.workunit.client.0.smithi120.stdout:9/297: dread d19/d1c/f1f [0,4194304] 0 2021-04-09T18:25:44.913 INFO:tasks.workunit.client.0.smithi120.stdout:9/298: chown d19/d1c/f23 186595515 1 2021-04-09T18:25:44.914 INFO:tasks.workunit.client.0.smithi120.stdout:1/205: dwrite d5/d1f/d22/d24/f2f [0,4194304] 0 2021-04-09T18:25:44.928 INFO:tasks.workunit.client.0.smithi120.stdout:9/299: mkdir d19/d1c/d29/d63 0 2021-04-09T18:25:44.929 INFO:tasks.workunit.client.0.smithi120.stdout:1/206: symlink d5/l3d 0 2021-04-09T18:25:44.929 INFO:tasks.workunit.client.0.smithi120.stdout:5/278: truncate d10/d12/d1b/d1f/f64 777540 0 2021-04-09T18:25:44.931 INFO:tasks.workunit.client.0.smithi120.stdout:9/300: mknod d19/d24/d37/d40/c64 1 2021-04-09T18:25:44.931 INFO:tasks.workunit.client.0.smithi120.stdout:5/279: stat d10/d12/f17 0 2021-04-09T18:25:44.934 INFO:tasks.workunit.client.0.smithi120.stdout:5/280: fsync d10/d12/d1b/d1f/f29 0 2021-04-09T18:25:44.935 INFO:tasks.workunit.client.0.smithi120.stdout:1/207: creat d5/d1f/d22/d24/d28/d2d/f3e x:0 0 0 2021-04-09T18:25:44.937 INFO:tasks.workunit.client.0.smithi120.stdout:5/281: stat d10/d12/f19 0 2021-04-09T18:25:44.938 INFO:tasks.workunit.client.0.smithi120.stdout:5/282: dread - d10/d12/d1b/d1f/f63 zero size 2021-04-09T18:25:44.939 INFO:tasks.workunit.client.0.smithi120.stdout:1/208: rename d5/d1f/l12 to d5/d1f/d22/l3f 0 2021-04-09T18:25:44.940 INFO:tasks.workunit.client.0.smithi120.stdout:3/313: dread d3/f8 [4194304,4194304] 0 2021-04-09T18:25:44.941 INFO:tasks.workunit.client.0.smithi120.stdout:1/209: write d5/d1f/f15 [1479224,65942] 0 2021-04-09T18:25:44.942 INFO:tasks.workunit.client.0.smithi120.stdout:5/283: rename d10/l13 to d10/d12/d1b/d3a/l6c 0 2021-04-09T18:25:44.945 INFO:tasks.workunit.client.0.smithi120.stdout:1/210: mkdir d5/d1f/d22/d24/d40 0 2021-04-09T18:25:44.948 INFO:tasks.workunit.client.0.smithi120.stdout:3/314: dwrite d3/de/d25/d2f/f3f [0,4194304] 0 2021-04-09T18:25:44.953 INFO:tasks.workunit.client.0.smithi120.stdout:3/315: rmdir d3/de/d25/d2f/d49/d4e 39 2021-04-09T18:25:44.953 INFO:tasks.workunit.client.0.smithi120.stdout:1/211: rmdir d5/d1f/d22/d24/d40 0 2021-04-09T18:25:44.954 INFO:tasks.workunit.client.0.smithi120.stdout:3/316: fsync d3/f42 0 2021-04-09T18:25:44.955 INFO:tasks.workunit.client.0.smithi120.stdout:3/317: write d3/de/f4f [108779,118293] 0 2021-04-09T18:25:44.958 INFO:tasks.workunit.client.0.smithi120.stdout:1/212: creat d5/d1f/d22/d24/f41 x:0 0 0 2021-04-09T18:25:44.959 INFO:tasks.workunit.client.0.smithi120.stdout:1/213: dread - d5/d1f/d22/d24/f29 zero size 2021-04-09T18:25:44.960 INFO:tasks.workunit.client.0.smithi120.stdout:1/214: chown d5/d1f/d22/d24/f29 2839 1 2021-04-09T18:25:44.966 INFO:tasks.workunit.client.0.smithi120.stdout:1/215: dwrite d5/f17 [0,4194304] 0 2021-04-09T18:25:44.970 INFO:tasks.workunit.client.0.smithi120.stdout:1/216: dread d5/f20 [0,4194304] 0 2021-04-09T18:25:44.988 INFO:tasks.workunit.client.0.smithi120.stdout:0/266: dread d0/d2/f27 [0,4194304] 0 2021-04-09T18:25:45.007 INFO:tasks.workunit.client.0.smithi120.stdout:4/293: dwrite d1f/d24/f26 [0,4194304] 0 2021-04-09T18:25:45.008 INFO:tasks.workunit.client.0.smithi120.stdout:8/209: write d2/d3/d11/ff [1147775,50665] 0 2021-04-09T18:25:45.011 INFO:tasks.workunit.client.0.smithi120.stdout:8/210: write d2/d3/f1a [1284394,125635] 0 2021-04-09T18:25:45.012 INFO:tasks.workunit.client.0.smithi120.stdout:1/217: creat d5/f42 x:0 0 0 2021-04-09T18:25:45.013 INFO:tasks.workunit.client.0.smithi120.stdout:7/190: write f4 [1780788,97704] 0 2021-04-09T18:25:45.014 INFO:tasks.workunit.client.0.smithi120.stdout:1/218: chown d5/f42 5901 1 2021-04-09T18:25:45.014 INFO:tasks.workunit.client.0.smithi120.stdout:3/318: rename d3/de/d25/d2f to d3/d5/d36/d1e/d6b 0 2021-04-09T18:25:45.017 INFO:tasks.workunit.client.0.smithi120.stdout:8/211: readlink d2/d3/d11/d2c/d2e/d3b/l35 0 2021-04-09T18:25:45.021 INFO:tasks.workunit.client.0.smithi120.stdout:4/294: dwrite d1f/f23 [0,4194304] 0 2021-04-09T18:25:45.024 INFO:tasks.workunit.client.0.smithi120.stdout:1/219: chown d5/d1f/d22/d24/d28 1044124355 1 2021-04-09T18:25:45.035 INFO:tasks.workunit.client.0.smithi120.stdout:1/220: dwrite d5/d1f/d22/d24/f2f [0,4194304] 0 2021-04-09T18:25:45.036 INFO:tasks.workunit.client.0.smithi120.stdout:7/191: creat db/d42/f43 x:0 0 0 2021-04-09T18:25:45.044 INFO:tasks.workunit.client.0.smithi120.stdout:5/284: write d10/d12/d1b/d1f/f57 [745674,124411] 0 2021-04-09T18:25:45.049 INFO:tasks.workunit.client.0.smithi120.stdout:8/212: rmdir d2/d3/d11/d2c/d2e 39 2021-04-09T18:25:45.052 INFO:tasks.workunit.client.0.smithi120.stdout:5/285: chown d10/d12/d1b/d1f/d39 423 1 2021-04-09T18:25:45.058 INFO:tasks.workunit.client.0.smithi120.stdout:5/286: write d10/d12/d1b/d1f/d33/d44/f49 [266634,115638] 0 2021-04-09T18:25:45.058 INFO:tasks.workunit.client.0.smithi120.stdout:7/192: write db/f29 [834508,62085] 0 2021-04-09T18:25:45.058 INFO:tasks.workunit.client.0.smithi120.stdout:1/221: creat d5/d1f/d22/d24/f43 x:0 0 0 2021-04-09T18:25:45.059 INFO:tasks.workunit.client.0.smithi120.stdout:6/218: truncate d6/d8/db/d12/d22/f2a 3475989 0 2021-04-09T18:25:45.059 INFO:tasks.workunit.client.0.smithi120.stdout:7/193: write f6 [339107,69608] 0 2021-04-09T18:25:45.060 INFO:tasks.workunit.client.0.smithi120.stdout:3/319: getdents d3/d5/d36/d3d 0 2021-04-09T18:25:45.069 INFO:tasks.workunit.client.0.smithi120.stdout:0/267: rename d0/d2/dd/l1f to d0/l50 0 2021-04-09T18:25:45.070 INFO:tasks.workunit.client.0.smithi120.stdout:9/301: truncate d19/d24/d2e/f3c 1083909 0 2021-04-09T18:25:45.070 INFO:tasks.workunit.client.0.smithi120.stdout:8/213: creat d2/d3/d3c/f43 x:0 0 0 2021-04-09T18:25:45.071 INFO:tasks.workunit.client.0.smithi120.stdout:6/219: creat d6/d8/d1a/f47 x:0 0 0 2021-04-09T18:25:45.072 INFO:tasks.workunit.client.0.smithi120.stdout:5/287: creat d10/d12/d1b/d1f/d33/d3d/f6d x:0 0 0 2021-04-09T18:25:45.089 INFO:tasks.workunit.client.0.smithi120.stdout:3/320: dwrite d3/d5/d36/d1e/d6b/f35 [0,4194304] 0 2021-04-09T18:25:45.095 INFO:tasks.workunit.client.0.smithi120.stdout:2/273: truncate d13/d15/d35/f53 234696 0 2021-04-09T18:25:45.099 INFO:tasks.workunit.client.0.smithi120.stdout:6/220: creat d6/d8/d3a/f48 x:0 0 0 2021-04-09T18:25:45.106 INFO:tasks.workunit.client.0.smithi120.stdout:7/194: creat db/d2c/f44 x:0 0 0 2021-04-09T18:25:45.107 INFO:tasks.workunit.client.0.smithi120.stdout:8/214: mkdir d2/d3/d11/d2c/d44 0 2021-04-09T18:25:45.108 INFO:tasks.workunit.client.0.smithi120.stdout:4/295: truncate d1f/d2c/d3b/d3e/f54 4097456 0 2021-04-09T18:25:45.109 INFO:tasks.workunit.client.0.smithi120.stdout:3/321: creat d3/d5/d36/d3d/f6c x:0 0 0 2021-04-09T18:25:45.111 INFO:tasks.workunit.client.0.smithi120.stdout:4/296: chown d1f/d24/d42 6008 1 2021-04-09T18:25:45.111 INFO:tasks.workunit.client.0.smithi120.stdout:6/221: unlink d6/d8/d1a/f47 0 2021-04-09T18:25:45.113 INFO:tasks.workunit.client.0.smithi120.stdout:5/288: rename d10/f51 to d10/f6e 0 2021-04-09T18:25:45.114 INFO:tasks.workunit.client.0.smithi120.stdout:7/195: read db/f15 [1352172,18055] 0 2021-04-09T18:25:45.116 INFO:tasks.workunit.client.0.smithi120.stdout:7/196: chown f7 9074344 1 2021-04-09T18:25:45.122 INFO:tasks.workunit.client.0.smithi120.stdout:7/197: creat db/d26/f45 x:0 0 0 2021-04-09T18:25:45.123 INFO:tasks.workunit.client.0.smithi120.stdout:3/322: dwrite d3/d5/f31 [4194304,4194304] 0 2021-04-09T18:25:45.124 INFO:tasks.workunit.client.0.smithi120.stdout:7/198: fsync db/f2f 0 2021-04-09T18:25:45.130 INFO:tasks.workunit.client.0.smithi120.stdout:1/222: symlink d5/d1f/l44 0 2021-04-09T18:25:45.131 INFO:tasks.workunit.client.0.smithi120.stdout:0/268: dwrite d0/d2/dd/f40 [0,4194304] 0 2021-04-09T18:25:45.133 INFO:tasks.workunit.client.0.smithi120.stdout:0/269: mknod d0/d2/da/d2e/c51 1 2021-04-09T18:25:45.134 INFO:tasks.workunit.client.0.smithi120.stdout:3/323: mkdir d3/d5/d36/d1e/d38/d6d 0 2021-04-09T18:25:45.134 INFO:tasks.workunit.client.0.smithi120.stdout:3/324: fsync d3/de/d25/f22 0 2021-04-09T18:25:45.137 INFO:tasks.workunit.client.0.smithi120.stdout:0/270: readlink d0/d2/l7 0 2021-04-09T18:25:45.139 INFO:tasks.workunit.client.0.smithi120.stdout:8/215: dread d2/d3/f1a [0,4194304] 0 2021-04-09T18:25:45.139 INFO:tasks.workunit.client.0.smithi120.stdout:0/271: write d0/d2/da/f37 [348549,106910] 0 2021-04-09T18:25:45.145 INFO:tasks.workunit.client.0.smithi120.stdout:1/223: fdatasync d5/f20 0 2021-04-09T18:25:45.146 INFO:tasks.workunit.client.0.smithi120.stdout:5/289: getdents d10/d12/d1b/d1f/d33/d44 0 2021-04-09T18:25:45.146 INFO:tasks.workunit.client.0.smithi120.stdout:1/224: mknod d5/d1f/d22/d24/c45 1 2021-04-09T18:25:45.146 INFO:tasks.workunit.client.0.smithi120.stdout:5/290: mknod d10/d12/d1b/d3a/c6f 1 2021-04-09T18:25:45.148 INFO:tasks.workunit.client.0.smithi120.stdout:4/297: truncate d1f/d2c/d3b/f53 7386619 0 2021-04-09T18:25:45.148 INFO:tasks.workunit.client.0.smithi120.stdout:8/216: write d2/d3/d11/f34 [885146,22436] 0 2021-04-09T18:25:45.150 INFO:tasks.workunit.client.0.smithi120.stdout:8/217: mknod d2/d37/d3e/d42/c45 1 2021-04-09T18:25:45.153 INFO:tasks.workunit.client.0.smithi120.stdout:2/274: dread d13/d15/f2a [8388608,4194304] 0 2021-04-09T18:25:45.154 INFO:tasks.workunit.client.0.smithi120.stdout:2/275: chown d13/f14 37971968 1 2021-04-09T18:25:45.155 INFO:tasks.workunit.client.0.smithi120.stdout:0/272: mkdir d0/d52 0 2021-04-09T18:25:45.156 INFO:tasks.workunit.client.0.smithi120.stdout:2/276: stat d13/d1b 0 2021-04-09T18:25:45.157 INFO:tasks.workunit.client.0.smithi120.stdout:4/298: rmdir d1f 39 2021-04-09T18:25:45.158 INFO:tasks.workunit.client.0.smithi120.stdout:3/325: rmdir d3/d5/d36/d1e/d6b/d49/d4e/d54/d55 0 2021-04-09T18:25:45.159 INFO:tasks.workunit.client.0.smithi120.stdout:5/291: write d10/d12/f27 [1346009,102989] 0 2021-04-09T18:25:45.159 INFO:tasks.workunit.client.0.smithi120.stdout:8/218: unlink d2/d3/d11/f36 0 2021-04-09T18:25:45.159 INFO:tasks.workunit.client.0.smithi120.stdout:1/225: dread d5/f17 [0,4194304] 0 2021-04-09T18:25:45.160 INFO:tasks.workunit.client.0.smithi120.stdout:0/273: symlink d0/d43/l53 0 2021-04-09T18:25:45.162 INFO:tasks.workunit.client.0.smithi120.stdout:3/326: fdatasync d3/d5/d36/d1e/d38/f44 0 2021-04-09T18:25:45.163 INFO:tasks.workunit.client.0.smithi120.stdout:5/292: chown d10/d12/d35/l5c 15916 1 2021-04-09T18:25:45.164 INFO:tasks.workunit.client.0.smithi120.stdout:8/219: fsync d2/f2d 0 2021-04-09T18:25:45.164 INFO:tasks.workunit.client.0.smithi120.stdout:0/274: fdatasync d0/d2/f3b 0 2021-04-09T18:25:45.168 INFO:tasks.workunit.client.0.smithi120.stdout:1/226: creat d5/d1f/d22/d24/d28/f46 x:0 0 0 2021-04-09T18:25:45.168 INFO:tasks.workunit.client.0.smithi120.stdout:0/275: chown d0/l15 5221337 1 2021-04-09T18:25:45.169 INFO:tasks.workunit.client.0.smithi120.stdout:5/293: stat d10/d12/d3b 0 2021-04-09T18:25:45.169 INFO:tasks.workunit.client.0.smithi120.stdout:3/327: creat d3/d5/d36/d3d/f6e x:0 0 0 2021-04-09T18:25:45.173 INFO:tasks.workunit.client.0.smithi120.stdout:1/227: read - d5/f42 zero size 2021-04-09T18:25:45.173 INFO:tasks.workunit.client.0.smithi120.stdout:8/220: write d2/d3/f1a [143673,8406] 0 2021-04-09T18:25:45.176 INFO:tasks.workunit.client.0.smithi120.stdout:5/294: creat d10/d12/d1b/d1f/d33/d3d/d50/f70 x:0 0 0 2021-04-09T18:25:45.181 INFO:tasks.workunit.client.0.smithi120.stdout:5/295: write d10/d12/d1b/d1f/f4d [483816,110761] 0 2021-04-09T18:25:45.186 INFO:tasks.workunit.client.0.smithi120.stdout:1/228: creat d5/d1f/d22/d2b/f47 x:0 0 0 2021-04-09T18:25:45.188 INFO:tasks.workunit.client.0.smithi120.stdout:0/276: dwrite d0/d2/da/f37 [0,4194304] 0 2021-04-09T18:25:45.190 INFO:tasks.workunit.client.0.smithi120.stdout:2/277: dwrite d13/f25 [0,4194304] 0 2021-04-09T18:25:45.192 INFO:tasks.workunit.client.0.smithi120.stdout:1/229: read - d5/d1f/d22/d24/d28/d2d/f3e zero size 2021-04-09T18:25:45.192 INFO:tasks.workunit.client.0.smithi120.stdout:2/278: readlink d13/l32 0 2021-04-09T18:25:45.193 INFO:tasks.workunit.client.0.smithi120.stdout:5/296: rmdir d10 39 2021-04-09T18:25:45.209 INFO:tasks.workunit.client.0.smithi120.stdout:0/277: fdatasync d0/d2/f26 0 2021-04-09T18:25:45.210 INFO:tasks.workunit.client.0.smithi120.stdout:4/299: dread d1f/d2c/d30/f4d [0,4194304] 0 2021-04-09T18:25:45.211 INFO:tasks.workunit.client.0.smithi120.stdout:0/278: write d0/d2/dd/f40 [1520121,34850] 0 2021-04-09T18:25:45.213 INFO:tasks.workunit.client.0.smithi120.stdout:1/230: rename d5/d1f/d22/d24/d28/d2d/f3e to d5/d1f/d22/d24/f48 0 2021-04-09T18:25:45.219 INFO:tasks.workunit.client.0.smithi120.stdout:0/279: dwrite d0/fc [8388608,4194304] 0 2021-04-09T18:25:45.248 INFO:tasks.workunit.client.0.smithi120.stdout:5/297: dread d10/f16 [0,4194304] 0 2021-04-09T18:25:45.252 INFO:tasks.workunit.client.0.smithi120.stdout:1/231: rename d5/l3d to d5/d1f/d22/d24/d28/l49 0 2021-04-09T18:25:45.257 INFO:tasks.workunit.client.0.smithi120.stdout:3/328: truncate d3/d5/f4d 5210859 0 2021-04-09T18:25:45.258 INFO:tasks.workunit.client.0.smithi120.stdout:2/279: truncate d13/f2c 606458 0 2021-04-09T18:25:45.259 INFO:tasks.workunit.client.0.smithi120.stdout:5/298: link fd d10/d12/d1b/d1f/f71 0 2021-04-09T18:25:45.263 INFO:tasks.workunit.client.0.smithi120.stdout:2/280: read d13/f2e [85218,48333] 0 2021-04-09T18:25:45.267 INFO:tasks.workunit.client.0.smithi120.stdout:5/299: creat d10/d12/f72 x:0 0 0 2021-04-09T18:25:45.268 INFO:tasks.workunit.client.0.smithi120.stdout:4/300: dwrite d1f/d2c/d3b/f4c [0,4194304] 0 2021-04-09T18:25:45.271 INFO:tasks.workunit.client.0.smithi120.stdout:2/281: dread d13/f14 [0,4194304] 0 2021-04-09T18:25:45.275 INFO:tasks.workunit.client.0.smithi120.stdout:3/329: truncate d3/de/f4f 281388 0 2021-04-09T18:25:45.275 INFO:tasks.workunit.client.0.smithi120.stdout:1/232: write d5/d1f/d22/d24/d28/d2d/f3a [47671,23803] 0 2021-04-09T18:25:45.276 INFO:tasks.workunit.client.0.smithi120.stdout:3/330: chown d3/l58 21246007 1 2021-04-09T18:25:45.281 INFO:tasks.workunit.client.0.smithi120.stdout:2/282: mkdir d13/d61 0 2021-04-09T18:25:45.286 INFO:tasks.workunit.client.0.smithi120.stdout:3/331: dwrite d3/f6 [0,4194304] 0 2021-04-09T18:25:45.287 INFO:tasks.workunit.client.0.smithi120.stdout:5/300: rename d10/d12/d1b/d1f/d39/f69 to d10/f73 0 2021-04-09T18:25:45.288 INFO:tasks.workunit.client.0.smithi120.stdout:1/233: dwrite d5/d1f/d22/d24/d28/d2d/f3a [0,4194304] 0 2021-04-09T18:25:45.289 INFO:tasks.workunit.client.0.smithi120.stdout:4/301: dread d1f/f28 [0,4194304] 0 2021-04-09T18:25:45.291 INFO:tasks.workunit.client.0.smithi120.stdout:5/301: creat d10/d12/d1b/d3a/f74 x:0 0 0 2021-04-09T18:25:45.292 INFO:tasks.workunit.client.0.smithi120.stdout:2/283: write d13/f47 [605055,121034] 0 2021-04-09T18:25:45.293 INFO:tasks.workunit.client.0.smithi120.stdout:2/284: mknod d13/d1b/d48/c62 1 2021-04-09T18:25:45.294 INFO:tasks.workunit.client.0.smithi120.stdout:1/234: unlink d5/l16 0 2021-04-09T18:25:45.296 INFO:tasks.workunit.client.0.smithi120.stdout:3/332: creat d3/d5/d36/d1e/d6b/d49/d4e/f6f x:0 0 0 2021-04-09T18:25:45.305 INFO:tasks.workunit.client.0.smithi120.stdout:1/235: symlink d5/d1f/d22/d2b/l4a 0 2021-04-09T18:25:45.306 INFO:tasks.workunit.client.0.smithi120.stdout:2/285: symlink d13/l63 0 2021-04-09T18:25:45.314 INFO:tasks.workunit.client.0.smithi120.stdout:3/333: rename d3/f8 to d3/f70 0 2021-04-09T18:25:45.315 INFO:tasks.workunit.client.0.smithi120.stdout:5/302: getdents d10/d12/d35 0 2021-04-09T18:25:45.319 INFO:tasks.workunit.client.0.smithi120.stdout:4/302: creat d1f/d24/d42/d49/f65 x:0 0 0 2021-04-09T18:25:45.323 INFO:tasks.workunit.client.0.smithi120.stdout:2/286: fsync d13/d1b/f33 0 2021-04-09T18:25:45.325 INFO:tasks.workunit.client.0.smithi120.stdout:1/236: dwrite d5/d1f/d22/d2b/f47 [0,4194304] 0 2021-04-09T18:25:45.325 INFO:tasks.workunit.client.0.smithi120.stdout:3/334: write d3/f70 [5301028,112039] 0 2021-04-09T18:25:45.327 INFO:tasks.workunit.client.0.smithi120.stdout:4/303: creat d1f/d2c/d34/f66 x:0 0 0 2021-04-09T18:25:45.328 INFO:tasks.workunit.client.0.smithi120.stdout:4/304: fsync d1f/d2c/f2e 0 2021-04-09T18:25:45.343 INFO:tasks.workunit.client.0.smithi120.stdout:4/305: rmdir d1f/d2c 39 2021-04-09T18:25:45.345 INFO:tasks.workunit.client.0.smithi120.stdout:5/303: link d10/d12/d1b/d1f/d33/l38 d10/d12/d1b/d1f/d33/d3d/l75 0 2021-04-09T18:25:45.348 INFO:tasks.workunit.client.0.smithi120.stdout:5/304: write d10/f16 [1427992,25399] 0 2021-04-09T18:25:45.350 INFO:tasks.workunit.client.0.smithi120.stdout:1/237: rename d5/d1f/d22/l3f to d5/l4b 0 2021-04-09T18:25:45.357 INFO:tasks.workunit.client.0.smithi120.stdout:4/306: link d1f/d2c/d3b/d3e/d64/l31 d1f/d24/l67 0 2021-04-09T18:25:45.360 INFO:tasks.workunit.client.0.smithi120.stdout:1/238: dwrite d5/d1f/d22/d24/d28/f36 [0,4194304] 0 2021-04-09T18:25:45.362 INFO:tasks.workunit.client.0.smithi120.stdout:4/307: dread d1f/f23 [0,4194304] 0 2021-04-09T18:25:45.364 INFO:tasks.workunit.client.0.smithi120.stdout:2/287: write d13/d15/d35/f5b [1516203,50170] 0 2021-04-09T18:25:45.366 INFO:tasks.workunit.client.0.smithi120.stdout:5/305: truncate d10/d12/d1b/d1f/f64 742102 0 2021-04-09T18:25:45.370 INFO:tasks.workunit.client.0.smithi120.stdout:1/239: dread d5/d1f/d22/d24/d28/f36 [0,4194304] 0 2021-04-09T18:25:45.372 INFO:tasks.workunit.client.0.smithi120.stdout:2/288: mkdir d13/d1b/d48/d49/d64 0 2021-04-09T18:25:45.374 INFO:tasks.workunit.client.0.smithi120.stdout:2/289: readlink d13/l22 0 2021-04-09T18:25:45.375 INFO:tasks.workunit.client.0.smithi120.stdout:3/335: dread d3/d5/d36/d1e/d38/f44 [0,4194304] 0 2021-04-09T18:25:45.375 INFO:tasks.workunit.client.0.smithi120.stdout:5/306: read d10/d12/f3c [1235830,124837] 0 2021-04-09T18:25:45.379 INFO:tasks.workunit.client.0.smithi120.stdout:5/307: dread - d10/d12/d3b/f67 zero size 2021-04-09T18:25:45.380 INFO:tasks.workunit.client.0.smithi120.stdout:2/290: creat d13/d1b/d48/d58/f65 x:0 0 0 2021-04-09T18:25:45.382 INFO:tasks.workunit.client.0.smithi120.stdout:3/336: symlink d3/d5/d36/d1e/d6b/d59/d68/l71 0 2021-04-09T18:25:45.384 INFO:tasks.workunit.client.0.smithi120.stdout:5/308: write d10/d12/d1b/d1f/d33/d3d/f6d [44824,25811] 0 2021-04-09T18:25:45.387 INFO:tasks.workunit.client.0.smithi120.stdout:2/291: dread d13/f2e [0,4194304] 0 2021-04-09T18:25:45.389 INFO:tasks.workunit.client.0.smithi120.stdout:5/309: rename d10/d12/f72 to d10/d12/d3b/f76 0 2021-04-09T18:25:45.392 INFO:tasks.workunit.client.0.smithi120.stdout:2/292: chown d13/d15/f24 737229 1 2021-04-09T18:25:45.396 INFO:tasks.workunit.client.0.smithi120.stdout:3/337: dwrite d3/d5/d36/f23 [4194304,4194304] 0 2021-04-09T18:25:45.396 INFO:tasks.workunit.client.0.smithi120.stdout:3/338: chown d3/de/d25/f15 0 1 2021-04-09T18:25:45.396 INFO:tasks.workunit.client.0.smithi120.stdout:2/293: read d13/d15/f42 [135299,62969] 0 2021-04-09T18:25:45.398 INFO:tasks.workunit.client.0.smithi120.stdout:5/310: link fd d10/d12/f77 0 2021-04-09T18:25:45.402 INFO:tasks.workunit.client.0.smithi120.stdout:3/339: rmdir d3/d5/d36/d1e/d6b/d49/d4e/d54 39 2021-04-09T18:25:45.404 INFO:tasks.workunit.client.0.smithi120.stdout:2/294: dwrite d13/f25 [0,4194304] 0 2021-04-09T18:25:45.406 INFO:tasks.workunit.client.0.smithi120.stdout:2/295: chown d13/d1b/d54/f60 372 1 2021-04-09T18:25:45.407 INFO:tasks.workunit.client.0.smithi120.stdout:5/311: dwrite d10/d12/d35/f6b [0,4194304] 0 2021-04-09T18:25:45.428 INFO:tasks.workunit.client.0.smithi120.stdout:2/296: dwrite d13/d15/f2a [0,4194304] 0 2021-04-09T18:25:45.431 INFO:tasks.workunit.client.0.smithi120.stdout:2/297: readlink d13/l22 0 2021-04-09T18:25:45.437 INFO:tasks.workunit.client.0.smithi120.stdout:2/298: dwrite d13/d15/d35/f5d [0,4194304] 0 2021-04-09T18:25:45.440 INFO:tasks.workunit.client.0.smithi120.stdout:1/240: truncate d5/d1f/d22/d24/f2f 1707535 0 2021-04-09T18:25:45.440 INFO:tasks.workunit.client.0.smithi120.stdout:5/312: mkdir d10/d12/d1b/d3a/d5b/d78 0 2021-04-09T18:25:45.448 INFO:tasks.workunit.client.0.smithi120.stdout:5/313: creat d10/d12/d1b/d1f/f79 x:0 0 0 2021-04-09T18:25:45.449 INFO:tasks.workunit.client.0.smithi120.stdout:3/340: truncate d3/d5/d36/d3d/f6c 479771 0 2021-04-09T18:25:45.450 INFO:tasks.workunit.client.0.smithi120.stdout:5/314: mknod d10/d12/d1b/d3a/c7a 1 2021-04-09T18:25:45.452 INFO:tasks.workunit.client.0.smithi120.stdout:3/341: write d3/f70 [3783571,3233] 0 2021-04-09T18:25:45.453 INFO:tasks.workunit.client.0.smithi120.stdout:3/342: read - d3/f37 zero size 2021-04-09T18:25:45.454 INFO:tasks.workunit.client.0.smithi120.stdout:1/241: dwrite d5/d1f/d22/d24/d28/f46 [0,4194304] 0 2021-04-09T18:25:45.460 INFO:tasks.workunit.client.0.smithi120.stdout:5/315: dwrite d10/d12/d3b/f67 [0,4194304] 0 2021-04-09T18:25:45.476 INFO:tasks.workunit.client.0.smithi120.stdout:5/316: creat d10/d12/d1b/d1f/d33/f7b x:0 0 0 2021-04-09T18:25:45.484 INFO:tasks.workunit.client.0.smithi120.stdout:5/317: write d10/d12/d1b/f34 [1260350,93944] 0 2021-04-09T18:25:45.485 INFO:tasks.workunit.client.0.smithi120.stdout:5/318: mknod d10/d12/d1b/d1f/d39/c7c 1 2021-04-09T18:25:45.494 INFO:tasks.workunit.client.0.smithi120.stdout:5/319: symlink d10/d12/d3b/l7d 0 2021-04-09T18:25:45.505 INFO:tasks.workunit.client.0.smithi120.stdout:5/320: dread d10/d12/d1b/f66 [0,4194304] 0 2021-04-09T18:25:45.507 INFO:tasks.workunit.client.0.smithi120.stdout:5/321: chown d10/d12/f1a 26505092 1 2021-04-09T18:25:45.509 INFO:tasks.workunit.client.0.smithi120.stdout:1/242: truncate d5/d1f/d22/d24/f48 135202 0 2021-04-09T18:25:45.509 INFO:tasks.workunit.client.0.smithi120.stdout:1/243: readlink d5/d1f/d22/d2b/l3c 0 2021-04-09T18:25:45.510 INFO:tasks.workunit.client.0.smithi120.stdout:1/244: mknod d5/d1f/d22/d24/c4c 1 2021-04-09T18:25:45.511 INFO:tasks.workunit.client.0.smithi120.stdout:1/245: mknod d5/d1f/d22/d2b/c4d 1 2021-04-09T18:25:45.515 INFO:tasks.workunit.client.0.smithi120.stdout:5/322: dread d10/d12/f19 [0,4194304] 0 2021-04-09T18:25:45.517 INFO:tasks.workunit.client.0.smithi120.stdout:5/323: dread d10/d12/d1b/d1f/d33/d44/f54 [0,4194304] 0 2021-04-09T18:25:45.518 INFO:tasks.workunit.client.0.smithi120.stdout:5/324: fsync d10/f2b 0 2021-04-09T18:25:45.520 INFO:tasks.workunit.client.0.smithi120.stdout:5/325: unlink d10/f2f 0 2021-04-09T18:25:45.523 INFO:tasks.workunit.client.0.smithi120.stdout:5/326: symlink d10/d12/d1b/d1f/d33/d3d/d50/l7e 0 2021-04-09T18:25:45.524 INFO:tasks.workunit.client.0.smithi120.stdout:5/327: chown d10/d12/d35/l47 12378 1 2021-04-09T18:25:45.525 INFO:tasks.workunit.client.0.smithi120.stdout:5/328: dread - d10/d12/d1b/d1f/d33/f7b zero size 2021-04-09T18:25:45.530 INFO:tasks.workunit.client.0.smithi120.stdout:3/343: dread d3/d5/f2c [0,4194304] 0 2021-04-09T18:25:45.532 INFO:tasks.workunit.client.0.smithi120.stdout:1/246: dread d5/f7 [0,4194304] 0 2021-04-09T18:25:45.533 INFO:tasks.workunit.client.0.smithi120.stdout:5/329: link d10/l58 d10/d12/d1b/d1f/d33/d3d/d50/l7f 0 2021-04-09T18:25:45.533 INFO:tasks.workunit.client.0.smithi120.stdout:3/344: stat d3/d5/d36/d1e/d6b/d49/d4e/f6f 0 2021-04-09T18:25:45.533 INFO:tasks.workunit.client.0.smithi120.stdout:1/247: fdatasync d5/f20 0 2021-04-09T18:25:45.538 INFO:tasks.workunit.client.0.smithi120.stdout:5/330: dwrite d10/d12/f17 [4194304,4194304] 0 2021-04-09T18:25:45.542 INFO:tasks.workunit.client.0.smithi120.stdout:1/248: dwrite d5/f20 [0,4194304] 0 2021-04-09T18:25:45.547 INFO:tasks.workunit.client.0.smithi120.stdout:5/331: rename d10/d12/f1e to d10/d12/d1b/d1f/d39/f80 0 2021-04-09T18:25:45.751 INFO:tasks.workunit.client.0.smithi120.stdout:1/249: chown d5/d1f/d22/d24/f48 98589 1 2021-04-09T18:25:45.752 INFO:tasks.workunit.client.0.smithi120.stdout:1/250: stat d5/d1f/l1e 0 2021-04-09T18:25:45.753 INFO:tasks.workunit.client.0.smithi120.stdout:5/332: creat d10/d12/d1b/d3a/d5b/d78/f81 x:0 0 0 2021-04-09T18:25:45.753 INFO:tasks.workunit.client.0.smithi120.stdout:1/251: read d5/f7 [245480,10866] 0 2021-04-09T18:25:45.754 INFO:tasks.workunit.client.0.smithi120.stdout:5/333: chown d10/d12/d1b/d1f/f59 34930969 1 2021-04-09T18:25:45.755 INFO:tasks.workunit.client.0.smithi120.stdout:1/252: symlink d5/l4e 0 2021-04-09T18:25:45.756 INFO:tasks.workunit.client.0.smithi120.stdout:5/334: symlink d10/d12/d1b/l82 0 2021-04-09T18:25:45.762 INFO:tasks.workunit.client.0.smithi120.stdout:1/253: link d5/l23 d5/d1f/d22/d24/l4f 0 2021-04-09T18:25:45.762 INFO:tasks.workunit.client.0.smithi120.stdout:5/335: dwrite d10/d12/d1b/d1f/d33/d3d/f3f [0,4194304] 0 2021-04-09T18:25:45.763 INFO:tasks.workunit.client.0.smithi120.stdout:1/254: stat d5/d1f/d22/d2b/l4a 0 2021-04-09T18:25:45.764 INFO:tasks.workunit.client.0.smithi120.stdout:5/336: chown d10/l58 49810 1 2021-04-09T18:25:45.765 INFO:tasks.workunit.client.0.smithi120.stdout:5/337: fdatasync d10/d12/d1b/d1f/f56 0 2021-04-09T18:25:45.767 INFO:tasks.workunit.client.0.smithi120.stdout:1/255: unlink d5/f42 0 2021-04-09T18:25:45.768 INFO:tasks.workunit.client.0.smithi120.stdout:5/338: fsync d10/d12/f17 0 2021-04-09T18:25:45.771 INFO:tasks.workunit.client.0.smithi120.stdout:1/256: mkdir d5/d50 0 2021-04-09T18:25:45.772 INFO:tasks.workunit.client.0.smithi120.stdout:5/339: dread d10/f16 [0,4194304] 0 2021-04-09T18:25:45.773 INFO:tasks.workunit.client.0.smithi120.stdout:1/257: dread - d5/d1f/d22/d24/f41 zero size 2021-04-09T18:25:45.773 INFO:tasks.workunit.client.0.smithi120.stdout:1/258: mknod d5/d1f/d22/d24/c51 1 2021-04-09T18:25:45.775 INFO:tasks.workunit.client.0.smithi120.stdout:5/340: fsync d10/d12/f1a 0 2021-04-09T18:25:45.776 INFO:tasks.workunit.client.0.smithi120.stdout:1/259: rmdir d5/d1f/d22/d24/d28 39 2021-04-09T18:25:45.777 INFO:tasks.workunit.client.0.smithi120.stdout:1/260: write d5/d1f/d22/d24/f43 [744571,91762] 0 2021-04-09T18:25:45.779 INFO:tasks.workunit.client.0.smithi120.stdout:5/341: unlink d10/d12/d1b/d1f/f4d 0 2021-04-09T18:25:45.781 INFO:tasks.workunit.client.0.smithi120.stdout:1/261: chown d5/d1f/d22/d24/f41 1 1 2021-04-09T18:25:45.783 INFO:tasks.workunit.client.0.smithi120.stdout:5/342: unlink d10/d12/f17 0 2021-04-09T18:25:45.785 INFO:tasks.workunit.client.0.smithi120.stdout:1/262: symlink d5/d1f/d22/d2b/l52 0 2021-04-09T18:25:45.786 INFO:tasks.workunit.client.0.smithi120.stdout:1/263: chown d5 2359 1 2021-04-09T18:25:45.787 INFO:tasks.workunit.client.0.smithi120.stdout:5/343: dread d10/d12/d3b/f67 [0,4194304] 0 2021-04-09T18:25:45.789 INFO:tasks.workunit.client.0.smithi120.stdout:1/264: rename d5/d1f/d22/d24/d28 to d5/d1f/d22/d24/d28/d53 22 2021-04-09T18:25:45.791 INFO:tasks.workunit.client.0.smithi120.stdout:5/344: dread d10/d12/d35/f6b [0,4194304] 0 2021-04-09T18:25:45.792 INFO:tasks.workunit.client.0.smithi120.stdout:1/265: creat d5/d1f/d22/f54 x:0 0 0 2021-04-09T18:25:45.793 INFO:tasks.workunit.client.0.smithi120.stdout:5/345: dread - d10/d12/d1b/d1f/d33/f3e zero size 2021-04-09T18:25:45.798 INFO:tasks.workunit.client.0.smithi120.stdout:1/266: dread d5/d1f/d22/d24/f48 [0,4194304] 0 2021-04-09T18:25:45.801 INFO:tasks.workunit.client.0.smithi120.stdout:1/267: write d5/d1f/f15 [752051,102880] 0 2021-04-09T18:25:45.802 INFO:tasks.workunit.client.0.smithi120.stdout:5/346: creat d10/d12/d1b/d1f/d33/d3d/d50/f83 x:0 0 0 2021-04-09T18:25:45.807 INFO:tasks.workunit.client.0.smithi120.stdout:1/268: dwrite d5/d1f/d22/f27 [0,4194304] 0 2021-04-09T18:25:45.814 INFO:tasks.workunit.client.0.smithi120.stdout:1/269: unlink d5/d1f/d22/d24/f48 0 2021-04-09T18:25:45.816 INFO:tasks.workunit.client.0.smithi120.stdout:5/347: rename d10/d12/d1b/d1f/d33 to d10/d12/d1b/d1f/d84 0 2021-04-09T18:25:45.817 INFO:tasks.workunit.client.0.smithi120.stdout:1/270: rmdir d5/d1f 39 2021-04-09T18:25:45.818 INFO:tasks.workunit.client.0.smithi120.stdout:5/348: write d10/d12/d1b/d1f/d84/d3d/f6d [296108,25696] 0 2021-04-09T18:25:45.821 INFO:tasks.workunit.client.0.smithi120.stdout:1/271: fdatasync d5/d1f/d22/d2b/f47 0 2021-04-09T18:25:45.824 INFO:tasks.workunit.client.0.smithi120.stdout:5/349: dwrite d10/d12/f27 [4194304,4194304] 0 2021-04-09T18:25:45.827 INFO:tasks.workunit.client.0.smithi120.stdout:1/272: rename d5/d1f/d22/f27 to d5/d50/f55 0 2021-04-09T18:25:45.828 INFO:tasks.workunit.client.0.smithi120.stdout:5/350: dread d10/f16 [0,4194304] 0 2021-04-09T18:25:45.834 INFO:tasks.workunit.client.0.smithi120.stdout:5/351: creat d10/d12/d1b/d1f/d84/d3d/d50/f85 x:0 0 0 2021-04-09T18:25:45.834 INFO:tasks.workunit.client.0.smithi120.stdout:1/273: dwrite d5/d1f/d22/f54 [0,4194304] 0 2021-04-09T18:25:45.836 INFO:tasks.workunit.client.0.smithi120.stdout:5/352: write d10/d12/d1b/f34 [1482681,15240] 0 2021-04-09T18:25:45.837 INFO:tasks.workunit.client.0.smithi120.stdout:1/274: unlink d5/d1f/d22/d24/f29 0 2021-04-09T18:25:45.839 INFO:tasks.workunit.client.0.smithi120.stdout:1/275: read d5/d1f/d22/d24/d28/f46 [3609983,22087] 0 2021-04-09T18:25:45.843 INFO:tasks.workunit.client.0.smithi120.stdout:5/353: link d10/d12/f24 d10/d12/d3b/f86 0 2021-04-09T18:25:45.847 INFO:tasks.workunit.client.0.smithi120.stdout:1/276: rename d5/l11 to d5/d1f/d22/d24/d28/l56 0 2021-04-09T18:25:45.849 INFO:tasks.workunit.client.0.smithi120.stdout:5/354: creat d10/d12/d1b/d1f/d39/f87 x:0 0 0 2021-04-09T18:25:45.850 INFO:tasks.workunit.client.0.smithi120.stdout:1/277: chown d5/d1f/d22/d2b/l39 20048 1 2021-04-09T18:25:45.851 INFO:tasks.workunit.client.0.smithi120.stdout:1/278: chown d5/d1f/d22/d24/d28/d2d 15806183 1 2021-04-09T18:25:45.854 INFO:tasks.workunit.client.0.smithi120.stdout:5/355: dread d10/d12/d35/f6b [0,4194304] 0 2021-04-09T18:25:45.860 INFO:tasks.workunit.client.0.smithi120.stdout:5/356: chown d10/d12/d1b/d1f/f64 1250 1 2021-04-09T18:25:45.860 INFO:tasks.workunit.client.0.smithi120.stdout:1/279: dread d5/d1f/d22/d2b/f47 [0,4194304] 0 2021-04-09T18:25:45.861 INFO:tasks.workunit.client.0.smithi120.stdout:1/280: dread d5/f7 [0,4194304] 0 2021-04-09T18:25:45.865 INFO:tasks.workunit.client.0.smithi120.stdout:1/281: creat d5/d1f/d22/d2b/f57 x:0 0 0 2021-04-09T18:25:45.870 INFO:tasks.workunit.client.0.smithi120.stdout:1/282: rename d5/d1f/d22/f54 to d5/d50/f58 0 2021-04-09T18:25:45.873 INFO:tasks.workunit.client.0.smithi120.stdout:1/283: write d5/d50/f55 [1388104,5138] 0 2021-04-09T18:25:45.879 INFO:tasks.workunit.client.0.smithi120.stdout:1/284: rename d5/d1f/d22/d24/f43 to d5/d1f/d22/d2b/f59 0 2021-04-09T18:25:45.889 INFO:tasks.workunit.client.0.smithi120.stdout:1/285: getdents d5/d1f/d22/d24 0 2021-04-09T18:25:45.896 INFO:tasks.workunit.client.0.smithi120.stdout:1/286: write d5/d1f/d22/d24/d28/f46 [1694588,37722] 0 2021-04-09T18:25:45.899 INFO:tasks.workunit.client.0.smithi120.stdout:1/287: write d5/d1f/d22/d24/d28/d2d/f3a [3151006,96803] 0 2021-04-09T18:25:45.901 INFO:tasks.workunit.client.0.smithi120.stdout:5/357: dread d10/f73 [0,4194304] 0 2021-04-09T18:25:45.905 INFO:tasks.workunit.client.0.smithi120.stdout:1/288: mkdir d5/d1f/d22/d24/d28/d2d/d5a 0 2021-04-09T18:25:45.907 INFO:tasks.workunit.client.0.smithi120.stdout:1/289: write d5/f7 [1811026,88043] 0 2021-04-09T18:25:45.908 INFO:tasks.workunit.client.0.smithi120.stdout:5/358: unlink d10/d12/d3b/l61 0 2021-04-09T18:25:45.909 INFO:tasks.workunit.client.0.smithi120.stdout:1/290: rename d5/d1f/d22 to d5/d1f/d22/d24/d28/d5b 22 2021-04-09T18:25:45.911 INFO:tasks.workunit.client.0.smithi120.stdout:1/291: mkdir d5/d5c 0 2021-04-09T18:25:45.914 INFO:tasks.workunit.client.0.smithi120.stdout:5/359: link d10/d12/d1b/d1f/d84/f7b d10/d12/d1b/d1f/d84/d44/f88 0 2021-04-09T18:25:45.919 INFO:tasks.workunit.client.0.smithi120.stdout:5/360: dwrite d10/d12/d1b/d1f/d84/d3d/d50/f85 [0,4194304] 0 2021-04-09T18:25:45.924 INFO:tasks.workunit.client.0.smithi120.stdout:5/361: write d10/d12/d1b/d1f/d84/d44/f54 [209138,53322] 0 2021-04-09T18:25:45.928 INFO:tasks.workunit.client.0.smithi120.stdout:5/362: chown d10/d12/d1b/d1f/f59 39474841 1 2021-04-09T18:25:45.932 INFO:tasks.workunit.client.0.smithi120.stdout:5/363: creat d10/d12/d1b/d1f/d39/f89 x:0 0 0 2021-04-09T18:25:45.935 INFO:tasks.workunit.client.0.smithi120.stdout:5/364: fdatasync d10/d12/d1b/d1f/f57 0 2021-04-09T18:25:45.936 INFO:tasks.workunit.client.0.smithi120.stdout:5/365: creat d10/d12/d1b/d3a/d5b/f8a x:0 0 0 2021-04-09T18:25:45.939 INFO:tasks.workunit.client.0.smithi120.stdout:5/366: creat d10/d12/d1b/f8b x:0 0 0 2021-04-09T18:25:45.943 INFO:tasks.workunit.client.0.smithi120.stdout:5/367: dwrite d10/d12/d1b/d1f/d84/d44/f54 [0,4194304] 0 2021-04-09T18:25:45.945 INFO:tasks.workunit.client.0.smithi120.stdout:5/368: rmdir d10/d12/d1b/d1f/d84/d44 39 2021-04-09T18:25:45.947 INFO:tasks.workunit.client.0.smithi120.stdout:5/369: rmdir d10/d12/d1b/d1f 39 2021-04-09T18:25:45.966 INFO:tasks.workunit.client.0.smithi120.stdout:5/370: dread d10/f11 [0,4194304] 0 2021-04-09T18:25:45.971 INFO:tasks.workunit.client.0.smithi120.stdout:5/371: rename d10/d12/d35 to d10/d12/d1b/d1f/d84/d44/d8c 0 2021-04-09T18:25:45.973 INFO:tasks.workunit.client.0.smithi120.stdout:5/372: chown d10/d12/d1b/d1f/d84/d44/f54 5 1 2021-04-09T18:25:45.976 INFO:tasks.workunit.client.0.smithi120.stdout:5/373: creat d10/d12/d1b/d3a/d5b/f8d x:0 0 0 2021-04-09T18:25:45.977 INFO:tasks.workunit.client.0.smithi120.stdout:5/374: dread - d10/d12/d1b/d3a/d5b/d78/f81 zero size 2021-04-09T18:25:45.981 INFO:tasks.workunit.client.0.smithi120.stdout:5/375: dread d10/d12/d3b/f67 [0,4194304] 0 2021-04-09T18:25:45.982 INFO:tasks.workunit.client.0.smithi120.stdout:5/376: fdatasync d10/d12/d3b/f67 0 2021-04-09T18:25:45.983 INFO:tasks.workunit.client.0.smithi120.stdout:5/377: readlink l6 0 2021-04-09T18:25:45.983 INFO:tasks.workunit.client.0.smithi120.stdout:5/378: rmdir d10/d12/d3b 39 2021-04-09T18:25:46.002 INFO:tasks.workunit.client.0.smithi120.stdout:5/379: dread d10/d12/d1b/d1f/f71 [0,4194304] 0 2021-04-09T18:25:46.003 INFO:tasks.workunit.client.0.smithi120.stdout:5/380: chown d10/d12/d1b/d3a/d5b/f8d 0 1 2021-04-09T18:25:46.005 INFO:tasks.workunit.client.0.smithi120.stdout:5/381: write d10/d12/d1b/d1f/d84/d3d/d50/f70 [468434,67078] 0 2021-04-09T18:25:46.007 INFO:tasks.workunit.client.0.smithi120.stdout:5/382: dread - d10/d12/d1b/d1f/d84/f7b zero size 2021-04-09T18:25:46.010 INFO:tasks.workunit.client.0.smithi120.stdout:5/383: creat d10/d12/d1b/d1f/d84/d3d/f8e x:0 0 0 2021-04-09T18:25:46.012 INFO:tasks.workunit.client.0.smithi120.stdout:5/384: chown d10/d12/d1b/d1f/d39/l40 39 1 2021-04-09T18:25:46.016 INFO:tasks.workunit.client.0.smithi120.stdout:5/385: mkdir d10/d12/d1b/d3a/d8f 0 2021-04-09T18:25:46.016 INFO:tasks.workunit.client.0.smithi120.stdout:5/386: stat d10/d12/d1b/d1f/f4e 0 2021-04-09T18:25:46.017 INFO:tasks.workunit.client.0.smithi120.stdout:5/387: creat d10/d12/f90 x:0 0 0 2021-04-09T18:25:46.019 INFO:tasks.workunit.client.0.smithi120.stdout:5/388: creat d10/d12/d1b/d3a/f91 x:0 0 0 2021-04-09T18:25:46.023 INFO:tasks.workunit.client.0.smithi120.stdout:5/389: dread d10/d12/d1b/d1f/d84/d44/f54 [0,4194304] 0 2021-04-09T18:25:46.028 INFO:tasks.workunit.client.0.smithi120.stdout:5/390: dread d10/d12/d1b/d1f/d84/d3d/d50/f85 [0,4194304] 0 2021-04-09T18:25:46.029 INFO:tasks.workunit.client.0.smithi120.stdout:5/391: rmdir d10 39 2021-04-09T18:25:46.037 INFO:tasks.workunit.client.0.smithi120.stdout:5/392: link d10/d12/d1b/d1f/d84/d44/d8c/l5c d10/d12/d1b/d1f/d84/d44/l92 0 2021-04-09T18:25:46.038 INFO:tasks.workunit.client.0.smithi120.stdout:5/393: rmdir d10/d12/d1b/d3a/d5b 39 2021-04-09T18:25:46.039 INFO:tasks.workunit.client.0.smithi120.stdout:5/394: dread - d10/d12/d1b/d1f/f4e zero size 2021-04-09T18:25:46.049 INFO:tasks.workunit.client.0.smithi120.stdout:5/395: dread d10/d12/d1b/d1f/d84/d3d/f41 [0,4194304] 0 2021-04-09T18:25:46.054 INFO:tasks.workunit.client.0.smithi120.stdout:5/396: dwrite d10/d12/d1b/d1f/d84/d44/f49 [0,4194304] 0 2021-04-09T18:25:46.055 INFO:tasks.workunit.client.0.smithi120.stdout:5/397: write d10/d12/d1b/d1f/d39/f87 [1043698,18152] 0 2021-04-09T18:25:46.061 INFO:tasks.workunit.client.0.smithi120.stdout:5/398: dread d10/f16 [0,4194304] 0 2021-04-09T18:25:46.064 INFO:tasks.workunit.client.0.smithi120.stdout:5/399: creat d10/f93 x:0 0 0 2021-04-09T18:25:46.067 INFO:tasks.workunit.client.0.smithi120.stdout:5/400: mkdir d10/d12/d1b/d1f/d84/d3d/d50/d94 0 2021-04-09T18:25:46.070 INFO:tasks.workunit.client.0.smithi120.stdout:5/401: mknod d10/d12/d1b/d3a/d5b/d78/c95 1 2021-04-09T18:25:46.076 INFO:tasks.workunit.client.0.smithi120.stdout:5/402: truncate fd 1584465 0 2021-04-09T18:25:46.079 INFO:tasks.workunit.client.0.smithi120.stdout:5/403: mkdir d10/d12/d1b/d3a/d5b/d96 0 2021-04-09T18:25:46.082 INFO:tasks.workunit.client.0.smithi120.stdout:5/404: symlink d10/d12/d1b/d1f/d84/d44/l97 0 2021-04-09T18:25:46.084 INFO:tasks.workunit.client.0.smithi120.stdout:5/405: chown d10/d12/d1b/d1f/d84/d44/d8c/l36 143660764 1 2021-04-09T18:25:46.089 INFO:tasks.workunit.client.0.smithi120.stdout:5/406: creat d10/d12/d1b/d1f/d84/d3d/d50/d94/f98 x:0 0 0 2021-04-09T18:25:46.092 INFO:tasks.workunit.client.0.smithi120.stdout:5/407: symlink d10/d12/d1b/d1f/d39/l99 0 2021-04-09T18:25:46.095 INFO:tasks.workunit.client.0.smithi120.stdout:5/408: chown d10/d12/d1b/d1f/d84/d3d/l75 24 1 2021-04-09T18:25:46.101 INFO:tasks.workunit.client.0.smithi120.stdout:5/409: rename d10/d12/d1b/d1f/d84/d44/d8c/l5c to d10/d12/d1b/d1f/d84/d44/d8c/l9a 0 2021-04-09T18:25:46.708 INFO:tasks.workunit.client.0.smithi120.stdout:9/302: sync 2021-04-09T18:25:46.708 INFO:tasks.workunit.client.0.smithi120.stdout:6/222: sync 2021-04-09T18:25:46.709 INFO:tasks.workunit.client.0.smithi120.stdout:6/223: readlink d6/d8/db/d12/d22/d30/d31/l3f 0 2021-04-09T18:25:46.710 INFO:tasks.workunit.client.0.smithi120.stdout:9/303: write d19/f1d [1013392,37523] 0 2021-04-09T18:25:46.711 INFO:tasks.workunit.client.0.smithi120.stdout:9/304: chown d19/f1d 20164446 1 2021-04-09T18:25:46.715 INFO:tasks.workunit.client.0.smithi120.stdout:9/305: symlink d19/d24/d2e/l65 0 2021-04-09T18:25:46.719 INFO:tasks.workunit.client.0.smithi120.stdout:6/224: dwrite d6/d8/db/d2b/f2e [0,4194304] 0 2021-04-09T18:25:46.719 INFO:tasks.workunit.client.0.smithi120.stdout:9/306: write d19/d24/d36/d47/f4e [3483882,128151] 0 2021-04-09T18:25:46.732 INFO:tasks.workunit.client.0.smithi120.stdout:6/225: mkdir d6/d8/db/d12/d22/d30/d41/d49 0 2021-04-09T18:25:46.737 INFO:tasks.workunit.client.0.smithi120.stdout:6/226: read d6/d8/db/d12/d22/f2a [502826,107217] 0 2021-04-09T18:25:46.742 INFO:tasks.workunit.client.0.smithi120.stdout:9/307: dwrite d19/d24/d2e/f3c [0,4194304] 0 2021-04-09T18:25:46.749 INFO:tasks.workunit.client.0.smithi120.stdout:9/308: dwrite d19/d24/f5e [0,4194304] 0 2021-04-09T18:25:46.766 INFO:tasks.workunit.client.0.smithi120.stdout:9/309: dread d19/d24/f28 [0,4194304] 0 2021-04-09T18:25:46.771 INFO:tasks.workunit.client.0.smithi120.stdout:9/310: rename d19/d24/d2e/l3b to d19/d1c/d52/l66 0 2021-04-09T18:25:46.774 INFO:tasks.workunit.client.0.smithi120.stdout:9/311: write d19/d1c/f20 [812674,15833] 0 2021-04-09T18:25:46.776 INFO:tasks.workunit.client.0.smithi120.stdout:9/312: mknod d19/d1c/c67 1 2021-04-09T18:25:46.779 INFO:tasks.workunit.client.0.smithi120.stdout:9/313: symlink d19/d2c/d5b/l68 0 2021-04-09T18:25:46.780 INFO:tasks.workunit.client.0.smithi120.stdout:9/314: chown d19/d24/l2f 217050 1 2021-04-09T18:25:46.781 INFO:tasks.workunit.client.0.smithi120.stdout:9/315: chown d19/f1d 0 1 2021-04-09T18:25:46.783 INFO:tasks.workunit.client.0.smithi120.stdout:9/316: rename d19/f1b to d19/d2c/f69 0 2021-04-09T18:25:46.784 INFO:tasks.workunit.client.0.smithi120.stdout:9/317: mknod d19/d1c/c6a 1 2021-04-09T18:25:46.788 INFO:tasks.workunit.client.0.smithi120.stdout:9/318: dwrite d19/d1c/f4f [0,4194304] 0 2021-04-09T18:25:46.791 INFO:tasks.workunit.client.0.smithi120.stdout:9/319: chown d19/d2c/d5b/l68 144366381 1 2021-04-09T18:25:46.848 INFO:tasks.workunit.client.0.smithi120.stdout:2/299: sync 2021-04-09T18:25:46.848 INFO:tasks.workunit.client.0.smithi120.stdout:0/280: sync 2021-04-09T18:25:46.849 INFO:tasks.workunit.client.0.smithi120.stdout:5/410: sync 2021-04-09T18:25:46.849 INFO:tasks.workunit.client.0.smithi120.stdout:3/345: sync 2021-04-09T18:25:46.850 INFO:tasks.workunit.client.0.smithi120.stdout:7/199: sync 2021-04-09T18:25:46.850 INFO:tasks.workunit.client.0.smithi120.stdout:8/221: sync 2021-04-09T18:25:46.850 INFO:tasks.workunit.client.0.smithi120.stdout:1/292: sync 2021-04-09T18:25:46.851 INFO:tasks.workunit.client.0.smithi120.stdout:4/308: sync 2021-04-09T18:25:46.852 INFO:tasks.workunit.client.0.smithi120.stdout:7/200: mknod db/d42/c46 1 2021-04-09T18:25:46.853 INFO:tasks.workunit.client.0.smithi120.stdout:4/309: chown d1f/d2c/d30 3646643 1 2021-04-09T18:25:46.853 INFO:tasks.workunit.client.0.smithi120.stdout:8/222: chown d2/d27/f29 284 1 2021-04-09T18:25:46.854 INFO:tasks.workunit.client.0.smithi120.stdout:3/346: write d3/d5/d36/d3d/f6e [50020,33145] 0 2021-04-09T18:25:46.855 INFO:tasks.workunit.client.0.smithi120.stdout:2/300: write d13/f14 [987074,114957] 0 2021-04-09T18:25:46.856 INFO:tasks.workunit.client.0.smithi120.stdout:9/320: creat d19/d1c/f6b x:0 0 0 2021-04-09T18:25:46.857 INFO:tasks.workunit.client.0.smithi120.stdout:5/411: mkdir d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b 0 2021-04-09T18:25:46.859 INFO:tasks.workunit.client.0.smithi120.stdout:3/347: read d3/de/f1b [2945624,114972] 0 2021-04-09T18:25:46.861 INFO:tasks.workunit.client.0.smithi120.stdout:4/310: symlink d1f/d2c/d30/l68 0 2021-04-09T18:25:46.862 INFO:tasks.workunit.client.0.smithi120.stdout:7/201: dwrite db/d2c/f44 [0,4194304] 0 2021-04-09T18:25:46.868 INFO:tasks.workunit.client.0.smithi120.stdout:3/348: dwrite d3/de/f1b [0,4194304] 0 2021-04-09T18:25:46.868 INFO:tasks.workunit.client.0.smithi120.stdout:2/301: fdatasync d13/f1d 0 2021-04-09T18:25:46.871 INFO:tasks.workunit.client.0.smithi120.stdout:0/281: link d0/d2/d4/l21 d0/d2/d4/l54 0 2021-04-09T18:25:46.873 INFO:tasks.workunit.client.0.smithi120.stdout:3/349: mknod d3/d5/d36/d1e/d38/d6d/c72 1 2021-04-09T18:25:46.880 INFO:tasks.workunit.client.0.smithi120.stdout:7/202: mkdir db/d2c/d30/d47 0 2021-04-09T18:25:46.880 INFO:tasks.workunit.client.0.smithi120.stdout:3/350: read d3/d5/d36/d1e/d6b/f3f [2770172,80988] 0 2021-04-09T18:25:46.881 INFO:tasks.workunit.client.0.smithi120.stdout:4/311: getdents d1f/d2c/d34/d60 0 2021-04-09T18:25:46.881 INFO:tasks.workunit.client.0.smithi120.stdout:9/321: creat d19/d1c/f6c x:0 0 0 2021-04-09T18:25:46.882 INFO:tasks.workunit.client.0.smithi120.stdout:2/302: dread d13/f14 [0,4194304] 0 2021-04-09T18:25:46.883 INFO:tasks.workunit.client.0.smithi120.stdout:8/223: getdents d2/d37/d3e 0 2021-04-09T18:25:46.884 INFO:tasks.workunit.client.0.smithi120.stdout:4/312: mknod d1f/d2c/d3b/d3e/d64/c69 1 2021-04-09T18:25:46.885 INFO:tasks.workunit.client.0.smithi120.stdout:4/313: stat fe 0 2021-04-09T18:25:46.886 INFO:tasks.workunit.client.0.smithi120.stdout:0/282: write d0/d2/f27 [404109,4065] 0 2021-04-09T18:25:46.889 INFO:tasks.workunit.client.0.smithi120.stdout:0/283: write d0/d2/da/f19 [2600541,96489] 0 2021-04-09T18:25:46.890 INFO:tasks.workunit.client.0.smithi120.stdout:5/412: rename d10/d12/d1b/f66 to d10/d12/d1b/d3a/f9c 0 2021-04-09T18:25:46.891 INFO:tasks.workunit.client.0.smithi120.stdout:7/203: creat db/d2c/d34/f48 x:0 0 0 2021-04-09T18:25:46.891 INFO:tasks.workunit.client.0.smithi120.stdout:0/284: chown d0/f41 328932 1 2021-04-09T18:25:46.893 INFO:tasks.workunit.client.0.smithi120.stdout:7/204: fdatasync db/f27 0 2021-04-09T18:25:46.894 INFO:tasks.workunit.client.0.smithi120.stdout:7/205: stat db/l14 0 2021-04-09T18:25:46.896 INFO:tasks.workunit.client.0.smithi120.stdout:8/224: creat d2/d3/d11/f46 x:0 0 0 2021-04-09T18:25:46.903 INFO:tasks.workunit.client.0.smithi120.stdout:9/322: getdents d19/d1c/d29/d63 0 2021-04-09T18:25:46.906 INFO:tasks.workunit.client.0.smithi120.stdout:6/227: sync 2021-04-09T18:25:46.909 INFO:tasks.workunit.client.0.smithi120.stdout:2/303: mkdir d13/d1b/d48/d49/d64/d66 0 2021-04-09T18:25:46.912 INFO:tasks.workunit.client.0.smithi120.stdout:5/413: dwrite d10/f6e [0,4194304] 0 2021-04-09T18:25:46.913 INFO:tasks.workunit.client.0.smithi120.stdout:6/228: fsync d6/d8/db/d12/d22/f40 0 2021-04-09T18:25:46.914 INFO:tasks.workunit.client.0.smithi120.stdout:4/314: dwrite d1f/f23 [4194304,4194304] 0 2021-04-09T18:25:46.914 INFO:tasks.workunit.client.0.smithi120.stdout:7/206: write db/f1a [50727,66411] 0 2021-04-09T18:25:46.922 INFO:tasks.workunit.client.0.smithi120.stdout:1/293: truncate d5/d1f/d22/d24/d28/f46 2202930 0 2021-04-09T18:25:46.923 INFO:tasks.workunit.client.0.smithi120.stdout:9/323: creat d19/d1c/d29/f6d x:0 0 0 2021-04-09T18:25:46.924 INFO:tasks.workunit.client.0.smithi120.stdout:1/294: mknod d5/d1f/d22/d24/c5d 1 2021-04-09T18:25:46.925 INFO:tasks.workunit.client.0.smithi120.stdout:8/225: creat d2/d3/d11/d2c/d2e/d3b/f47 x:0 0 0 2021-04-09T18:25:46.930 INFO:tasks.workunit.client.0.smithi120.stdout:6/229: creat d6/d8/f4a x:0 0 0 2021-04-09T18:25:46.930 INFO:tasks.workunit.client.0.smithi120.stdout:9/324: fdatasync d19/d1c/f6c 0 2021-04-09T18:25:46.935 INFO:tasks.workunit.client.0.smithi120.stdout:3/351: getdents d3 0 2021-04-09T18:25:46.938 INFO:tasks.workunit.client.0.smithi120.stdout:4/315: write d1f/d24/f25 [1040185,18020] 0 2021-04-09T18:25:46.942 INFO:tasks.workunit.client.0.smithi120.stdout:4/316: write d1f/f40 [410467,64677] 0 2021-04-09T18:25:46.942 INFO:tasks.workunit.client.0.smithi120.stdout:3/352: chown d3/d5/l7 98 1 2021-04-09T18:25:46.943 INFO:tasks.workunit.client.0.smithi120.stdout:3/353: dread - d3/f37 zero size 2021-04-09T18:25:46.943 INFO:tasks.workunit.client.0.smithi120.stdout:7/207: symlink db/d2c/l49 0 2021-04-09T18:25:46.947 INFO:tasks.workunit.client.0.smithi120.stdout:0/285: dread d0/fc [4194304,4194304] 0 2021-04-09T18:25:46.950 INFO:tasks.workunit.client.0.smithi120.stdout:5/414: creat d10/d12/d1b/d1f/d84/f9d x:0 0 0 2021-04-09T18:25:46.950 INFO:tasks.workunit.client.0.smithi120.stdout:3/354: write d3/d5/d36/d1e/d6b/d49/d4e/f6f [249007,46501] 0 2021-04-09T18:25:46.951 INFO:tasks.workunit.client.0.smithi120.stdout:8/226: dwrite d2/d3/d8/f1d [0,4194304] 0 2021-04-09T18:25:46.951 INFO:tasks.workunit.client.0.smithi120.stdout:7/208: symlink db/d38/d3c/l4a 0 2021-04-09T18:25:46.957 INFO:tasks.workunit.client.0.smithi120.stdout:7/209: write f7 [802489,72384] 0 2021-04-09T18:25:46.965 INFO:tasks.workunit.client.0.smithi120.stdout:8/227: dwrite d2/d27/f2f [0,4194304] 0 2021-04-09T18:25:46.969 INFO:tasks.workunit.client.0.smithi120.stdout:3/355: mkdir d3/d5/d36/d1e/d6b/d49/d73 0 2021-04-09T18:25:46.970 INFO:tasks.workunit.client.0.smithi120.stdout:6/230: creat d6/d8/db/d12/f4b x:0 0 0 2021-04-09T18:25:46.972 INFO:tasks.workunit.client.0.smithi120.stdout:1/295: getdents d5/d1f/d22/d2b 0 2021-04-09T18:25:46.973 INFO:tasks.workunit.client.0.smithi120.stdout:7/210: write db/d26/f2d [697593,40666] 0 2021-04-09T18:25:46.975 INFO:tasks.workunit.client.0.smithi120.stdout:0/286: dread d0/d2/da/f37 [0,4194304] 0 2021-04-09T18:25:46.976 INFO:tasks.workunit.client.0.smithi120.stdout:3/356: chown d3/d5/d36/d1e/d6b/d59/d68 1726 1 2021-04-09T18:25:46.977 INFO:tasks.workunit.client.0.smithi120.stdout:2/304: truncate d13/d1b/f44 594545 0 2021-04-09T18:25:46.978 INFO:tasks.workunit.client.0.smithi120.stdout:0/287: write d0/d2/d4/f29 [5313620,36466] 0 2021-04-09T18:25:46.983 INFO:tasks.workunit.client.0.smithi120.stdout:1/296: write d5/f17 [2198585,30167] 0 2021-04-09T18:25:46.983 INFO:tasks.workunit.client.0.smithi120.stdout:3/357: creat d3/d5/f74 x:0 0 0 2021-04-09T18:25:46.985 INFO:tasks.workunit.client.0.smithi120.stdout:3/358: chown d3/d5/d36/d1e/d38/f44 2681519 1 2021-04-09T18:25:46.987 INFO:tasks.workunit.client.0.smithi120.stdout:0/288: dread d0/d2/da/f19 [4194304,4194304] 0 2021-04-09T18:25:46.988 INFO:tasks.workunit.client.0.smithi120.stdout:0/289: write d0/f3c [262272,22096] 0 2021-04-09T18:25:46.989 INFO:tasks.workunit.client.0.smithi120.stdout:7/211: link db/d26/f2e db/d42/f4b 0 2021-04-09T18:25:46.993 INFO:tasks.workunit.client.0.smithi120.stdout:6/231: creat d6/d8/f4c x:0 0 0 2021-04-09T18:25:46.993 INFO:tasks.workunit.client.0.smithi120.stdout:1/297: stat d5/l14 0 2021-04-09T18:25:46.994 INFO:tasks.workunit.client.0.smithi120.stdout:8/228: getdents d2/d3/d8 0 2021-04-09T18:25:46.999 INFO:tasks.workunit.client.0.smithi120.stdout:8/229: dread - d2/d3/d11/d2c/d2e/d3b/f47 zero size 2021-04-09T18:25:47.004 INFO:tasks.workunit.client.0.smithi120.stdout:6/232: write d6/d8/d3a/f48 [372377,113188] 0 2021-04-09T18:25:47.005 INFO:tasks.workunit.client.0.smithi120.stdout:6/233: chown d6/d8/f4c 3 1 2021-04-09T18:25:47.008 INFO:tasks.workunit.client.0.smithi120.stdout:9/325: dread d19/d24/f55 [0,4194304] 0 2021-04-09T18:25:47.015 INFO:tasks.workunit.client.0.smithi120.stdout:8/230: rename d2/d3/d3c/f43 to d2/d27/f48 0 2021-04-09T18:25:47.021 INFO:tasks.workunit.client.0.smithi120.stdout:0/290: dread d0/d2/f27 [0,4194304] 0 2021-04-09T18:25:47.022 INFO:tasks.workunit.client.0.smithi120.stdout:8/231: dwrite d2/d3/d11/ff [0,4194304] 0 2021-04-09T18:25:47.024 INFO:tasks.workunit.client.0.smithi120.stdout:8/232: readlink d2/d3/d11/d2c/d2e/d3b/l35 0 2021-04-09T18:25:47.032 INFO:tasks.workunit.client.0.smithi120.stdout:8/233: symlink d2/d37/l49 0 2021-04-09T18:25:47.034 INFO:tasks.workunit.client.0.smithi120.stdout:8/234: mknod d2/d3/d11/d2c/d2e/d3b/c4a 1 2021-04-09T18:25:47.035 INFO:tasks.workunit.client.0.smithi120.stdout:6/234: getdents d6/d8/d3a 0 2021-04-09T18:25:47.042 INFO:tasks.workunit.client.0.smithi120.stdout:7/212: truncate f4 1481469 0 2021-04-09T18:25:47.053 INFO:tasks.workunit.client.0.smithi120.stdout:7/213: mkdir db/d26/d4c 0 2021-04-09T18:25:47.056 INFO:tasks.workunit.client.0.smithi120.stdout:1/298: truncate d5/d1f/d22/d24/d28/f36 2666843 0 2021-04-09T18:25:47.057 INFO:tasks.workunit.client.0.smithi120.stdout:3/359: dread d3/f42 [0,4194304] 0 2021-04-09T18:25:47.059 INFO:tasks.workunit.client.0.smithi120.stdout:8/235: mkdir d2/d27/d3f/d4b 0 2021-04-09T18:25:47.061 INFO:tasks.workunit.client.0.smithi120.stdout:6/235: mkdir d6/d8/db/d2b/d4d 0 2021-04-09T18:25:47.078 INFO:tasks.workunit.client.0.smithi120.stdout:6/236: getdents d6/d8/db/d12/d22/d30/d41/d49 0 2021-04-09T18:25:47.080 INFO:tasks.workunit.client.0.smithi120.stdout:6/237: fsync d6/d8/db/d12/f18 0 2021-04-09T18:25:47.080 INFO:tasks.workunit.client.0.smithi120.stdout:6/238: mknod d6/d8/db/d2b/c4e 1 2021-04-09T18:25:47.081 INFO:tasks.workunit.client.0.smithi120.stdout:7/214: getdents db/d2c/d30 0 2021-04-09T18:25:47.084 INFO:tasks.workunit.client.0.smithi120.stdout:8/236: dread d2/d3/d11/d2c/d2e/d3b/f33 [0,4194304] 0 2021-04-09T18:25:47.092 INFO:tasks.workunit.client.0.smithi120.stdout:7/215: dwrite db/d38/d3c/f3d [0,4194304] 0 2021-04-09T18:25:47.094 INFO:tasks.workunit.client.0.smithi120.stdout:8/237: dwrite d2/d3/f1a [0,4194304] 0 2021-04-09T18:25:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:8/238: dread - d2/f39 zero size 2021-04-09T18:25:47.098 INFO:tasks.workunit.client.0.smithi120.stdout:8/239: fsync d2/d3/d11/f34 0 2021-04-09T18:25:47.099 INFO:tasks.workunit.client.0.smithi120.stdout:1/299: write d5/d1f/d22/d24/d28/f36 [3659091,2720] 0 2021-04-09T18:25:47.100 INFO:tasks.workunit.client.0.smithi120.stdout:6/239: rename d6/d8/db/d12/d22/d30/d31/d37/f3d to d6/d8/db/d12/d22/d30/d41/d49/f4f 0 2021-04-09T18:25:47.121 INFO:tasks.workunit.client.0.smithi120.stdout:1/300: creat d5/d1f/d22/d2b/f5e x:0 0 0 2021-04-09T18:25:47.126 INFO:tasks.workunit.client.0.smithi120.stdout:6/240: creat d6/d8/d1a/f50 x:0 0 0 2021-04-09T18:25:47.128 INFO:tasks.workunit.client.0.smithi120.stdout:1/301: symlink d5/d1f/l5f 0 2021-04-09T18:25:47.128 INFO:tasks.workunit.client.0.smithi120.stdout:6/241: read d6/d8/db/d12/f1f [128546,58860] 0 2021-04-09T18:25:47.129 INFO:tasks.workunit.client.0.smithi120.stdout:1/302: mknod d5/d1f/d22/d24/d28/d2d/d5a/c60 1 2021-04-09T18:25:47.129 INFO:tasks.workunit.client.0.smithi120.stdout:8/240: creat d2/d3/f4c x:0 0 0 2021-04-09T18:25:47.130 INFO:tasks.workunit.client.0.smithi120.stdout:1/303: chown d5/d1f/d22/d24/l34 673387094 1 2021-04-09T18:25:47.134 INFO:tasks.workunit.client.0.smithi120.stdout:8/241: read d2/d3/f12 [1709968,116962] 0 2021-04-09T18:25:47.135 INFO:tasks.workunit.client.0.smithi120.stdout:8/242: mknod d2/d37/d3e/c4d 1 2021-04-09T18:25:47.138 INFO:tasks.workunit.client.0.smithi120.stdout:1/304: mkdir d5/d50/d61 0 2021-04-09T18:25:47.138 INFO:tasks.workunit.client.0.smithi120.stdout:7/216: link db/d26/f2e db/f4d 0 2021-04-09T18:25:47.139 INFO:tasks.workunit.client.0.smithi120.stdout:8/243: mkdir d2/d3/d8/d4e 0 2021-04-09T18:25:47.141 INFO:tasks.workunit.client.0.smithi120.stdout:8/244: chown d2/d3/d11/f1f 15488094 1 2021-04-09T18:25:47.159 INFO:tasks.workunit.client.0.smithi120.stdout:7/217: dread f6 [0,4194304] 0 2021-04-09T18:25:47.161 INFO:tasks.workunit.client.0.smithi120.stdout:1/305: dread d5/d1f/f15 [0,4194304] 0 2021-04-09T18:25:47.327 INFO:tasks.workunit.client.0.smithi120.stdout:6/242: creat d6/d8/db/f51 x:0 0 0 2021-04-09T18:25:47.327 INFO:tasks.workunit.client.0.smithi120.stdout:6/243: stat d6/d8/db/d2b 0 2021-04-09T18:25:47.329 INFO:tasks.workunit.client.0.smithi120.stdout:8/245: mkdir d2/d3/d3c/d4f 0 2021-04-09T18:25:47.329 INFO:tasks.workunit.client.0.smithi120.stdout:8/246: chown d2/f40 3780821 1 2021-04-09T18:25:47.334 INFO:tasks.workunit.client.0.smithi120.stdout:8/247: dwrite d2/d3/f23 [4194304,4194304] 0 2021-04-09T18:25:47.351 INFO:tasks.workunit.client.0.smithi120.stdout:4/317: sync 2021-04-09T18:25:47.363 INFO:tasks.workunit.client.0.smithi120.stdout:7/218: rename db/l2a to db/d26/d4c/l4e 0 2021-04-09T18:25:47.365 INFO:tasks.workunit.client.0.smithi120.stdout:4/318: mkdir d1f/d2c/d56/d6a 0 2021-04-09T18:25:47.367 INFO:tasks.workunit.client.0.smithi120.stdout:1/306: rename d5/d1f/d22/d24/d28/f36 to d5/d1f/d22/d2b/f62 0 2021-04-09T18:25:47.370 INFO:tasks.workunit.client.0.smithi120.stdout:7/219: dwrite db/d26/f45 [0,4194304] 0 2021-04-09T18:25:47.371 INFO:tasks.workunit.client.0.smithi120.stdout:1/307: mkdir d5/d1f/d22/d24/d28/d63 0 2021-04-09T18:25:47.376 INFO:tasks.workunit.client.0.smithi120.stdout:4/319: dwrite d1f/d24/d42/d49/f65 [0,4194304] 0 2021-04-09T18:25:47.377 INFO:tasks.workunit.client.0.smithi120.stdout:6/244: write d6/d8/db/d12/d22/f23 [2238774,57206] 0 2021-04-09T18:25:47.378 INFO:tasks.workunit.client.0.smithi120.stdout:7/220: read f7 [3580403,68351] 0 2021-04-09T18:25:47.380 INFO:tasks.workunit.client.0.smithi120.stdout:7/221: dread - db/d2c/d34/f48 zero size 2021-04-09T18:25:47.381 INFO:tasks.workunit.client.0.smithi120.stdout:7/222: mknod db/d2c/d30/c4f 1 2021-04-09T18:25:47.382 INFO:tasks.workunit.client.0.smithi120.stdout:7/223: chown db/l24 9536210 1 2021-04-09T18:25:47.386 INFO:tasks.workunit.client.0.smithi120.stdout:8/248: rename d2/d27/d3f to d2/d3/d50 0 2021-04-09T18:25:47.396 INFO:tasks.workunit.client.0.smithi120.stdout:1/308: write d5/d1f/d22/d24/d28/f46 [401166,77932] 0 2021-04-09T18:25:47.400 INFO:tasks.workunit.client.0.smithi120.stdout:2/305: dread d13/d1b/d48/d49/f4b [4194304,4194304] 0 2021-04-09T18:25:47.404 INFO:tasks.workunit.client.0.smithi120.stdout:2/306: read d13/d15/d35/f53 [199756,112417] 0 2021-04-09T18:25:47.407 INFO:tasks.workunit.client.0.smithi120.stdout:4/320: rename d1f/d24/d42/d49 to d1f/d24/d6b 0 2021-04-09T18:25:47.411 INFO:tasks.workunit.client.0.smithi120.stdout:1/309: truncate d5/d1f/d22/d2b/f5e 829435 0 2021-04-09T18:25:47.471 INFO:tasks.workunit.client.0.smithi120.stdout:3/360: sync 2021-04-09T18:25:47.471 INFO:tasks.workunit.client.0.smithi120.stdout:9/326: sync 2021-04-09T18:25:47.472 INFO:tasks.workunit.client.0.smithi120.stdout:5/415: sync 2021-04-09T18:25:47.472 INFO:tasks.workunit.client.0.smithi120.stdout:0/291: sync 2021-04-09T18:25:47.472 INFO:tasks.workunit.client.0.smithi120.stdout:5/416: chown d10/d12/d1b/d1f/f79 14 1 2021-04-09T18:25:47.473 INFO:tasks.workunit.client.0.smithi120.stdout:3/361: stat d3/de/l21 0 2021-04-09T18:25:47.473 INFO:tasks.workunit.client.0.smithi120.stdout:6/245: rename d6/d8/db/d43 to d6/d8/d52 0 2021-04-09T18:25:47.475 INFO:tasks.workunit.client.0.smithi120.stdout:9/327: rmdir d19/d2c 39 2021-04-09T18:25:47.476 INFO:tasks.workunit.client.0.smithi120.stdout:6/246: fdatasync d6/d8/db/d2b/f2e 0 2021-04-09T18:25:47.478 INFO:tasks.workunit.client.0.smithi120.stdout:7/224: rename db/fd to db/d38/f50 0 2021-04-09T18:25:47.479 INFO:tasks.workunit.client.0.smithi120.stdout:9/328: rmdir d19/d24/d37/d40 39 2021-04-09T18:25:47.480 INFO:tasks.workunit.client.0.smithi120.stdout:5/417: dread d10/d12/d3b/f67 [0,4194304] 0 2021-04-09T18:25:47.482 INFO:tasks.workunit.client.0.smithi120.stdout:5/418: mknod d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b/c9e 1 2021-04-09T18:25:47.484 INFO:tasks.workunit.client.0.smithi120.stdout:6/247: creat d6/d8/db/d12/d22/d30/d31/f53 x:0 0 0 2021-04-09T18:25:47.484 INFO:tasks.workunit.client.0.smithi120.stdout:0/292: write d0/d2/dd/f38 [1561293,34561] 0 2021-04-09T18:25:47.486 INFO:tasks.workunit.client.0.smithi120.stdout:9/329: rmdir d19/d24/d36/d47/d4b 39 2021-04-09T18:25:47.488 INFO:tasks.workunit.client.0.smithi120.stdout:1/310: rename d5/d1f/d22/d24/d28 to d5/d64 0 2021-04-09T18:25:47.491 INFO:tasks.workunit.client.0.smithi120.stdout:0/293: unlink d0/d2/da/f48 0 2021-04-09T18:25:47.496 INFO:tasks.workunit.client.0.smithi120.stdout:1/311: unlink d5/d1f/d22/d2b/l39 0 2021-04-09T18:25:47.497 INFO:tasks.workunit.client.0.smithi120.stdout:0/294: rename d0/d2/l7 to d0/d2/da/l55 0 2021-04-09T18:25:47.501 INFO:tasks.workunit.client.0.smithi120.stdout:6/248: rmdir d6/d8/db/d12 39 2021-04-09T18:25:47.504 INFO:tasks.workunit.client.0.smithi120.stdout:3/362: dread d3/d5/d36/d1e/d6b/f35 [0,4194304] 0 2021-04-09T18:25:47.506 INFO:tasks.workunit.client.0.smithi120.stdout:6/249: chown d6/d8/db/d12/d22/d30/d41 3172377 1 2021-04-09T18:25:47.513 INFO:tasks.workunit.client.0.smithi120.stdout:6/250: rename d6/d8/db/d12/d22/d30 to d6/d8/d1a/d36/d54 0 2021-04-09T18:25:47.514 INFO:tasks.workunit.client.0.smithi120.stdout:5/419: write fd [439149,52737] 0 2021-04-09T18:25:47.514 INFO:tasks.workunit.client.0.smithi120.stdout:5/420: chown d10 17347 1 2021-04-09T18:25:47.516 INFO:tasks.workunit.client.0.smithi120.stdout:1/312: mknod d5/d1f/d22/d24/c65 1 2021-04-09T18:25:47.517 INFO:tasks.workunit.client.0.smithi120.stdout:6/251: symlink d6/d8/d1a/l55 0 2021-04-09T18:25:47.520 INFO:tasks.workunit.client.0.smithi120.stdout:1/313: dread d5/d1f/d22/d2b/f47 [0,4194304] 0 2021-04-09T18:25:47.525 INFO:tasks.workunit.client.0.smithi120.stdout:1/314: dwrite d5/d64/d2d/f3a [0,4194304] 0 2021-04-09T18:25:47.526 INFO:tasks.workunit.client.0.smithi120.stdout:5/421: rename d10/d12/d3b/l7d to d10/d12/d1b/d1f/d84/l9f 0 2021-04-09T18:25:47.528 INFO:tasks.workunit.client.0.smithi120.stdout:1/315: mkdir d5/d64/d66 0 2021-04-09T18:25:47.530 INFO:tasks.workunit.client.0.smithi120.stdout:6/252: truncate d6/d8/db/d12/f1f 1298202 0 2021-04-09T18:25:47.530 INFO:tasks.workunit.client.0.smithi120.stdout:1/316: read d5/d1f/d22/d2b/f47 [3282501,124786] 0 2021-04-09T18:25:47.544 INFO:tasks.workunit.client.0.smithi120.stdout:5/422: creat d10/d12/d1b/d1f/d84/fa0 x:0 0 0 2021-04-09T18:25:47.544 INFO:tasks.workunit.client.0.smithi120.stdout:5/423: readlink d10/d12/d1b/d1f/d84/l38 0 2021-04-09T18:25:47.545 INFO:tasks.workunit.client.0.smithi120.stdout:5/424: mknod d10/d12/d1b/d1f/d84/d3d/ca1 1 2021-04-09T18:25:47.549 INFO:tasks.workunit.client.0.smithi120.stdout:1/317: symlink d5/d50/d61/l67 0 2021-04-09T18:25:47.556 INFO:tasks.workunit.client.0.smithi120.stdout:1/318: dwrite d5/d50/f55 [0,4194304] 0 2021-04-09T18:25:47.565 INFO:tasks.workunit.client.0.smithi120.stdout:1/319: dwrite d5/d1f/d22/d2b/f47 [0,4194304] 0 2021-04-09T18:25:47.571 INFO:tasks.workunit.client.0.smithi120.stdout:6/253: dread d6/d8/f10 [0,4194304] 0 2021-04-09T18:25:47.572 INFO:tasks.workunit.client.0.smithi120.stdout:1/320: dwrite d5/d64/f46 [0,4194304] 0 2021-04-09T18:25:47.576 INFO:tasks.workunit.client.0.smithi120.stdout:5/425: symlink d10/d12/la2 0 2021-04-09T18:25:47.576 INFO:tasks.workunit.client.0.smithi120.stdout:6/254: mkdir d6/d8/d3a/d56 0 2021-04-09T18:25:47.578 INFO:tasks.workunit.client.0.smithi120.stdout:6/255: write d6/d8/db/d12/d22/f40 [54530,24118] 0 2021-04-09T18:25:47.583 INFO:tasks.workunit.client.0.smithi120.stdout:5/426: mkdir d10/d12/d1b/d1f/d84/d44/d8c/da3 0 2021-04-09T18:25:47.585 INFO:tasks.workunit.client.0.smithi120.stdout:5/427: chown d10/d12/f1a 210286 1 2021-04-09T18:25:47.586 INFO:tasks.workunit.client.0.smithi120.stdout:6/256: dwrite d6/d8/f4c [0,4194304] 0 2021-04-09T18:25:47.590 INFO:tasks.workunit.client.0.smithi120.stdout:6/257: read d6/d8/db/d2b/f2e [899025,25504] 0 2021-04-09T18:25:47.592 INFO:tasks.workunit.client.0.smithi120.stdout:1/321: creat d5/d1f/d22/d24/f68 x:0 0 0 2021-04-09T18:25:47.594 INFO:tasks.workunit.client.0.smithi120.stdout:5/428: symlink d10/d12/d1b/d3a/la4 0 2021-04-09T18:25:47.603 INFO:tasks.workunit.client.0.smithi120.stdout:5/429: dwrite d10/d12/d1b/d1f/f79 [0,4194304] 0 2021-04-09T18:25:47.604 INFO:tasks.workunit.client.0.smithi120.stdout:1/322: rename d5/f17 to d5/d64/d2d/d5a/f69 0 2021-04-09T18:25:47.604 INFO:tasks.workunit.client.0.smithi120.stdout:0/295: truncate d0/d2/d4/f29 223381 0 2021-04-09T18:25:47.605 INFO:tasks.workunit.client.0.smithi120.stdout:5/430: stat d10/d12/d1b/d1f/f79 0 2021-04-09T18:25:47.606 INFO:tasks.workunit.client.0.smithi120.stdout:1/323: write d5/d64/f46 [1492499,25459] 0 2021-04-09T18:25:47.612 INFO:tasks.workunit.client.0.smithi120.stdout:3/363: write d3/d5/d36/d1e/f40 [499390,130600] 0 2021-04-09T18:25:47.613 INFO:tasks.workunit.client.0.smithi120.stdout:1/324: write d5/d1f/d22/d2b/f62 [3806297,19394] 0 2021-04-09T18:25:47.614 INFO:tasks.workunit.client.0.smithi120.stdout:1/325: readlink d5/d1f/l10 0 2021-04-09T18:25:47.615 INFO:tasks.workunit.client.0.smithi120.stdout:1/326: fdatasync d5/d64/d2d/f3a 0 2021-04-09T18:25:47.622 INFO:tasks.workunit.client.0.smithi120.stdout:3/364: readlink d3/d5/d36/d1e/d6b/d59/d68/l62 0 2021-04-09T18:25:47.623 INFO:tasks.workunit.client.0.smithi120.stdout:5/431: rename d10/f2b to d10/d12/d1b/d1f/d84/d3d/d50/fa5 0 2021-04-09T18:25:47.630 INFO:tasks.workunit.client.0.smithi120.stdout:1/327: dwrite d5/f7 [0,4194304] 0 2021-04-09T18:25:47.630 INFO:tasks.workunit.client.0.smithi120.stdout:3/365: write d3/d5/d36/d1e/f40 [1792486,108740] 0 2021-04-09T18:25:47.636 INFO:tasks.workunit.client.0.smithi120.stdout:1/328: unlink d5/d1f/l30 0 2021-04-09T18:25:47.638 INFO:tasks.workunit.client.0.smithi120.stdout:0/296: read d0/d2/dd/f4b [3587423,14220] 0 2021-04-09T18:25:47.639 INFO:tasks.workunit.client.0.smithi120.stdout:8/249: sync 2021-04-09T18:25:47.642 INFO:tasks.workunit.client.0.smithi120.stdout:6/258: truncate d6/d8/db/d12/f1f 1064505 0 2021-04-09T18:25:47.642 INFO:tasks.workunit.client.0.smithi120.stdout:5/432: dwrite d10/d12/d1b/d1f/d84/d3d/f6d [0,4194304] 0 2021-04-09T18:25:47.644 INFO:tasks.workunit.client.0.smithi120.stdout:0/297: mkdir d0/d52/d56 0 2021-04-09T18:25:47.645 INFO:tasks.workunit.client.0.smithi120.stdout:0/298: chown d0/d2/da 14134853 1 2021-04-09T18:25:47.651 INFO:tasks.workunit.client.0.smithi120.stdout:3/366: truncate d3/d5/d36/d1e/d6b/f3f 1239498 0 2021-04-09T18:25:47.656 INFO:tasks.workunit.client.0.smithi120.stdout:5/433: mkdir d10/d12/d1b/d1f/d84/d44/d8c/da6 0 2021-04-09T18:25:47.658 INFO:tasks.workunit.client.0.smithi120.stdout:1/329: dwrite d5/d50/f58 [0,4194304] 0 2021-04-09T18:25:47.662 INFO:tasks.workunit.client.0.smithi120.stdout:3/367: creat d3/d5/d36/d1e/d6b/d49/d4e/d54/f75 x:0 0 0 2021-04-09T18:25:47.666 INFO:tasks.workunit.client.0.smithi120.stdout:6/259: dwrite d6/d8/f25 [0,4194304] 0 2021-04-09T18:25:47.667 INFO:tasks.workunit.client.0.smithi120.stdout:6/260: chown d6/d8 15 1 2021-04-09T18:25:47.668 INFO:tasks.workunit.client.0.smithi120.stdout:6/261: write d6/d8/db/d12/f18 [432628,110346] 0 2021-04-09T18:25:47.669 INFO:tasks.workunit.client.0.smithi120.stdout:5/434: creat d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b/fa7 x:0 0 0 2021-04-09T18:25:47.670 INFO:tasks.workunit.client.0.smithi120.stdout:6/262: write d6/d8/db/f2c [518492,14062] 0 2021-04-09T18:25:47.671 INFO:tasks.workunit.client.0.smithi120.stdout:2/307: sync 2021-04-09T18:25:47.671 INFO:tasks.workunit.client.0.smithi120.stdout:9/330: sync 2021-04-09T18:25:47.672 INFO:tasks.workunit.client.0.smithi120.stdout:7/225: sync 2021-04-09T18:25:47.672 INFO:tasks.workunit.client.0.smithi120.stdout:3/368: creat d3/d5/d36/d1e/d38/d61/f76 x:0 0 0 2021-04-09T18:25:47.672 INFO:tasks.workunit.client.0.smithi120.stdout:9/331: stat d19 0 2021-04-09T18:25:47.674 INFO:tasks.workunit.client.0.smithi120.stdout:3/369: chown d3/de/l24 46 1 2021-04-09T18:25:47.675 INFO:tasks.workunit.client.0.smithi120.stdout:7/226: dread - db/d2c/d34/f48 zero size 2021-04-09T18:25:47.678 INFO:tasks.workunit.client.0.smithi120.stdout:0/299: dread d0/f3c [0,4194304] 0 2021-04-09T18:25:47.679 INFO:tasks.workunit.client.0.smithi120.stdout:2/308: creat d13/d1b/d48/d58/f67 x:0 0 0 2021-04-09T18:25:47.682 INFO:tasks.workunit.client.0.smithi120.stdout:6/263: creat d6/f57 x:0 0 0 2021-04-09T18:25:47.684 INFO:tasks.workunit.client.0.smithi120.stdout:6/264: dread - d6/d8/db/f39 zero size 2021-04-09T18:25:47.691 INFO:tasks.workunit.client.0.smithi120.stdout:9/332: getdents d19/d24/d36/d47 0 2021-04-09T18:25:47.695 INFO:tasks.workunit.client.0.smithi120.stdout:6/265: creat d6/d8/d1a/d36/d54/d41/d49/f58 x:0 0 0 2021-04-09T18:25:47.697 INFO:tasks.workunit.client.0.smithi120.stdout:9/333: read d19/f1d [809453,108612] 0 2021-04-09T18:25:47.698 INFO:tasks.workunit.client.0.smithi120.stdout:3/370: truncate d3/de/d25/f65 1046759 0 2021-04-09T18:25:47.698 INFO:tasks.workunit.client.0.smithi120.stdout:2/309: truncate d13/d1b/f33 947677 0 2021-04-09T18:25:47.700 INFO:tasks.workunit.client.0.smithi120.stdout:9/334: chown d19/d24/d37/f5f 683299783 1 2021-04-09T18:25:47.701 INFO:tasks.workunit.client.0.smithi120.stdout:6/266: creat d6/d8/d3a/f59 x:0 0 0 2021-04-09T18:25:47.704 INFO:tasks.workunit.client.0.smithi120.stdout:1/330: read d5/d64/d2d/d5a/f69 [4074838,34716] 0 2021-04-09T18:25:47.710 INFO:tasks.workunit.client.0.smithi120.stdout:6/267: mkdir d6/d8/d1a/d36/d5a 0 2021-04-09T18:25:47.711 INFO:tasks.workunit.client.0.smithi120.stdout:2/310: dwrite d13/d1b/d48/f57 [0,4194304] 0 2021-04-09T18:25:47.712 INFO:tasks.workunit.client.0.smithi120.stdout:5/435: getdents d10/d12/d1b/d1f/d84/d3d/d50 0 2021-04-09T18:25:47.716 INFO:tasks.workunit.client.0.smithi120.stdout:9/335: dwrite d19/d1c/f53 [0,4194304] 0 2021-04-09T18:25:47.716 INFO:tasks.workunit.client.0.smithi120.stdout:1/331: dread d5/f7 [0,4194304] 0 2021-04-09T18:25:47.727 INFO:tasks.workunit.client.0.smithi120.stdout:3/371: dread d3/de/d25/f65 [0,4194304] 0 2021-04-09T18:25:47.730 INFO:tasks.workunit.client.0.smithi120.stdout:9/336: creat d19/d24/d36/f6e x:0 0 0 2021-04-09T18:25:47.731 INFO:tasks.workunit.client.0.smithi120.stdout:1/332: readlink d5/l23 0 2021-04-09T18:25:47.732 INFO:tasks.workunit.client.0.smithi120.stdout:5/436: symlink d10/d12/la8 0 2021-04-09T18:25:47.734 INFO:tasks.workunit.client.0.smithi120.stdout:3/372: dread d3/d5/d36/d1e/d6b/f35 [0,4194304] 0 2021-04-09T18:25:47.736 INFO:tasks.workunit.client.0.smithi120.stdout:9/337: mkdir d19/d24/d36/d47/d6f 0 2021-04-09T18:25:47.737 INFO:tasks.workunit.client.0.smithi120.stdout:9/338: dread - d19/d1c/f6c zero size 2021-04-09T18:25:47.739 INFO:tasks.workunit.client.0.smithi120.stdout:5/437: mkdir d10/d12/d1b/d1f/d84/d3d/d50/da9 0 2021-04-09T18:25:47.742 INFO:tasks.workunit.client.0.smithi120.stdout:6/268: truncate d6/d8/db/f24 1465724 0 2021-04-09T18:25:47.747 INFO:tasks.workunit.client.0.smithi120.stdout:9/339: mkdir d19/d24/d37/d40/d70 0 2021-04-09T18:25:47.747 INFO:tasks.workunit.client.0.smithi120.stdout:1/333: dwrite d5/d1f/d22/d2b/f59 [0,4194304] 0 2021-04-09T18:25:47.747 INFO:tasks.workunit.client.0.smithi120.stdout:9/340: write f17 [3213924,71020] 0 2021-04-09T18:25:47.748 INFO:tasks.workunit.client.0.smithi120.stdout:5/438: mkdir d10/daa 0 2021-04-09T18:25:47.751 INFO:tasks.workunit.client.0.smithi120.stdout:1/334: creat d5/d64/d2d/d5a/f6a x:0 0 0 2021-04-09T18:25:47.756 INFO:tasks.workunit.client.0.smithi120.stdout:1/335: symlink d5/d1f/l6b 0 2021-04-09T18:25:47.757 INFO:tasks.workunit.client.0.smithi120.stdout:9/341: creat d19/d1c/d29/d63/f71 x:0 0 0 2021-04-09T18:25:47.762 INFO:tasks.workunit.client.0.smithi120.stdout:4/321: dread d1f/d24/f25 [0,4194304] 0 2021-04-09T18:25:47.765 INFO:tasks.workunit.client.0.smithi120.stdout:5/439: read d10/d12/d1b/d3a/f9c [392009,115726] 0 2021-04-09T18:25:47.766 INFO:tasks.workunit.client.0.smithi120.stdout:1/336: mkdir d5/d1f/d22/d6c 0 2021-04-09T18:25:47.769 INFO:tasks.workunit.client.0.smithi120.stdout:4/322: getdents d1f/d2c/d34/d60 0 2021-04-09T18:25:47.769 INFO:tasks.workunit.client.0.smithi120.stdout:9/342: creat d19/d2c/d5b/f72 x:0 0 0 2021-04-09T18:25:47.773 INFO:tasks.workunit.client.0.smithi120.stdout:5/440: mkdir d10/d12/d1b/d1f/d39/dab 0 2021-04-09T18:25:47.773 INFO:tasks.workunit.client.0.smithi120.stdout:4/323: readlink d1f/d24/d6b/l59 0 2021-04-09T18:25:47.774 INFO:tasks.workunit.client.0.smithi120.stdout:1/337: symlink d5/d1f/d22/d2b/l6d 0 2021-04-09T18:25:47.776 INFO:tasks.workunit.client.0.smithi120.stdout:5/441: dread d10/d12/d1b/d1f/f64 [0,4194304] 0 2021-04-09T18:25:47.777 INFO:tasks.workunit.client.0.smithi120.stdout:2/311: write d13/f2e [445758,23679] 0 2021-04-09T18:25:47.780 INFO:tasks.workunit.client.0.smithi120.stdout:5/442: unlink d10/f73 0 2021-04-09T18:25:47.783 INFO:tasks.workunit.client.0.smithi120.stdout:9/343: dwrite d19/d1c/f4f [0,4194304] 0 2021-04-09T18:25:47.784 INFO:tasks.workunit.client.0.smithi120.stdout:4/324: dwrite f1a [0,4194304] 0 2021-04-09T18:25:47.784 INFO:tasks.workunit.client.0.smithi120.stdout:5/443: fsync d10/d12/d1b/d1f/f59 0 2021-04-09T18:25:47.785 INFO:tasks.workunit.client.0.smithi120.stdout:1/338: dread d5/d50/f55 [0,4194304] 0 2021-04-09T18:25:47.786 INFO:tasks.workunit.client.0.smithi120.stdout:9/344: dread - d19/d2c/f69 zero size 2021-04-09T18:25:47.787 INFO:tasks.workunit.client.0.smithi120.stdout:2/312: dread f9 [0,4194304] 0 2021-04-09T18:25:47.791 INFO:tasks.workunit.client.0.smithi120.stdout:5/444: creat d10/d12/d1b/d1f/d84/d3d/d50/d94/fac x:0 0 0 2021-04-09T18:25:47.793 INFO:tasks.workunit.client.0.smithi120.stdout:4/325: rename d1f/d2c/d30/l68 to d1f/d2c/d30/l6c 0 2021-04-09T18:25:47.794 INFO:tasks.workunit.client.0.smithi120.stdout:5/445: write d10/d12/d1b/d1f/d39/f87 [1283822,43686] 0 2021-04-09T18:25:47.798 INFO:tasks.workunit.client.0.smithi120.stdout:2/313: link d13/d15/d35/f5d d13/d15/d35/f68 0 2021-04-09T18:25:47.801 INFO:tasks.workunit.client.0.smithi120.stdout:2/314: chown d13 31856958 1 2021-04-09T18:25:47.802 INFO:tasks.workunit.client.0.smithi120.stdout:1/339: creat d5/d64/d2d/f6e x:0 0 0 2021-04-09T18:25:47.804 INFO:tasks.workunit.client.0.smithi120.stdout:4/326: creat d1f/d2c/d34/f6d x:0 0 0 2021-04-09T18:25:47.804 INFO:tasks.workunit.client.0.smithi120.stdout:2/315: read d13/d15/f42 [23840,87399] 0 2021-04-09T18:25:47.805 INFO:tasks.workunit.client.0.smithi120.stdout:1/340: mknod d5/d1f/d22/d24/c6f 1 2021-04-09T18:25:47.805 INFO:tasks.workunit.client.0.smithi120.stdout:5/446: creat d10/d12/d1b/d1f/d84/d44/d8c/fad x:0 0 0 2021-04-09T18:25:47.810 INFO:tasks.workunit.client.0.smithi120.stdout:1/341: write d5/d1f/d22/d24/f41 [657870,59395] 0 2021-04-09T18:25:47.812 INFO:tasks.workunit.client.0.smithi120.stdout:1/342: dread - d5/d1f/d22/d24/f68 zero size 2021-04-09T18:25:47.819 INFO:tasks.workunit.client.0.smithi120.stdout:5/447: chown d10/d12/d1b/d3a/d8f 11 1 2021-04-09T18:25:47.820 INFO:tasks.workunit.client.0.smithi120.stdout:2/316: truncate d13/d1b/f44 592767 0 2021-04-09T18:25:47.824 INFO:tasks.workunit.client.0.smithi120.stdout:1/343: getdents d5 0 2021-04-09T18:25:47.827 INFO:tasks.workunit.client.0.smithi120.stdout:1/344: chown d5/d1f/d22/d24/f41 0 1 2021-04-09T18:25:47.828 INFO:tasks.workunit.client.0.smithi120.stdout:2/317: fdatasync d13/d15/d35/f68 0 2021-04-09T18:25:47.828 INFO:tasks.workunit.client.0.smithi120.stdout:4/327: truncate d1f/d2c/d34/f6d 436693 0 2021-04-09T18:25:47.830 INFO:tasks.workunit.client.0.smithi120.stdout:1/345: write d5/d50/f58 [5038907,71985] 0 2021-04-09T18:25:47.831 INFO:tasks.workunit.client.0.smithi120.stdout:2/318: chown d13/d1b/f33 420826997 1 2021-04-09T18:25:47.833 INFO:tasks.workunit.client.0.smithi120.stdout:5/448: rename d10/d12/d1b/d1f/d84/d3d/d50/d94/f98 to d10/fae 0 2021-04-09T18:25:47.834 INFO:tasks.workunit.client.0.smithi120.stdout:5/449: read - d10/d12/d1b/d1f/d84/f3e zero size 2021-04-09T18:25:47.836 INFO:tasks.workunit.client.0.smithi120.stdout:1/346: chown d5/d1f/d22/d24/l4f 13 1 2021-04-09T18:25:47.845 INFO:tasks.workunit.client.0.smithi120.stdout:1/347: dread d5/d1f/d22/d2b/f59 [0,4194304] 0 2021-04-09T18:25:47.845 INFO:tasks.workunit.client.0.smithi120.stdout:4/328: creat d1f/d24/d6b/f6e x:0 0 0 2021-04-09T18:25:47.846 INFO:tasks.workunit.client.0.smithi120.stdout:4/329: stat d1f/d2c/d30/f4d 0 2021-04-09T18:25:47.846 INFO:tasks.workunit.client.0.smithi120.stdout:4/330: chown l13 6052889 1 2021-04-09T18:25:47.847 INFO:tasks.workunit.client.0.smithi120.stdout:1/348: creat d5/d64/d2d/f70 x:0 0 0 2021-04-09T18:25:47.852 INFO:tasks.workunit.client.0.smithi120.stdout:3/373: dwrite d3/d5/f4d [0,4194304] 0 2021-04-09T18:25:47.854 INFO:tasks.workunit.client.0.smithi120.stdout:4/331: rename l13 to d1f/d2c/d30/l6f 0 2021-04-09T18:25:47.863 INFO:tasks.workunit.client.0.smithi120.stdout:9/345: creat d19/d24/d36/d47/f73 x:0 0 0 2021-04-09T18:25:47.864 INFO:tasks.workunit.client.0.smithi120.stdout:4/332: symlink d1f/d2c/d3b/l70 0 2021-04-09T18:25:47.867 INFO:tasks.workunit.client.0.smithi120.stdout:3/374: rename d3/d5/d36/f10 to d3/d5/f77 0 2021-04-09T18:25:47.868 INFO:tasks.workunit.client.0.smithi120.stdout:9/346: readlink d19/d24/l34 0 2021-04-09T18:25:47.876 INFO:tasks.workunit.client.0.smithi120.stdout:5/450: truncate d10/d12/d1b/d1f/f59 559078 0 2021-04-09T18:25:47.876 INFO:tasks.workunit.client.0.smithi120.stdout:6/269: truncate d6/d8/db/d12/f18 81853 0 2021-04-09T18:25:47.879 INFO:tasks.workunit.client.0.smithi120.stdout:3/375: dwrite d3/d5/d36/d3d/f6e [0,4194304] 0 2021-04-09T18:25:47.882 INFO:tasks.workunit.client.0.smithi120.stdout:4/333: creat d1f/f71 x:0 0 0 2021-04-09T18:25:47.884 INFO:tasks.workunit.client.0.smithi120.stdout:6/270: symlink d6/d8/d1a/d36/d54/d41/d49/l5b 0 2021-04-09T18:25:47.885 INFO:tasks.workunit.client.0.smithi120.stdout:9/347: dwrite f16 [4194304,4194304] 0 2021-04-09T18:25:47.886 INFO:tasks.workunit.client.0.smithi120.stdout:5/451: creat d10/d12/d1b/d1f/d84/d3d/d50/faf x:0 0 0 2021-04-09T18:25:47.887 INFO:tasks.workunit.client.0.smithi120.stdout:9/348: fsync d19/f32 0 2021-04-09T18:25:47.887 INFO:tasks.workunit.client.0.smithi120.stdout:4/334: creat d1f/d2c/d56/f72 x:0 0 0 2021-04-09T18:25:47.889 INFO:tasks.workunit.client.0.smithi120.stdout:5/452: write d10/d12/d1b/d3a/f91 [234464,15728] 0 2021-04-09T18:25:47.892 INFO:tasks.workunit.client.0.smithi120.stdout:6/271: rename d6/d8/db/d12/f28 to d6/d8/d1a/d36/f5c 0 2021-04-09T18:25:47.893 INFO:tasks.workunit.client.0.smithi120.stdout:6/272: write d6/fc [2960638,19154] 0 2021-04-09T18:25:47.895 INFO:tasks.workunit.client.0.smithi120.stdout:9/349: creat d19/f74 x:0 0 0 2021-04-09T18:25:47.898 INFO:tasks.workunit.client.0.smithi120.stdout:4/335: fsync d1f/d2c/d3b/d3e/f54 0 2021-04-09T18:25:47.902 INFO:tasks.workunit.client.0.smithi120.stdout:9/350: creat d19/d24/d37/d40/f75 x:0 0 0 2021-04-09T18:25:47.903 INFO:tasks.workunit.client.0.smithi120.stdout:5/453: dwrite d10/d12/d1b/d1f/f57 [0,4194304] 0 2021-04-09T18:25:47.903 INFO:tasks.workunit.client.0.smithi120.stdout:2/319: write d13/f2c [1154000,20667] 0 2021-04-09T18:25:47.907 INFO:tasks.workunit.client.0.smithi120.stdout:6/273: mkdir d6/d8/d1a/d36/d5a/d5d 0 2021-04-09T18:25:47.908 INFO:tasks.workunit.client.0.smithi120.stdout:9/351: write d19/d1c/f1f [3434927,29476] 0 2021-04-09T18:25:47.909 INFO:tasks.workunit.client.0.smithi120.stdout:3/376: truncate d3/de/f4f 999614 0 2021-04-09T18:25:47.914 INFO:tasks.workunit.client.0.smithi120.stdout:9/352: read d19/d1c/f4f [2468850,61216] 0 2021-04-09T18:25:47.917 INFO:tasks.workunit.client.0.smithi120.stdout:6/274: write d6/d8/d1a/d36/d54/d41/d49/f4f [861989,30056] 0 2021-04-09T18:25:47.919 INFO:tasks.workunit.client.0.smithi120.stdout:6/275: chown d6/d8/db/d12/d22/f27 368490 1 2021-04-09T18:25:47.919 INFO:tasks.workunit.client.0.smithi120.stdout:5/454: write d10/d12/d3b/f86 [2653737,55602] 0 2021-04-09T18:25:47.928 INFO:tasks.workunit.client.0.smithi120.stdout:6/276: symlink d6/d8/d1a/d36/d54/d31/d37/l5e 0 2021-04-09T18:25:47.929 INFO:tasks.workunit.client.0.smithi120.stdout:5/455: readlink d10/d12/d1b/d1f/d84/d44/l92 0 2021-04-09T18:25:47.929 INFO:tasks.workunit.client.0.smithi120.stdout:2/320: creat d13/d15/f69 x:0 0 0 2021-04-09T18:25:47.937 INFO:tasks.workunit.client.0.smithi120.stdout:6/277: unlink d6/d8/d3a/f48 0 2021-04-09T18:25:47.938 INFO:tasks.workunit.client.0.smithi120.stdout:9/353: rmdir d19/d24/d37/d40/d70 0 2021-04-09T18:25:47.940 INFO:tasks.workunit.client.0.smithi120.stdout:6/278: mknod d6/d8/db/d12/d22/c5f 1 2021-04-09T18:25:47.941 INFO:tasks.workunit.client.0.smithi120.stdout:5/456: dwrite d10/d12/d1b/d1f/d84/d3d/d50/f70 [0,4194304] 0 2021-04-09T18:25:47.944 INFO:tasks.workunit.client.0.smithi120.stdout:1/349: write d5/d1f/d22/d24/f2f [368796,46526] 0 2021-04-09T18:25:47.944 INFO:tasks.workunit.client.0.smithi120.stdout:4/336: getdents d1f/d2c/d56 0 2021-04-09T18:25:47.951 INFO:tasks.workunit.client.0.smithi120.stdout:6/279: unlink d6/d8/db/f51 0 2021-04-09T18:25:47.952 INFO:tasks.workunit.client.0.smithi120.stdout:5/457: creat d10/d12/d3b/fb0 x:0 0 0 2021-04-09T18:25:47.952 INFO:tasks.workunit.client.0.smithi120.stdout:4/337: mkdir d1f/d2c/d3b/d3e/d73 0 2021-04-09T18:25:47.956 INFO:tasks.workunit.client.0.smithi120.stdout:1/350: dread d5/d1f/d22/d2b/f59 [0,4194304] 0 2021-04-09T18:25:47.958 INFO:tasks.workunit.client.0.smithi120.stdout:1/351: dread - d5/d64/d2d/d5a/f6a zero size 2021-04-09T18:25:47.960 INFO:tasks.workunit.client.0.smithi120.stdout:6/280: rename d6/d8/db/d12/d22/l32 to d6/d8/d1a/d36/d54/d31/d37/l60 0 2021-04-09T18:25:47.962 INFO:tasks.workunit.client.0.smithi120.stdout:1/352: rmdir d5 39 2021-04-09T18:25:47.963 INFO:tasks.workunit.client.0.smithi120.stdout:6/281: chown d6/d8/db/d12/d22/f23 13165065 1 2021-04-09T18:25:47.964 INFO:tasks.workunit.client.0.smithi120.stdout:4/338: dwrite d1f/d2c/d3b/d3e/f48 [0,4194304] 0 2021-04-09T18:25:47.965 INFO:tasks.workunit.client.0.smithi120.stdout:5/458: dread d10/d12/d1b/d1f/f57 [0,4194304] 0 2021-04-09T18:25:47.965 INFO:tasks.workunit.client.0.smithi120.stdout:4/339: stat l1d 0 2021-04-09T18:25:47.970 INFO:tasks.workunit.client.0.smithi120.stdout:6/282: mkdir d6/d8/d1a/d36/d54/d31/d37/d61 0 2021-04-09T18:25:47.970 INFO:tasks.workunit.client.0.smithi120.stdout:4/340: creat d1f/d2c/d56/f74 x:0 0 0 2021-04-09T18:25:47.971 INFO:tasks.workunit.client.0.smithi120.stdout:5/459: creat d10/d12/d1b/d3a/d5b/fb1 x:0 0 0 2021-04-09T18:25:47.972 INFO:tasks.workunit.client.0.smithi120.stdout:4/341: rmdir d1f 39 2021-04-09T18:25:47.973 INFO:tasks.workunit.client.0.smithi120.stdout:1/353: link d5/d1f/l6b d5/d1f/d22/d6c/l71 0 2021-04-09T18:25:47.974 INFO:tasks.workunit.client.0.smithi120.stdout:5/460: read - d10/d12/d1b/d1f/d84/d44/d8c/fad zero size 2021-04-09T18:25:47.982 INFO:tasks.workunit.client.0.smithi120.stdout:6/283: rename d6/d8/d1a/d36/d54/d31/d37/l44 to d6/d8/d1a/d36/d54/d41/l62 0 2021-04-09T18:25:47.982 INFO:tasks.workunit.client.0.smithi120.stdout:4/342: unlink d1f/f28 0 2021-04-09T18:25:47.983 INFO:tasks.workunit.client.0.smithi120.stdout:4/343: mknod d1f/d2c/d3b/d3e/c75 1 2021-04-09T18:25:47.984 INFO:tasks.workunit.client.0.smithi120.stdout:1/354: creat d5/d5c/f72 x:0 0 0 2021-04-09T18:25:47.986 INFO:tasks.workunit.client.0.smithi120.stdout:6/284: chown d6/d8/f26 92488059 1 2021-04-09T18:25:47.986 INFO:tasks.workunit.client.0.smithi120.stdout:4/344: symlink d1f/d2c/d56/l76 0 2021-04-09T18:25:47.987 INFO:tasks.workunit.client.0.smithi120.stdout:1/355: fsync d5/d1f/d22/d2b/f47 0 2021-04-09T18:25:47.988 INFO:tasks.workunit.client.0.smithi120.stdout:1/356: mknod d5/d64/c73 1 2021-04-09T18:25:47.988 INFO:tasks.workunit.client.0.smithi120.stdout:6/285: write d6/d8/d1a/f34 [845134,87629] 0 2021-04-09T18:25:47.989 INFO:tasks.workunit.client.0.smithi120.stdout:1/357: chown d5/d1f/d22/d6c 36761 1 2021-04-09T18:25:47.990 INFO:tasks.workunit.client.0.smithi120.stdout:1/358: mknod d5/d1f/d22/d2b/c74 1 2021-04-09T18:25:47.990 INFO:tasks.workunit.client.0.smithi120.stdout:4/345: mkdir d1f/d2c/d3b/d3e/d77 0 2021-04-09T18:25:47.992 INFO:tasks.workunit.client.0.smithi120.stdout:1/359: mkdir d5/d5c/d75 0 2021-04-09T18:25:47.994 INFO:tasks.workunit.client.0.smithi120.stdout:1/360: chown d5/d64/f46 903811 1 2021-04-09T18:25:47.995 INFO:tasks.workunit.client.0.smithi120.stdout:6/286: dwrite d6/f2f [0,4194304] 0 2021-04-09T18:25:48.000 INFO:tasks.workunit.client.0.smithi120.stdout:6/287: symlink d6/d8/d3a/l63 0 2021-04-09T18:25:48.004 INFO:tasks.workunit.client.0.smithi120.stdout:2/321: dwrite d13/d1b/f44 [0,4194304] 0 2021-04-09T18:25:48.005 INFO:tasks.workunit.client.0.smithi120.stdout:4/346: dwrite d1f/d24/f26 [0,4194304] 0 2021-04-09T18:25:48.008 INFO:tasks.workunit.client.0.smithi120.stdout:2/322: dread - d13/d1b/d54/f60 zero size 2021-04-09T18:25:48.011 INFO:tasks.workunit.client.0.smithi120.stdout:2/323: write d13/d1b/d48/d58/f65 [820550,78084] 0 2021-04-09T18:25:48.014 INFO:tasks.workunit.client.0.smithi120.stdout:1/361: dwrite d5/f7 [4194304,4194304] 0 2021-04-09T18:25:48.017 INFO:tasks.workunit.client.0.smithi120.stdout:1/362: symlink d5/d1f/d22/l76 0 2021-04-09T18:25:48.031 INFO:tasks.workunit.client.0.smithi120.stdout:2/324: rmdir d13/d15 39 2021-04-09T18:25:48.032 INFO:tasks.workunit.client.0.smithi120.stdout:1/363: link d5/d64/l3b d5/d50/d61/l77 0 2021-04-09T18:25:48.032 INFO:tasks.workunit.client.0.smithi120.stdout:1/364: unlink d5/d64/f46 0 2021-04-09T18:25:48.039 INFO:tasks.workunit.client.0.smithi120.stdout:4/347: read d1f/d2c/d3b/f5e [706209,60369] 0 2021-04-09T18:25:48.046 INFO:tasks.workunit.client.0.smithi120.stdout:1/365: creat d5/d1f/d22/d2b/f78 x:0 0 0 2021-04-09T18:25:48.047 INFO:tasks.workunit.client.0.smithi120.stdout:6/288: rename d6/d8/d1a/d36/d54/d41/l62 to d6/d8/d52/l64 0 2021-04-09T18:25:48.048 INFO:tasks.workunit.client.0.smithi120.stdout:2/325: symlink d13/l6a 0 2021-04-09T18:25:48.051 INFO:tasks.workunit.client.0.smithi120.stdout:1/366: rmdir d5/d50/d61 39 2021-04-09T18:25:48.053 INFO:tasks.workunit.client.0.smithi120.stdout:6/289: symlink d6/d8/d52/l65 0 2021-04-09T18:25:48.053 INFO:tasks.workunit.client.0.smithi120.stdout:2/326: chown d13/d1b/d48/d49/l59 1540 1 2021-04-09T18:25:48.053 INFO:tasks.workunit.client.0.smithi120.stdout:1/367: rmdir d5 39 2021-04-09T18:25:48.060 INFO:tasks.workunit.client.0.smithi120.stdout:4/348: truncate d1f/d2c/d56/f72 1037990 0 2021-04-09T18:25:48.061 INFO:tasks.workunit.client.0.smithi120.stdout:4/349: fsync fe 0 2021-04-09T18:25:48.063 INFO:tasks.workunit.client.0.smithi120.stdout:1/368: write d5/f20 [172599,60857] 0 2021-04-09T18:25:48.065 INFO:tasks.workunit.client.0.smithi120.stdout:1/369: chown d5/d1f/d22/d2b/f57 117 1 2021-04-09T18:25:48.065 INFO:tasks.workunit.client.0.smithi120.stdout:2/327: dread d13/d15/f2a [4194304,4194304] 0 2021-04-09T18:25:48.066 INFO:tasks.workunit.client.0.smithi120.stdout:2/328: chown d13/d1b/l27 29601 1 2021-04-09T18:25:48.068 INFO:tasks.workunit.client.0.smithi120.stdout:1/370: creat d5/d1f/d22/d24/f79 x:0 0 0 2021-04-09T18:25:48.071 INFO:tasks.workunit.client.0.smithi120.stdout:1/371: creat d5/d1f/d22/d2b/f7a x:0 0 0 2021-04-09T18:25:48.077 INFO:tasks.workunit.client.0.smithi120.stdout:2/329: rmdir d13/d1b/d48/d49/d64/d66 0 2021-04-09T18:25:48.079 INFO:tasks.workunit.client.0.smithi120.stdout:2/330: unlink d13/f14 0 2021-04-09T18:25:48.195 INFO:tasks.workunit.client.0.smithi120.stdout:8/250: sync 2021-04-09T18:25:48.197 INFO:tasks.workunit.client.0.smithi120.stdout:8/251: write d2/d3/d11/ff [387953,128733] 0 2021-04-09T18:25:48.197 INFO:tasks.workunit.client.0.smithi120.stdout:8/252: readlink d2/d37/l49 0 2021-04-09T18:25:48.198 INFO:tasks.workunit.client.0.smithi120.stdout:8/253: chown d2/d3/d11/d2c 144516 1 2021-04-09T18:25:48.202 INFO:tasks.workunit.client.0.smithi120.stdout:8/254: creat d2/d3/f51 x:0 0 0 2021-04-09T18:25:48.205 INFO:tasks.workunit.client.0.smithi120.stdout:8/255: dread d2/d3/d11/ff [0,4194304] 0 2021-04-09T18:25:48.206 INFO:tasks.workunit.client.0.smithi120.stdout:8/256: mknod d2/d27/c52 1 2021-04-09T18:25:48.207 INFO:tasks.workunit.client.0.smithi120.stdout:8/257: stat d2/d27/f48 0 2021-04-09T18:25:48.212 INFO:tasks.workunit.client.0.smithi120.stdout:8/258: dwrite d2/d3/d11/d2c/d2e/d3b/f38 [0,4194304] 0 2021-04-09T18:25:48.215 INFO:tasks.workunit.client.0.smithi120.stdout:8/259: unlink d2/d3/f12 0 2021-04-09T18:25:48.417 INFO:tasks.workunit.client.0.smithi120.stdout:1/372: fsync d5/d64/d2d/d5a/f69 0 2021-04-09T18:25:48.422 INFO:tasks.workunit.client.0.smithi120.stdout:1/373: dwrite d5/d1f/d22/d24/f41 [0,4194304] 0 2021-04-09T18:25:48.423 INFO:tasks.workunit.client.0.smithi120.stdout:1/374: read - d5/d1f/d22/d24/f68 zero size 2021-04-09T18:25:48.428 INFO:tasks.workunit.client.0.smithi120.stdout:1/375: dwrite d5/d64/d2d/f3a [4194304,4194304] 0 2021-04-09T18:25:48.441 INFO:tasks.workunit.client.0.smithi120.stdout:1/376: getdents d5 0 2021-04-09T18:25:48.442 INFO:tasks.workunit.client.0.smithi120.stdout:1/377: chown d5/d64/d2d/f6e 27124 1 2021-04-09T18:25:48.443 INFO:tasks.workunit.client.0.smithi120.stdout:1/378: mknod d5/d1f/d22/d2b/c7b 1 2021-04-09T18:25:48.444 INFO:tasks.workunit.client.0.smithi120.stdout:1/379: chown d5/d1f/d22/d6c 239210396 1 2021-04-09T18:25:48.444 INFO:tasks.workunit.client.0.smithi120.stdout:2/331: write d13/d15/f42 [153275,69383] 0 2021-04-09T18:25:48.445 INFO:tasks.workunit.client.0.smithi120.stdout:1/380: fdatasync d5/d64/d2d/d5a/f6a 0 2021-04-09T18:25:48.448 INFO:tasks.workunit.client.0.smithi120.stdout:1/381: chown d5/d64/l3b 0 1 2021-04-09T18:25:48.450 INFO:tasks.workunit.client.0.smithi120.stdout:2/332: dwrite d13/d15/f2a [8388608,4194304] 0 2021-04-09T18:25:48.453 INFO:tasks.workunit.client.0.smithi120.stdout:2/333: readlink d13/d15/l23 0 2021-04-09T18:25:48.457 INFO:tasks.workunit.client.0.smithi120.stdout:2/334: rename d13/l32 to d13/d1b/d48/d49/d64/l6b 0 2021-04-09T18:25:48.467 INFO:tasks.workunit.client.0.smithi120.stdout:8/260: truncate d2/d3/f1a 2873626 0 2021-04-09T18:25:48.474 INFO:tasks.workunit.client.0.smithi120.stdout:2/335: truncate fb 4551969 0 2021-04-09T18:25:48.479 INFO:tasks.workunit.client.0.smithi120.stdout:8/261: dwrite d2/f2d [0,4194304] 0 2021-04-09T18:25:48.480 INFO:tasks.workunit.client.0.smithi120.stdout:1/382: truncate d5/d1f/d22/d24/f41 733827 0 2021-04-09T18:25:48.481 INFO:tasks.workunit.client.0.smithi120.stdout:1/383: stat d5/d64/l3b 0 2021-04-09T18:25:48.483 INFO:tasks.workunit.client.0.smithi120.stdout:2/336: dread - d13/d1b/d48/d58/f67 zero size 2021-04-09T18:25:48.492 INFO:tasks.workunit.client.0.smithi120.stdout:8/262: dwrite d2/f39 [0,4194304] 0 2021-04-09T18:25:48.493 INFO:tasks.workunit.client.0.smithi120.stdout:2/337: symlink d13/d1b/l6c 0 2021-04-09T18:25:48.494 INFO:tasks.workunit.client.0.smithi120.stdout:8/263: chown d2/d3/d11/d2c/d2e/d3b/f38 2 1 2021-04-09T18:25:48.495 INFO:tasks.workunit.client.0.smithi120.stdout:1/384: dwrite d5/d64/d2d/d5a/f6a [0,4194304] 0 2021-04-09T18:25:48.497 INFO:tasks.workunit.client.0.smithi120.stdout:2/338: symlink d13/d1b/d48/d49/l6d 0 2021-04-09T18:25:48.500 INFO:tasks.workunit.client.0.smithi120.stdout:8/264: unlink d2/d3/d11/d2c/d2e/d3b/f38 0 2021-04-09T18:25:48.556 INFO:tasks.workunit.client.0.smithi120.stdout:2/339: getdents d13/d1b 0 2021-04-09T18:25:48.559 INFO:tasks.workunit.client.0.smithi120.stdout:2/340: rename d13/d1b to d13/d61/d6e 0 2021-04-09T18:25:48.560 INFO:tasks.workunit.client.0.smithi120.stdout:2/341: mknod d13/d61/d6e/c6f 1 2021-04-09T18:25:48.563 INFO:tasks.workunit.client.0.smithi120.stdout:8/265: truncate d2/d3/d11/d2c/f32 82747 0 2021-04-09T18:25:48.565 INFO:tasks.workunit.client.0.smithi120.stdout:2/342: unlink d13/d15/d35/f5d 0 2021-04-09T18:25:48.566 INFO:tasks.workunit.client.0.smithi120.stdout:2/343: rmdir d13 39 2021-04-09T18:25:48.571 INFO:tasks.workunit.client.0.smithi120.stdout:8/266: link d2/d3/f1a d2/d37/d3e/d42/f53 0 2021-04-09T18:25:48.573 INFO:tasks.workunit.client.0.smithi120.stdout:2/344: rename d13/d15/l41 to d13/l70 0 2021-04-09T18:25:48.574 INFO:tasks.workunit.client.0.smithi120.stdout:8/267: symlink d2/d3/d11/l54 0 2021-04-09T18:25:48.574 INFO:tasks.workunit.client.0.smithi120.stdout:2/345: chown d13/d61/d6e/f44 3246 1 2021-04-09T18:25:48.574 INFO:tasks.workunit.client.0.smithi120.stdout:2/346: fdatasync d13/d15/f42 0 2021-04-09T18:25:48.577 INFO:tasks.workunit.client.0.smithi120.stdout:2/347: creat d13/d61/d6e/d54/f71 x:0 0 0 2021-04-09T18:25:48.578 INFO:tasks.workunit.client.0.smithi120.stdout:8/268: getdents d2/d37 0 2021-04-09T18:25:48.580 INFO:tasks.workunit.client.0.smithi120.stdout:2/348: creat d13/f72 x:0 0 0 2021-04-09T18:25:48.584 INFO:tasks.workunit.client.0.smithi120.stdout:8/269: truncate d2/d3/f51 203165 0 2021-04-09T18:25:48.586 INFO:tasks.workunit.client.0.smithi120.stdout:8/270: rename d2/f40 to d2/d3/d8/f55 0 2021-04-09T18:25:48.591 INFO:tasks.workunit.client.0.smithi120.stdout:8/271: dwrite d2/d3/f23 [4194304,4194304] 0 2021-04-09T18:25:48.597 INFO:tasks.workunit.client.0.smithi120.stdout:8/272: creat d2/d3/d11/d2c/d2e/d3b/f56 x:0 0 0 2021-04-09T18:25:48.600 INFO:tasks.workunit.client.0.smithi120.stdout:8/273: fsync d2/d3/f51 0 2021-04-09T18:25:48.606 INFO:tasks.workunit.client.0.smithi120.stdout:8/274: dwrite d2/d3/d11/f34 [0,4194304] 0 2021-04-09T18:25:48.609 INFO:tasks.workunit.client.0.smithi120.stdout:2/349: truncate d13/d15/f24 362512 0 2021-04-09T18:25:48.620 INFO:tasks.workunit.client.0.smithi120.stdout:8/275: dwrite d2/d3/d11/f1f [4194304,4194304] 0 2021-04-09T18:25:48.625 INFO:tasks.workunit.client.0.smithi120.stdout:8/276: fdatasync d2/d3/d11/f26 0 2021-04-09T18:25:48.630 INFO:tasks.workunit.client.0.smithi120.stdout:8/277: stat d2/d3/d3c/d4f 0 2021-04-09T18:25:48.631 INFO:tasks.workunit.client.0.smithi120.stdout:2/350: dwrite d13/d61/d6e/f33 [0,4194304] 0 2021-04-09T18:25:48.650 INFO:tasks.workunit.client.0.smithi120.stdout:2/351: rename d13/d15/d35/f53 to d13/f73 0 2021-04-09T18:25:48.651 INFO:tasks.workunit.client.0.smithi120.stdout:7/227: sync 2021-04-09T18:25:48.651 INFO:tasks.workunit.client.0.smithi120.stdout:0/300: sync 2021-04-09T18:25:48.652 INFO:tasks.workunit.client.0.smithi120.stdout:2/352: dread - d13/d61/d6e/d54/f71 zero size 2021-04-09T18:25:48.653 INFO:tasks.workunit.client.0.smithi120.stdout:7/228: fsync db/d42/f43 0 2021-04-09T18:25:48.653 INFO:tasks.workunit.client.0.smithi120.stdout:2/353: write d13/f19 [1088337,13186] 0 2021-04-09T18:25:48.655 INFO:tasks.workunit.client.0.smithi120.stdout:7/229: unlink db/f16 0 2021-04-09T18:25:48.656 INFO:tasks.workunit.client.0.smithi120.stdout:2/354: write d13/d15/f42 [505738,120726] 0 2021-04-09T18:25:48.667 INFO:tasks.workunit.client.0.smithi120.stdout:7/230: mkdir db/d38/d51 0 2021-04-09T18:25:48.667 INFO:tasks.workunit.client.0.smithi120.stdout:2/355: rmdir d13/d61/d6e/d48/d58 39 2021-04-09T18:25:48.667 INFO:tasks.workunit.client.0.smithi120.stdout:0/301: dwrite d0/d2/f3b [0,4194304] 0 2021-04-09T18:25:48.670 INFO:tasks.workunit.client.0.smithi120.stdout:0/302: readlink d0/d2/d4/l39 0 2021-04-09T18:25:48.671 INFO:tasks.workunit.client.0.smithi120.stdout:8/278: dread d2/d27/f2f [0,4194304] 0 2021-04-09T18:25:48.675 INFO:tasks.workunit.client.0.smithi120.stdout:8/279: write d2/d3/d11/f34 [4566235,95200] 0 2021-04-09T18:25:48.684 INFO:tasks.workunit.client.0.smithi120.stdout:7/231: link db/d2c/d34/f41 db/d2c/d30/f52 0 2021-04-09T18:25:48.686 INFO:tasks.workunit.client.0.smithi120.stdout:7/232: chown db/l17 0 1 2021-04-09T18:25:48.700 INFO:tasks.workunit.client.0.smithi120.stdout:8/280: rmdir d2/d3/d8/d4e 0 2021-04-09T18:25:48.700 INFO:tasks.workunit.client.0.smithi120.stdout:0/303: getdents d0/d2/dd 0 2021-04-09T18:25:48.701 INFO:tasks.workunit.client.0.smithi120.stdout:7/233: read db/f15 [3528284,90350] 0 2021-04-09T18:25:48.701 INFO:tasks.workunit.client.0.smithi120.stdout:2/356: truncate d13/d61/d6e/d48/d58/f65 292072 0 2021-04-09T18:25:48.702 INFO:tasks.workunit.client.0.smithi120.stdout:8/281: link d2/d3/d11/d2c/d2e/d3b/f2b d2/d3/d50/f57 0 2021-04-09T18:25:48.705 INFO:tasks.workunit.client.0.smithi120.stdout:2/357: unlink d13/l28 0 2021-04-09T18:25:48.707 INFO:tasks.workunit.client.0.smithi120.stdout:8/282: unlink d2/d3/d11/l54 0 2021-04-09T18:25:48.708 INFO:tasks.workunit.client.0.smithi120.stdout:2/358: dread d13/d15/f42 [0,4194304] 0 2021-04-09T18:25:48.709 INFO:tasks.workunit.client.0.smithi120.stdout:8/283: chown d2/d3/d11/d2c/d2e/d3b/f56 0 1 2021-04-09T18:25:48.710 INFO:tasks.workunit.client.0.smithi120.stdout:2/359: dread - d13/d61/d6e/d48/d58/f67 zero size 2021-04-09T18:25:48.710 INFO:tasks.workunit.client.0.smithi120.stdout:0/304: creat d0/f57 x:0 0 0 2021-04-09T18:25:48.711 INFO:tasks.workunit.client.0.smithi120.stdout:2/360: write f6 [7838629,70504] 0 2021-04-09T18:25:48.712 INFO:tasks.workunit.client.0.smithi120.stdout:0/305: rmdir d0/d2/da/d2e 39 2021-04-09T18:25:48.715 INFO:tasks.workunit.client.0.smithi120.stdout:2/361: creat d13/d61/d6e/d48/d49/d64/f74 x:0 0 0 2021-04-09T18:25:48.717 INFO:tasks.workunit.client.0.smithi120.stdout:0/306: write d0/d2/dd/f4b [1213785,87302] 0 2021-04-09T18:25:48.718 INFO:tasks.workunit.client.0.smithi120.stdout:8/284: dwrite d2/d3/d8/f55 [0,4194304] 0 2021-04-09T18:25:48.735 INFO:tasks.workunit.client.0.smithi120.stdout:0/307: rename d0/d2/da/l32 to d0/d2/da/d2e/l58 0 2021-04-09T18:25:48.737 INFO:tasks.workunit.client.0.smithi120.stdout:0/308: dread - d0/d2/da/d23/f2f zero size 2021-04-09T18:25:48.739 INFO:tasks.workunit.client.0.smithi120.stdout:0/309: rmdir d0/d2/dd 39 2021-04-09T18:25:48.740 INFO:tasks.workunit.client.0.smithi120.stdout:8/285: link d2/d37/d3e/d42/f53 d2/d3/f58 0 2021-04-09T18:25:48.743 INFO:tasks.workunit.client.0.smithi120.stdout:0/310: creat d0/d2/d4/f59 x:0 0 0 2021-04-09T18:25:48.749 INFO:tasks.workunit.client.0.smithi120.stdout:0/311: dread d0/d2/d4/f29 [0,4194304] 0 2021-04-09T18:25:48.749 INFO:tasks.workunit.client.0.smithi120.stdout:3/377: sync 2021-04-09T18:25:48.750 INFO:tasks.workunit.client.0.smithi120.stdout:5/461: sync 2021-04-09T18:25:48.750 INFO:tasks.workunit.client.0.smithi120.stdout:4/350: sync 2021-04-09T18:25:48.750 INFO:tasks.workunit.client.0.smithi120.stdout:6/290: sync 2021-04-09T18:25:48.750 INFO:tasks.workunit.client.0.smithi120.stdout:9/354: sync 2021-04-09T18:25:48.751 INFO:tasks.workunit.client.0.smithi120.stdout:6/291: mknod d6/c66 1 2021-04-09T18:25:48.752 INFO:tasks.workunit.client.0.smithi120.stdout:5/462: write d10/d12/f1a [2161916,51056] 0 2021-04-09T18:25:48.753 INFO:tasks.workunit.client.0.smithi120.stdout:8/286: write d2/d3/d11/d2c/f31 [435399,86546] 0 2021-04-09T18:25:48.755 INFO:tasks.workunit.client.0.smithi120.stdout:2/362: dread f6 [0,4194304] 0 2021-04-09T18:25:48.757 INFO:tasks.workunit.client.0.smithi120.stdout:9/355: mkdir d19/d1c/d29/d76 0 2021-04-09T18:25:48.759 INFO:tasks.workunit.client.0.smithi120.stdout:3/378: symlink d3/d5/d36/d1e/d6b/d59/l78 0 2021-04-09T18:25:48.762 INFO:tasks.workunit.client.0.smithi120.stdout:0/312: dwrite d0/d2/da/f19 [4194304,4194304] 0 2021-04-09T18:25:48.763 INFO:tasks.workunit.client.0.smithi120.stdout:2/363: creat d13/d61/d6e/f75 x:0 0 0 2021-04-09T18:25:48.764 INFO:tasks.workunit.client.0.smithi120.stdout:4/351: getdents d1f/d2c/d3b/d3e/d5c 0 2021-04-09T18:25:48.766 INFO:tasks.workunit.client.0.smithi120.stdout:3/379: dread - d3/d5/d36/d1e/d6b/d49/d4e/f60 zero size 2021-04-09T18:25:48.766 INFO:tasks.workunit.client.0.smithi120.stdout:2/364: write d13/d15/f69 [913311,72273] 0 2021-04-09T18:25:48.771 INFO:tasks.workunit.client.0.smithi120.stdout:5/463: link d10/d12/d1b/d1f/f56 d10/d12/d1b/d1f/d39/fb2 0 2021-04-09T18:25:48.771 INFO:tasks.workunit.client.0.smithi120.stdout:6/292: write d6/d8/d1a/d36/f5c [538072,106030] 0 2021-04-09T18:25:48.775 INFO:tasks.workunit.client.0.smithi120.stdout:3/380: write d3/d5/f2c [2616382,89052] 0 2021-04-09T18:25:48.775 INFO:tasks.workunit.client.0.smithi120.stdout:0/313: mkdir d0/d5a 0 2021-04-09T18:25:48.776 INFO:tasks.workunit.client.0.smithi120.stdout:2/365: mkdir d13/d61/d6e/d48/d49/d76 0 2021-04-09T18:25:48.777 INFO:tasks.workunit.client.0.smithi120.stdout:0/314: read - d0/d2/da/f2c zero size 2021-04-09T18:25:48.777 INFO:tasks.workunit.client.0.smithi120.stdout:1/385: sync 2021-04-09T18:25:48.783 INFO:tasks.workunit.client.0.smithi120.stdout:9/356: rename d19/f1d to d19/d24/d37/f77 0 2021-04-09T18:25:48.785 INFO:tasks.workunit.client.0.smithi120.stdout:6/293: dread d6/d8/f25 [0,4194304] 0 2021-04-09T18:25:48.790 INFO:tasks.workunit.client.0.smithi120.stdout:3/381: link d3/f70 d3/d5/d36/d1e/d6b/f79 0 2021-04-09T18:25:48.794 INFO:tasks.workunit.client.0.smithi120.stdout:2/366: rename d13/d61/d6e/l38 to d13/d61/d6e/d48/d58/l77 0 2021-04-09T18:25:48.795 INFO:tasks.workunit.client.0.smithi120.stdout:8/287: truncate d2/d3/d11/d2c/d2e/d3b/f56 684143 0 2021-04-09T18:25:48.797 INFO:tasks.workunit.client.0.smithi120.stdout:0/315: dwrite d0/d2/dd/f4b [0,4194304] 0 2021-04-09T18:25:48.797 INFO:tasks.workunit.client.0.smithi120.stdout:9/357: creat d19/f78 x:0 0 0 2021-04-09T18:25:48.798 INFO:tasks.workunit.client.0.smithi120.stdout:2/367: mknod d13/d61/d6e/d48/c78 1 2021-04-09T18:25:48.801 INFO:tasks.workunit.client.0.smithi120.stdout:6/294: link d6/d8/db/d12/d22/f3c d6/d8/db/f67 0 2021-04-09T18:25:48.806 INFO:tasks.workunit.client.0.smithi120.stdout:2/368: creat d13/d61/f79 x:0 0 0 2021-04-09T18:25:48.806 INFO:tasks.workunit.client.0.smithi120.stdout:6/295: mkdir d6/d8/db/d2b/d68 0 2021-04-09T18:25:48.810 INFO:tasks.workunit.client.0.smithi120.stdout:3/382: link d3/d5/d36/d1e/d6b/d49/d4e/l5a d3/d5/d36/l7a 0 2021-04-09T18:25:48.812 INFO:tasks.workunit.client.0.smithi120.stdout:2/369: mkdir d13/d7a 0 2021-04-09T18:25:48.814 INFO:tasks.workunit.client.0.smithi120.stdout:3/383: chown d3/d5 13271621 1 2021-04-09T18:25:48.823 INFO:tasks.workunit.client.0.smithi120.stdout:6/296: dwrite d6/d8/f26 [0,4194304] 0 2021-04-09T18:25:48.825 INFO:tasks.workunit.client.0.smithi120.stdout:7/234: dread f7 [0,4194304] 0 2021-04-09T18:25:48.827 INFO:tasks.workunit.client.0.smithi120.stdout:3/384: creat d3/d5/d36/d1e/d38/f7b x:0 0 0 2021-04-09T18:25:48.829 INFO:tasks.workunit.client.0.smithi120.stdout:3/385: chown d3/de/l3a 209046774 1 2021-04-09T18:25:48.831 INFO:tasks.workunit.client.0.smithi120.stdout:8/288: dwrite d2/d3/f1a [0,4194304] 0 2021-04-09T18:25:48.832 INFO:tasks.workunit.client.0.smithi120.stdout:2/370: unlink d13/d61/d6e/d48/d49/d64/l6b 0 2021-04-09T18:25:48.834 INFO:tasks.workunit.client.0.smithi120.stdout:7/235: mkdir db/d26/d4c/d53 0 2021-04-09T18:25:48.838 INFO:tasks.workunit.client.0.smithi120.stdout:8/289: dread - d2/d3/d11/f46 zero size 2021-04-09T18:25:48.839 INFO:tasks.workunit.client.0.smithi120.stdout:5/464: dread d10/d12/f3c [0,4194304] 0 2021-04-09T18:25:48.840 INFO:tasks.workunit.client.0.smithi120.stdout:2/371: symlink d13/d7a/l7b 0 2021-04-09T18:25:48.847 INFO:tasks.workunit.client.0.smithi120.stdout:7/236: rename db/d2c/d30/d47 to db/d42/d54 0 2021-04-09T18:25:48.847 INFO:tasks.workunit.client.0.smithi120.stdout:6/297: dwrite d6/d8/f25 [0,4194304] 0 2021-04-09T18:25:48.851 INFO:tasks.workunit.client.0.smithi120.stdout:7/237: write db/f25 [2740251,58211] 0 2021-04-09T18:25:48.851 INFO:tasks.workunit.client.0.smithi120.stdout:7/238: mknod db/d2c/d34/c55 1 2021-04-09T18:25:48.855 INFO:tasks.workunit.client.0.smithi120.stdout:5/465: rename d10/d12/d1b/d1f/d84/d44/d8c/f6b to d10/d12/d1b/d1f/d39/dab/fb3 0 2021-04-09T18:25:48.855 INFO:tasks.workunit.client.0.smithi120.stdout:3/386: creat d3/d5/d36/d1e/d6b/d49/f7c x:0 0 0 2021-04-09T18:25:48.858 INFO:tasks.workunit.client.0.smithi120.stdout:6/298: chown d6/d8/d1a/d36/d54/d41/d49/f4f 6 1 2021-04-09T18:25:48.858 INFO:tasks.workunit.client.0.smithi120.stdout:2/372: dwrite d13/f2c [0,4194304] 0 2021-04-09T18:25:48.859 INFO:tasks.workunit.client.0.smithi120.stdout:8/290: dwrite d2/f2d [0,4194304] 0 2021-04-09T18:25:48.865 INFO:tasks.workunit.client.0.smithi120.stdout:2/373: mkdir d13/d61/d7c 0 2021-04-09T18:25:48.867 INFO:tasks.workunit.client.0.smithi120.stdout:7/239: symlink db/d26/d4c/d53/l56 0 2021-04-09T18:25:48.876 INFO:tasks.workunit.client.0.smithi120.stdout:2/374: creat d13/d61/d6e/f7d x:0 0 0 2021-04-09T18:25:48.878 INFO:tasks.workunit.client.0.smithi120.stdout:5/466: dwrite d10/d12/d1b/d3a/d5b/f8d [0,4194304] 0 2021-04-09T18:25:48.883 INFO:tasks.workunit.client.0.smithi120.stdout:2/375: write d13/f47 [843340,26993] 0 2021-04-09T18:25:48.888 INFO:tasks.workunit.client.0.smithi120.stdout:2/376: dread d13/d61/d6e/f2b [0,4194304] 0 2021-04-09T18:25:48.901 INFO:tasks.workunit.client.0.smithi120.stdout:6/299: symlink d6/d8/d1a/d36/d54/d31/d37/d61/l69 0 2021-04-09T18:25:48.902 INFO:tasks.workunit.client.0.smithi120.stdout:7/240: dwrite db/f2b [0,4194304] 0 2021-04-09T18:25:48.902 INFO:tasks.workunit.client.0.smithi120.stdout:2/377: mkdir d13/d61/d6e/d48/d58/d7e 0 2021-04-09T18:25:48.905 INFO:tasks.workunit.client.0.smithi120.stdout:2/378: mknod d13/d61/d6e/c7f 1 2021-04-09T18:25:48.906 INFO:tasks.workunit.client.0.smithi120.stdout:6/300: rmdir d6/d8/d1a 39 2021-04-09T18:25:48.906 INFO:tasks.workunit.client.0.smithi120.stdout:7/241: chown db/d26/f45 0 1 2021-04-09T18:25:48.906 INFO:tasks.workunit.client.0.smithi120.stdout:5/467: mkdir d10/daa/db4 0 2021-04-09T18:25:48.907 INFO:tasks.workunit.client.0.smithi120.stdout:6/301: chown d6 27759 1 2021-04-09T18:25:48.907 INFO:tasks.workunit.client.0.smithi120.stdout:8/291: truncate d2/d3/d50/f57 2308881 0 2021-04-09T18:25:48.916 INFO:tasks.workunit.client.0.smithi120.stdout:2/379: rename d13/d61/d6e to d13/d7a/d80 0 2021-04-09T18:25:48.918 INFO:tasks.workunit.client.0.smithi120.stdout:0/316: dread d0/d2/f26 [0,4194304] 0 2021-04-09T18:25:48.921 INFO:tasks.workunit.client.0.smithi120.stdout:2/380: mknod d13/d15/c81 1 2021-04-09T18:25:48.925 INFO:tasks.workunit.client.0.smithi120.stdout:2/381: dread - d13/d7a/d80/d54/f71 zero size 2021-04-09T18:25:48.925 INFO:tasks.workunit.client.0.smithi120.stdout:0/317: fsync d0/d2/d4/f29 0 2021-04-09T18:25:48.927 INFO:tasks.workunit.client.0.smithi120.stdout:6/302: chown d6/d8/d1a/d36/d54/d31/d37/d61/l69 3110 1 2021-04-09T18:25:48.933 INFO:tasks.workunit.client.0.smithi120.stdout:6/303: read d6/d8/db/f24 [1378589,112720] 0 2021-04-09T18:25:48.934 INFO:tasks.workunit.client.0.smithi120.stdout:5/468: getdents d10/d12/d1b/d3a 0 2021-04-09T18:25:48.940 INFO:tasks.workunit.client.0.smithi120.stdout:8/292: dwrite d2/d3/d11/d2c/f32 [0,4194304] 0 2021-04-09T18:25:48.940 INFO:tasks.workunit.client.0.smithi120.stdout:7/242: link db/d2c/d30/f52 db/d26/d4c/d53/f57 0 2021-04-09T18:25:48.942 INFO:tasks.workunit.client.0.smithi120.stdout:8/293: chown d2/d3/d11/d2c/d2e/d3b 2459651 1 2021-04-09T18:25:48.942 INFO:tasks.workunit.client.0.smithi120.stdout:7/243: write db/f2b [2584407,46646] 0 2021-04-09T18:25:48.943 INFO:tasks.workunit.client.0.smithi120.stdout:7/244: chown db/f15 15670 1 2021-04-09T18:25:48.950 INFO:tasks.workunit.client.0.smithi120.stdout:8/294: read d2/d3/f23 [109204,117809] 0 2021-04-09T18:25:48.955 INFO:tasks.workunit.client.0.smithi120.stdout:8/295: symlink d2/d3/d50/l59 0 2021-04-09T18:25:48.974 INFO:tasks.workunit.client.0.smithi120.stdout:5/469: getdents d10/d12/d1b/d1f/d39 0 2021-04-09T18:25:48.979 INFO:tasks.workunit.client.0.smithi120.stdout:7/245: dwrite db/d2c/d34/f41 [0,4194304] 0 2021-04-09T18:25:49.000 INFO:tasks.workunit.client.0.smithi120.stdout:5/470: fsync d10/d12/d1b/d3a/f9c 0 2021-04-09T18:25:49.047 INFO:tasks.workunit.client.0.smithi120.stdout:6/304: dread d6/d8/d1a/f34 [0,4194304] 0 2021-04-09T18:25:49.048 INFO:tasks.workunit.client.0.smithi120.stdout:7/246: symlink db/d38/l58 0 2021-04-09T18:25:49.053 INFO:tasks.workunit.client.0.smithi120.stdout:7/247: mkdir db/d2c/d30/d59 0 2021-04-09T18:25:49.054 INFO:tasks.workunit.client.0.smithi120.stdout:6/305: mkdir d6/d8/db/d2b/d68/d6a 0 2021-04-09T18:25:49.055 INFO:tasks.workunit.client.0.smithi120.stdout:6/306: mknod d6/d8/db/d2b/c6b 1 2021-04-09T18:25:49.056 INFO:tasks.workunit.client.0.smithi120.stdout:6/307: readlink d6/d8/d1a/d36/d54/d31/d37/l5e 0 2021-04-09T18:25:49.060 INFO:tasks.workunit.client.0.smithi120.stdout:6/308: dread d6/f2f [0,4194304] 0 2021-04-09T18:25:49.061 INFO:tasks.workunit.client.0.smithi120.stdout:6/309: write d6/d8/db/f2c [98400,105458] 0 2021-04-09T18:25:49.064 INFO:tasks.workunit.client.0.smithi120.stdout:8/296: link d2/d3/d11/d2c/d2e/d3b/f56 d2/d3/f5a 0 2021-04-09T18:25:49.310 INFO:tasks.workunit.client.0.smithi120.stdout:8/297: rename d2/d3/d11/d2c/d2e/d3b/f56 to d2/d3/d3c/d4f/f5b 0 2021-04-09T18:25:49.312 INFO:tasks.workunit.client.0.smithi120.stdout:8/298: symlink d2/d3/d11/l5c 0 2021-04-09T18:25:49.316 INFO:tasks.workunit.client.0.smithi120.stdout:6/310: truncate d6/d8/db/f39 510376 0 2021-04-09T18:25:49.321 INFO:tasks.workunit.client.0.smithi120.stdout:6/311: dwrite d6/d8/d3a/f59 [0,4194304] 0 2021-04-09T18:25:49.323 INFO:tasks.workunit.client.0.smithi120.stdout:8/299: link d2/d27/f48 d2/d37/d3e/f5d 0 2021-04-09T18:25:49.433 INFO:tasks.workunit.client.0.smithi120.stdout:4/352: sync 2021-04-09T18:25:49.438 INFO:tasks.workunit.client.0.smithi120.stdout:7/248: dwrite f2 [4194304,4194304] 0 2021-04-09T18:25:49.439 INFO:tasks.workunit.client.0.smithi120.stdout:7/249: chown db/d26/l3a 1155394 1 2021-04-09T18:25:49.450 INFO:tasks.workunit.client.0.smithi120.stdout:4/353: dread d1f/d2c/d34/f6d [0,4194304] 0 2021-04-09T18:25:49.451 INFO:tasks.workunit.client.0.smithi120.stdout:4/354: write d1f/d24/d6b/f6e [693797,23015] 0 2021-04-09T18:25:49.453 INFO:tasks.workunit.client.0.smithi120.stdout:7/250: rename db/d38/d51 to db/d42/d54/d5a 0 2021-04-09T18:25:49.458 INFO:tasks.workunit.client.0.smithi120.stdout:7/251: dwrite db/d2c/d34/f48 [0,4194304] 0 2021-04-09T18:25:49.460 INFO:tasks.workunit.client.0.smithi120.stdout:4/355: rmdir d1f/d2c/d56 39 2021-04-09T18:25:49.465 INFO:tasks.workunit.client.0.smithi120.stdout:7/252: dwrite db/d2c/f44 [0,4194304] 0 2021-04-09T18:25:49.469 INFO:tasks.workunit.client.0.smithi120.stdout:7/253: write db/d26/d4c/d53/f57 [2588639,123299] 0 2021-04-09T18:25:49.469 INFO:tasks.workunit.client.0.smithi120.stdout:4/356: dwrite d1f/d2c/d3b/f4c [0,4194304] 0 2021-04-09T18:25:49.471 INFO:tasks.workunit.client.0.smithi120.stdout:6/312: write d6/d8/db/d12/f1f [722626,117709] 0 2021-04-09T18:25:49.473 INFO:tasks.workunit.client.0.smithi120.stdout:7/254: write db/f1a [1422335,61951] 0 2021-04-09T18:25:49.481 INFO:tasks.workunit.client.0.smithi120.stdout:4/357: stat d1f/d24/l67 0 2021-04-09T18:25:49.483 INFO:tasks.workunit.client.0.smithi120.stdout:3/387: sync 2021-04-09T18:25:49.484 INFO:tasks.workunit.client.0.smithi120.stdout:9/358: sync 2021-04-09T18:25:49.484 INFO:tasks.workunit.client.0.smithi120.stdout:2/382: sync 2021-04-09T18:25:49.484 INFO:tasks.workunit.client.0.smithi120.stdout:5/471: sync 2021-04-09T18:25:49.485 INFO:tasks.workunit.client.0.smithi120.stdout:0/318: sync 2021-04-09T18:25:49.486 INFO:tasks.workunit.client.0.smithi120.stdout:2/383: chown d13/f73 1191746 1 2021-04-09T18:25:49.487 INFO:tasks.workunit.client.0.smithi120.stdout:7/255: creat db/d2c/d34/f5b x:0 0 0 2021-04-09T18:25:49.488 INFO:tasks.workunit.client.0.smithi120.stdout:1/386: sync 2021-04-09T18:25:49.489 INFO:tasks.workunit.client.0.smithi120.stdout:7/256: stat db/l17 0 2021-04-09T18:25:49.490 INFO:tasks.workunit.client.0.smithi120.stdout:9/359: unlink d19/d2c/d5b/f72 0 2021-04-09T18:25:49.491 INFO:tasks.workunit.client.0.smithi120.stdout:5/472: write d10/d12/d1b/d1f/d84/d3d/d50/d94/fac [108264,118506] 0 2021-04-09T18:25:49.496 INFO:tasks.workunit.client.0.smithi120.stdout:4/358: dwrite d1f/d24/f26 [4194304,4194304] 0 2021-04-09T18:25:49.501 INFO:tasks.workunit.client.0.smithi120.stdout:6/313: read d6/d8/db/d12/d22/f2a [692525,123549] 0 2021-04-09T18:25:49.501 INFO:tasks.workunit.client.0.smithi120.stdout:5/473: write d10/d12/d1b/d1f/d39/f89 [406378,127555] 0 2021-04-09T18:25:49.506 INFO:tasks.workunit.client.0.smithi120.stdout:6/314: chown d6/d8/db/d12/d22/f23 174642033 1 2021-04-09T18:25:49.506 INFO:tasks.workunit.client.0.smithi120.stdout:7/257: unlink db/f4d 0 2021-04-09T18:25:49.507 INFO:tasks.workunit.client.0.smithi120.stdout:3/388: rmdir d3/d5/d36/d1e/d6b/d49/d4e 39 2021-04-09T18:25:49.509 INFO:tasks.workunit.client.0.smithi120.stdout:1/387: mkdir d5/d1f/d22/d24/d7c 0 2021-04-09T18:25:49.513 INFO:tasks.workunit.client.0.smithi120.stdout:9/360: creat d19/d2c/f79 x:0 0 0 2021-04-09T18:25:49.514 INFO:tasks.workunit.client.0.smithi120.stdout:4/359: symlink d1f/d2c/d3b/d3e/d64/l78 0 2021-04-09T18:25:49.515 INFO:tasks.workunit.client.0.smithi120.stdout:8/300: sync 2021-04-09T18:25:49.517 INFO:tasks.workunit.client.0.smithi120.stdout:2/384: getdents d13/d7a/d80/d48/d49/d76 0 2021-04-09T18:25:49.518 INFO:tasks.workunit.client.0.smithi120.stdout:6/315: mkdir d6/d8/d52/d6c 0 2021-04-09T18:25:49.519 INFO:tasks.workunit.client.0.smithi120.stdout:3/389: fsync f1 0 2021-04-09T18:25:49.519 INFO:tasks.workunit.client.0.smithi120.stdout:5/474: creat d10/daa/fb5 x:0 0 0 2021-04-09T18:25:49.520 INFO:tasks.workunit.client.0.smithi120.stdout:1/388: creat d5/f7d x:0 0 0 2021-04-09T18:25:49.521 INFO:tasks.workunit.client.0.smithi120.stdout:1/389: chown d5/d64 23 1 2021-04-09T18:25:49.522 INFO:tasks.workunit.client.0.smithi120.stdout:7/258: symlink db/d2c/d34/l5c 0 2021-04-09T18:25:49.533 INFO:tasks.workunit.client.0.smithi120.stdout:5/475: write d10/d12/d1b/d1f/f63 [50874,22660] 0 2021-04-09T18:25:49.533 INFO:tasks.workunit.client.0.smithi120.stdout:8/301: dwrite d2/d3/f4c [0,4194304] 0 2021-04-09T18:25:49.534 INFO:tasks.workunit.client.0.smithi120.stdout:8/302: mknod d2/d37/c5e 1 2021-04-09T18:25:49.535 INFO:tasks.workunit.client.0.smithi120.stdout:7/259: mkdir db/d2c/d34/d5d 0 2021-04-09T18:25:49.538 INFO:tasks.workunit.client.0.smithi120.stdout:4/360: dread d1f/d24/f26 [4194304,4194304] 0 2021-04-09T18:25:49.541 INFO:tasks.workunit.client.0.smithi120.stdout:3/390: symlink d3/d5/d36/d1e/d6b/d49/d73/l7d 0 2021-04-09T18:25:49.543 INFO:tasks.workunit.client.0.smithi120.stdout:9/361: creat d19/f7a x:0 0 0 2021-04-09T18:25:49.546 INFO:tasks.workunit.client.0.smithi120.stdout:2/385: dread f4 [8388608,4194304] 0 2021-04-09T18:25:49.547 INFO:tasks.workunit.client.0.smithi120.stdout:7/260: dwrite db/f2b [4194304,4194304] 0 2021-04-09T18:25:49.551 INFO:tasks.workunit.client.0.smithi120.stdout:2/386: chown d13/d7a/d80/d48/d49/d76 1172 1 2021-04-09T18:25:49.553 INFO:tasks.workunit.client.0.smithi120.stdout:4/361: dwrite d1f/f23 [0,4194304] 0 2021-04-09T18:25:49.556 INFO:tasks.workunit.client.0.smithi120.stdout:6/316: fsync d6/d8/db/d12/f18 0 2021-04-09T18:25:49.558 INFO:tasks.workunit.client.0.smithi120.stdout:6/317: mknod d6/d8/db/d12/c6d 1 2021-04-09T18:25:49.560 INFO:tasks.workunit.client.0.smithi120.stdout:9/362: dwrite d19/d24/d36/f6e [0,4194304] 0 2021-04-09T18:25:49.563 INFO:tasks.workunit.client.0.smithi120.stdout:8/303: write d2/d3/d11/f26 [579541,40690] 0 2021-04-09T18:25:49.566 INFO:tasks.workunit.client.0.smithi120.stdout:6/318: stat d6/d8/d1a/d36/d54/d41/d49/f4f 0 2021-04-09T18:25:49.575 INFO:tasks.workunit.client.0.smithi120.stdout:4/362: creat d1f/d2c/d3b/d3e/d64/d4f/f79 x:0 0 0 2021-04-09T18:25:49.576 INFO:tasks.workunit.client.0.smithi120.stdout:5/476: rmdir d10/d12/d1b/d3a/d8f 0 2021-04-09T18:25:49.580 INFO:tasks.workunit.client.0.smithi120.stdout:2/387: creat d13/d7a/d80/d48/d49/d76/f82 x:0 0 0 2021-04-09T18:25:49.584 INFO:tasks.workunit.client.0.smithi120.stdout:1/390: write d5/d1f/d22/d24/f41 [1436980,29128] 0 2021-04-09T18:25:49.585 INFO:tasks.workunit.client.0.smithi120.stdout:3/391: link d3/d5/d36/f23 d3/d5/d36/d1e/d6b/d49/d4e/d54/f7e 0 2021-04-09T18:25:49.586 INFO:tasks.workunit.client.0.smithi120.stdout:8/304: creat d2/d3/f5f x:0 0 0 2021-04-09T18:25:49.592 INFO:tasks.workunit.client.0.smithi120.stdout:6/319: mkdir d6/d8/d1a/d36/d5a/d5d/d6e 0 2021-04-09T18:25:49.592 INFO:tasks.workunit.client.0.smithi120.stdout:7/261: write f6 [1740679,81442] 0 2021-04-09T18:25:49.595 INFO:tasks.workunit.client.0.smithi120.stdout:2/388: mkdir d13/d7a/d80/d48/d49/d64/d83 0 2021-04-09T18:25:49.595 INFO:tasks.workunit.client.0.smithi120.stdout:3/392: mkdir d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f 0 2021-04-09T18:25:49.597 INFO:tasks.workunit.client.0.smithi120.stdout:6/320: rmdir d6/d8/db/d12/d22 39 2021-04-09T18:25:49.602 INFO:tasks.workunit.client.0.smithi120.stdout:8/305: creat d2/d3/f60 x:0 0 0 2021-04-09T18:25:49.604 INFO:tasks.workunit.client.0.smithi120.stdout:0/319: dread d0/d2/dd/f40 [0,4194304] 0 2021-04-09T18:25:49.607 INFO:tasks.workunit.client.0.smithi120.stdout:0/320: chown d0/d2/d4/f29 15108 1 2021-04-09T18:25:49.607 INFO:tasks.workunit.client.0.smithi120.stdout:8/306: readlink d2/d3/d8/l22 0 2021-04-09T18:25:49.608 INFO:tasks.workunit.client.0.smithi120.stdout:3/393: dwrite d3/d5/d36/d3d/f6e [0,4194304] 0 2021-04-09T18:25:49.609 INFO:tasks.workunit.client.0.smithi120.stdout:8/307: write d2/f2d [4472047,33204] 0 2021-04-09T18:25:49.611 INFO:tasks.workunit.client.0.smithi120.stdout:3/394: chown d3/d5/d36/d3d/f6e 15305483 1 2021-04-09T18:25:49.612 INFO:tasks.workunit.client.0.smithi120.stdout:2/389: dread d13/f47 [0,4194304] 0 2021-04-09T18:25:49.615 INFO:tasks.workunit.client.0.smithi120.stdout:4/363: rename d1f/d2c/d3b/d3e/d64 to d1f/d2c/d34/d60/d7a 0 2021-04-09T18:25:49.616 INFO:tasks.workunit.client.0.smithi120.stdout:9/363: dwrite d19/d1c/f4f [0,4194304] 0 2021-04-09T18:25:49.618 INFO:tasks.workunit.client.0.smithi120.stdout:9/364: mknod d19/d24/d2e/c7b 1 2021-04-09T18:25:49.621 INFO:tasks.workunit.client.0.smithi120.stdout:9/365: write d19/d1c/f4f [4149003,103344] 0 2021-04-09T18:25:49.625 INFO:tasks.workunit.client.0.smithi120.stdout:8/308: symlink d2/d3/d8/l61 0 2021-04-09T18:25:49.626 INFO:tasks.workunit.client.0.smithi120.stdout:2/390: dwrite d13/d7a/d80/d48/d49/d76/f82 [0,4194304] 0 2021-04-09T18:25:49.628 INFO:tasks.workunit.client.0.smithi120.stdout:9/366: mknod d19/d2c/d5b/c7c 1 2021-04-09T18:25:49.630 INFO:tasks.workunit.client.0.smithi120.stdout:4/364: dread - d1f/d24/f3c zero size 2021-04-09T18:25:49.631 INFO:tasks.workunit.client.0.smithi120.stdout:1/391: rename d5/d1f/d22/d2b/f57 to d5/d50/d61/f7e 0 2021-04-09T18:25:49.634 INFO:tasks.workunit.client.0.smithi120.stdout:6/321: truncate d6/d8/f4a 526324 0 2021-04-09T18:25:49.635 INFO:tasks.workunit.client.0.smithi120.stdout:3/395: dwrite d3/d5/d36/d1e/d38/d61/f76 [0,4194304] 0 2021-04-09T18:25:49.638 INFO:tasks.workunit.client.0.smithi120.stdout:1/392: dread - d5/d5c/f72 zero size 2021-04-09T18:25:49.638 INFO:tasks.workunit.client.0.smithi120.stdout:9/367: rmdir d19/d2c 39 2021-04-09T18:25:49.639 INFO:tasks.workunit.client.0.smithi120.stdout:5/477: dwrite d10/d12/d1b/d1f/d84/f7b [0,4194304] 0 2021-04-09T18:25:49.642 INFO:tasks.workunit.client.0.smithi120.stdout:0/321: rename d0/d2/f3b to d0/d2/f5b 0 2021-04-09T18:25:49.643 INFO:tasks.workunit.client.0.smithi120.stdout:9/368: chown d19/f7a 3 1 2021-04-09T18:25:49.644 INFO:tasks.workunit.client.0.smithi120.stdout:4/365: creat d1f/d2c/d30/f7b x:0 0 0 2021-04-09T18:25:49.644 INFO:tasks.workunit.client.0.smithi120.stdout:0/322: mknod d0/d43/d49/c5c 1 2021-04-09T18:25:49.645 INFO:tasks.workunit.client.0.smithi120.stdout:8/309: dread d2/d3/d11/f1f [4194304,4194304] 0 2021-04-09T18:25:49.646 INFO:tasks.workunit.client.0.smithi120.stdout:3/396: readlink d3/de/l21 0 2021-04-09T18:25:49.646 INFO:tasks.workunit.client.0.smithi120.stdout:1/393: write d5/d1f/d22/f2c [1524696,11237] 0 2021-04-09T18:25:49.650 INFO:tasks.workunit.client.0.smithi120.stdout:0/323: chown d0/d2/da/d2e/l44 27 1 2021-04-09T18:25:49.657 INFO:tasks.workunit.client.0.smithi120.stdout:9/369: write d19/d24/d36/d47/f57 [323906,43473] 0 2021-04-09T18:25:49.659 INFO:tasks.workunit.client.0.smithi120.stdout:8/310: dread d2/d3/d11/f34 [0,4194304] 0 2021-04-09T18:25:49.662 INFO:tasks.workunit.client.0.smithi120.stdout:5/478: fdatasync d10/d12/d1b/d1f/d84/d3d/f5e 0 2021-04-09T18:25:49.662 INFO:tasks.workunit.client.0.smithi120.stdout:9/370: dread - d19/d1c/d29/d63/f71 zero size 2021-04-09T18:25:49.663 INFO:tasks.workunit.client.0.smithi120.stdout:8/311: stat d2/d3/f28 0 2021-04-09T18:25:49.663 INFO:tasks.workunit.client.0.smithi120.stdout:3/397: dread d3/d5/f4d [0,4194304] 0 2021-04-09T18:25:49.664 INFO:tasks.workunit.client.0.smithi120.stdout:1/394: symlink d5/d50/d61/l7f 0 2021-04-09T18:25:49.671 INFO:tasks.workunit.client.0.smithi120.stdout:9/371: write d19/d2c/f79 [735929,79241] 0 2021-04-09T18:25:49.672 INFO:tasks.workunit.client.0.smithi120.stdout:3/398: fdatasync d3/de/d25/f65 0 2021-04-09T18:25:49.675 INFO:tasks.workunit.client.0.smithi120.stdout:0/324: creat d0/d52/d56/f5d x:0 0 0 2021-04-09T18:25:49.681 INFO:tasks.workunit.client.0.smithi120.stdout:1/395: creat d5/d1f/d22/d6c/f80 x:0 0 0 2021-04-09T18:25:49.683 INFO:tasks.workunit.client.0.smithi120.stdout:9/372: dwrite fb [0,4194304] 0 2021-04-09T18:25:49.687 INFO:tasks.workunit.client.0.smithi120.stdout:9/373: unlink lf 0 2021-04-09T18:25:49.690 INFO:tasks.workunit.client.0.smithi120.stdout:3/399: mkdir d3/d5/d36/d1e/d6b/d49/d5e/d80 0 2021-04-09T18:25:49.696 INFO:tasks.workunit.client.0.smithi120.stdout:9/374: creat d19/d1c/d29/d63/f7d x:0 0 0 2021-04-09T18:25:49.696 INFO:tasks.workunit.client.0.smithi120.stdout:3/400: mknod d3/d5/d36/d1e/d38/d61/c81 1 2021-04-09T18:25:49.699 INFO:tasks.workunit.client.0.smithi120.stdout:6/322: rename d6/d8/f4a to d6/d8/db/d2b/f6f 0 2021-04-09T18:25:49.700 INFO:tasks.workunit.client.0.smithi120.stdout:5/479: dread d10/d12/d1b/d1f/d39/f87 [0,4194304] 0 2021-04-09T18:25:49.706 INFO:tasks.workunit.client.0.smithi120.stdout:6/323: mknod d6/d8/d1a/d36/d5a/d5d/c70 1 2021-04-09T18:25:49.707 INFO:tasks.workunit.client.0.smithi120.stdout:3/401: mkdir d3/de/d25/d53/d82 0 2021-04-09T18:25:49.708 INFO:tasks.workunit.client.0.smithi120.stdout:7/262: dwrite db/d26/f2e [0,4194304] 0 2021-04-09T18:25:49.715 INFO:tasks.workunit.client.0.smithi120.stdout:0/325: write d0/f30 [429088,35921] 0 2021-04-09T18:25:49.716 INFO:tasks.workunit.client.0.smithi120.stdout:0/326: dread - d0/d2/f46 zero size 2021-04-09T18:25:49.717 INFO:tasks.workunit.client.0.smithi120.stdout:8/312: write d2/d3/d50/f57 [479585,123769] 0 2021-04-09T18:25:49.721 INFO:tasks.workunit.client.0.smithi120.stdout:9/375: creat d19/d1c/d52/f7e x:0 0 0 2021-04-09T18:25:49.728 INFO:tasks.workunit.client.0.smithi120.stdout:0/327: rename d0/d2/dd/f4b to d0/d2/dd/f5e 0 2021-04-09T18:25:49.732 INFO:tasks.workunit.client.0.smithi120.stdout:5/480: mkdir d10/d12/d1b/d1f/d84/d3d/d50/da9/db6 0 2021-04-09T18:25:49.732 INFO:tasks.workunit.client.0.smithi120.stdout:7/263: link db/d42/f43 db/d26/f5e 0 2021-04-09T18:25:49.733 INFO:tasks.workunit.client.0.smithi120.stdout:3/402: mkdir d3/d5/d36/d1e/d6b/d6a/d83 0 2021-04-09T18:25:49.735 INFO:tasks.workunit.client.0.smithi120.stdout:6/324: fsync d6/d8/db/f39 0 2021-04-09T18:25:49.739 INFO:tasks.workunit.client.0.smithi120.stdout:9/376: creat d19/d24/d36/d47/d6f/f7f x:0 0 0 2021-04-09T18:25:49.741 INFO:tasks.workunit.client.0.smithi120.stdout:9/377: write f17 [1871020,100723] 0 2021-04-09T18:25:49.743 INFO:tasks.workunit.client.0.smithi120.stdout:9/378: write d19/d1c/d29/d63/f7d [564140,8573] 0 2021-04-09T18:25:49.747 INFO:tasks.workunit.client.0.smithi120.stdout:3/403: rename d3/d5/d36/d1e/d38/f7b to d3/d5/d36/d1e/d6b/d49/d73/f84 0 2021-04-09T18:25:49.752 INFO:tasks.workunit.client.0.smithi120.stdout:1/396: truncate d5/d1f/d22/d24/f2f 2642030 0 2021-04-09T18:25:49.752 INFO:tasks.workunit.client.0.smithi120.stdout:9/379: dwrite d19/d24/d36/f45 [0,4194304] 0 2021-04-09T18:25:49.759 INFO:tasks.workunit.client.0.smithi120.stdout:6/325: rename d6/d8/db/d12/d22/f23 to d6/d8/d1a/d36/d5a/d5d/d6e/f71 0 2021-04-09T18:25:49.760 INFO:tasks.workunit.client.0.smithi120.stdout:8/313: getdents d2/d3/d11/d2c/d2e/d3b 0 2021-04-09T18:25:49.761 INFO:tasks.workunit.client.0.smithi120.stdout:9/380: rmdir d19/d1c/d29 39 2021-04-09T18:25:49.761 INFO:tasks.workunit.client.0.smithi120.stdout:4/366: dread d1f/d24/f33 [0,4194304] 0 2021-04-09T18:25:49.763 INFO:tasks.workunit.client.0.smithi120.stdout:1/397: creat d5/d1f/f81 x:0 0 0 2021-04-09T18:25:49.763 INFO:tasks.workunit.client.0.smithi120.stdout:8/314: fdatasync d2/d3/d11/d2c/f31 0 2021-04-09T18:25:49.765 INFO:tasks.workunit.client.0.smithi120.stdout:8/315: read - d2/d27/f41 zero size 2021-04-09T18:25:49.768 INFO:tasks.workunit.client.0.smithi120.stdout:4/367: unlink fe 0 2021-04-09T18:25:49.768 INFO:tasks.workunit.client.0.smithi120.stdout:8/316: mknod d2/d3/d11/d2c/d2e/d3b/c62 1 2021-04-09T18:25:49.770 INFO:tasks.workunit.client.0.smithi120.stdout:2/391: dread d13/d15/d35/f5b [0,4194304] 0 2021-04-09T18:25:49.771 INFO:tasks.workunit.client.0.smithi120.stdout:4/368: write d1f/d24/d6b/f6e [1502259,63146] 0 2021-04-09T18:25:49.781 INFO:tasks.workunit.client.0.smithi120.stdout:5/481: write d10/d12/f19 [150102,118099] 0 2021-04-09T18:25:49.781 INFO:tasks.workunit.client.0.smithi120.stdout:9/381: link d19/f74 d19/d1c/f80 0 2021-04-09T18:25:49.781 INFO:tasks.workunit.client.0.smithi120.stdout:7/264: write f4 [43950,113917] 0 2021-04-09T18:25:49.783 INFO:tasks.workunit.client.0.smithi120.stdout:8/317: symlink d2/d37/l63 0 2021-04-09T18:25:49.787 INFO:tasks.workunit.client.0.smithi120.stdout:4/369: mkdir d1f/d2c/d3b/d3e/d7c 0 2021-04-09T18:25:49.788 INFO:tasks.workunit.client.0.smithi120.stdout:7/265: mknod db/c5f 1 2021-04-09T18:25:49.790 INFO:tasks.workunit.client.0.smithi120.stdout:9/382: write d19/f38 [520662,23581] 0 2021-04-09T18:25:49.794 INFO:tasks.workunit.client.0.smithi120.stdout:2/392: mkdir d13/d84 0 2021-04-09T18:25:49.796 INFO:tasks.workunit.client.0.smithi120.stdout:5/482: fdatasync d10/d12/d1b/d1f/d84/d3d/f41 0 2021-04-09T18:25:49.799 INFO:tasks.workunit.client.0.smithi120.stdout:8/318: dread d2/d37/d3e/d42/f53 [0,4194304] 0 2021-04-09T18:25:49.800 INFO:tasks.workunit.client.0.smithi120.stdout:6/326: creat d6/d8/db/d12/f72 x:0 0 0 2021-04-09T18:25:49.800 INFO:tasks.workunit.client.0.smithi120.stdout:1/398: truncate d5/d64/d2d/d5a/f6a 833910 0 2021-04-09T18:25:49.803 INFO:tasks.workunit.client.0.smithi120.stdout:4/370: rmdir d1f/d2c/d34/d60/d7a/d4b 0 2021-04-09T18:25:49.804 INFO:tasks.workunit.client.0.smithi120.stdout:5/483: write d10/d12/d1b/d1f/f79 [841859,129455] 0 2021-04-09T18:25:49.805 INFO:tasks.workunit.client.0.smithi120.stdout:3/404: truncate d3/d5/f28 1964063 0 2021-04-09T18:25:49.812 INFO:tasks.workunit.client.0.smithi120.stdout:9/383: dwrite d19/d1c/f53 [4194304,4194304] 0 2021-04-09T18:25:49.812 INFO:tasks.workunit.client.0.smithi120.stdout:5/484: chown d10/d12/d1b/d1f/d84/d3d/d50/d94/fac 140268082 1 2021-04-09T18:25:49.818 INFO:tasks.workunit.client.0.smithi120.stdout:2/393: dwrite d13/f72 [0,4194304] 0 2021-04-09T18:25:49.822 INFO:tasks.workunit.client.0.smithi120.stdout:8/319: dwrite d2/d3/d11/d2c/d2e/d3b/f47 [0,4194304] 0 2021-04-09T18:25:49.824 INFO:tasks.workunit.client.0.smithi120.stdout:1/399: creat d5/d64/f82 x:0 0 0 2021-04-09T18:25:49.828 INFO:tasks.workunit.client.0.smithi120.stdout:4/371: mknod d1f/d24/c7d 1 2021-04-09T18:25:49.832 INFO:tasks.workunit.client.0.smithi120.stdout:6/327: creat d6/d8/d1a/d36/d54/d41/d49/f73 x:0 0 0 2021-04-09T18:25:49.837 INFO:tasks.workunit.client.0.smithi120.stdout:0/328: dread d0/d2/dd/f38 [0,4194304] 0 2021-04-09T18:25:49.842 INFO:tasks.workunit.client.0.smithi120.stdout:8/320: mkdir d2/d3/d50/d64 0 2021-04-09T18:25:49.844 INFO:tasks.workunit.client.0.smithi120.stdout:4/372: fdatasync d1f/d2c/d3b/f5e 0 2021-04-09T18:25:49.845 INFO:tasks.workunit.client.0.smithi120.stdout:0/329: mkdir d0/d2/d4/d5f 0 2021-04-09T18:25:49.853 INFO:tasks.workunit.client.0.smithi120.stdout:0/330: write d0/d2/d4/f59 [636928,53339] 0 2021-04-09T18:25:49.853 INFO:tasks.workunit.client.0.smithi120.stdout:6/328: mkdir d6/d8/db/d2b/d68/d6a/d74 0 2021-04-09T18:25:49.853 INFO:tasks.workunit.client.0.smithi120.stdout:7/266: truncate db/d2c/d34/f48 3506399 0 2021-04-09T18:25:49.856 INFO:tasks.workunit.client.0.smithi120.stdout:0/331: write d0/d2/dd/f5e [3333638,22039] 0 2021-04-09T18:25:49.858 INFO:tasks.workunit.client.0.smithi120.stdout:1/400: getdents d5/d64/d2d/d5a 0 2021-04-09T18:25:49.860 INFO:tasks.workunit.client.0.smithi120.stdout:1/401: fsync d5/f7 0 2021-04-09T18:25:49.860 INFO:tasks.workunit.client.0.smithi120.stdout:2/394: write d13/d7a/d80/f45 [512890,114208] 0 2021-04-09T18:25:49.868 INFO:tasks.workunit.client.0.smithi120.stdout:9/384: write d19/d1c/f23 [4929668,39414] 0 2021-04-09T18:25:49.868 INFO:tasks.workunit.client.0.smithi120.stdout:7/267: dread db/d26/f2e [0,4194304] 0 2021-04-09T18:25:49.869 INFO:tasks.workunit.client.0.smithi120.stdout:9/385: write fb [1687552,125596] 0 2021-04-09T18:25:49.869 INFO:tasks.workunit.client.0.smithi120.stdout:8/321: write d2/d3/f51 [546483,31957] 0 2021-04-09T18:25:49.870 INFO:tasks.workunit.client.0.smithi120.stdout:2/395: readlink d13/d7a/d80/d48/d58/l77 0 2021-04-09T18:25:49.870 INFO:tasks.workunit.client.0.smithi120.stdout:6/329: dread d6/d8/d1a/d36/d54/d41/d49/f4f [0,4194304] 0 2021-04-09T18:25:49.875 INFO:tasks.workunit.client.0.smithi120.stdout:4/373: getdents d1f/d2c/d30 0 2021-04-09T18:25:49.875 INFO:tasks.workunit.client.0.smithi120.stdout:8/322: read d2/d27/f2f [3239465,65688] 0 2021-04-09T18:25:49.877 INFO:tasks.workunit.client.0.smithi120.stdout:3/405: dwrite d3/d5/d36/d1e/f39 [0,4194304] 0 2021-04-09T18:25:49.877 INFO:tasks.workunit.client.0.smithi120.stdout:1/402: unlink d5/d64/d2d/d5a/f69 0 2021-04-09T18:25:49.884 INFO:tasks.workunit.client.0.smithi120.stdout:0/332: unlink d0/d2/dd/l17 0 2021-04-09T18:25:49.896 INFO:tasks.workunit.client.0.smithi120.stdout:7/268: creat db/d26/f60 x:0 0 0 2021-04-09T18:25:49.897 INFO:tasks.workunit.client.0.smithi120.stdout:7/269: chown db/l17 5207654 1 2021-04-09T18:25:49.899 INFO:tasks.workunit.client.0.smithi120.stdout:3/406: symlink d3/d5/d36/d1e/d38/d61/l85 0 2021-04-09T18:25:49.900 INFO:tasks.workunit.client.0.smithi120.stdout:0/333: write d0/d2/d4/f13 [1128848,100752] 0 2021-04-09T18:25:49.901 INFO:tasks.workunit.client.0.smithi120.stdout:6/330: dread d6/f2f [0,4194304] 0 2021-04-09T18:25:49.902 INFO:tasks.workunit.client.0.smithi120.stdout:0/334: read - d0/f4e zero size 2021-04-09T18:25:49.903 INFO:tasks.workunit.client.0.smithi120.stdout:2/396: readlink d13/d7a/d80/d48/d49/l4f 0 2021-04-09T18:25:49.905 INFO:tasks.workunit.client.0.smithi120.stdout:8/323: link d2/d27/f29 d2/d3/d8/f65 0 2021-04-09T18:25:49.906 INFO:tasks.workunit.client.0.smithi120.stdout:7/270: mknod db/c61 1 2021-04-09T18:25:49.906 INFO:tasks.workunit.client.0.smithi120.stdout:6/331: unlink d6/d8/db/f2c 0 2021-04-09T18:25:49.908 INFO:tasks.workunit.client.0.smithi120.stdout:1/403: link d5/d64/d2d/f6e d5/d1f/d22/d24/f83 0 2021-04-09T18:25:49.911 INFO:tasks.workunit.client.0.smithi120.stdout:1/404: fsync d5/d1f/d22/d2b/f62 0 2021-04-09T18:25:49.911 INFO:tasks.workunit.client.0.smithi120.stdout:6/332: write d6/d8/d1a/d36/d54/d41/d49/f73 [524397,60087] 0 2021-04-09T18:25:49.912 INFO:tasks.workunit.client.0.smithi120.stdout:0/335: link d0/d2/da/d23/f2f d0/d2/f60 0 2021-04-09T18:25:49.913 INFO:tasks.workunit.client.0.smithi120.stdout:1/405: fsync d5/d1f/d22/d2b/f62 0 2021-04-09T18:25:49.916 INFO:tasks.workunit.client.0.smithi120.stdout:7/271: dread db/f2b [0,4194304] 0 2021-04-09T18:25:49.918 INFO:tasks.workunit.client.0.smithi120.stdout:9/386: read f7 [2407163,43308] 0 2021-04-09T18:25:49.918 INFO:tasks.workunit.client.0.smithi120.stdout:0/336: mkdir d0/d2/d4/d5f/d61 0 2021-04-09T18:25:49.919 INFO:tasks.workunit.client.0.smithi120.stdout:2/397: dwrite d13/d7a/d80/f75 [0,4194304] 0 2021-04-09T18:25:49.919 INFO:tasks.workunit.client.0.smithi120.stdout:7/272: mknod db/c62 1 2021-04-09T18:25:49.919 INFO:tasks.workunit.client.0.smithi120.stdout:6/333: dread d6/d8/db/f39 [0,4194304] 0 2021-04-09T18:25:49.921 INFO:tasks.workunit.client.0.smithi120.stdout:9/387: fdatasync f12 0 2021-04-09T18:25:49.923 INFO:tasks.workunit.client.0.smithi120.stdout:0/337: read d0/d2/dd/f38 [474048,122777] 0 2021-04-09T18:25:49.923 INFO:tasks.workunit.client.0.smithi120.stdout:1/406: rename d5/d1f/d22/d2b/l3c to d5/d1f/d22/l84 0 2021-04-09T18:25:49.925 INFO:tasks.workunit.client.0.smithi120.stdout:1/407: stat d5/d1f/d22/d2b/l6d 0 2021-04-09T18:25:49.926 INFO:tasks.workunit.client.0.smithi120.stdout:6/334: dread d6/d8/db/f39 [0,4194304] 0 2021-04-09T18:25:49.928 INFO:tasks.workunit.client.0.smithi120.stdout:2/398: dread d13/d7a/d80/f33 [0,4194304] 0 2021-04-09T18:25:49.932 INFO:tasks.workunit.client.0.smithi120.stdout:6/335: chown d6/d8/d1a/l20 0 1 2021-04-09T18:25:49.937 INFO:tasks.workunit.client.0.smithi120.stdout:6/336: read d6/d8/f4c [2909868,55984] 0 2021-04-09T18:25:49.937 INFO:tasks.workunit.client.0.smithi120.stdout:9/388: readlink d19/d1c/d29/l5c 0 2021-04-09T18:25:49.943 INFO:tasks.workunit.client.0.smithi120.stdout:1/408: rmdir d5/d50/d61 39 2021-04-09T18:25:49.943 INFO:tasks.workunit.client.0.smithi120.stdout:2/399: symlink d13/d7a/d80/d54/l85 0 2021-04-09T18:25:49.943 INFO:tasks.workunit.client.0.smithi120.stdout:0/338: mkdir d0/d5a/d62 0 2021-04-09T18:25:49.945 INFO:tasks.workunit.client.0.smithi120.stdout:9/389: unlink d19/d1c/f4f 0 2021-04-09T18:25:49.948 INFO:tasks.workunit.client.0.smithi120.stdout:2/400: rmdir d13/d61 39 2021-04-09T18:25:49.949 INFO:tasks.workunit.client.0.smithi120.stdout:6/337: dwrite d6/d8/f26 [0,4194304] 0 2021-04-09T18:25:49.950 INFO:tasks.workunit.client.0.smithi120.stdout:7/273: write db/d42/f43 [484405,47402] 0 2021-04-09T18:25:49.951 INFO:tasks.workunit.client.0.smithi120.stdout:6/338: dread - d6/d8/d1a/f50 zero size 2021-04-09T18:25:49.951 INFO:tasks.workunit.client.0.smithi120.stdout:0/339: rmdir d0/d2/dd 39 2021-04-09T18:25:49.951 INFO:tasks.workunit.client.0.smithi120.stdout:2/401: chown d13/d7a/d80/f45 0 1 2021-04-09T18:25:49.954 INFO:tasks.workunit.client.0.smithi120.stdout:9/390: mkdir d19/d81 0 2021-04-09T18:25:49.955 INFO:tasks.workunit.client.0.smithi120.stdout:0/340: symlink d0/d43/l63 0 2021-04-09T18:25:49.957 INFO:tasks.workunit.client.0.smithi120.stdout:7/274: write db/d26/f45 [5001212,3852] 0 2021-04-09T18:25:49.961 INFO:tasks.workunit.client.0.smithi120.stdout:9/391: dread - d19/d1c/d52/f61 zero size 2021-04-09T18:25:49.962 INFO:tasks.workunit.client.0.smithi120.stdout:8/324: dread d2/d3/d8/f65 [0,4194304] 0 2021-04-09T18:25:49.962 INFO:tasks.workunit.client.0.smithi120.stdout:8/325: readlink d2/d3/d8/l61 0 2021-04-09T18:25:49.964 INFO:tasks.workunit.client.0.smithi120.stdout:2/402: dwrite d13/d15/f69 [0,4194304] 0 2021-04-09T18:25:49.967 INFO:tasks.workunit.client.0.smithi120.stdout:9/392: write f12 [2335418,4425] 0 2021-04-09T18:25:49.969 INFO:tasks.workunit.client.0.smithi120.stdout:6/339: creat d6/d8/d1a/d36/d54/f75 x:0 0 0 2021-04-09T18:25:49.970 INFO:tasks.workunit.client.0.smithi120.stdout:0/341: rename d0/d43/l63 to d0/d5a/l64 0 2021-04-09T18:25:49.973 INFO:tasks.workunit.client.0.smithi120.stdout:8/326: creat d2/d3/d11/d2c/d2e/d3b/f66 x:0 0 0 2021-04-09T18:25:49.974 INFO:tasks.workunit.client.0.smithi120.stdout:6/340: dread - d6/d8/db/d12/f4b zero size 2021-04-09T18:25:49.974 INFO:tasks.workunit.client.0.smithi120.stdout:2/403: creat d13/d7a/d80/d48/d58/f86 x:0 0 0 2021-04-09T18:25:49.975 INFO:tasks.workunit.client.0.smithi120.stdout:9/393: readlink d19/d1c/d29/l33 0 2021-04-09T18:25:49.980 INFO:tasks.workunit.client.0.smithi120.stdout:2/404: chown d13/f47 29037 1 2021-04-09T18:25:49.990 INFO:tasks.workunit.client.0.smithi120.stdout:8/327: creat d2/d3/d11/d2c/d2e/d3b/f67 x:0 0 0 2021-04-09T18:25:49.990 INFO:tasks.workunit.client.0.smithi120.stdout:0/342: dwrite d0/f4e [0,4194304] 0 2021-04-09T18:25:49.991 INFO:tasks.workunit.client.0.smithi120.stdout:6/341: dwrite d6/d8/f26 [0,4194304] 0 2021-04-09T18:25:49.992 INFO:tasks.workunit.client.0.smithi120.stdout:1/409: rmdir d5/d64/d66 0 2021-04-09T18:25:50.000 INFO:tasks.workunit.client.0.smithi120.stdout:8/328: dwrite d2/d3/d11/f1f [4194304,4194304] 0 2021-04-09T18:25:50.001 INFO:tasks.workunit.client.0.smithi120.stdout:0/343: symlink d0/d43/d49/l65 0 2021-04-09T18:25:50.003 INFO:tasks.workunit.client.0.smithi120.stdout:0/344: write d0/f57 [557804,96470] 0 2021-04-09T18:25:50.003 INFO:tasks.workunit.client.0.smithi120.stdout:8/329: readlink d2/d37/l49 0 2021-04-09T18:25:50.006 INFO:tasks.workunit.client.0.smithi120.stdout:6/342: unlink d6/d8/d1a/d36/d54/f33 0 2021-04-09T18:25:50.008 INFO:tasks.workunit.client.0.smithi120.stdout:2/405: rename d13/d15/d35/l4d to d13/d7a/d80/l87 0 2021-04-09T18:25:50.009 INFO:tasks.workunit.client.0.smithi120.stdout:8/330: dread d2/d3/d11/f1f [4194304,4194304] 0 2021-04-09T18:25:50.016 INFO:tasks.workunit.client.0.smithi120.stdout:0/345: fdatasync d0/d2/dd/f38 0 2021-04-09T18:25:50.018 INFO:tasks.workunit.client.0.smithi120.stdout:1/410: rename d5/d1f/d22/d2b/l4a to d5/d1f/l85 0 2021-04-09T18:25:50.018 INFO:tasks.workunit.client.0.smithi120.stdout:6/343: dwrite d6/fc [4194304,4194304] 0 2021-04-09T18:25:50.022 INFO:tasks.workunit.client.0.smithi120.stdout:6/344: chown d6/d8/db/f67 7831 1 2021-04-09T18:25:50.025 INFO:tasks.workunit.client.0.smithi120.stdout:6/345: dread - d6/d8/d1a/d36/d54/f75 zero size 2021-04-09T18:25:50.032 INFO:tasks.workunit.client.0.smithi120.stdout:1/411: mkdir d5/d64/d63/d86 0 2021-04-09T18:25:50.036 INFO:tasks.workunit.client.0.smithi120.stdout:1/412: write d5/f7 [4671512,97591] 0 2021-04-09T18:25:50.041 INFO:tasks.workunit.client.0.smithi120.stdout:2/406: link d13/l63 d13/d84/l88 0 2021-04-09T18:25:50.049 INFO:tasks.workunit.client.0.smithi120.stdout:1/413: stat d5/d64/l49 0 2021-04-09T18:25:50.057 INFO:tasks.workunit.client.0.smithi120.stdout:2/407: rename d13/d7a/d80/f75 to d13/d61/f89 0 2021-04-09T18:25:50.058 INFO:tasks.workunit.client.0.smithi120.stdout:6/346: link d6/d8/db/d2b/f6f d6/d8/d1a/d36/d54/d31/f76 0 2021-04-09T18:25:50.065 INFO:tasks.workunit.client.0.smithi120.stdout:2/408: dread d13/f2c [0,4194304] 0 2021-04-09T18:25:50.068 INFO:tasks.workunit.client.0.smithi120.stdout:2/409: chown d13/d7a/d80/l3b 78202 1 2021-04-09T18:25:50.072 INFO:tasks.workunit.client.0.smithi120.stdout:5/485: dread d10/d12/d1b/d1f/d84/d3d/d50/f70 [0,4194304] 0 2021-04-09T18:25:50.073 INFO:tasks.workunit.client.0.smithi120.stdout:6/347: dwrite d6/d8/f10 [0,4194304] 0 2021-04-09T18:25:50.079 INFO:tasks.workunit.client.0.smithi120.stdout:7/275: dwrite db/d38/f50 [4194304,4194304] 0 2021-04-09T18:25:50.081 INFO:tasks.workunit.client.0.smithi120.stdout:7/276: chown db/f15 35 1 2021-04-09T18:25:50.082 INFO:tasks.workunit.client.0.smithi120.stdout:6/348: rmdir d6/d8/d1a/d36 39 2021-04-09T18:25:50.085 INFO:tasks.workunit.client.0.smithi120.stdout:7/277: symlink db/d2c/d30/l63 0 2021-04-09T18:25:50.086 INFO:tasks.workunit.client.0.smithi120.stdout:9/394: dread d19/d24/d2e/f3c [0,4194304] 0 2021-04-09T18:25:50.087 INFO:tasks.workunit.client.0.smithi120.stdout:5/486: getdents d10/daa 0 2021-04-09T18:25:50.087 INFO:tasks.workunit.client.0.smithi120.stdout:7/278: chown db/d26/f2d 308 1 2021-04-09T18:25:50.108 INFO:tasks.workunit.client.0.smithi120.stdout:6/349: fdatasync d6/d8/d1a/d36/d54/d31/f53 0 2021-04-09T18:25:50.109 INFO:tasks.workunit.client.0.smithi120.stdout:9/395: rename d19/f78 to d19/d24/d36/d47/d6f/f82 0 2021-04-09T18:25:50.110 INFO:tasks.workunit.client.0.smithi120.stdout:2/410: dwrite d13/f2c [0,4194304] 0 2021-04-09T18:25:50.115 INFO:tasks.workunit.client.0.smithi120.stdout:5/487: getdents d10/d12/d1b/d1f 0 2021-04-09T18:25:50.116 INFO:tasks.workunit.client.0.smithi120.stdout:1/414: dwrite d5/f20 [0,4194304] 0 2021-04-09T18:25:50.117 INFO:tasks.workunit.client.0.smithi120.stdout:5/488: fdatasync d10/d12/d1b/d1f/d84/d44/f49 0 2021-04-09T18:25:50.120 INFO:tasks.workunit.client.0.smithi120.stdout:9/396: unlink d19/d24/l34 0 2021-04-09T18:25:50.122 INFO:tasks.workunit.client.0.smithi120.stdout:1/415: mkdir d5/d1f/d22/d87 0 2021-04-09T18:25:50.123 INFO:tasks.workunit.client.0.smithi120.stdout:5/489: creat d10/d12/d1b/d1f/d84/d3d/fb7 x:0 0 0 2021-04-09T18:25:50.124 INFO:tasks.workunit.client.0.smithi120.stdout:8/331: dread d2/d3/d50/f57 [0,4194304] 0 2021-04-09T18:25:50.131 INFO:tasks.workunit.client.0.smithi120.stdout:8/332: write d2/d3/d11/d2c/d2e/d3b/f33 [3128103,93387] 0 2021-04-09T18:25:50.132 INFO:tasks.workunit.client.0.smithi120.stdout:9/397: creat d19/d1c/d29/d76/f83 x:0 0 0 2021-04-09T18:25:50.134 INFO:tasks.workunit.client.0.smithi120.stdout:8/333: read - d2/d27/f48 zero size 2021-04-09T18:25:50.139 INFO:tasks.workunit.client.0.smithi120.stdout:9/398: write d19/d1c/f6c [949188,6164] 0 2021-04-09T18:25:50.139 INFO:tasks.workunit.client.0.smithi120.stdout:1/416: getdents d5/d1f/d22/d2b 0 2021-04-09T18:25:50.149 INFO:tasks.workunit.client.0.smithi120.stdout:8/334: creat d2/d3/d3c/f68 x:0 0 0 2021-04-09T18:25:50.149 INFO:tasks.workunit.client.0.smithi120.stdout:2/411: truncate d13/d7a/d80/d54/f60 883567 0 2021-04-09T18:25:50.153 INFO:tasks.workunit.client.0.smithi120.stdout:9/399: mknod d19/d24/d36/d47/d4b/c84 1 2021-04-09T18:25:50.153 INFO:tasks.workunit.client.0.smithi120.stdout:8/335: dread d2/d27/f29 [0,4194304] 0 2021-04-09T18:25:50.157 INFO:tasks.workunit.client.0.smithi120.stdout:1/417: creat d5/d64/d63/d86/f88 x:0 0 0 2021-04-09T18:25:50.158 INFO:tasks.workunit.client.0.smithi120.stdout:2/412: symlink d13/d15/d35/l8a 0 2021-04-09T18:25:50.159 INFO:tasks.workunit.client.0.smithi120.stdout:1/418: mknod d5/d64/d63/d86/c89 1 2021-04-09T18:25:50.165 INFO:tasks.workunit.client.0.smithi120.stdout:2/413: creat d13/d7a/d80/d48/d49/d64/f8b x:0 0 0 2021-04-09T18:25:50.168 INFO:tasks.workunit.client.0.smithi120.stdout:9/400: dwrite d19/d24/d36/f6e [0,4194304] 0 2021-04-09T18:25:50.177 INFO:tasks.workunit.client.0.smithi120.stdout:2/414: rename d13/d7a/d80/d48/f57 to d13/d7a/d80/d48/d58/f8c 0 2021-04-09T18:25:50.184 INFO:tasks.workunit.client.0.smithi120.stdout:1/419: truncate d5/d1f/d22/d2b/f5e 1302672 0 2021-04-09T18:25:50.187 INFO:tasks.workunit.client.0.smithi120.stdout:2/415: getdents d13/d7a/d80/d48/d58/d7e 0 2021-04-09T18:25:50.190 INFO:tasks.workunit.client.0.smithi120.stdout:1/420: symlink d5/d50/l8a 0 2021-04-09T18:25:50.192 INFO:tasks.workunit.client.0.smithi120.stdout:1/421: dread - d5/d1f/d22/d2b/f78 zero size 2021-04-09T18:25:50.192 INFO:tasks.workunit.client.0.smithi120.stdout:8/336: write d2/d3/f28 [627640,95927] 0 2021-04-09T18:25:50.204 INFO:tasks.workunit.client.0.smithi120.stdout:1/422: dwrite d5/d1f/d22/d24/f41 [0,4194304] 0 2021-04-09T18:25:50.214 INFO:tasks.workunit.client.0.smithi120.stdout:1/423: creat d5/d64/d2d/f8b x:0 0 0 2021-04-09T18:25:50.220 INFO:tasks.workunit.client.0.smithi120.stdout:9/401: dwrite d19/d2c/f46 [0,4194304] 0 2021-04-09T18:25:50.225 INFO:tasks.workunit.client.0.smithi120.stdout:2/416: dwrite d13/f18 [0,4194304] 0 2021-04-09T18:25:50.226 INFO:tasks.workunit.client.0.smithi120.stdout:2/417: write d13/f72 [5236542,13023] 0 2021-04-09T18:25:50.228 INFO:tasks.workunit.client.0.smithi120.stdout:9/402: creat d19/d24/d37/d40/f85 x:0 0 0 2021-04-09T18:25:50.229 INFO:tasks.workunit.client.0.smithi120.stdout:8/337: write d2/d3/d11/d2c/d2e/d3b/f33 [1796901,56040] 0 2021-04-09T18:25:50.232 INFO:tasks.workunit.client.0.smithi120.stdout:2/418: mkdir d13/d8d 0 2021-04-09T18:25:50.237 INFO:tasks.workunit.client.0.smithi120.stdout:1/424: truncate d5/d64/d2d/f8b 599983 0 2021-04-09T18:25:50.237 INFO:tasks.workunit.client.0.smithi120.stdout:2/419: fsync f6 0 2021-04-09T18:25:50.240 INFO:tasks.workunit.client.0.smithi120.stdout:2/420: chown d13/d7a/d80/f7d 53477 1 2021-04-09T18:25:50.241 INFO:tasks.workunit.client.0.smithi120.stdout:2/421: write d13/f72 [4117221,60997] 0 2021-04-09T18:25:50.242 INFO:tasks.workunit.client.0.smithi120.stdout:2/422: chown f4 0 1 2021-04-09T18:25:50.246 INFO:tasks.workunit.client.0.smithi120.stdout:9/403: creat d19/d24/d37/f86 x:0 0 0 2021-04-09T18:25:50.248 INFO:tasks.workunit.client.0.smithi120.stdout:2/423: creat d13/d8d/f8e x:0 0 0 2021-04-09T18:25:50.249 INFO:tasks.workunit.client.0.smithi120.stdout:9/404: fsync d19/d1c/f20 0 2021-04-09T18:25:50.252 INFO:tasks.workunit.client.0.smithi120.stdout:8/338: dwrite d2/d3/d8/f1d [0,4194304] 0 2021-04-09T18:25:50.253 INFO:tasks.workunit.client.0.smithi120.stdout:2/424: mknod d13/d7a/d80/d48/d58/d7e/c8f 1 2021-04-09T18:25:50.253 INFO:tasks.workunit.client.0.smithi120.stdout:1/425: dwrite d5/d1f/d22/d24/f79 [0,4194304] 0 2021-04-09T18:25:50.256 INFO:tasks.workunit.client.0.smithi120.stdout:8/339: readlink d2/d3/d50/l59 0 2021-04-09T18:25:50.261 INFO:tasks.workunit.client.0.smithi120.stdout:1/426: symlink d5/d64/d2d/d5a/l8c 0 2021-04-09T18:25:50.264 INFO:tasks.workunit.client.0.smithi120.stdout:9/405: dread fb [0,4194304] 0 2021-04-09T18:25:50.265 INFO:tasks.workunit.client.0.smithi120.stdout:2/425: dwrite d13/d15/f69 [0,4194304] 0 2021-04-09T18:25:50.267 INFO:tasks.workunit.client.0.smithi120.stdout:2/426: chown d13/d7a/d80/l27 84825224 1 2021-04-09T18:25:50.270 INFO:tasks.workunit.client.0.smithi120.stdout:2/427: chown d13/d15/f2d 425388395 1 2021-04-09T18:25:50.280 INFO:tasks.workunit.client.0.smithi120.stdout:1/427: unlink d5/l33 0 2021-04-09T18:25:50.290 INFO:tasks.workunit.client.0.smithi120.stdout:9/406: dwrite d19/d24/d36/d47/f4e [4194304,4194304] 0 2021-04-09T18:25:50.296 INFO:tasks.workunit.client.0.smithi120.stdout:2/428: mkdir d13/d7a/d80/d48/d90 0 2021-04-09T18:25:50.298 INFO:tasks.workunit.client.0.smithi120.stdout:1/428: dread - d5/d1f/d22/d2b/f7a zero size 2021-04-09T18:25:50.304 INFO:tasks.workunit.client.0.smithi120.stdout:6/350: dread d6/d8/f13 [0,4194304] 0 2021-04-09T18:25:50.306 INFO:tasks.workunit.client.0.smithi120.stdout:1/429: unlink d5/f7d 0 2021-04-09T18:25:50.316 INFO:tasks.workunit.client.0.smithi120.stdout:1/430: dread d5/d1f/d22/d2b/f5e [0,4194304] 0 2021-04-09T18:25:50.324 INFO:tasks.workunit.client.0.smithi120.stdout:1/431: mkdir d5/d64/d2d/d5a/d8d 0 2021-04-09T18:25:50.325 INFO:tasks.workunit.client.0.smithi120.stdout:1/432: mkdir d5/d1f/d22/d2b/d8e 0 2021-04-09T18:25:50.330 INFO:tasks.workunit.client.0.smithi120.stdout:1/433: rename d5/d1f/d22/d2b/f5e to d5/d64/d63/f8f 0 2021-04-09T18:25:50.331 INFO:tasks.workunit.client.0.smithi120.stdout:1/434: write d5/d64/d2d/f70 [467502,4619] 0 2021-04-09T18:25:50.333 INFO:tasks.workunit.client.0.smithi120.stdout:1/435: rmdir d5/d1f/d22/d24 39 2021-04-09T18:25:50.334 INFO:tasks.workunit.client.0.smithi120.stdout:1/436: stat d5/d1f/l10 0 2021-04-09T18:25:50.334 INFO:tasks.workunit.client.0.smithi120.stdout:1/437: mknod d5/d64/c90 1 2021-04-09T18:25:50.335 INFO:tasks.workunit.client.0.smithi120.stdout:1/438: mknod d5/d64/d63/c91 1 2021-04-09T18:25:50.337 INFO:tasks.workunit.client.0.smithi120.stdout:7/279: dread db/d38/d3c/f3d [0,4194304] 0 2021-04-09T18:25:50.338 INFO:tasks.workunit.client.0.smithi120.stdout:7/280: stat db/f15 0 2021-04-09T18:25:50.341 INFO:tasks.workunit.client.0.smithi120.stdout:1/439: dwrite d5/d1f/d22/d2b/f7a [0,4194304] 0 2021-04-09T18:25:50.342 INFO:tasks.workunit.client.0.smithi120.stdout:1/440: mknod d5/d5c/c92 1 2021-04-09T18:25:50.344 INFO:tasks.workunit.client.0.smithi120.stdout:1/441: chown d5/d1f/l6b 10382343 1 2021-04-09T18:25:50.347 INFO:tasks.workunit.client.0.smithi120.stdout:9/407: write d19/d24/d37/d40/f56 [580567,105588] 0 2021-04-09T18:25:50.353 INFO:tasks.workunit.client.0.smithi120.stdout:1/442: mkdir d5/d64/d63/d86/d93 0 2021-04-09T18:25:50.373 INFO:tasks.workunit.client.0.smithi120.stdout:9/408: rename d19/f54 to d19/d1c/d29/d63/f87 0 2021-04-09T18:25:50.380 INFO:tasks.workunit.client.0.smithi120.stdout:2/429: dwrite d13/d7a/d80/f2f [0,4194304] 0 2021-04-09T18:25:50.388 INFO:tasks.workunit.client.0.smithi120.stdout:6/351: truncate d6/d8/d1a/d36/d54/d41/d49/f4f 1438686 0 2021-04-09T18:25:50.391 INFO:tasks.workunit.client.0.smithi120.stdout:6/352: symlink d6/d8/db/d12/l77 0 2021-04-09T18:25:50.397 INFO:tasks.workunit.client.0.smithi120.stdout:6/353: dread d6/d8/d1a/d36/d54/d31/f76 [0,4194304] 0 2021-04-09T18:25:50.565 INFO:tasks.workunit.client.0.smithi120.stdout:9/409: write d19/d1c/f80 [71856,59826] 0 2021-04-09T18:25:50.565 INFO:tasks.workunit.client.0.smithi120.stdout:1/443: dread d5/d1f/d22/d2b/f47 [0,4194304] 0 2021-04-09T18:25:50.569 INFO:tasks.workunit.client.0.smithi120.stdout:9/410: write d19/d1c/d52/f7e [161879,8000] 0 2021-04-09T18:25:50.571 INFO:tasks.workunit.client.0.smithi120.stdout:9/411: symlink d19/d24/d36/l88 0 2021-04-09T18:25:50.573 INFO:tasks.workunit.client.0.smithi120.stdout:2/430: dwrite d13/f1d [4194304,4194304] 0 2021-04-09T18:25:50.576 INFO:tasks.workunit.client.0.smithi120.stdout:9/412: rename d19/d1c to d19/d24/d37/d40/d89 0 2021-04-09T18:25:50.578 INFO:tasks.workunit.client.0.smithi120.stdout:6/354: write d6/d8/db/d12/d22/f2a [992607,90589] 0 2021-04-09T18:25:50.580 INFO:tasks.workunit.client.0.smithi120.stdout:1/444: write d5/d64/d2d/f6e [459348,63529] 0 2021-04-09T18:25:50.582 INFO:tasks.workunit.client.0.smithi120.stdout:6/355: mknod d6/d8/d1a/d36/d54/d41/d49/c78 1 2021-04-09T18:25:50.583 INFO:tasks.workunit.client.0.smithi120.stdout:1/445: write d5/d1f/d22/d24/f79 [2152979,53000] 0 2021-04-09T18:25:50.589 INFO:tasks.workunit.client.0.smithi120.stdout:1/446: symlink d5/d1f/d22/d2b/d8e/l94 0 2021-04-09T18:25:50.591 INFO:tasks.workunit.client.0.smithi120.stdout:6/356: dread d6/d8/d1a/d36/d54/d41/d49/f4f [0,4194304] 0 2021-04-09T18:25:50.593 INFO:tasks.workunit.client.0.smithi120.stdout:1/447: unlink d5/f20 0 2021-04-09T18:25:50.601 INFO:tasks.workunit.client.0.smithi120.stdout:1/448: rename d5/d50/d61/l77 to d5/d64/l95 0 2021-04-09T18:25:50.604 INFO:tasks.workunit.client.0.smithi120.stdout:2/431: dwrite d13/d15/f24 [0,4194304] 0 2021-04-09T18:25:50.606 INFO:tasks.workunit.client.0.smithi120.stdout:2/432: readlink d13/d7a/d80/d48/d49/l6d 0 2021-04-09T18:25:50.606 INFO:tasks.workunit.client.0.smithi120.stdout:1/449: dread d5/d64/d63/f8f [0,4194304] 0 2021-04-09T18:25:50.610 INFO:tasks.workunit.client.0.smithi120.stdout:1/450: rmdir d5/d50 39 2021-04-09T18:25:50.614 INFO:tasks.workunit.client.0.smithi120.stdout:1/451: rename d5/d1f/d22/d6c/f80 to d5/d1f/f96 0 2021-04-09T18:25:50.616 INFO:tasks.workunit.client.0.smithi120.stdout:6/357: dwrite d6/d8/db/f67 [0,4194304] 0 2021-04-09T18:25:50.621 INFO:tasks.workunit.client.0.smithi120.stdout:1/452: rename d5/d1f/d22/l84 to d5/d1f/d22/d24/l97 0 2021-04-09T18:25:50.622 INFO:tasks.workunit.client.0.smithi120.stdout:6/358: mkdir d6/d8/d3a/d79 0 2021-04-09T18:25:50.636 INFO:tasks.workunit.client.0.smithi120.stdout:1/453: dwrite d5/d1f/d22/d24/f68 [0,4194304] 0 2021-04-09T18:25:50.636 INFO:tasks.workunit.client.0.smithi120.stdout:2/433: fsync d13/d15/f24 0 2021-04-09T18:25:50.639 INFO:tasks.workunit.client.0.smithi120.stdout:6/359: mkdir d6/d8/d1a/d36/d54/d31/d37/d61/d7a 0 2021-04-09T18:25:50.640 INFO:tasks.workunit.client.0.smithi120.stdout:6/360: stat d6/d8/db/d12/d22/f2a 0 2021-04-09T18:25:50.646 INFO:tasks.workunit.client.0.smithi120.stdout:6/361: dread d6/d8/f13 [0,4194304] 0 2021-04-09T18:25:50.646 INFO:tasks.workunit.client.0.smithi120.stdout:1/454: dwrite d5/d1f/f81 [0,4194304] 0 2021-04-09T18:25:50.655 INFO:tasks.workunit.client.0.smithi120.stdout:6/362: symlink d6/d8/db/d2b/d68/d6a/l7b 0 2021-04-09T18:25:50.659 INFO:tasks.workunit.client.0.smithi120.stdout:1/455: rename d5/d1f/d22/d2b/f59 to d5/d50/f98 0 2021-04-09T18:25:50.660 INFO:tasks.workunit.client.0.smithi120.stdout:1/456: mknod d5/d50/d61/c99 1 2021-04-09T18:25:50.663 INFO:tasks.workunit.client.0.smithi120.stdout:2/434: dread fb [0,4194304] 0 2021-04-09T18:25:50.672 INFO:tasks.workunit.client.0.smithi120.stdout:6/363: rename d6/d8/db/d12/f72 to d6/d8/d1a/d36/d54/d41/d49/f7c 0 2021-04-09T18:25:50.674 INFO:tasks.workunit.client.0.smithi120.stdout:1/457: read d5/d1f/d22/d24/f83 [398635,58101] 0 2021-04-09T18:25:50.677 INFO:tasks.workunit.client.0.smithi120.stdout:6/364: dwrite d6/d8/d1a/f50 [0,4194304] 0 2021-04-09T18:25:50.680 INFO:tasks.workunit.client.0.smithi120.stdout:1/458: rename d5/d64/l49 to d5/d64/d2d/d5a/l9a 0 2021-04-09T18:25:50.682 INFO:tasks.workunit.client.0.smithi120.stdout:2/435: getdents d13/d7a/d80 0 2021-04-09T18:25:50.683 INFO:tasks.workunit.client.0.smithi120.stdout:2/436: readlink d13/l6a 0 2021-04-09T18:25:50.683 INFO:tasks.workunit.client.0.smithi120.stdout:1/459: chown d5/d1f/l10 1 1 2021-04-09T18:25:50.688 INFO:tasks.workunit.client.0.smithi120.stdout:1/460: write d5/d1f/d22/d24/f79 [2487263,129546] 0 2021-04-09T18:25:50.688 INFO:tasks.workunit.client.0.smithi120.stdout:2/437: chown d13/d7a/d80/l6c 24 1 2021-04-09T18:25:50.688 INFO:tasks.workunit.client.0.smithi120.stdout:6/365: creat d6/d8/db/f7d x:0 0 0 2021-04-09T18:25:50.691 INFO:tasks.workunit.client.0.smithi120.stdout:6/366: rmdir d6/d8/d1a/d36/d54/d41 39 2021-04-09T18:25:50.694 INFO:tasks.workunit.client.0.smithi120.stdout:2/438: unlink d13/d7a/d80/d48/d49/f4b 0 2021-04-09T18:25:50.698 INFO:tasks.workunit.client.0.smithi120.stdout:1/461: dwrite d5/d1f/f96 [0,4194304] 0 2021-04-09T18:25:50.699 INFO:tasks.workunit.client.0.smithi120.stdout:6/367: creat d6/d8/d3a/d79/f7e x:0 0 0 2021-04-09T18:25:50.704 INFO:tasks.workunit.client.0.smithi120.stdout:6/368: mkdir d6/d7f 0 2021-04-09T18:25:50.707 INFO:tasks.workunit.client.0.smithi120.stdout:2/439: dwrite d13/d7a/d80/f2f [0,4194304] 0 2021-04-09T18:25:50.711 INFO:tasks.workunit.client.0.smithi120.stdout:1/462: link d5/d64/l95 d5/d1f/d22/d2b/l9b 0 2021-04-09T18:25:50.712 INFO:tasks.workunit.client.0.smithi120.stdout:2/440: symlink d13/d15/l91 0 2021-04-09T18:25:50.718 INFO:tasks.workunit.client.0.smithi120.stdout:2/441: write d13/d7a/d80/d48/d49/d76/f82 [2970749,92634] 0 2021-04-09T18:25:50.719 INFO:tasks.workunit.client.0.smithi120.stdout:6/369: dwrite d6/d8/d3a/d79/f7e [0,4194304] 0 2021-04-09T18:25:50.727 INFO:tasks.workunit.client.0.smithi120.stdout:1/463: rename d5/d1f/d22/d24/f79 to d5/d64/d63/d86/f9c 0 2021-04-09T18:25:50.727 INFO:tasks.workunit.client.0.smithi120.stdout:2/442: dread d13/d7a/d80/d48/d58/f8c [0,4194304] 0 2021-04-09T18:25:50.742 INFO:tasks.workunit.client.0.smithi120.stdout:1/464: read d5/d64/d2d/f8b [57702,17223] 0 2021-04-09T18:25:50.742 INFO:tasks.workunit.client.0.smithi120.stdout:1/465: stat d5/d5c 0 2021-04-09T18:25:50.762 INFO:tasks.workunit.client.0.smithi120.stdout:1/466: dread d5/d50/f98 [0,4194304] 0 2021-04-09T18:25:50.763 INFO:tasks.workunit.client.0.smithi120.stdout:1/467: chown d5/d1f/d22/d2b/f7a 98577323 1 2021-04-09T18:25:50.764 INFO:tasks.workunit.client.0.smithi120.stdout:6/370: link d6/d8/db/f24 d6/d8/d1a/d36/d5a/d5d/d6e/f80 0 2021-04-09T18:25:50.769 INFO:tasks.workunit.client.0.smithi120.stdout:1/468: dread d5/d64/d2d/f70 [0,4194304] 0 2021-04-09T18:25:50.771 INFO:tasks.workunit.client.0.smithi120.stdout:6/371: unlink d6/f2f 0 2021-04-09T18:25:50.773 INFO:tasks.workunit.client.0.smithi120.stdout:1/469: symlink d5/d1f/l9d 0 2021-04-09T18:25:50.778 INFO:tasks.workunit.client.0.smithi120.stdout:1/470: dread d5/d64/d2d/f6e [0,4194304] 0 2021-04-09T18:25:50.780 INFO:tasks.workunit.client.0.smithi120.stdout:6/372: symlink d6/d8/db/d2b/l81 0 2021-04-09T18:25:50.781 INFO:tasks.workunit.client.0.smithi120.stdout:6/373: mknod d6/d8/db/d12/d22/c82 1 2021-04-09T18:25:50.782 INFO:tasks.workunit.client.0.smithi120.stdout:6/374: mknod d6/d8/d1a/d36/d54/d31/d37/d61/c83 1 2021-04-09T18:25:50.974 INFO:tasks.workunit.client.0.smithi120.stdout:6/375: mknod d6/d8/db/d12/c84 1 2021-04-09T18:25:51.225 INFO:tasks.workunit.client.0.smithi120.stdout:6/376: dwrite d6/d8/db/f39 [0,4194304] 0 2021-04-09T18:25:51.228 INFO:tasks.workunit.client.0.smithi120.stdout:6/377: creat d6/d8/d1a/d36/d54/d31/f85 x:0 0 0 2021-04-09T18:25:51.236 INFO:tasks.workunit.client.0.smithi120.stdout:1/471: truncate d5/d64/d2d/f70 638552 0 2021-04-09T18:25:51.237 INFO:tasks.workunit.client.0.smithi120.stdout:1/472: chown d5/d1f/d22/d87 57849 1 2021-04-09T18:25:51.241 INFO:tasks.workunit.client.0.smithi120.stdout:1/473: creat d5/d64/d2d/d5a/f9e x:0 0 0 2021-04-09T18:25:51.244 INFO:tasks.workunit.client.0.smithi120.stdout:6/378: fdatasync d6/d8/d1a/d36/d54/d41/d49/f4f 0 2021-04-09T18:25:51.253 INFO:tasks.workunit.client.0.smithi120.stdout:6/379: link d6/fc d6/d8/d1a/d36/d54/d31/f86 0 2021-04-09T18:25:51.521 INFO:tasks.workunit.client.0.smithi120.stdout:1/474: truncate d5/d1f/d22/d24/f41 1665726 0 2021-04-09T18:25:51.526 INFO:tasks.workunit.client.0.smithi120.stdout:1/475: dwrite d5/d5c/f72 [0,4194304] 0 2021-04-09T18:25:51.527 INFO:tasks.workunit.client.0.smithi120.stdout:1/476: rmdir d5/d1f/d22/d24 39 2021-04-09T18:25:51.534 INFO:tasks.workunit.client.0.smithi120.stdout:1/477: symlink d5/d64/d2d/d5a/d8d/l9f 0 2021-04-09T18:25:51.535 INFO:tasks.workunit.client.0.smithi120.stdout:1/478: mknod d5/d5c/ca0 1 2021-04-09T18:25:51.536 INFO:tasks.workunit.client.0.smithi120.stdout:1/479: fdatasync d5/d64/d2d/f8b 0 2021-04-09T18:25:51.541 INFO:tasks.workunit.client.0.smithi120.stdout:1/480: dread d5/d1f/d22/d24/f68 [0,4194304] 0 2021-04-09T18:25:51.547 INFO:tasks.workunit.client.0.smithi120.stdout:1/481: dwrite d5/d1f/d22/d2b/f47 [0,4194304] 0 2021-04-09T18:25:51.549 INFO:tasks.workunit.client.0.smithi120.stdout:4/374: sync 2021-04-09T18:25:51.549 INFO:tasks.workunit.client.0.smithi120.stdout:1/482: symlink d5/d64/la1 0 2021-04-09T18:25:51.558 INFO:tasks.workunit.client.0.smithi120.stdout:4/375: symlink d1f/d2c/d30/l7e 0 2021-04-09T18:25:51.558 INFO:tasks.workunit.client.0.smithi120.stdout:1/483: mknod d5/d1f/d22/ca2 1 2021-04-09T18:25:51.559 INFO:tasks.workunit.client.0.smithi120.stdout:4/376: stat d1f/d2c/d3b/f53 0 2021-04-09T18:25:51.563 INFO:tasks.workunit.client.0.smithi120.stdout:1/484: getdents d5/d64/d2d/d5a 0 2021-04-09T18:25:51.564 INFO:tasks.workunit.client.0.smithi120.stdout:4/377: fsync d1f/d2c/d56/f72 0 2021-04-09T18:25:51.571 INFO:tasks.workunit.client.0.smithi120.stdout:4/378: write d1f/d24/f3c [754799,112907] 0 2021-04-09T18:25:51.573 INFO:tasks.workunit.client.0.smithi120.stdout:4/379: readlink d1f/d24/d42/l50 0 2021-04-09T18:25:51.673 INFO:tasks.workunit.client.0.smithi120.stdout:9/413: sync 2021-04-09T18:25:51.673 INFO:tasks.workunit.client.0.smithi120.stdout:2/443: sync 2021-04-09T18:25:51.673 INFO:tasks.workunit.client.0.smithi120.stdout:5/490: sync 2021-04-09T18:25:51.674 INFO:tasks.workunit.client.0.smithi120.stdout:6/380: sync 2021-04-09T18:25:51.674 INFO:tasks.workunit.client.0.smithi120.stdout:0/346: sync 2021-04-09T18:25:51.674 INFO:tasks.workunit.client.0.smithi120.stdout:8/340: sync 2021-04-09T18:25:51.674 INFO:tasks.workunit.client.0.smithi120.stdout:7/281: sync 2021-04-09T18:25:51.674 INFO:tasks.workunit.client.0.smithi120.stdout:3/407: sync 2021-04-09T18:25:51.675 INFO:tasks.workunit.client.0.smithi120.stdout:2/444: fsync d13/d15/f24 0 2021-04-09T18:25:51.677 INFO:tasks.workunit.client.0.smithi120.stdout:0/347: write d0/f30 [452892,52242] 0 2021-04-09T18:25:51.679 INFO:tasks.workunit.client.0.smithi120.stdout:8/341: creat d2/d27/f69 x:0 0 0 2021-04-09T18:25:51.681 INFO:tasks.workunit.client.0.smithi120.stdout:0/348: fsync d0/d2/dd/f5e 0 2021-04-09T18:25:51.681 INFO:tasks.workunit.client.0.smithi120.stdout:7/282: creat db/d42/d54/d5a/f64 x:0 0 0 2021-04-09T18:25:51.683 INFO:tasks.workunit.client.0.smithi120.stdout:6/381: rmdir d6/d8/db/d2b/d68/d6a 39 2021-04-09T18:25:51.684 INFO:tasks.workunit.client.0.smithi120.stdout:5/491: creat d10/d12/d1b/d1f/d39/dab/fb8 x:0 0 0 2021-04-09T18:25:51.685 INFO:tasks.workunit.client.0.smithi120.stdout:2/445: symlink d13/d7a/d80/d48/d49/d76/l92 0 2021-04-09T18:25:51.686 INFO:tasks.workunit.client.0.smithi120.stdout:7/283: fdatasync db/f27 0 2021-04-09T18:25:51.686 INFO:tasks.workunit.client.0.smithi120.stdout:8/342: dread - d2/d3/d11/d2c/d2e/d3b/f67 zero size 2021-04-09T18:25:51.687 INFO:tasks.workunit.client.0.smithi120.stdout:9/414: dread d19/d2c/f46 [0,4194304] 0 2021-04-09T18:25:51.688 INFO:tasks.workunit.client.0.smithi120.stdout:0/349: unlink d0/d2/f27 0 2021-04-09T18:25:51.690 INFO:tasks.workunit.client.0.smithi120.stdout:2/446: mknod d13/d15/c93 1 2021-04-09T18:25:51.690 INFO:tasks.workunit.client.0.smithi120.stdout:5/492: mknod d10/d12/d1b/d1f/d84/d3d/d50/da9/cb9 1 2021-04-09T18:25:51.690 INFO:tasks.workunit.client.0.smithi120.stdout:6/382: creat d6/d8/d1a/d36/d5a/f87 x:0 0 0 2021-04-09T18:25:51.691 INFO:tasks.workunit.client.0.smithi120.stdout:0/350: creat d0/d43/f66 x:0 0 0 2021-04-09T18:25:51.693 INFO:tasks.workunit.client.0.smithi120.stdout:0/351: mknod d0/d2/dd/c67 1 2021-04-09T18:25:51.693 INFO:tasks.workunit.client.0.smithi120.stdout:3/408: truncate d3/de/d25/f15 5722622 0 2021-04-09T18:25:51.694 INFO:tasks.workunit.client.0.smithi120.stdout:9/415: read d19/d2c/f48 [3028187,22447] 0 2021-04-09T18:25:51.695 INFO:tasks.workunit.client.0.smithi120.stdout:8/343: rename d2/d3/d11/d2c/d2e to d2/d3/d11/d6a 0 2021-04-09T18:25:51.696 INFO:tasks.workunit.client.0.smithi120.stdout:0/352: chown d0/d2/da/d23 110439 1 2021-04-09T18:25:51.696 INFO:tasks.workunit.client.0.smithi120.stdout:7/284: link db/d26/f60 db/d42/f65 0 2021-04-09T18:25:51.698 INFO:tasks.workunit.client.0.smithi120.stdout:2/447: dread d13/f2c [0,4194304] 0 2021-04-09T18:25:51.699 INFO:tasks.workunit.client.0.smithi120.stdout:6/383: rename d6/d8/db/d12/f1f to d6/d8/d1a/d36/d54/d41/d49/f88 0 2021-04-09T18:25:51.702 INFO:tasks.workunit.client.0.smithi120.stdout:3/409: unlink d3/d5/d36/d1e/d6b/d59/d68/l62 0 2021-04-09T18:25:51.703 INFO:tasks.workunit.client.0.smithi120.stdout:6/384: chown d6/d8/d1a/d36/d54/d41/d49 0 1 2021-04-09T18:25:51.704 INFO:tasks.workunit.client.0.smithi120.stdout:3/410: chown d3/l58 1 1 2021-04-09T18:25:51.707 INFO:tasks.workunit.client.0.smithi120.stdout:9/416: dwrite d19/d24/d36/f6e [4194304,4194304] 0 2021-04-09T18:25:51.707 INFO:tasks.workunit.client.0.smithi120.stdout:5/493: truncate d10/d12/d3b/f76 226085 0 2021-04-09T18:25:51.710 INFO:tasks.workunit.client.0.smithi120.stdout:6/385: creat d6/d8/d1a/d36/f89 x:0 0 0 2021-04-09T18:25:51.710 INFO:tasks.workunit.client.0.smithi120.stdout:0/353: dwrite d0/d2/d4/f29 [0,4194304] 0 2021-04-09T18:25:51.713 INFO:tasks.workunit.client.0.smithi120.stdout:7/285: getdents db/d38/d3c 0 2021-04-09T18:25:51.714 INFO:tasks.workunit.client.0.smithi120.stdout:6/386: mkdir d6/d8/d1a/d36/d54/d31/d8a 0 2021-04-09T18:25:51.735 INFO:tasks.workunit.client.0.smithi120.stdout:2/448: write d13/d7a/d80/f2b [92833,81917] 0 2021-04-09T18:25:51.746 INFO:tasks.workunit.client.0.smithi120.stdout:2/449: rename d13/d7a/d80/d48/d90 to d13/d7a/d80/d48/d49/d64/d83/d94 0 2021-04-09T18:25:51.746 INFO:tasks.workunit.client.0.smithi120.stdout:8/344: truncate d2/d3/d8/f55 4815571 0 2021-04-09T18:25:51.751 INFO:tasks.workunit.client.0.smithi120.stdout:0/354: write d0/d2/d4/f4c [214006,37850] 0 2021-04-09T18:25:51.754 INFO:tasks.workunit.client.0.smithi120.stdout:8/345: mkdir d2/d3/d11/d6a/d3b/d6b 0 2021-04-09T18:25:51.756 INFO:tasks.workunit.client.0.smithi120.stdout:9/417: fsync d19/d24/d36/f6e 0 2021-04-09T18:25:51.758 INFO:tasks.workunit.client.0.smithi120.stdout:9/418: fdatasync d19/d24/d37/d40/d89/f23 0 2021-04-09T18:25:51.758 INFO:tasks.workunit.client.0.smithi120.stdout:0/355: creat d0/d2/d4/d5f/f68 x:0 0 0 2021-04-09T18:25:51.759 INFO:tasks.workunit.client.0.smithi120.stdout:8/346: symlink d2/d37/l6c 0 2021-04-09T18:25:51.761 INFO:tasks.workunit.client.0.smithi120.stdout:9/419: write d19/d24/d37/d40/d89/d29/f6d [561961,36677] 0 2021-04-09T18:25:51.761 INFO:tasks.workunit.client.0.smithi120.stdout:9/420: chown d19/d2c 101 1 2021-04-09T18:25:51.763 INFO:tasks.workunit.client.0.smithi120.stdout:6/387: truncate d6/d8/d1a/d36/d5a/d5d/d6e/f71 1922401 0 2021-04-09T18:25:51.764 INFO:tasks.workunit.client.0.smithi120.stdout:9/421: write d19/d24/d37/d40/d89/f80 [445163,97423] 0 2021-04-09T18:25:51.766 INFO:tasks.workunit.client.0.smithi120.stdout:5/494: dread d10/d12/f24 [0,4194304] 0 2021-04-09T18:25:51.766 INFO:tasks.workunit.client.0.smithi120.stdout:9/422: write d19/f32 [894819,16161] 0 2021-04-09T18:25:51.769 INFO:tasks.workunit.client.0.smithi120.stdout:8/347: creat d2/d3/d8/f6d x:0 0 0 2021-04-09T18:25:51.770 INFO:tasks.workunit.client.0.smithi120.stdout:0/356: mkdir d0/d5a/d62/d69 0 2021-04-09T18:25:51.770 INFO:tasks.workunit.client.0.smithi120.stdout:2/450: truncate d13/d15/d35/f3e 1406034 0 2021-04-09T18:25:51.771 INFO:tasks.workunit.client.0.smithi120.stdout:6/388: creat d6/d8/d1a/d36/d5a/d5d/d6e/f8b x:0 0 0 2021-04-09T18:25:51.771 INFO:tasks.workunit.client.0.smithi120.stdout:8/348: readlink d2/d37/l6c 0 2021-04-09T18:25:51.773 INFO:tasks.workunit.client.0.smithi120.stdout:2/451: readlink d13/d7a/d80/d48/d49/l4f 0 2021-04-09T18:25:51.774 INFO:tasks.workunit.client.0.smithi120.stdout:6/389: fdatasync d6/d8/d1a/d36/f89 0 2021-04-09T18:25:51.775 INFO:tasks.workunit.client.0.smithi120.stdout:2/452: fdatasync d13/f72 0 2021-04-09T18:25:51.779 INFO:tasks.workunit.client.0.smithi120.stdout:4/380: dread d1f/d24/d6b/f57 [0,4194304] 0 2021-04-09T18:25:51.780 INFO:tasks.workunit.client.0.smithi120.stdout:2/453: dread d13/d7a/d80/f2b [0,4194304] 0 2021-04-09T18:25:51.780 INFO:tasks.workunit.client.0.smithi120.stdout:5/495: link d10/d12/d1b/d1f/f71 d10/d12/d1b/d1f/d84/d3d/d50/da9/fba 0 2021-04-09T18:25:51.781 INFO:tasks.workunit.client.0.smithi120.stdout:4/381: chown d1f/l21 421138 1 2021-04-09T18:25:51.783 INFO:tasks.workunit.client.0.smithi120.stdout:6/390: rename d6/d8/db/d12/d22/f3c to d6/d8/db/d2b/d4d/f8c 0 2021-04-09T18:25:51.787 INFO:tasks.workunit.client.0.smithi120.stdout:3/411: dread d3/d5/d36/d1e/d38/f44 [0,4194304] 0 2021-04-09T18:25:51.788 INFO:tasks.workunit.client.0.smithi120.stdout:3/412: chown d3/d5/d36/d1e/d38 211213 1 2021-04-09T18:25:51.789 INFO:tasks.workunit.client.0.smithi120.stdout:3/413: fsync d3/de/f1b 0 2021-04-09T18:25:51.790 INFO:tasks.workunit.client.0.smithi120.stdout:3/414: stat d3/f42 0 2021-04-09T18:25:51.791 INFO:tasks.workunit.client.0.smithi120.stdout:6/391: creat d6/d8/d1a/d36/d5a/f8d x:0 0 0 2021-04-09T18:25:51.794 INFO:tasks.workunit.client.0.smithi120.stdout:8/349: write d2/d37/d3e/f5d [599962,19730] 0 2021-04-09T18:25:51.796 INFO:tasks.workunit.client.0.smithi120.stdout:8/350: chown d2/d3/d50/l59 3 1 2021-04-09T18:25:51.798 INFO:tasks.workunit.client.0.smithi120.stdout:3/415: dwrite d3/d5/d36/d1e/d38/d61/f76 [4194304,4194304] 0 2021-04-09T18:25:51.798 INFO:tasks.workunit.client.0.smithi120.stdout:5/496: rename d10/d12/d1b/d3a/d5b/d96 to d10/d12/d1b/d1f/d39/dbb 0 2021-04-09T18:25:51.801 INFO:tasks.workunit.client.0.smithi120.stdout:4/382: rmdir d1f/d2c/d3b/d3e/d5c 0 2021-04-09T18:25:51.801 INFO:tasks.workunit.client.0.smithi120.stdout:1/485: sync 2021-04-09T18:25:51.801 INFO:tasks.workunit.client.0.smithi120.stdout:6/392: creat d6/d8/d52/d6c/f8e x:0 0 0 2021-04-09T18:25:51.804 INFO:tasks.workunit.client.0.smithi120.stdout:8/351: rmdir d2/d27 39 2021-04-09T18:25:51.813 INFO:tasks.workunit.client.0.smithi120.stdout:3/416: rename d3/de/d25/d53/d82 to d3/d5/d36/d1e/d6b/d59/d86 0 2021-04-09T18:25:51.816 INFO:tasks.workunit.client.0.smithi120.stdout:6/393: write d6/d8/d1a/f34 [17402,69019] 0 2021-04-09T18:25:51.819 INFO:tasks.workunit.client.0.smithi120.stdout:8/352: dread - d2/d27/f41 zero size 2021-04-09T18:25:51.820 INFO:tasks.workunit.client.0.smithi120.stdout:2/454: link d13/d7a/d80/d48/d49/l56 d13/d15/l95 0 2021-04-09T18:25:51.822 INFO:tasks.workunit.client.0.smithi120.stdout:5/497: creat d10/d12/d1b/d1f/d84/d44/d8c/da6/fbc x:0 0 0 2021-04-09T18:25:51.823 INFO:tasks.workunit.client.0.smithi120.stdout:3/417: mkdir d3/de/d87 0 2021-04-09T18:25:51.825 INFO:tasks.workunit.client.0.smithi120.stdout:4/383: link d1f/f71 d1f/d2c/d3b/d3e/d7c/f7f 0 2021-04-09T18:25:51.827 INFO:tasks.workunit.client.0.smithi120.stdout:4/384: mknod d1f/d2c/d56/c80 1 2021-04-09T18:25:51.828 INFO:tasks.workunit.client.0.smithi120.stdout:2/455: symlink d13/d7a/d80/l96 0 2021-04-09T18:25:51.831 INFO:tasks.workunit.client.0.smithi120.stdout:4/385: chown d1f/d24/d6b/f57 118567 1 2021-04-09T18:25:51.831 INFO:tasks.workunit.client.0.smithi120.stdout:2/456: fdatasync d13/d7a/d80/d48/d58/f67 0 2021-04-09T18:25:51.833 INFO:tasks.workunit.client.0.smithi120.stdout:6/394: creat d6/d8/db/d2b/d68/d6a/f8f x:0 0 0 2021-04-09T18:25:51.837 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:51.838 INFO:tasks.workunit.client.0.smithi120.stdout:3/418: dwrite d3/d5/d36/d1e/d6b/d49/d4e/f60 [0,4194304] 0 2021-04-09T18:25:51.842 INFO:tasks.workunit.client.0.smithi120.stdout:1/486: dread d5/d1f/d22/f2c [0,4194304] 0 2021-04-09T18:25:51.846 INFO:tasks.workunit.client.0.smithi120.stdout:1/487: mkdir d5/d64/d63/d86/da3 0 2021-04-09T18:25:51.847 INFO:tasks.workunit.client.0.smithi120.stdout:1/488: dread - d5/d64/f82 zero size 2021-04-09T18:25:51.850 INFO:tasks.workunit.client.0.smithi120.stdout:2/457: write d13/d15/f2d [911780,65031] 0 2021-04-09T18:25:51.856 INFO:tasks.workunit.client.0.smithi120.stdout:3/419: rename d3/de/l4b to d3/de/l88 0 2021-04-09T18:25:51.861 INFO:tasks.workunit.client.0.smithi120.stdout:2/458: mknod d13/c97 1 2021-04-09T18:25:51.862 INFO:tasks.workunit.client.0.smithi120.stdout:6/395: link d6/d8/db/d12/d22/f27 d6/d8/d1a/d36/d54/d31/d37/d61/f90 0 2021-04-09T18:25:51.863 INFO:tasks.workunit.client.0.smithi120.stdout:5/498: dwrite d10/d12/d1b/d1f/d39/dab/fb3 [4194304,4194304] 0 2021-04-09T18:25:51.863 INFO:tasks.workunit.client.0.smithi120.stdout:2/459: chown d13/d15/f69 60032083 1 2021-04-09T18:25:51.867 INFO:tasks.workunit.client.0.smithi120.stdout:1/489: rename d5/l1b to d5/d5c/d75/la4 0 2021-04-09T18:25:51.870 INFO:tasks.workunit.client.0.smithi120.stdout:2/460: mkdir d13/d61/d7c/d98 0 2021-04-09T18:25:51.871 INFO:tasks.workunit.client.0.smithi120.stdout:1/490: write d5/d1f/d22/d24/f83 [951247,53511] 0 2021-04-09T18:25:51.875 INFO:tasks.workunit.client.0.smithi120.stdout:3/420: rename d3/d5/d36/d1e/d6b/d59 to d3/d5/d36/d1e/d6b/d49/d89 0 2021-04-09T18:25:51.882 INFO:tasks.workunit.client.0.smithi120.stdout:5/499: rename d10/d12/d1b/d1f/d84/d3d/f6d to d10/d12/d1b/fbd 0 2021-04-09T18:25:51.882 INFO:tasks.workunit.client.0.smithi120.stdout:5/500: dread - d10/fae zero size 2021-04-09T18:25:51.885 INFO:tasks.workunit.client.0.smithi120.stdout:2/461: rename d13/f19 to d13/d8d/f99 0 2021-04-09T18:25:51.887 INFO:tasks.workunit.client.0.smithi120.stdout:2/462: chown d13/d7a/d80/l3b 27008 1 2021-04-09T18:25:51.894 INFO:tasks.workunit.client.0.smithi120.stdout:3/421: rename d3/l58 to d3/d5/d36/d1e/d6b/d49/d73/l8a 0 2021-04-09T18:25:51.896 INFO:tasks.workunit.client.0.smithi120.stdout:3/422: chown d3/d5/d36/d1e 2 1 2021-04-09T18:25:51.897 INFO:tasks.workunit.client.0.smithi120.stdout:2/463: dwrite d13/d7a/d80/d48/d49/d64/f74 [0,4194304] 0 2021-04-09T18:25:51.898 INFO:tasks.workunit.client.0.smithi120.stdout:3/423: write d3/d5/d36/d1e/f39 [2784236,121351] 0 2021-04-09T18:25:51.901 INFO:tasks.workunit.client.0.smithi120.stdout:2/464: chown d13/l22 35710105 1 2021-04-09T18:25:51.908 INFO:tasks.workunit.client.0.smithi120.stdout:2/465: rename d13/d7a/d80/l27 to d13/d7a/d80/d48/d49/d64/d83/l9a 0 2021-04-09T18:25:51.909 INFO:tasks.workunit.client.0.smithi120.stdout:2/466: mknod d13/d7a/d80/c9b 1 2021-04-09T18:25:51.916 INFO:tasks.workunit.client.0.smithi120.stdout:8/353: dread d2/d3/d11/f34 [0,4194304] 0 2021-04-09T18:25:51.919 INFO:tasks.workunit.client.0.smithi120.stdout:6/396: dread d6/d8/f25 [4194304,4194304] 0 2021-04-09T18:25:51.920 INFO:tasks.workunit.client.0.smithi120.stdout:2/467: dwrite d13/d61/f89 [0,4194304] 0 2021-04-09T18:25:51.926 INFO:tasks.workunit.client.0.smithi120.stdout:8/354: dwrite d2/d27/f69 [0,4194304] 0 2021-04-09T18:25:51.931 INFO:tasks.workunit.client.0.smithi120.stdout:6/397: dwrite d6/d8/db/d12/f4b [0,4194304] 0 2021-04-09T18:25:51.933 INFO:tasks.workunit.client.0.smithi120.stdout:8/355: creat d2/f6e x:0 0 0 2021-04-09T18:25:51.933 INFO:tasks.workunit.client.0.smithi120.stdout:6/398: write d6/d8/db/d2b/d68/d6a/f8f [1029151,1489] 0 2021-04-09T18:25:51.943 INFO:tasks.workunit.client.0.smithi120.stdout:0/357: dread d0/d2/da/f19 [8388608,4194304] 0 2021-04-09T18:25:51.943 INFO:tasks.workunit.client.0.smithi120.stdout:6/399: dwrite d6/d8/d1a/d36/d54/f75 [0,4194304] 0 2021-04-09T18:25:51.944 INFO:tasks.workunit.client.0.smithi120.stdout:0/358: unlink d0/f4e 0 2021-04-09T18:25:51.946 INFO:tasks.workunit.client.0.smithi120.stdout:0/359: symlink d0/d5a/l6a 0 2021-04-09T18:25:51.947 INFO:tasks.workunit.client.0.smithi120.stdout:0/360: chown d0/fc 12 1 2021-04-09T18:25:51.950 INFO:tasks.workunit.client.0.smithi120.stdout:0/361: write d0/d2/da/f19 [6473644,91305] 0 2021-04-09T18:25:51.952 INFO:tasks.workunit.client.0.smithi120.stdout:6/400: getdents d6 0 2021-04-09T18:25:51.954 INFO:tasks.workunit.client.0.smithi120.stdout:6/401: write d6/d8/d3a/f59 [525159,72097] 0 2021-04-09T18:25:51.962 INFO:tasks.workunit.client.0.smithi120.stdout:6/402: unlink d6/d8/l11 0 2021-04-09T18:25:51.963 INFO:tasks.workunit.client.0.smithi120.stdout:0/362: getdents d0/d2 0 2021-04-09T18:25:51.972 INFO:tasks.workunit.client.0.smithi120.stdout:6/403: truncate d6/d8/d1a/d36/d54/d31/f76 907305 0 2021-04-09T18:25:51.979 INFO:tasks.workunit.client.0.smithi120.stdout:5/501: write d10/d12/d1b/d1f/d84/d3d/f8e [321209,62620] 0 2021-04-09T18:25:51.988 INFO:tasks.workunit.client.0.smithi120.stdout:3/424: dwrite d3/d5/d36/d1e/d6b/d49/f4a [0,4194304] 0 2021-04-09T18:25:51.990 INFO:tasks.workunit.client.0.smithi120.stdout:8/356: truncate d2/d3/d8/f1d 1531160 0 2021-04-09T18:25:51.993 INFO:tasks.workunit.client.0.smithi120.stdout:6/404: link d6/d8/d1a/d36/d54/d31/f85 d6/d8/d3a/d79/f91 0 2021-04-09T18:25:51.995 INFO:tasks.workunit.client.0.smithi120.stdout:8/357: mknod d2/d3/d11/d2c/c6f 1 2021-04-09T18:25:51.995 INFO:tasks.workunit.client.0.smithi120.stdout:3/425: chown d3/d5/d36/d1e/d38/l47 15 1 2021-04-09T18:25:51.998 INFO:tasks.workunit.client.0.smithi120.stdout:2/468: dwrite fb [0,4194304] 0 2021-04-09T18:25:52.004 INFO:tasks.workunit.client.0.smithi120.stdout:5/502: dread d10/d12/f24 [0,4194304] 0 2021-04-09T18:25:52.014 INFO:tasks.workunit.client.0.smithi120.stdout:8/358: dwrite d2/d27/f48 [0,4194304] 0 2021-04-09T18:25:52.020 INFO:tasks.workunit.client.0.smithi120.stdout:2/469: truncate d13/f25 4256650 0 2021-04-09T18:25:52.024 INFO:tasks.workunit.client.0.smithi120.stdout:2/470: chown d13/d7a/d80/d48/d58/d7e 175514 1 2021-04-09T18:25:52.026 INFO:tasks.workunit.client.0.smithi120.stdout:8/359: creat d2/d3/d11/d6a/f70 x:0 0 0 2021-04-09T18:25:52.026 INFO:tasks.workunit.client.0.smithi120.stdout:6/405: truncate d6/d8/d52/d6c/f8e 797686 0 2021-04-09T18:25:52.028 INFO:tasks.workunit.client.0.smithi120.stdout:8/360: chown d2/d37/l49 300 1 2021-04-09T18:25:52.029 INFO:tasks.workunit.client.0.smithi120.stdout:5/503: truncate d10/d12/d1b/d1f/d84/d44/f65 1220173 0 2021-04-09T18:25:52.030 INFO:tasks.workunit.client.0.smithi120.stdout:5/504: mknod d10/d12/d1b/d1f/cbe 1 2021-04-09T18:25:52.030 INFO:tasks.workunit.client.0.smithi120.stdout:0/363: truncate d0/f3c 159963 0 2021-04-09T18:25:52.034 INFO:tasks.workunit.client.0.smithi120.stdout:0/364: unlink d0/d2/d4/f4c 0 2021-04-09T18:25:52.038 INFO:tasks.workunit.client.0.smithi120.stdout:2/471: getdents d13/d7a/d80/d48/d49/d64 0 2021-04-09T18:25:52.043 INFO:tasks.workunit.client.0.smithi120.stdout:8/361: getdents d2/d37/d3e 0 2021-04-09T18:25:52.043 INFO:tasks.workunit.client.0.smithi120.stdout:5/505: rename d10/f6e to d10/d12/fbf 0 2021-04-09T18:25:52.050 INFO:tasks.workunit.client.0.smithi120.stdout:3/426: write d3/d5/d36/d1e/d6b/d49/d4e/d54/f7e [5156168,95893] 0 2021-04-09T18:25:52.052 INFO:tasks.workunit.client.0.smithi120.stdout:0/365: dwrite d0/d2/da/f2c [0,4194304] 0 2021-04-09T18:25:52.054 INFO:tasks.workunit.client.0.smithi120.stdout:8/362: unlink d2/d3/d8/f55 0 2021-04-09T18:25:52.058 INFO:tasks.workunit.client.0.smithi120.stdout:6/406: truncate d6/d8/d3a/d79/f91 279243 0 2021-04-09T18:25:52.058 INFO:tasks.workunit.client.0.smithi120.stdout:0/366: chown d0/d43/f66 544463 1 2021-04-09T18:25:52.058 INFO:tasks.workunit.client.0.smithi120.stdout:5/506: symlink d10/d12/d1b/d1f/d84/d3d/d50/d94/lc0 0 2021-04-09T18:25:52.059 INFO:tasks.workunit.client.0.smithi120.stdout:2/472: rename d13/f2c to d13/d15/f9c 0 2021-04-09T18:25:52.065 INFO:tasks.workunit.client.0.smithi120.stdout:5/507: dread - d10/d12/d1b/d1f/d84/d3d/d50/f83 zero size 2021-04-09T18:25:52.069 INFO:tasks.workunit.client.0.smithi120.stdout:5/508: write d10/d12/d1b/d1f/d84/d3d/f8e [273958,48973] 0 2021-04-09T18:25:52.069 INFO:tasks.workunit.client.0.smithi120.stdout:7/286: sync 2021-04-09T18:25:52.085 INFO:tasks.workunit.client.0.smithi120.stdout:3/427: rename d3/de/f4f to d3/d5/d36/d3d/f8b 0 2021-04-09T18:25:52.094 INFO:tasks.workunit.client.0.smithi120.stdout:2/473: rename d13/d7a/d80/d48/d58/d7e to d13/d7a/d80/d48/d49/d64/d9d 0 2021-04-09T18:25:52.096 INFO:tasks.workunit.client.0.smithi120.stdout:6/407: dread d6/d8/d1a/d36/d5a/d5d/d6e/f80 [0,4194304] 0 2021-04-09T18:25:52.096 INFO:tasks.workunit.client.0.smithi120.stdout:2/474: chown d13/d7a/d80/f33 0 1 2021-04-09T18:25:52.098 INFO:tasks.workunit.client.0.smithi120.stdout:7/287: link db/f1a db/d2c/d30/f66 0 2021-04-09T18:25:52.099 INFO:tasks.workunit.client.0.smithi120.stdout:5/509: creat d10/d12/d1b/d1f/d84/d44/d8c/da3/fc1 x:0 0 0 2021-04-09T18:25:52.100 INFO:tasks.workunit.client.0.smithi120.stdout:7/288: dread - db/d42/d54/d5a/f64 zero size 2021-04-09T18:25:52.101 INFO:tasks.workunit.client.0.smithi120.stdout:7/289: chown f7 57976 1 2021-04-09T18:25:52.102 INFO:tasks.workunit.client.0.smithi120.stdout:6/408: dread - d6/d8/d1a/d36/f3e zero size 2021-04-09T18:25:52.104 INFO:tasks.workunit.client.0.smithi120.stdout:5/510: rmdir d10 39 2021-04-09T18:25:52.105 INFO:tasks.workunit.client.0.smithi120.stdout:8/363: truncate d2/d3/d8/f1d 75926 0 2021-04-09T18:25:52.111 INFO:tasks.workunit.client.0.smithi120.stdout:7/290: creat db/d26/d4c/d53/f67 x:0 0 0 2021-04-09T18:25:52.111 INFO:tasks.workunit.client.0.smithi120.stdout:3/428: getdents d3/d5/d36 0 2021-04-09T18:25:52.112 INFO:tasks.workunit.client.0.smithi120.stdout:8/364: rename d2/d3/d11/d2c to d2/d3/d11/d2c/d44/d71 22 2021-04-09T18:25:52.113 INFO:tasks.workunit.client.0.smithi120.stdout:5/511: dread - d10/d12/d1b/d1f/d84/d44/d8c/da6/fbc zero size 2021-04-09T18:25:52.118 INFO:tasks.workunit.client.0.smithi120.stdout:8/365: rmdir d2/d3/d11/d6a/d3b 39 2021-04-09T18:25:52.119 INFO:tasks.workunit.client.0.smithi120.stdout:5/512: dread d10/d12/d1b/d1f/f63 [0,4194304] 0 2021-04-09T18:25:52.120 INFO:tasks.workunit.client.0.smithi120.stdout:8/366: write d2/d3/d8/f6d [720724,41435] 0 2021-04-09T18:25:52.123 INFO:tasks.workunit.client.0.smithi120.stdout:3/429: dwrite d3/f37 [0,4194304] 0 2021-04-09T18:25:52.125 INFO:tasks.workunit.client.0.smithi120.stdout:2/475: getdents d13/d7a/d80/d48 0 2021-04-09T18:25:52.134 INFO:tasks.workunit.client.0.smithi120.stdout:0/367: dwrite d0/f41 [0,4194304] 0 2021-04-09T18:25:52.137 INFO:tasks.workunit.client.0.smithi120.stdout:3/430: creat d3/d5/d36/d1e/d6b/d49/d4e/f8c x:0 0 0 2021-04-09T18:25:52.139 INFO:tasks.workunit.client.0.smithi120.stdout:3/431: chown d3/d5/d36/d1e/d6b/d6a 17 1 2021-04-09T18:25:52.139 INFO:tasks.workunit.client.0.smithi120.stdout:0/368: rmdir d0/d43 39 2021-04-09T18:25:52.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.120 7f07ca9e0700 1 Processor -- start 2021-04-09T18:25:52.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.120 7f07ca9e0700 1 -- start start 2021-04-09T18:25:52.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.120 7f07ca9e0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f07c40d7160 0x7f07c40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.120 7f07ca9e0700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07c40d55a0 0x7f07c40d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.120 7f07ca9e0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40d5fc0 0x7f07c40d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.120 7f07ca9e0700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c40e80a0 con 0x7f07c40d7160 2021-04-09T18:25:52.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.120 7f07ca9e0700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c40d80f0 con 0x7f07c40d55a0 2021-04-09T18:25:52.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.120 7f07ca9e0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40d6be0 con 0x7f07c40d5fc0 2021-04-09T18:25:52.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c8ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40d5fc0 0x7f07c40d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c8ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40d5fc0 0x7f07c40d63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:43046/0 (socket says 172.21.15.120:43046) 2021-04-09T18:25:52.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c8ffd700 1 -- 172.21.15.120:0/569772271 learned_addr learned my addr 172.21.15.120:0/569772271 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:52.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c3fff700 1 --2- 172.21.15.120:0/569772271 >> v2:172.21.15.120:3300/0 conn(0x7f07c40d7160 0x7f07c40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c37fe700 1 --2- 172.21.15.120:0/569772271 >> v2:172.21.15.134:3300/0 conn(0x7f07c40d55a0 0x7f07c40d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c8ffd700 1 -- 172.21.15.120:0/569772271 >> v2:172.21.15.134:3300/0 conn(0x7f07c40d55a0 msgr2=0x7f07c40d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:52.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c8ffd700 1 --2- 172.21.15.120:0/569772271 >> v2:172.21.15.134:3300/0 conn(0x7f07c40d55a0 0x7f07c40d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c8ffd700 1 -- 172.21.15.120:0/569772271 >> v2:172.21.15.120:3300/0 conn(0x7f07c40d7160 msgr2=0x7f07c40d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:52.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c8ffd700 1 --2- 172.21.15.120:0/569772271 >> v2:172.21.15.120:3300/0 conn(0x7f07c40d7160 0x7f07c40d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c8ffd700 1 -- 172.21.15.120:0/569772271 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c41a2ac0 con 0x7f07c40d5fc0 2021-04-09T18:25:52.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c8ffd700 1 --2- 172.21.15.120:0/569772271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40d5fc0 0x7f07c40d63c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f07bc006aa0 tx=0x7f07bc009f20).ready entity=mon.2 client_cookie=adf2ceb587fcb61 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:52.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.121 7f07c2ffd700 1 -- 172.21.15.120:0/569772271 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07bc000f90 con 0x7f07c40d5fc0 2021-04-09T18:25:52.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.122 7f07c2ffd700 1 -- 172.21.15.120:0/569772271 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc003030 con 0x7f07c40d5fc0 2021-04-09T18:25:52.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.122 7f07c2ffd700 1 -- 172.21.15.120:0/569772271 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07bc00b840 con 0x7f07c40d5fc0 2021-04-09T18:25:52.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.122 7f07ca9e0700 1 -- 172.21.15.120:0/569772271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40d5fc0 msgr2=0x7f07c40d63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.122 7f07ca9e0700 1 --2- 172.21.15.120:0/569772271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40d5fc0 0x7f07c40d63c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f07bc006aa0 tx=0x7f07bc009f20).stop 2021-04-09T18:25:52.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.123 7f07ca9e0700 1 -- 172.21.15.120:0/569772271 shutdown_connections 2021-04-09T18:25:52.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.123 7f07ca9e0700 1 --2- 172.21.15.120:0/569772271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40d5fc0 0x7f07c40d63c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.123 7f07ca9e0700 1 --2- 172.21.15.120:0/569772271 >> v2:172.21.15.134:3300/0 conn(0x7f07c40d55a0 0x7f07c40d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.123 7f07ca9e0700 1 --2- 172.21.15.120:0/569772271 >> v2:172.21.15.120:3300/0 conn(0x7f07c40d7160 0x7f07c40d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.123 7f07ca9e0700 1 -- 172.21.15.120:0/569772271 >> 172.21.15.120:0/569772271 conn(0x7f07c40d1590 msgr2=0x7f07c40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:52.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.123 7f07ca9e0700 1 -- 172.21.15.120:0/569772271 shutdown_connections 2021-04-09T18:25:52.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.123 7f07ca9e0700 1 -- 172.21.15.120:0/569772271 wait complete. 2021-04-09T18:25:52.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.152 7f07ca9e0700 1 Processor -- start 2021-04-09T18:25:52.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.152 7f07ca9e0700 1 -- start start 2021-04-09T18:25:52.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07ca9e0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c418fb80 0x7f07c4190d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07ca9e0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4190210 0x7f07c40b8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07ca9e0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c40b8b90 0x7f07c41a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07ca9e0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c41916f0 con 0x7f07c40b8b90 2021-04-09T18:25:52.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07ca9e0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c4191390 con 0x7f07c4190210 2021-04-09T18:25:52.155 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07ca9e0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c41a1600 con 0x7f07c418fb80 2021-04-09T18:25:52.155 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c8ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c40b8b90 0x7f07c41a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.155 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c8ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c40b8b90 0x7f07c41a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56392/0 (socket says 172.21.15.120:56392) 2021-04-09T18:25:52.155 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c8ffd700 1 -- 172.21.15.120:0/2447991391 learned_addr learned my addr 172.21.15.120:0/2447991391 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:52.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c37fe700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4190210 0x7f07c40b8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c3fff700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c418fb80 0x7f07c4190d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c8ffd700 1 -- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c418fb80 msgr2=0x7f07c4190d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c8ffd700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c418fb80 0x7f07c4190d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c8ffd700 1 -- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4190210 msgr2=0x7f07c40b8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c8ffd700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4190210 0x7f07c40b8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c8ffd700 1 -- 172.21.15.120:0/2447991391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c41a1820 con 0x7f07c40b8b90 2021-04-09T18:25:52.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.153 7f07c3fff700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c418fb80 0x7f07c4190d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:25:52.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.154 7f07c8ffd700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c40b8b90 0x7f07c41a0fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f07bc00b940 tx=0x7f07bc00bce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:52.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.154 7f07c0ff9700 1 -- 172.21.15.120:0/2447991391 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07bc00c570 con 0x7f07c40b8b90 2021-04-09T18:25:52.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.154 7f07c0ff9700 1 -- 172.21.15.120:0/2447991391 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc00c870 con 0x7f07c40b8b90 2021-04-09T18:25:52.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.154 7f07c0ff9700 1 -- 172.21.15.120:0/2447991391 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07bc00ccc0 con 0x7f07c40b8b90 2021-04-09T18:25:52.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.154 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c41a1820 con 0x7f07c40b8b90 2021-04-09T18:25:52.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.154 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c40c0510 con 0x7f07c40b8b90 2021-04-09T18:25:52.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.155 7f07c0ff9700 1 -- 172.21.15.120:0/2447991391 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f07bc00c2f0 con 0x7f07c40b8b90 2021-04-09T18:25:52.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.155 7f07c0ff9700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07a40188c0 0x7f07a401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.155 7f07c0ff9700 1 -- 172.21.15.120:0/2447991391 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f07bc032df0 con 0x7f07c40b8b90 2021-04-09T18:25:52.160 INFO:tasks.workunit.client.0.smithi120.stdout:0/369: dwrite d0/d2/dd/f5e [0,4194304] 0 2021-04-09T18:25:52.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.160 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c4182680 con 0x7f07c40b8b90 2021-04-09T18:25:52.161 INFO:tasks.workunit.client.0.smithi120.stdout:3/432: creat d3/d5/f8d x:0 0 0 2021-04-09T18:25:52.161 INFO:tasks.workunit.client.0.smithi120.stdout:0/370: mkdir d0/d2/da/d23/d6b 0 2021-04-09T18:25:52.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.166 7f07c3fff700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07a40188c0 0x7f07a401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.166 7f07c3fff700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07a40188c0 0x7f07a401adc0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:52.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.167 7f07c0ff9700 1 -- 172.21.15.120:0/2447991391 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f07bc027f80 con 0x7f07c40b8b90 2021-04-09T18:25:52.165 INFO:tasks.workunit.client.0.smithi120.stdout:0/371: unlink d0/d2/d4/d5f/f68 0 2021-04-09T18:25:52.171 INFO:tasks.workunit.client.0.smithi120.stdout:0/372: stat d0/f3c 0 2021-04-09T18:25:52.338 INFO:tasks.workunit.client.0.smithi120.stdout:4/386: sync 2021-04-09T18:25:52.338 INFO:tasks.workunit.client.0.smithi120.stdout:9/423: sync 2021-04-09T18:25:52.339 INFO:tasks.workunit.client.0.smithi120.stdout:0/373: mkdir d0/d5a/d6c 0 2021-04-09T18:25:52.342 INFO:tasks.workunit.client.0.smithi120.stdout:4/387: symlink d1f/d24/l81 0 2021-04-09T18:25:52.344 INFO:tasks.workunit.client.0.smithi120.stdout:9/424: dread d19/d24/d37/d40/d89/d52/f7e [0,4194304] 0 2021-04-09T18:25:52.346 INFO:tasks.workunit.client.0.smithi120.stdout:9/425: write d19/d24/d37/d40/f56 [659449,70656] 0 2021-04-09T18:25:52.353 INFO:tasks.workunit.client.0.smithi120.stdout:3/433: write d3/de/d25/f15 [1800443,32269] 0 2021-04-09T18:25:52.358 INFO:tasks.workunit.client.0.smithi120.stdout:8/367: truncate d2/d3/d11/f34 5521243 0 2021-04-09T18:25:52.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.369 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07c4182680 con 0x7f07c40b8b90 2021-04-09T18:25:52.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.370 7f07c0ff9700 1 -- 172.21.15.120:0/2447991391 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f07bc027f80 con 0x7f07c40b8b90 2021-04-09T18:25:52.363 INFO:tasks.workunit.client.0.smithi120.stdout:2/476: dread f4 [0,4194304] 0 2021-04-09T18:25:52.364 INFO:tasks.workunit.client.0.smithi120.stdout:8/368: creat d2/d3/d11/d6a/d3b/f72 x:0 0 0 2021-04-09T18:25:52.365 INFO:tasks.workunit.client.0.smithi120.stdout:3/434: link d3/d5/d36/d1e/d6b/d49/d4e/l5a d3/d5/d36/d1e/d38/l8e 0 2021-04-09T18:25:52.366 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2021-04-09T18:25:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:52.366 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:52.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.376 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07a40188c0 msgr2=0x7f07a401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.376 7f07ca9e0700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07a40188c0 0x7f07a401adc0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.377 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c40b8b90 msgr2=0x7f07c41a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.377 7f07ca9e0700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c40b8b90 0x7f07c41a0fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f07bc00b940 tx=0x7f07bc00bce0).stop 2021-04-09T18:25:52.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.377 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 shutdown_connections 2021-04-09T18:25:52.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.377 7f07ca9e0700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c40b8b90 0x7f07c41a0fe0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.377 7f07ca9e0700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4190210 0x7f07c40b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.377 7f07ca9e0700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07a40188c0 0x7f07a401adc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.377 7f07ca9e0700 1 --2- 172.21.15.120:0/2447991391 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c418fb80 0x7f07c4190d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.377 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 >> 172.21.15.120:0/2447991391 conn(0x7f07c4195530 msgr2=0x7f07c4099e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:52.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.378 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 shutdown_connections 2021-04-09T18:25:52.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.378 7f07ca9e0700 1 -- 172.21.15.120:0/2447991391 wait complete. 2021-04-09T18:25:52.373 INFO:tasks.workunit.client.0.smithi120.stdout:2/477: dwrite d13/d7a/d80/d48/d49/d64/f74 [0,4194304] 0 2021-04-09T18:25:52.378 INFO:tasks.workunit.client.0.smithi120.stdout:2/478: symlink d13/d8d/l9e 0 2021-04-09T18:25:52.378 INFO:tasks.workunit.client.0.smithi120.stdout:4/388: dwrite d1f/d2c/d56/f72 [0,4194304] 0 2021-04-09T18:25:52.381 INFO:tasks.workunit.client.0.smithi120.stdout:0/374: truncate d0/d2/dd/f5e 1089193 0 2021-04-09T18:25:52.385 INFO:tasks.mds_thrash.fs.[None]:kill mds.a (rank=0) 2021-04-09T18:25:52.385 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:25:52.386 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:25:52.386 INFO:tasks.workunit.client.0.smithi120.stdout:0/375: rename d0/d2/da/f37 to d0/d52/f6d 0 2021-04-09T18:25:52.387 INFO:tasks.workunit.client.0.smithi120.stdout:0/376: fsync d0/d2/f26 0 2021-04-09T18:25:52.391 INFO:tasks.workunit.client.0.smithi120.stdout:9/426: dread d19/f32 [0,4194304] 0 2021-04-09T18:25:52.393 INFO:tasks.workunit.client.0.smithi120.stdout:3/435: dwrite d3/d5/f74 [0,4194304] 0 2021-04-09T18:25:52.404 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:25:52.404 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:52.416 INFO:tasks.workunit.client.0.smithi120.stdout:4/389: dread f1a [0,4194304] 0 2021-04-09T18:25:52.480 INFO:tasks.workunit.client.0.smithi120.stdout:0/377: dread d0/d2/dd/f40 [0,4194304] 0 2021-04-09T18:25:52.482 INFO:tasks.workunit.client.0.smithi120.stdout:0/378: read d0/d2/dd/f38 [889748,84546] 0 2021-04-09T18:25:52.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d891fb700 1 Processor -- start 2021-04-09T18:25:52.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d891fb700 1 -- start start 2021-04-09T18:25:52.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d891fb700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1d840d7160 0x7f1d840d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.614 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d891fb700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1d840d6190 0x7f1d840d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d891fb700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d840d6be0 con 0x7f1d840d55a0 2021-04-09T18:25:52.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d891fb700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d840d80f0 con 0x7f1d840d7160 2021-04-09T18:25:52.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d891fb700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d841a2ac0 con 0x7f1d840d6190 2021-04-09T18:25:52.615 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d82d9d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1d840d7160 0x7f1d840d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d82d9d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1d840d7160 0x7f1d840d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56400/0 (socket says 172.21.15.120:56400) 2021-04-09T18:25:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d82d9d700 1 -- 172.21.15.120:0/3491914515 learned_addr learned my addr 172.21.15.120:0/3491914515 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.600 7f1d8359e700 1 --2- 172.21.15.120:0/3491914515 >> v2:172.21.15.134:3300/0 conn(0x7f1d840d6190 0x7f1d840d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d82d9d700 1 -- 172.21.15.120:0/3491914515 >> v2:172.21.15.134:3300/0 conn(0x7f1d840d6190 msgr2=0x7f1d840d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d82d9d700 1 --2- 172.21.15.120:0/3491914515 >> v2:172.21.15.134:3300/0 conn(0x7f1d840d6190 0x7f1d840d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d82d9d700 1 -- 172.21.15.120:0/3491914515 >> v1:172.21.15.134:6789/0 conn(0x7f1d840d55a0 legacy=0x7f1d840d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d81d9b700 1 -- 172.21.15.120:0/3491914515 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958356919 0 0) 0x7f1d6c000fe0 con 0x7f1d840d55a0 2021-04-09T18:25:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d82d9d700 1 -- 172.21.15.120:0/3491914515 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d841ac1f0 con 0x7f1d840d7160 2021-04-09T18:25:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d82d9d700 1 --2- 172.21.15.120:0/3491914515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840d7160 0x7f1d840d7560 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f1d74006700 tx=0x7f1d74009b80).ready entity=mon.0 client_cookie=87535028c01c3b8f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d81d9b700 1 -- 172.21.15.120:0/3491914515 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1d7400c0c0 con 0x7f1d840d7160 2021-04-09T18:25:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d81d9b700 1 -- 172.21.15.120:0/3491914515 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400c440 con 0x7f1d840d7160 2021-04-09T18:25:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d81d9b700 1 -- 172.21.15.120:0/3491914515 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1d7400c920 con 0x7f1d840d7160 2021-04-09T18:25:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d891fb700 1 -- 172.21.15.120:0/3491914515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840d7160 msgr2=0x7f1d840d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.601 7f1d891fb700 1 --2- 172.21.15.120:0/3491914515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840d7160 0x7f1d840d7560 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f1d74006700 tx=0x7f1d74009b80).stop 2021-04-09T18:25:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.602 7f1d891fb700 1 -- 172.21.15.120:0/3491914515 shutdown_connections 2021-04-09T18:25:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.602 7f1d891fb700 1 --2- 172.21.15.120:0/3491914515 >> v2:172.21.15.134:3300/0 conn(0x7f1d840d6190 0x7f1d840d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.602 7f1d891fb700 1 --2- 172.21.15.120:0/3491914515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840d7160 0x7f1d840d7560 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.602 7f1d891fb700 1 -- 172.21.15.120:0/3491914515 >> 172.21.15.120:0/3491914515 conn(0x7f1d840d1590 msgr2=0x7f1d840d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.602 7f1d891fb700 1 -- 172.21.15.120:0/3491914515 shutdown_connections 2021-04-09T18:25:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.602 7f1d891fb700 1 -- 172.21.15.120:0/3491914515 wait complete. 2021-04-09T18:25:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.621 7f1d891fb700 1 Processor -- start 2021-04-09T18:25:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.621 7f1d891fb700 1 -- start start 2021-04-09T18:25:52.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.621 7f1d891fb700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d8408a9b0 0x7f1d8408b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.621 7f1d891fb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840b1fe0 0x7f1d840b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d891fb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84183f10 0x7f1d84184310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d891fb700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84197600 con 0x7f1d840b1fe0 2021-04-09T18:25:52.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d891fb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8408ae30 con 0x7f1d84183f10 2021-04-09T18:25:52.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d891fb700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8408b990 con 0x7f1d8408a9b0 2021-04-09T18:25:52.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8259c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840b1fe0 0x7f1d840b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8259c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840b1fe0 0x7f1d840b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56408/0 (socket says 172.21.15.120:56408) 2021-04-09T18:25:52.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8259c700 1 -- 172.21.15.120:0/954548275 learned_addr learned my addr 172.21.15.120:0/954548275 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:52.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d82d9d700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d8408a9b0 0x7f1d8408b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8359e700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84183f10 0x7f1d84184310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8259c700 1 -- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d8408a9b0 msgr2=0x7f1d8408b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8259c700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d8408a9b0 0x7f1d8408b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8259c700 1 -- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84183f10 msgr2=0x7f1d84184310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8259c700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84183f10 0x7f1d84184310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8259c700 1 -- 172.21.15.120:0/954548275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d841971c0 con 0x7f1d840b1fe0 2021-04-09T18:25:52.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8359e700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84183f10 0x7f1d84184310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:25:52.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d82d9d700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d8408a9b0 0x7f1d8408b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:25:52.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d8259c700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840b1fe0 0x7f1d840b23e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f1d6c009980 tx=0x7f1d6c00bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:52.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d7b7fe700 1 -- 172.21.15.120:0/954548275 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1d6c003030 con 0x7f1d840b1fe0 2021-04-09T18:25:52.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d7b7fe700 1 -- 172.21.15.120:0/954548275 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c001400 con 0x7f1d840b1fe0 2021-04-09T18:25:52.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d891fb700 1 -- 172.21.15.120:0/954548275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d841971c0 con 0x7f1d840b1fe0 2021-04-09T18:25:52.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d7b7fe700 1 -- 172.21.15.120:0/954548275 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1d6c001850 con 0x7f1d840b1fe0 2021-04-09T18:25:52.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.622 7f1d891fb700 1 -- 172.21.15.120:0/954548275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d841971c0 con 0x7f1d840b1fe0 2021-04-09T18:25:52.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.623 7f1d7b7fe700 1 -- 172.21.15.120:0/954548275 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1d6c0015e0 con 0x7f1d840b1fe0 2021-04-09T18:25:52.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.623 7f1d7b7fe700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1d68018930 0x7f1d6801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:52.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.623 7f1d7b7fe700 1 -- 172.21.15.120:0/954548275 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f1d6c033010 con 0x7f1d840b1fe0 2021-04-09T18:25:52.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.623 7f1d82d9d700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1d68018930 0x7f1d6801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:52.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.623 7f1d82d9d700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1d68018930 0x7f1d6801ae10 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:52.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.645 7f1d891fb700 1 -- 172.21.15.120:0/954548275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d84182a20 con 0x7f1d840b1fe0 2021-04-09T18:25:52.640 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.648 7f1d7b7fe700 1 -- 172.21.15.120:0/954548275 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1d6c00be10 con 0x7f1d840b1fe0 2021-04-09T18:25:52.663 INFO:tasks.workunit.client.0.smithi120.stdout:1/491: sync 2021-04-09T18:25:52.668 INFO:tasks.workunit.client.0.smithi120.stdout:1/492: dwrite d5/d50/f58 [0,4194304] 0 2021-04-09T18:25:52.669 INFO:tasks.workunit.client.0.smithi120.stdout:1/493: stat d5/d64/d2d/d5a/l9a 0 2021-04-09T18:25:52.670 INFO:tasks.workunit.client.0.smithi120.stdout:1/494: chown d5/d1f/d22/d2b/f78 56371872 1 2021-04-09T18:25:52.803 INFO:tasks.workunit.client.0.smithi120.stdout:6/409: sync 2021-04-09T18:25:52.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.836 7f1d891fb700 1 -- 172.21.15.120:0/954548275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d84182a20 con 0x7f1d840b1fe0 2021-04-09T18:25:52.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.837 7f1d7b7fe700 1 -- 172.21.15.120:0/954548275 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f1d6c001400 con 0x7f1d840b1fe0 2021-04-09T18:25:52.830 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2021-04-09T18:25:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:52.831 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:52.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 -- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1d68018930 msgr2=0x7f1d6801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1d68018930 0x7f1d6801ae10 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 -- 172.21.15.120:0/954548275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840b1fe0 msgr2=0x7f1d840b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:52.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840b1fe0 0x7f1d840b23e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f1d6c009980 tx=0x7f1d6c00bcd0).stop 2021-04-09T18:25:52.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 -- 172.21.15.120:0/954548275 shutdown_connections 2021-04-09T18:25:52.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84183f10 0x7f1d84184310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d840b1fe0 0x7f1d840b23e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1d68018930 0x7f1d6801ae10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 --2- 172.21.15.120:0/954548275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d8408a9b0 0x7f1d8408b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:52.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 -- 172.21.15.120:0/954548275 >> 172.21.15.120:0/954548275 conn(0x7f1d8418dcd0 msgr2=0x7f1d84187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:52.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 -- 172.21.15.120:0/954548275 shutdown_connections 2021-04-09T18:25:52.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:52.840 7f1d891fb700 1 -- 172.21.15.120:0/954548275 wait complete. 2021-04-09T18:25:52.843 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:25:52.879 INFO:tasks.workunit.client.0.smithi120.stdout:7/291: sync 2021-04-09T18:25:52.879 INFO:tasks.workunit.client.0.smithi120.stdout:2/479: sync 2021-04-09T18:25:52.880 INFO:tasks.workunit.client.0.smithi120.stdout:5/513: sync 2021-04-09T18:25:54.844 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:55.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.024 7f01f751e700 1 Processor -- start 2021-04-09T18:25:55.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.024 7f01f751e700 1 -- start start 2021-04-09T18:25:55.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f751e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 0x7f01f00d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f751e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f00d63b0 0x7f01f01ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f751e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f00d7960 con 0x7f01f00d7160 2021-04-09T18:25:55.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f751e700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f00d80f0 con 0x7f01f00d7560 2021-04-09T18:25:55.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f751e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00d6be0 con 0x7f01f00d63b0 2021-04-09T18:25:55.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f4b39700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 0x7f01f00d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f4b39700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 0x7f01f00d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56426/0 (socket says 172.21.15.120:56426) 2021-04-09T18:25:55.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f5b3b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f00d63b0 0x7f01f01ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f4b39700 1 -- 172.21.15.120:0/657766557 learned_addr learned my addr 172.21.15.120:0/657766557 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:55.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f4b39700 1 -- 172.21.15.120:0/657766557 >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 msgr2=0x7f01f00d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 16 2021-04-09T18:25:55.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f4b39700 1 -- 172.21.15.120:0/657766557 >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 msgr2=0x7f01f00d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-04-09T18:25:55.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f4b39700 1 --2- 172.21.15.120:0/657766557 >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 0x7f01f00d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:25:55.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f4b39700 1 --2- 172.21.15.120:0/657766557 >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 0x7f01f00d5d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:25:55.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01e3fff700 1 -- 172.21.15.120:0/657766557 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028250520 0 0) 0x7f01e4000fe0 con 0x7f01f00d7160 2021-04-09T18:25:55.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01e3fff700 1 -- 172.21.15.120:0/657766557 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01dc002fe0 con 0x7f01f00d7160 2021-04-09T18:25:55.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f5b3b700 1 -- 172.21.15.120:0/657766557 >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 msgr2=0x7f01f00d5d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-04-09T18:25:55.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f5b3b700 1 --2- 172.21.15.120:0/657766557 >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 0x7f01f00d5d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f5b3b700 1 -- 172.21.15.120:0/657766557 >> v1:172.21.15.134:6789/0 conn(0x7f01f00d7160 legacy=0x7f01f00d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f5b3b700 1 -- 172.21.15.120:0/657766557 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f01a2ac0 con 0x7f01f00d63b0 2021-04-09T18:25:55.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.025 7f01f5b3b700 1 --2- 172.21.15.120:0/657766557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f00d63b0 0x7f01f01ab1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f01e8006ad0 tx=0x7f01e8009ad0).ready entity=mon.2 client_cookie=ef32a63c0fb888d6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:55.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.026 7f01e3fff700 1 -- 172.21.15.120:0/657766557 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01e80022e0 con 0x7f01f00d63b0 2021-04-09T18:25:55.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.026 7f01e3fff700 1 -- 172.21.15.120:0/657766557 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e8006410 con 0x7f01f00d63b0 2021-04-09T18:25:55.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.026 7f01e3fff700 1 -- 172.21.15.120:0/657766557 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01e8002620 con 0x7f01f00d63b0 2021-04-09T18:25:55.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.026 7f01f751e700 1 -- 172.21.15.120:0/657766557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f00d63b0 msgr2=0x7f01f01ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.026 7f01f751e700 1 --2- 172.21.15.120:0/657766557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f00d63b0 0x7f01f01ab1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f01e8006ad0 tx=0x7f01e8009ad0).stop 2021-04-09T18:25:55.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.026 7f01f751e700 1 -- 172.21.15.120:0/657766557 shutdown_connections 2021-04-09T18:25:55.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.026 7f01f751e700 1 --2- 172.21.15.120:0/657766557 >> v2:172.21.15.120:3300/0 conn(0x7f01f00d7560 0x7f01f00d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.026 7f01f751e700 1 --2- 172.21.15.120:0/657766557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f00d63b0 0x7f01f01ab1e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.026 7f01f751e700 1 -- 172.21.15.120:0/657766557 >> 172.21.15.120:0/657766557 conn(0x7f01f00d1590 msgr2=0x7f01f00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:55.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.027 7f01f751e700 1 -- 172.21.15.120:0/657766557 shutdown_connections 2021-04-09T18:25:55.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.027 7f01f751e700 1 -- 172.21.15.120:0/657766557 wait complete. 2021-04-09T18:25:55.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.045 7f01f751e700 1 Processor -- start 2021-04-09T18:25:55.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.045 7f01f751e700 1 -- start start 2021-04-09T18:25:55.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f751e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f019e0e0 0x7f01f019d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f751e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f0182ed0 0x7f01f0181f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f751e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f01832d0 0x7f01f00af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f751e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f019e4e0 con 0x7f01f01832d0 2021-04-09T18:25:55.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f751e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f019dd90 con 0x7f01f019e0e0 2021-04-09T18:25:55.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f751e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0182950 con 0x7f01f0182ed0 2021-04-09T18:25:55.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f5b3b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f01832d0 0x7f01f00af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f5b3b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f01832d0 0x7f01f00af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56430/0 (socket says 172.21.15.120:56430) 2021-04-09T18:25:55.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f5b3b700 1 -- 172.21.15.120:0/3597141349 learned_addr learned my addr 172.21.15.120:0/3597141349 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:55.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f4b39700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f0182ed0 0x7f01f0181f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f5b3b700 1 -- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f0182ed0 msgr2=0x7f01f0181f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f5b3b700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f0182ed0 0x7f01f0181f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f5b3b700 1 -- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f019e0e0 msgr2=0x7f01f019d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f5b3b700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f019e0e0 0x7f01f019d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:25:55.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f5b3b700 1 -- 172.21.15.120:0/3597141349 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f0182570 con 0x7f01f01832d0 2021-04-09T18:25:55.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01f5b3b700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f01832d0 0x7f01f00af870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f01e800b590 tx=0x7f01e800b930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:55.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01e1ffb700 1 -- 172.21.15.120:0/3597141349 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01e8002030 con 0x7f01f01832d0 2021-04-09T18:25:55.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.046 7f01e1ffb700 1 -- 172.21.15.120:0/3597141349 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e8002330 con 0x7f01f01832d0 2021-04-09T18:25:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.047 7f01e1ffb700 1 -- 172.21.15.120:0/3597141349 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01e8002780 con 0x7f01f01832d0 2021-04-09T18:25:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.047 7f01f751e700 1 -- 172.21.15.120:0/3597141349 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f0182570 con 0x7f01f01832d0 2021-04-09T18:25:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.047 7f01f751e700 1 -- 172.21.15.120:0/3597141349 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f0182570 con 0x7f01f01832d0 2021-04-09T18:25:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.047 7f01e1ffb700 1 -- 172.21.15.120:0/3597141349 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f01e8000a70 con 0x7f01f01832d0 2021-04-09T18:25:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.047 7f01e1ffb700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d0018930 0x7f01d001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:55.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.047 7f01e1ffb700 1 -- 172.21.15.120:0/3597141349 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f01e8032cb0 con 0x7f01f01832d0 2021-04-09T18:25:55.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.047 7f01f533a700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d0018930 0x7f01d001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:55.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.048 7f01f533a700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d0018930 0x7f01d001adc0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:55.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.071 7f01f751e700 1 -- 172.21.15.120:0/3597141349 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f0179cb0 con 0x7f01f01832d0 2021-04-09T18:25:55.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.074 7f01e1ffb700 1 -- 172.21.15.120:0/3597141349 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f01e801f780 con 0x7f01f01832d0 2021-04-09T18:25:55.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.254 7f01f751e700 1 -- 172.21.15.120:0/3597141349 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01f0179cb0 con 0x7f01f01832d0 2021-04-09T18:25:55.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.254 7f01e1ffb700 1 -- 172.21.15.120:0/3597141349 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f01e8000a70 con 0x7f01f01832d0 2021-04-09T18:25:55.248 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2021-04-09T18:25:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:55.249 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:55.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 -- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d0018930 msgr2=0x7f01d001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d0018930 0x7f01d001adc0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 -- 172.21.15.120:0/3597141349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f01832d0 msgr2=0x7f01f00af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:55.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f01832d0 0x7f01f00af870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f01e800b590 tx=0x7f01e800b930).stop 2021-04-09T18:25:55.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 -- 172.21.15.120:0/3597141349 shutdown_connections 2021-04-09T18:25:55.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f01832d0 0x7f01f00af870 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d0018930 0x7f01d001adc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f0182ed0 0x7f01f0181f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 --2- 172.21.15.120:0/3597141349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f019e0e0 0x7f01f019d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:25:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 -- 172.21.15.120:0/3597141349 >> 172.21.15.120:0/3597141349 conn(0x7f01f0184f60 msgr2=0x7f01f0094050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 -- 172.21.15.120:0/3597141349 shutdown_connections 2021-04-09T18:25:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:55.257 7f01f751e700 1 -- 172.21.15.120:0/3597141349 wait complete. 2021-04-09T18:25:55.260 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:25:57.261 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:57.452 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.439 7fa74f9bf700 1 Processor -- start 2021-04-09T18:25:57.453 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.439 7fa74f9bf700 1 -- start start 2021-04-09T18:25:57.453 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74f9bf700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7480d7160 0x7fa7480d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.453 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74f9bf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7480d55a0 0x7fa7480d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.454 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74f9bf700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa7480d5fc0 0x7fa7480d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.454 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74f9bf700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480e80a0 con 0x7fa7480d7160 2021-04-09T18:25:57.454 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74f9bf700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480d80f0 con 0x7fa7480d5fc0 2021-04-09T18:25:57.454 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74f9bf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480d6be0 con 0x7fa7480d55a0 2021-04-09T18:25:57.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74d7db700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7480d7160 0x7fa7480d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74d7db700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7480d7160 0x7fa7480d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56442/0 (socket says 172.21.15.120:56442) 2021-04-09T18:25:57.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74d7db700 1 -- 172.21.15.120:0/3260023629 learned_addr learned my addr 172.21.15.120:0/3260023629 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:57.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74dfdc700 1 --2- 172.21.15.120:0/3260023629 >> v2:172.21.15.134:3300/0 conn(0x7fa7480d5fc0 0x7fa7480d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.455 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74cfda700 1 --2- 172.21.15.120:0/3260023629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7480d55a0 0x7fa7480d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74d7db700 1 -- 172.21.15.120:0/3260023629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7480d55a0 msgr2=0x7fa7480d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:57.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74d7db700 1 --2- 172.21.15.120:0/3260023629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7480d55a0 0x7fa7480d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74d7db700 1 -- 172.21.15.120:0/3260023629 >> v2:172.21.15.134:3300/0 conn(0x7fa7480d5fc0 msgr2=0x7fa7480d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:57.456 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74d7db700 1 --2- 172.21.15.120:0/3260023629 >> v2:172.21.15.134:3300/0 conn(0x7fa7480d5fc0 0x7fa7480d63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.440 7fa74d7db700 1 -- 172.21.15.120:0/3260023629 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7481a2ac0 con 0x7fa7480d7160 2021-04-09T18:25:57.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.441 7fa74d7db700 1 --2- 172.21.15.120:0/3260023629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7480d7160 0x7fa7480d7560 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fa744006700 tx=0x7fa744009b00).ready entity=mon.0 client_cookie=ffdb47bc2b1c0a92 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:57.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.441 7fa73ffff700 1 -- 172.21.15.120:0/3260023629 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa74400c0c0 con 0x7fa7480d7160 2021-04-09T18:25:57.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.441 7fa73ffff700 1 -- 172.21.15.120:0/3260023629 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74400c400 con 0x7fa7480d7160 2021-04-09T18:25:57.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.441 7fa73ffff700 1 -- 172.21.15.120:0/3260023629 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa74400c8e0 con 0x7fa7480d7160 2021-04-09T18:25:57.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.441 7fa74f9bf700 1 -- 172.21.15.120:0/3260023629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7480d7160 msgr2=0x7fa7480d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.441 7fa74f9bf700 1 --2- 172.21.15.120:0/3260023629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7480d7160 0x7fa7480d7560 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fa744006700 tx=0x7fa744009b00).stop 2021-04-09T18:25:57.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.442 7fa74f9bf700 1 -- 172.21.15.120:0/3260023629 shutdown_connections 2021-04-09T18:25:57.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.442 7fa74f9bf700 1 --2- 172.21.15.120:0/3260023629 >> v2:172.21.15.134:3300/0 conn(0x7fa7480d5fc0 0x7fa7480d63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.442 7fa74f9bf700 1 --2- 172.21.15.120:0/3260023629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7480d55a0 0x7fa7480d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.442 7fa74f9bf700 1 --2- 172.21.15.120:0/3260023629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7480d7160 0x7fa7480d7560 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.442 7fa74f9bf700 1 -- 172.21.15.120:0/3260023629 >> 172.21.15.120:0/3260023629 conn(0x7fa7480d1590 msgr2=0x7fa7480d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:57.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.442 7fa74f9bf700 1 -- 172.21.15.120:0/3260023629 shutdown_connections 2021-04-09T18:25:57.459 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.442 7fa74f9bf700 1 -- 172.21.15.120:0/3260023629 wait complete. 2021-04-09T18:25:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.460 7fa74f9bf700 1 Processor -- start 2021-04-09T18:25:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.460 7fa74f9bf700 1 -- start start 2021-04-09T18:25:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74f9bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa748191390 0x7fa74808ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74f9bf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7480b1f70 0x7fa7480b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74f9bf700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7481838d0 0x7fa748183cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74f9bf700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74808b330 con 0x7fa748191390 2021-04-09T18:25:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74f9bf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481842f0 con 0x7fa7480b1f70 2021-04-09T18:25:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74f9bf700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa748184510 con 0x7fa7481838d0 2021-04-09T18:25:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74d7db700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa748191390 0x7fa74808ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74d7db700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa748191390 0x7fa74808ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56450/0 (socket says 172.21.15.120:56450) 2021-04-09T18:25:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74d7db700 1 -- 172.21.15.120:0/3288968240 learned_addr learned my addr 172.21.15.120:0/3288968240 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:57.465 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74cfda700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7480b1f70 0x7fa7480b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.465 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74dfdc700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7481838d0 0x7fa748183cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.465 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74d7db700 1 -- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7481838d0 msgr2=0x7fa748183cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.465 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74d7db700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7481838d0 0x7fa748183cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.466 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74d7db700 1 -- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7480b1f70 msgr2=0x7fa7480b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.466 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74d7db700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7480b1f70 0x7fa7480b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.466 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74d7db700 1 -- 172.21.15.120:0/3288968240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480b9ca0 con 0x7fa748191390 2021-04-09T18:25:57.466 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.461 7fa74d7db700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa748191390 0x7fa74808ad10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fa74400b660 tx=0x7fa74400ba00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:57.466 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.462 7fa73dffb700 1 -- 172.21.15.120:0/3288968240 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa744009440 con 0x7fa748191390 2021-04-09T18:25:57.467 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.462 7fa73dffb700 1 -- 172.21.15.120:0/3288968240 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744006390 con 0x7fa748191390 2021-04-09T18:25:57.467 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.462 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7480b9ca0 con 0x7fa748191390 2021-04-09T18:25:57.467 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.462 7fa73dffb700 1 -- 172.21.15.120:0/3288968240 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa744002030 con 0x7fa748191390 2021-04-09T18:25:57.467 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.462 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7480b9ca0 con 0x7fa748191390 2021-04-09T18:25:57.468 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.462 7fa73dffb700 1 -- 172.21.15.120:0/3288968240 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa7440093e0 con 0x7fa748191390 2021-04-09T18:25:57.468 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.462 7fa73dffb700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa728018930 0x7fa72801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:57.468 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.462 7fa73dffb700 1 -- 172.21.15.120:0/3288968240 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fa744032cb0 con 0x7fa748191390 2021-04-09T18:25:57.468 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.463 7fa74cfda700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa728018930 0x7fa72801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:57.468 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.463 7fa74cfda700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa728018930 0x7fa72801ae10 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:57.478 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.486 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74818cc10 con 0x7fa748191390 2021-04-09T18:25:57.482 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.489 7fa73dffb700 1 -- 172.21.15.120:0/3288968240 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa744006370 con 0x7fa748191390 2021-04-09T18:25:57.659 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.666 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa74818cc10 con 0x7fa748191390 2021-04-09T18:25:57.660 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.667 7fa73dffb700 1 -- 172.21.15.120:0/3288968240 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fa74400bdf0 con 0x7fa748191390 2021-04-09T18:25:57.660 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2021-04-09T18:25:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:25:57.661 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:25:57.662 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa728018930 msgr2=0x7fa72801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa728018930 0x7fa72801ae10 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa748191390 msgr2=0x7fa74808ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:57.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa748191390 0x7fa74808ad10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fa74400b660 tx=0x7fa74400ba00).stop 2021-04-09T18:25:57.663 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 shutdown_connections 2021-04-09T18:25:57.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa728018930 0x7fa72801ae10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7481838d0 0x7fa748183cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7480b1f70 0x7fa7480b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 --2- 172.21.15.120:0/3288968240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa748191390 0x7fa74808ad10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:57.664 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 >> 172.21.15.120:0/3288968240 conn(0x7fa74819a7e0 msgr2=0x7fa748093af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:57.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.669 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 shutdown_connections 2021-04-09T18:25:57.665 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:57.670 7fa74f9bf700 1 -- 172.21.15.120:0/3288968240 wait complete. 2021-04-09T18:25:57.672 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:25:59.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:25:59.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.858 7ff183a22700 1 Processor -- start 2021-04-09T18:25:59.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.858 7ff183a22700 1 -- start start 2021-04-09T18:25:59.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.858 7ff183a22700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c0d7560 0x7ff17c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:59.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.858 7ff183a22700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c0d7960 con 0x7ff17c0d63b0 2021-04-09T18:25:59.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.858 7ff183a22700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c0d6be0 con 0x7ff17c0d7160 2021-04-09T18:25:59.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.858 7ff183a22700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c1a2ac0 con 0x7ff17c0d7560 2021-04-09T18:25:59.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.858 7ff18203f700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff17c0d63b0 0x7ff17c1ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51372/0 (socket says 172.21.15.120:51372) 2021-04-09T18:25:59.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.858 7ff18203f700 1 -- 172.21.15.120:0/1443390716 learned_addr learned my addr 172.21.15.120:0/1443390716 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:25:59.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18103d700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c0d7560 0x7ff17c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:59.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811435610 0 0) 0x7ff174000d30 con 0x7ff17c0d63b0 2021-04-09T18:25:59.877 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff164002fe0 con 0x7ff17c0d63b0 2021-04-09T18:25:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047713949 0 0) 0x7ff16c001080 con 0x7ff17c0d7160 2021-04-09T18:25:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff164003210 con 0x7ff17c0d7160 2021-04-09T18:25:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 466767665 0 0) 0x7ff174001460 con 0x7ff17c0d63b0 2021-04-09T18:25:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c0d7560 msgr2=0x7ff17c0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c0d7560 0x7ff17c0d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 >> v1:172.21.15.134:6789/0 conn(0x7ff17c0d7160 legacy=0x7ff17c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c1a2cb0 con 0x7ff17c0d63b0 2021-04-09T18:25:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7ff174001980 con 0x7ff17c0d63b0 2021-04-09T18:25:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 >> v1:172.21.15.120:6789/0 conn(0x7ff17c0d63b0 legacy=0x7ff17c1ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff164003b90 0x7ff164005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff164006820 0x7ff164008d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1640095a0 0x7ff16400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff164050380 con 0x7ff1640095a0 2021-04-09T18:25:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff164050560 con 0x7ff164006820 2021-04-09T18:25:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18083c700 1 -- 172.21.15.120:0/1443390716 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff164050780 con 0x7ff164003b90 2021-04-09T18:25:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18103d700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c0d7560 0x7ff17c0d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:25:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18203f700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1640095a0 0x7ff16400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18183e700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff164003b90 0x7ff164005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:59.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18203f700 1 -- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff164003b90 msgr2=0x7ff164005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:59.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18203f700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff164003b90 0x7ff164005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:59.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18203f700 1 -- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff164006820 msgr2=0x7ff164008d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:25:59.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.859 7ff18203f700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff164006820 0x7ff164008d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-04-09T18:25:59.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.860 7ff18203f700 1 -- 172.21.15.120:0/1443390716 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff164050a20 con 0x7ff1640095a0 2021-04-09T18:25:59.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.860 7ff18203f700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1640095a0 0x7ff16400bac0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7ff174007c70 tx=0x7ff17400a310).ready entity=mon.0 client_cookie=3912aa928caf03b0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:59.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.860 7ff18083c700 1 -- 172.21.15.120:0/1443390716 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1740070c0 con 0x7ff1640095a0 2021-04-09T18:25:59.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.860 7ff18083c700 1 -- 172.21.15.120:0/1443390716 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1740073c0 con 0x7ff1640095a0 2021-04-09T18:25:59.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.860 7ff18083c700 1 -- 172.21.15.120:0/1443390716 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff17400ab90 con 0x7ff1640095a0 2021-04-09T18:25:59.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.860 7ff183a22700 1 -- 172.21.15.120:0/1443390716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1640095a0 msgr2=0x7ff16400bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:59.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.860 7ff183a22700 1 --2- 172.21.15.120:0/1443390716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1640095a0 0x7ff16400bac0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7ff174007c70 tx=0x7ff17400a310).stop 2021-04-09T18:25:59.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.860 7ff18203f700 1 -- 172.21.15.120:0/1443390716 reap_dead start 2021-04-09T18:25:59.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.861 7ff183a22700 1 -- 172.21.15.120:0/1443390716 shutdown_connections 2021-04-09T18:25:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.861 7ff183a22700 1 -- 172.21.15.120:0/1443390716 >> 172.21.15.120:0/1443390716 conn(0x7ff17c0d1590 msgr2=0x7ff17c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:25:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.861 7ff183a22700 1 -- 172.21.15.120:0/1443390716 shutdown_connections 2021-04-09T18:25:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.861 7ff183a22700 1 -- 172.21.15.120:0/1443390716 wait complete. 2021-04-09T18:25:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff183a22700 1 Processor -- start 2021-04-09T18:25:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff183a22700 1 -- start start 2021-04-09T18:25:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff183a22700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c1971c0 0x7ff17c193ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff183a22700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff17c18ad80 0x7ff17c18b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff183a22700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff17c18bd70 0x7ff17c18c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff183a22700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0b0e80 con 0x7ff17c18ad80 2021-04-09T18:25:59.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff183a22700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0b1070 con 0x7ff17c18bd70 2021-04-09T18:25:59.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff183a22700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0b1290 con 0x7ff17c1971c0 2021-04-09T18:25:59.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18103d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff17c18ad80 0x7ff17c18b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:59.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18103d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff17c18ad80 0x7ff17c18b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56470/0 (socket says 172.21.15.120:56470) 2021-04-09T18:25:59.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18103d700 1 -- 172.21.15.120:0/1561784225 learned_addr learned my addr 172.21.15.120:0/1561784225 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:25:59.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18183e700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c1971c0 0x7ff17c193ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:59.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18203f700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff17c18bd70 0x7ff17c18c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:59.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18103d700 1 -- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c1971c0 msgr2=0x7ff17c193ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:59.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18103d700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c1971c0 0x7ff17c193ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:59.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18103d700 1 -- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff17c18bd70 msgr2=0x7ff17c18c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:25:59.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18103d700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff17c18bd70 0x7ff17c18c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:25:59.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18103d700 1 -- 172.21.15.120:0/1561784225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c0b14b0 con 0x7ff17c18ad80 2021-04-09T18:25:59.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18183e700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c1971c0 0x7ff17c193ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:25:59.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.880 7ff18203f700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff17c18bd70 0x7ff17c18c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:25:59.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.881 7ff18103d700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff17c18ad80 0x7ff17c18b180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7ff170006f60 tx=0x7ff17000b970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:59.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.881 7ff17a7fc700 1 -- 172.21.15.120:0/1561784225 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff170000b50 con 0x7ff17c18ad80 2021-04-09T18:25:59.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.881 7ff17a7fc700 1 -- 172.21.15.120:0/1561784225 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170002030 con 0x7ff17c18ad80 2021-04-09T18:25:59.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.881 7ff183a22700 1 -- 172.21.15.120:0/1561784225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17c0b14b0 con 0x7ff17c18ad80 2021-04-09T18:25:59.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.881 7ff17a7fc700 1 -- 172.21.15.120:0/1561784225 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff170002510 con 0x7ff17c18ad80 2021-04-09T18:25:59.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.881 7ff183a22700 1 -- 172.21.15.120:0/1561784225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c0b14b0 con 0x7ff17c18ad80 2021-04-09T18:25:59.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.881 7ff17a7fc700 1 -- 172.21.15.120:0/1561784225 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff170002210 con 0x7ff17c18ad80 2021-04-09T18:25:59.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.882 7ff17a7fc700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff15c018930 0x7ff15c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:25:59.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.882 7ff17a7fc700 1 -- 172.21.15.120:0/1561784225 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ff170032c30 con 0x7ff17c18ad80 2021-04-09T18:25:59.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.882 7ff18183e700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff15c018930 0x7ff15c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:25:59.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.882 7ff18183e700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff15c018930 0x7ff15c01ae10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:25:59.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.904 7ff183a22700 1 -- 172.21.15.120:0/1561784225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c182a20 con 0x7ff17c18ad80 2021-04-09T18:25:59.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:25:59.908 7ff17a7fc700 1 -- 172.21.15.120:0/1561784225 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff170000940 con 0x7ff17c18ad80 2021-04-09T18:26:00.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.085 7ff183a22700 1 -- 172.21.15.120:0/1561784225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff17c182a20 con 0x7ff17c18ad80 2021-04-09T18:26:00.078 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.085 7ff17a7fc700 1 -- 172.21.15.120:0/1561784225 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2107 (secure 0 0 0) 0x7ff17000bd60 con 0x7ff17c18ad80 2021-04-09T18:26:00.079 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2021-04-09T18:26:00.079 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:00.079 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:00.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 -- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff15c018930 msgr2=0x7ff15c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:00.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff15c018930 0x7ff15c01ae10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:00.081 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 -- 172.21.15.120:0/1561784225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff17c18ad80 msgr2=0x7ff17c18b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:00.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff17c18ad80 0x7ff17c18b180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7ff170006f60 tx=0x7ff17000b970).stop 2021-04-09T18:26:00.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 -- 172.21.15.120:0/1561784225 shutdown_connections 2021-04-09T18:26:00.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff17c18bd70 0x7ff17c18c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:00.082 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff17c18ad80 0x7ff17c18b180 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:00.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff15c018930 0x7ff15c01ae10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:00.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 --2- 172.21.15.120:0/1561784225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff17c1971c0 0x7ff17c193ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:00.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 -- 172.21.15.120:0/1561784225 >> 172.21.15.120:0/1561784225 conn(0x7ff17c18dcd0 msgr2=0x7ff17c187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:00.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 -- 172.21.15.120:0/1561784225 shutdown_connections 2021-04-09T18:26:00.083 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:00.088 7ff183a22700 1 -- 172.21.15.120:0/1561784225 wait complete. 2021-04-09T18:26:00.091 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:26:01.462 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:01.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:02.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.270 7fea4b478700 1 Processor -- start 2021-04-09T18:26:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.270 7fea4b478700 1 -- start start 2021-04-09T18:26:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea4b478700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea440d7560 0x7fea440d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea4b478700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea440d63b0 0x7fea441ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea4b478700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea440d7960 con 0x7fea440d7160 2021-04-09T18:26:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea4b478700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea440d80f0 con 0x7fea440d63b0 2021-04-09T18:26:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea4b478700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea440d6be0 con 0x7fea440d7560 2021-04-09T18:26:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea49294700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fea440d7160 0x7fea440d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51390/0 (socket says 172.21.15.120:51390) 2021-04-09T18:26:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea49294700 1 -- 172.21.15.120:0/2879448319 learned_addr learned my addr 172.21.15.120:0/2879448319 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:26:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea48a93700 1 --2- 172.21.15.120:0/2879448319 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea440d7560 0x7fea440d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea49a95700 1 --2- 172.21.15.120:0/2879448319 >> v2:172.21.15.134:3300/0 conn(0x7fea440d63b0 0x7fea441ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea43fff700 1 -- 172.21.15.120:0/2879448319 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196864424 0 0) 0x7fea2c001060 con 0x7fea440d7160 2021-04-09T18:26:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.271 7fea43fff700 1 -- 172.21.15.120:0/2879448319 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea30002fe0 con 0x7fea440d7160 2021-04-09T18:26:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea43fff700 1 -- 172.21.15.120:0/2879448319 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4109530717 0 0) 0x7fea2c001460 con 0x7fea440d7160 2021-04-09T18:26:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea48a93700 1 -- 172.21.15.120:0/2879448319 >> v2:172.21.15.134:3300/0 conn(0x7fea440d63b0 msgr2=0x7fea441ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:02.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea48a93700 1 --2- 172.21.15.120:0/2879448319 >> v2:172.21.15.134:3300/0 conn(0x7fea440d63b0 0x7fea441ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea48a93700 1 -- 172.21.15.120:0/2879448319 >> v1:172.21.15.120:6789/0 conn(0x7fea440d7160 legacy=0x7fea440d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:02.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea48a93700 1 -- 172.21.15.120:0/2879448319 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea441a2ac0 con 0x7fea440d7560 2021-04-09T18:26:02.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea49a95700 1 --2- 172.21.15.120:0/2879448319 >> v2:172.21.15.134:3300/0 conn(0x7fea440d63b0 0x7fea441ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:02.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea48a93700 1 --2- 172.21.15.120:0/2879448319 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea440d7560 0x7fea440d5d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fea34006650 tx=0x7fea34009a80).ready entity=mon.2 client_cookie=91ac0b682593e507 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:02.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea43fff700 1 -- 172.21.15.120:0/2879448319 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea340009b0 con 0x7fea440d7560 2021-04-09T18:26:02.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea43fff700 1 -- 172.21.15.120:0/2879448319 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3400c0c0 con 0x7fea440d7560 2021-04-09T18:26:02.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea43fff700 1 -- 172.21.15.120:0/2879448319 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea340009b0 con 0x7fea440d7560 2021-04-09T18:26:02.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea4b478700 1 -- 172.21.15.120:0/2879448319 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea440d7560 msgr2=0x7fea440d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:02.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.272 7fea4b478700 1 --2- 172.21.15.120:0/2879448319 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea440d7560 0x7fea440d5d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fea34006650 tx=0x7fea34009a80).stop 2021-04-09T18:26:02.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.273 7fea4b478700 1 -- 172.21.15.120:0/2879448319 shutdown_connections 2021-04-09T18:26:02.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.273 7fea4b478700 1 --2- 172.21.15.120:0/2879448319 >> v2:172.21.15.134:3300/0 conn(0x7fea440d63b0 0x7fea441ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.273 7fea4b478700 1 --2- 172.21.15.120:0/2879448319 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea440d7560 0x7fea440d5d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.273 7fea4b478700 1 -- 172.21.15.120:0/2879448319 >> 172.21.15.120:0/2879448319 conn(0x7fea440d1590 msgr2=0x7fea440d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:02.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.273 7fea4b478700 1 -- 172.21.15.120:0/2879448319 shutdown_connections 2021-04-09T18:26:02.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.273 7fea4b478700 1 -- 172.21.15.120:0/2879448319 wait complete. 2021-04-09T18:26:02.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.291 7fea4b478700 1 Processor -- start 2021-04-09T18:26:02.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.291 7fea4b478700 1 -- start start 2021-04-09T18:26:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea4b478700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea44187380 0x7fea44189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea4b478700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea44187780 0x7fea440987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea4b478700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea44189c50 0x7fea440b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea4b478700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4418ce60 con 0x7fea44189c50 2021-04-09T18:26:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea4b478700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea44098e10 con 0x7fea44187780 2021-04-09T18:26:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea4b478700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea44099030 con 0x7fea44187380 2021-04-09T18:26:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea49a95700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea44189c50 0x7fea440b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea49a95700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea44189c50 0x7fea440b8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56488/0 (socket says 172.21.15.120:56488) 2021-04-09T18:26:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea49a95700 1 -- 172.21.15.120:0/667290116 learned_addr learned my addr 172.21.15.120:0/667290116 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea49294700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea44187380 0x7fea44189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.292 7fea48a93700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea44187780 0x7fea440987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea49a95700 1 -- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea44187380 msgr2=0x7fea44189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea49a95700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea44187380 0x7fea44189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea49a95700 1 -- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea44187780 msgr2=0x7fea440987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea49a95700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea44187780 0x7fea440987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea49a95700 1 -- 172.21.15.120:0/667290116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440b8b30 con 0x7fea44189c50 2021-04-09T18:26:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea49a95700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea44189c50 0x7fea440b8510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fea3c00d7d0 tx=0x7fea3c00db70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea41ffb700 1 -- 172.21.15.120:0/667290116 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea3c000c10 con 0x7fea44189c50 2021-04-09T18:26:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea41ffb700 1 -- 172.21.15.120:0/667290116 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c00b080 con 0x7fea44189c50 2021-04-09T18:26:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea4b478700 1 -- 172.21.15.120:0/667290116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea440b8b30 con 0x7fea44189c50 2021-04-09T18:26:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea41ffb700 1 -- 172.21.15.120:0/667290116 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fea3c0096e0 con 0x7fea44189c50 2021-04-09T18:26:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.293 7fea4b478700 1 -- 172.21.15.120:0/667290116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea440b8b30 con 0x7fea44189c50 2021-04-09T18:26:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.294 7fea41ffb700 1 -- 172.21.15.120:0/667290116 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fea3c009250 con 0x7fea44189c50 2021-04-09T18:26:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.294 7fea41ffb700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fea28018930 0x7fea2801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.294 7fea41ffb700 1 -- 172.21.15.120:0/667290116 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fea3c034e80 con 0x7fea44189c50 2021-04-09T18:26:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.294 7fea49294700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fea28018930 0x7fea2801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.294 7fea49294700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fea28018930 0x7fea2801ae10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:02.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.317 7fea4b478700 1 -- 172.21.15.120:0/667290116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea44189100 con 0x7fea44189c50 2021-04-09T18:26:02.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.320 7fea41ffb700 1 -- 172.21.15.120:0/667290116 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fea3c006370 con 0x7fea44189c50 2021-04-09T18:26:02.489 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.497 7fea4b478700 1 -- 172.21.15.120:0/667290116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea44189100 con 0x7fea44189c50 2021-04-09T18:26:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.497 7fea41ffb700 1 -- 172.21.15.120:0/667290116 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fea3c00afe0 con 0x7fea44189c50 2021-04-09T18:26:02.490 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2021-04-09T18:26:02.491 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:02.491 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:02.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.499 7fea4b478700 1 -- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fea28018930 msgr2=0x7fea2801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.499 7fea4b478700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fea28018930 0x7fea2801ae10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.499 7fea4b478700 1 -- 172.21.15.120:0/667290116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea44189c50 msgr2=0x7fea440b8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.499 7fea4b478700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea44189c50 0x7fea440b8510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fea3c00d7d0 tx=0x7fea3c00db70).stop 2021-04-09T18:26:02.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.500 7fea4b478700 1 -- 172.21.15.120:0/667290116 shutdown_connections 2021-04-09T18:26:02.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.500 7fea4b478700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea44189c50 0x7fea440b8510 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.500 7fea4b478700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea44187780 0x7fea440987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.500 7fea4b478700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fea28018930 0x7fea2801ae10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.500 7fea4b478700 1 --2- 172.21.15.120:0/667290116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea44187380 0x7fea44189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.500 7fea4b478700 1 -- 172.21.15.120:0/667290116 >> 172.21.15.120:0/667290116 conn(0x7fea4418dc90 msgr2=0x7fea4408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.500 7fea4b478700 1 -- 172.21.15.120:0/667290116 shutdown_connections 2021-04-09T18:26:02.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:02.500 7fea4b478700 1 -- 172.21.15.120:0/667290116 wait complete. 2021-04-09T18:26:02.502 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:26:04.503 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:04.696 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.682 7f0587c68700 1 Processor -- start 2021-04-09T18:26:04.696 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.682 7f0587c68700 1 -- start start 2021-04-09T18:26:04.696 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0587c68700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05800eac40 0x7f05800dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:04.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0587c68700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05800d61e0 con 0x7f05800d1b40 2021-04-09T18:26:04.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0587c68700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05800f38e0 con 0x7f05800d6760 2021-04-09T18:26:04.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0587c68700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800eaa10 con 0x7f05800eac40 2021-04-09T18:26:04.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0585283700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f05800d1b40 0x7f0580088000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51412/0 (socket says 172.21.15.120:51412) 2021-04-09T18:26:04.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0585283700 1 -- 172.21.15.120:0/951664737 learned_addr learned my addr 172.21.15.120:0/951664737 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:26:04.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0585a84700 1 --2- 172.21.15.120:0/951664737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05800eac40 0x7f05800dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:04.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0584a82700 1 -- 172.21.15.120:0/951664737 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192313 0 0) 0x7f05700009b0 con 0x7f05800d1b40 2021-04-09T18:26:04.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0584a82700 1 -- 172.21.15.120:0/951664737 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f056c002fe0 con 0x7f05800d1b40 2021-04-09T18:26:04.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0584a82700 1 -- 172.21.15.120:0/951664737 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044575538 0 0) 0x7f0578000d30 con 0x7f05800d6760 2021-04-09T18:26:04.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0584a82700 1 -- 172.21.15.120:0/951664737 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f056c003210 con 0x7f05800d6760 2021-04-09T18:26:04.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0584a82700 1 -- 172.21.15.120:0/951664737 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2876897095 0 0) 0x7f0570001010 con 0x7f05800d1b40 2021-04-09T18:26:04.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0585a84700 1 -- 172.21.15.120:0/951664737 >> v1:172.21.15.134:6789/0 conn(0x7f05800d6760 legacy=0x7f05800d5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:04.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0585a84700 1 -- 172.21.15.120:0/951664737 >> v1:172.21.15.120:6789/0 conn(0x7f05800d1b40 legacy=0x7f0580088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:04.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.683 7f0585a84700 1 -- 172.21.15.120:0/951664737 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05800887f0 con 0x7f05800eac40 2021-04-09T18:26:04.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.684 7f0585a84700 1 --2- 172.21.15.120:0/951664737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05800eac40 0x7f05800dc6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f057c006650 tx=0x7f057c009a80).ready entity=mon.2 client_cookie=dad7743f82c789d2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:04.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.684 7f0584a82700 1 -- 172.21.15.120:0/951664737 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f057c0009b0 con 0x7f05800eac40 2021-04-09T18:26:04.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.684 7f0584a82700 1 -- 172.21.15.120:0/951664737 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c00c0c0 con 0x7f05800eac40 2021-04-09T18:26:04.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.684 7f0584a82700 1 -- 172.21.15.120:0/951664737 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f057c00c510 con 0x7f05800eac40 2021-04-09T18:26:04.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.684 7f0587c68700 1 -- 172.21.15.120:0/951664737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05800eac40 msgr2=0x7f05800dc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:04.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.684 7f0587c68700 1 --2- 172.21.15.120:0/951664737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05800eac40 0x7f05800dc6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f057c006650 tx=0x7f057c009a80).stop 2021-04-09T18:26:04.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.685 7f0587c68700 1 -- 172.21.15.120:0/951664737 shutdown_connections 2021-04-09T18:26:04.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.685 7f0587c68700 1 --2- 172.21.15.120:0/951664737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05800eac40 0x7f05800dc6b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:04.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.685 7f0587c68700 1 -- 172.21.15.120:0/951664737 >> 172.21.15.120:0/951664737 conn(0x7f05800e93c0 msgr2=0x7f0580100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:04.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.685 7f0587c68700 1 -- 172.21.15.120:0/951664737 shutdown_connections 2021-04-09T18:26:04.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.685 7f0587c68700 1 -- 172.21.15.120:0/951664737 wait complete. 2021-04-09T18:26:04.703 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.703 7f0587c68700 1 Processor -- start 2021-04-09T18:26:04.703 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.703 7f0587c68700 1 -- start start 2021-04-09T18:26:04.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0587c68700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800c39c0 0x7f0580095450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:04.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0587c68700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0580095a70 0x7f05800941d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:04.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0587c68700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05800947f0 0x7f0580191c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:04.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0587c68700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c3200 con 0x7f05800947f0 2021-04-09T18:26:04.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0587c68700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c3550 con 0x7f05800c39c0 2021-04-09T18:26:04.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0587c68700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0580192230 con 0x7f0580095a70 2021-04-09T18:26:04.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0586285700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05800947f0 0x7f0580191c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:04.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0586285700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05800947f0 0x7f0580191c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56504/0 (socket says 172.21.15.120:56504) 2021-04-09T18:26:04.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0586285700 1 -- 172.21.15.120:0/1383112719 learned_addr learned my addr 172.21.15.120:0/1383112719 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:04.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0585283700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0580095a70 0x7f05800941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:04.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0585a84700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800c39c0 0x7f0580095450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:04.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0586285700 1 -- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0580095a70 msgr2=0x7f05800941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:04.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0586285700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0580095a70 0x7f05800941d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:04.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0586285700 1 -- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800c39c0 msgr2=0x7f0580095450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:04.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0586285700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800c39c0 0x7f0580095450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:04.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0586285700 1 -- 172.21.15.120:0/1383112719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580192450 con 0x7f05800947f0 2021-04-09T18:26:04.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0585a84700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800c39c0 0x7f0580095450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:04.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0585283700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0580095a70 0x7f05800941d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:04.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.704 7f0586285700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05800947f0 0x7f0580191c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f0578009980 tx=0x7f057800bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:04.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.705 7f05767fc700 1 -- 172.21.15.120:0/1383112719 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f057800be10 con 0x7f05800947f0 2021-04-09T18:26:04.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.705 7f05767fc700 1 -- 172.21.15.120:0/1383112719 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578005870 con 0x7f05800947f0 2021-04-09T18:26:04.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.705 7f0587c68700 1 -- 172.21.15.120:0/1383112719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0580192450 con 0x7f05800947f0 2021-04-09T18:26:04.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.705 7f05767fc700 1 -- 172.21.15.120:0/1383112719 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0578005d50 con 0x7f05800947f0 2021-04-09T18:26:04.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.705 7f0587c68700 1 -- 172.21.15.120:0/1383112719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0580192450 con 0x7f05800947f0 2021-04-09T18:26:04.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.705 7f05767fc700 1 -- 172.21.15.120:0/1383112719 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0578005a50 con 0x7f05800947f0 2021-04-09T18:26:04.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.705 7f05767fc700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0568018930 0x7f056801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:04.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.705 7f05767fc700 1 -- 172.21.15.120:0/1383112719 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f0578032ff0 con 0x7f05800947f0 2021-04-09T18:26:04.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.705 7f0585a84700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0568018930 0x7f056801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:04.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.706 7f0585a84700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0568018930 0x7f056801ae10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:04.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.729 7f0587c68700 1 -- 172.21.15.120:0/1383112719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0580088500 con 0x7f05800947f0 2021-04-09T18:26:04.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.733 7f05767fc700 1 -- 172.21.15.120:0/1383112719 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f057800be10 con 0x7f05800947f0 2021-04-09T18:26:04.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.911 7f0587c68700 1 -- 172.21.15.120:0/1383112719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05800ccba0 con 0x7f05800947f0 2021-04-09T18:26:04.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.911 7f05767fc700 1 -- 172.21.15.120:0/1383112719 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f0578005870 con 0x7f05800947f0 2021-04-09T18:26:04.905 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2021-04-09T18:26:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:04.905 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:25:10.645276","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4839":{"gid":4839,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":33,"addr":"172.21.15.120:6833/3967329066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3967329066},{"type":"v1","addr":"172.21.15.120:6833","nonce":3967329066}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:04.907 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 -- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0568018930 msgr2=0x7f056801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:04.908 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0568018930 0x7f056801ae10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:04.908 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 -- 172.21.15.120:0/1383112719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05800947f0 msgr2=0x7f0580191c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:04.908 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05800947f0 0x7f0580191c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f0578009980 tx=0x7f057800bcd0).stop 2021-04-09T18:26:04.908 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 -- 172.21.15.120:0/1383112719 shutdown_connections 2021-04-09T18:26:04.909 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05800947f0 0x7f0580191c10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:04.909 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0568018930 0x7f056801ae10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:04.909 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0580095a70 0x7f05800941d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:04.909 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 --2- 172.21.15.120:0/1383112719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800c39c0 0x7f0580095450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:04.910 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 -- 172.21.15.120:0/1383112719 >> 172.21.15.120:0/1383112719 conn(0x7f05800ab640 msgr2=0x7f058009fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:04.910 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 -- 172.21.15.120:0/1383112719 shutdown_connections 2021-04-09T18:26:04.910 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:04.914 7f0587c68700 1 -- 172.21.15.120:0/1383112719 wait complete. 2021-04-09T18:26:04.917 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:26:06.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:07.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.095 7fe1f1ccc700 1 Processor -- start 2021-04-09T18:26:07.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.095 7fe1f1ccc700 1 -- start start 2021-04-09T18:26:07.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1f1ccc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe1ec0d6580 0x7fe1ec1ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1f1ccc700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec0d7960 con 0x7fe1ec0d7560 2021-04-09T18:26:07.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1f1ccc700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec0d6980 con 0x7fe1ec0d7160 2021-04-09T18:26:07.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1f1ccc700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ec0d6be0 con 0x7fe1ec0d6580 2021-04-09T18:26:07.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1eaffd700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe1ec0d7560 0x7fe1ec0d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51432/0 (socket says 172.21.15.120:51432) 2021-04-09T18:26:07.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1eaffd700 1 -- 172.21.15.120:0/3752461413 learned_addr learned my addr 172.21.15.120:0/3752461413 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:26:07.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1ebfff700 1 --2- 172.21.15.120:0/3752461413 >> v2:172.21.15.134:3300/0 conn(0x7fe1ec0d6580 0x7fe1ec1ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1ea7fc700 1 -- 172.21.15.120:0/3752461413 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588988179 0 0) 0x7fe1e00009b0 con 0x7fe1ec0d7560 2021-04-09T18:26:07.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1ea7fc700 1 -- 172.21.15.120:0/3752461413 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d4002fe0 con 0x7fe1ec0d7560 2021-04-09T18:26:07.111 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1ea7fc700 1 -- 172.21.15.120:0/3752461413 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833145929 0 0) 0x7fe1dc000fe0 con 0x7fe1ec0d7160 2021-04-09T18:26:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1ea7fc700 1 -- 172.21.15.120:0/3752461413 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d4003090 con 0x7fe1ec0d7160 2021-04-09T18:26:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1ebfff700 1 -- 172.21.15.120:0/3752461413 >> v1:172.21.15.134:6789/0 conn(0x7fe1ec0d7160 legacy=0x7fe1ec0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1ebfff700 1 -- 172.21.15.120:0/3752461413 >> v1:172.21.15.120:6789/0 conn(0x7fe1ec0d7560 legacy=0x7fe1ec0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.096 7fe1ebfff700 1 -- 172.21.15.120:0/3752461413 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec1a2ac0 con 0x7fe1ec0d6580 2021-04-09T18:26:07.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1ebfff700 1 --2- 172.21.15.120:0/3752461413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ec0d6580 0x7fe1ec1ac1f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fe1e4006ad0 tx=0x7fe1e4009a50).ready entity=mon.1 client_cookie=5a0b7a68e6f68050 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:07.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1ea7fc700 1 -- 172.21.15.120:0/3752461413 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1e40066a0 con 0x7fe1ec0d6580 2021-04-09T18:26:07.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1ea7fc700 1 -- 172.21.15.120:0/3752461413 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4006410 con 0x7fe1ec0d6580 2021-04-09T18:26:07.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1ea7fc700 1 -- 172.21.15.120:0/3752461413 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1e40024d0 con 0x7fe1ec0d6580 2021-04-09T18:26:07.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1f1ccc700 1 -- 172.21.15.120:0/3752461413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ec0d6580 msgr2=0x7fe1ec1ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1f1ccc700 1 --2- 172.21.15.120:0/3752461413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ec0d6580 0x7fe1ec1ac1f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fe1e4006ad0 tx=0x7fe1e4009a50).stop 2021-04-09T18:26:07.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1f1ccc700 1 -- 172.21.15.120:0/3752461413 shutdown_connections 2021-04-09T18:26:07.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1f1ccc700 1 --2- 172.21.15.120:0/3752461413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ec0d6580 0x7fe1ec1ac1f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1f1ccc700 1 -- 172.21.15.120:0/3752461413 >> 172.21.15.120:0/3752461413 conn(0x7fe1ec0d1590 msgr2=0x7fe1ec0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:07.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1f1ccc700 1 -- 172.21.15.120:0/3752461413 shutdown_connections 2021-04-09T18:26:07.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.097 7fe1f1ccc700 1 -- 172.21.15.120:0/3752461413 wait complete. 2021-04-09T18:26:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.116 7fe1f1ccc700 1 Processor -- start 2021-04-09T18:26:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.116 7fe1f1ccc700 1 -- start start 2021-04-09T18:26:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1f1ccc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1ec182e70 0x7fe1ec191530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1f1ccc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1ec1a0270 0x7fe1ec1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1f1ccc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ec1a0c90 0x7fe1ec1a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1f1ccc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec191b50 con 0x7fe1ec182e70 2021-04-09T18:26:07.120 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1f1ccc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec17e7f0 con 0x7fe1ec1a0c90 2021-04-09T18:26:07.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1f1ccc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec17ea10 con 0x7fe1ec1a0270 2021-04-09T18:26:07.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eb7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1ec182e70 0x7fe1ec191530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.121 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eb7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1ec182e70 0x7fe1ec191530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56522/0 (socket says 172.21.15.120:56522) 2021-04-09T18:26:07.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eb7fe700 1 -- 172.21.15.120:0/3565284171 learned_addr learned my addr 172.21.15.120:0/3565284171 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:07.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eaffd700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1ec1a0270 0x7fe1ec1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1ebfff700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ec1a0c90 0x7fe1ec1a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eb7fe700 1 -- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1ec1a0270 msgr2=0x7fe1ec1a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eb7fe700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1ec1a0270 0x7fe1ec1a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eb7fe700 1 -- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ec1a0c90 msgr2=0x7fe1ec1a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eb7fe700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ec1a0c90 0x7fe1ec1a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eb7fe700 1 -- 172.21.15.120:0/3565284171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec17ec30 con 0x7fe1ec182e70 2021-04-09T18:26:07.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.117 7fe1eb7fe700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1ec182e70 0x7fe1ec191530 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fe1dc009980 tx=0x7fe1dc00bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:07.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.118 7fe1d3fff700 1 -- 172.21.15.120:0/3565284171 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1dc00be10 con 0x7fe1ec182e70 2021-04-09T18:26:07.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.118 7fe1d3fff700 1 -- 172.21.15.120:0/3565284171 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00c2f0 con 0x7fe1ec182e70 2021-04-09T18:26:07.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.118 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec17ec30 con 0x7fe1ec182e70 2021-04-09T18:26:07.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.118 7fe1d3fff700 1 -- 172.21.15.120:0/3565284171 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1dc00c810 con 0x7fe1ec182e70 2021-04-09T18:26:07.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.118 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec17ec30 con 0x7fe1ec182e70 2021-04-09T18:26:07.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.118 7fe1d3fff700 1 -- 172.21.15.120:0/3565284171 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe1dc0011a0 con 0x7fe1ec182e70 2021-04-09T18:26:07.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.118 7fe1d3fff700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1cc018930 0x7fe1cc01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.118 7fe1d3fff700 1 -- 172.21.15.120:0/3565284171 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7fe1dc033050 con 0x7fe1ec182e70 2021-04-09T18:26:07.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.119 7fe1eaffd700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1cc018930 0x7fe1cc01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.119 7fe1eaffd700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1cc018930 0x7fe1cc01ae10 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:07.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.142 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec1807b0 con 0x7fe1ec182e70 2021-04-09T18:26:07.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.145 7fe1d3fff700 1 -- 172.21.15.120:0/3565284171 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe1dc00be10 con 0x7fe1ec182e70 2021-04-09T18:26:07.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.321 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1ec1807b0 con 0x7fe1ec182e70 2021-04-09T18:26:07.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.322 7fe1d3fff700 1 -- 172.21.15.120:0/3565284171 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+1767 (secure 0 0 0) 0x7fe1dc001ee0 con 0x7fe1ec182e70 2021-04-09T18:26:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:07.315 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:05.791907","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:replay","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:07.316 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2021-04-09T18:26:07.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1cc018930 msgr2=0x7fe1cc01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1cc018930 0x7fe1cc01ae10 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1ec182e70 msgr2=0x7fe1ec191530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1ec182e70 0x7fe1ec191530 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fe1dc009980 tx=0x7fe1dc00bcd0).stop 2021-04-09T18:26:07.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 shutdown_connections 2021-04-09T18:26:07.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ec1a0c90 0x7fe1ec1a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe1cc018930 0x7fe1cc01ae10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1ec1a0270 0x7fe1ec1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 --2- 172.21.15.120:0/3565284171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1ec182e70 0x7fe1ec191530 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.324 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 >> 172.21.15.120:0/3565284171 conn(0x7fe1ec183a00 msgr2=0x7fe1ec1904d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:07.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.325 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 shutdown_connections 2021-04-09T18:26:07.320 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.325 7fe1f1ccc700 1 -- 172.21.15.120:0/3565284171 wait complete. 2021-04-09T18:26:07.327 INFO:tasks.mds_thrash.fs.[None]:mds.a down, removed from mdsmap 2021-04-09T18:26:07.327 INFO:tasks.mds_thrash.fs.[None]:waiting for mds cluster to stabilize... 2021-04-09T18:26:07.328 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:07.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.503 7f7466ecd700 1 Processor -- start 2021-04-09T18:26:07.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.503 7f7466ecd700 1 -- start start 2021-04-09T18:26:07.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.503 7f7466ecd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f74600d7160 0x7f74600d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.503 7f7466ecd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600d6190 0x7f74600d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.503 7f7466ecd700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74600d6be0 con 0x7f74600d55a0 2021-04-09T18:26:07.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.503 7f7466ecd700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74600d80f0 con 0x7f74600d7160 2021-04-09T18:26:07.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.503 7f7466ecd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74601a2ac0 con 0x7f74600d6190 2021-04-09T18:26:07.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f745ffff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f74600d55a0 0x7f74600d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51442/0 (socket says 172.21.15.120:51442) 2021-04-09T18:26:07.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f745ffff700 1 -- 172.21.15.120:0/621784334 learned_addr learned my addr 172.21.15.120:0/621784334 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:26:07.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f7464ce9700 1 --2- 172.21.15.120:0/621784334 >> v2:172.21.15.134:3300/0 conn(0x7f74600d7160 0x7f74600d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f74654ea700 1 --2- 172.21.15.120:0/621784334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600d6190 0x7f74600d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f745f7fe700 1 -- 172.21.15.120:0/621784334 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233248967 0 0) 0x7f7450001060 con 0x7f74600d55a0 2021-04-09T18:26:07.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f745f7fe700 1 -- 172.21.15.120:0/621784334 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f744c002fe0 con 0x7f74600d55a0 2021-04-09T18:26:07.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f7464ce9700 1 -- 172.21.15.120:0/621784334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600d6190 msgr2=0x7f74600d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:07.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f7464ce9700 1 --2- 172.21.15.120:0/621784334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600d6190 0x7f74600d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f7464ce9700 1 -- 172.21.15.120:0/621784334 >> v1:172.21.15.120:6789/0 conn(0x7f74600d55a0 legacy=0x7f74600d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f745f7fe700 1 -- 172.21.15.120:0/621784334 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1068365303 0 0) 0x7f7450001250 con 0x7f74600d55a0 2021-04-09T18:26:07.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f7464ce9700 1 -- 172.21.15.120:0/621784334 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74601a2cb0 con 0x7f74600d7160 2021-04-09T18:26:07.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f74654ea700 1 --2- 172.21.15.120:0/621784334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600d6190 0x7f74600d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:07.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f7464ce9700 1 --2- 172.21.15.120:0/621784334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74600d7160 0x7f74600d7560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7448006650 tx=0x7f7448009a80).ready entity=mon.1 client_cookie=e2bb0cf041b44814 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:07.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f745f7fe700 1 -- 172.21.15.120:0/621784334 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74480009b0 con 0x7f74600d7160 2021-04-09T18:26:07.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f745f7fe700 1 -- 172.21.15.120:0/621784334 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744800c0c0 con 0x7f74600d7160 2021-04-09T18:26:07.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f745f7fe700 1 -- 172.21.15.120:0/621784334 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74480009b0 con 0x7f74600d7160 2021-04-09T18:26:07.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f7466ecd700 1 -- 172.21.15.120:0/621784334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74600d7160 msgr2=0x7f74600d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.504 7f7466ecd700 1 --2- 172.21.15.120:0/621784334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74600d7160 0x7f74600d7560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7448006650 tx=0x7f7448009a80).stop 2021-04-09T18:26:07.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.505 7f7466ecd700 1 -- 172.21.15.120:0/621784334 shutdown_connections 2021-04-09T18:26:07.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.505 7f7466ecd700 1 --2- 172.21.15.120:0/621784334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600d6190 0x7f74600d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.505 7f7466ecd700 1 --2- 172.21.15.120:0/621784334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74600d7160 0x7f74600d7560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.505 7f7466ecd700 1 -- 172.21.15.120:0/621784334 >> 172.21.15.120:0/621784334 conn(0x7f74600d1590 msgr2=0x7f74600d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:07.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.505 7f7466ecd700 1 -- 172.21.15.120:0/621784334 shutdown_connections 2021-04-09T18:26:07.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.505 7f7466ecd700 1 -- 172.21.15.120:0/621784334 wait complete. 2021-04-09T18:26:07.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.524 7f7466ecd700 1 Processor -- start 2021-04-09T18:26:07.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.524 7f7466ecd700 1 -- start start 2021-04-09T18:26:07.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.524 7f7466ecd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7460187670 0x7f74600a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.524 7f7466ecd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74600a5050 0x7f74600b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.524 7f7466ecd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600b5710 0x7f74601838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.524 7f7466ecd700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600b5b10 con 0x7f7460187670 2021-04-09T18:26:07.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.524 7f7466ecd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600b5d30 con 0x7f74600a5050 2021-04-09T18:26:07.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.524 7f7466ecd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74600b5f50 con 0x7f74600b5710 2021-04-09T18:26:07.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.524 7f7464ce9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7460187670 0x7f74600a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7464ce9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7460187670 0x7f74600a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56536/0 (socket says 172.21.15.120:56536) 2021-04-09T18:26:07.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7464ce9700 1 -- 172.21.15.120:0/4079868808 learned_addr learned my addr 172.21.15.120:0/4079868808 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:07.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f74654ea700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600b5710 0x7f74601838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f745ffff700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74600a5050 0x7f74600b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7464ce9700 1 -- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600b5710 msgr2=0x7f74601838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7464ce9700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600b5710 0x7f74601838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7464ce9700 1 -- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74600a5050 msgr2=0x7f74600b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7464ce9700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74600a5050 0x7f74600b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7464ce9700 1 -- 172.21.15.120:0/4079868808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460183ef0 con 0x7f7460187670 2021-04-09T18:26:07.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7464ce9700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7460187670 0x7f74600a4a30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f7448009650 tx=0x7f744800b960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:07.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f745d7fa700 1 -- 172.21.15.120:0/4079868808 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74480093a0 con 0x7f7460187670 2021-04-09T18:26:07.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f745d7fa700 1 -- 172.21.15.120:0/4079868808 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744800bd50 con 0x7f7460187670 2021-04-09T18:26:07.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7460183ef0 con 0x7f7460187670 2021-04-09T18:26:07.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f745d7fa700 1 -- 172.21.15.120:0/4079868808 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f74480052e0 con 0x7f7460187670 2021-04-09T18:26:07.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.525 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7460183ef0 con 0x7f7460187670 2021-04-09T18:26:07.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.526 7f745d7fa700 1 -- 172.21.15.120:0/4079868808 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7448006030 con 0x7f7460187670 2021-04-09T18:26:07.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.526 7f745d7fa700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7444018930 0x7f744401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:07.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.526 7f745d7fa700 1 -- 172.21.15.120:0/4079868808 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7f7448032ca0 con 0x7f7460187670 2021-04-09T18:26:07.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.526 7f745ffff700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7444018930 0x7f744401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:07.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.526 7f745ffff700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7444018930 0x7f744401ae10 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:07.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.549 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74601829e0 con 0x7f7460187670 2021-04-09T18:26:07.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.553 7f745d7fa700 1 -- 172.21.15.120:0/4079868808 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f74480009c0 con 0x7f7460187670 2021-04-09T18:26:07.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.731 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74601829e0 con 0x7f7460187670 2021-04-09T18:26:07.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.731 7f745d7fa700 1 -- 172.21.15.120:0/4079868808 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+1767 (secure 0 0 0) 0x7f744800bd50 con 0x7f7460187670 2021-04-09T18:26:07.724 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2021-04-09T18:26:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:07.725 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:05.791907","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:replay","state_seq":2,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.733 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7444018930 msgr2=0x7f744401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.733 7f7466ecd700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7444018930 0x7f744401ae10 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.733 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7460187670 msgr2=0x7f74600a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.733 7f7466ecd700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7460187670 0x7f74600a4a30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f7448009650 tx=0x7f744800b960).stop 2021-04-09T18:26:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.734 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 shutdown_connections 2021-04-09T18:26:07.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.734 7f7466ecd700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7444018930 0x7f744401ae10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.734 7f7466ecd700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74600b5710 0x7f74601838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.734 7f7466ecd700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74600a5050 0x7f74600b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.734 7f7466ecd700 1 --2- 172.21.15.120:0/4079868808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7460187670 0x7f74600a4a30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:07.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.734 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 >> 172.21.15.120:0/4079868808 conn(0x7f746018dc90 msgr2=0x7f746008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:07.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.734 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 shutdown_connections 2021-04-09T18:26:07.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:07.734 7f7466ecd700 1 -- 172.21.15.120:0/4079868808 wait complete. 2021-04-09T18:26:07.737 INFO:tasks.mds_thrash.fs.[None]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 25, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-04-09 18:19:55.049244", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 25, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4718": { "addr": "172.21.15.134:6835/497894564", "addrs": { "addrvec": [ { "addr": "172.21.15.134:6834", "nonce": 497894564, "type": "v2" }, { "addr": "172.21.15.134:6835", "nonce": 497894564, "type": "v1" } ] }, "export_targets": [], "features": 4611087854035861503, "flags": 0, "gid": 4718, "incarnation": 25, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 26, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "-1 (unspecified)", "modified": "2021-04-09 18:26:05.791907", "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4718 } } } ], "standbys": [] } 2021-04-09T18:26:09.738 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:09.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.913 7f3be6967700 1 Processor -- start 2021-04-09T18:26:09.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.913 7f3be6967700 1 -- start start 2021-04-09T18:26:09.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be6967700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3be00d6580 0x7f3be01ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be6967700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be00d7960 con 0x7f3be00d7560 2021-04-09T18:26:09.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be6967700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be00d6980 con 0x7f3be00d7160 2021-04-09T18:26:09.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be6967700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be00d6be0 con 0x7f3be00d6580 2021-04-09T18:26:09.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be4f84700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3be00d6580 0x7f3be01ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3bd7fff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3be00d7560 0x7f3be00d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51460/0 (socket says 172.21.15.120:51460) 2021-04-09T18:26:09.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3bd7fff700 1 -- 172.21.15.120:0/1858171155 learned_addr learned my addr 172.21.15.120:0/1858171155 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:26:09.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be4f84700 1 -- 172.21.15.120:0/1858171155 >> v1:172.21.15.134:6789/0 conn(0x7f3be00d7160 legacy=0x7f3be00d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:09.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be4f84700 1 -- 172.21.15.120:0/1858171155 >> v1:172.21.15.120:6789/0 conn(0x7f3be00d7560 legacy=0x7f3be00d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:09.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be4f84700 1 -- 172.21.15.120:0/1858171155 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be01a2ac0 con 0x7f3be00d6580 2021-04-09T18:26:09.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3bdf7fe700 1 -- 172.21.15.120:0/1858171155 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633778836 0 0) 0x7f3bc8000ce0 con 0x7f3be00d7560 2021-04-09T18:26:09.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be4f84700 1 --2- 172.21.15.120:0/1858171155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be00d6580 0x7f3be01ac1f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f3bd8006e30 tx=0x7f3bd8009de0).ready entity=mon.0 client_cookie=43b9cdc5a802d7a8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:09.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3bdf7fe700 1 -- 172.21.15.120:0/1858171155 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3bd800b300 con 0x7f3be00d6580 2021-04-09T18:26:09.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3bdf7fe700 1 -- 172.21.15.120:0/1858171155 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd800b680 con 0x7f3be00d6580 2021-04-09T18:26:09.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3bdf7fe700 1 -- 172.21.15.120:0/1858171155 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3bd800bb60 con 0x7f3be00d6580 2021-04-09T18:26:09.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be6967700 1 -- 172.21.15.120:0/1858171155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be00d6580 msgr2=0x7f3be01ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:09.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.914 7f3be6967700 1 --2- 172.21.15.120:0/1858171155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be00d6580 0x7f3be01ac1f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f3bd8006e30 tx=0x7f3bd8009de0).stop 2021-04-09T18:26:09.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.915 7f3be6967700 1 -- 172.21.15.120:0/1858171155 shutdown_connections 2021-04-09T18:26:09.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.915 7f3be6967700 1 --2- 172.21.15.120:0/1858171155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be00d6580 0x7f3be01ac1f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:09.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.915 7f3be6967700 1 -- 172.21.15.120:0/1858171155 >> 172.21.15.120:0/1858171155 conn(0x7f3be00d1590 msgr2=0x7f3be00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:09.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.915 7f3be6967700 1 -- 172.21.15.120:0/1858171155 shutdown_connections 2021-04-09T18:26:09.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.915 7f3be6967700 1 -- 172.21.15.120:0/1858171155 wait complete. 2021-04-09T18:26:09.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3be6967700 1 Processor -- start 2021-04-09T18:26:09.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3be6967700 1 -- start start 2021-04-09T18:26:09.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3be6967700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3be008b3d0 0x7f3be008aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3be6967700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be019cfa0 0x7f3be008b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3be6967700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be019d3a0 0x7f3be008bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3be6967700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be019ca20 con 0x7f3be019cfa0 2021-04-09T18:26:09.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3be6967700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be008c520 con 0x7f3be019d3a0 2021-04-09T18:26:09.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3be6967700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be008c700 con 0x7f3be008b3d0 2021-04-09T18:26:09.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3bd7fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be019cfa0 0x7f3be008b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3bd7fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be019cfa0 0x7f3be008b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56556/0 (socket says 172.21.15.120:56556) 2021-04-09T18:26:09.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.934 7f3bd7fff700 1 -- 172.21.15.120:0/4247840279 learned_addr learned my addr 172.21.15.120:0/4247840279 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:09.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bd7fff700 1 -- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3be008b3d0 msgr2=0x7f3be008aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:09.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bdffff700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3be008b3d0 0x7f3be008aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3be4f84700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be019d3a0 0x7f3be008bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bd7fff700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3be008b3d0 0x7f3be008aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:09.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bd7fff700 1 -- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be019d3a0 msgr2=0x7f3be008bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:09.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bd7fff700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be019d3a0 0x7f3be008bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:09.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bd7fff700 1 -- 172.21.15.120:0/4247840279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be008c920 con 0x7f3be019cfa0 2021-04-09T18:26:09.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3be4f84700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be019d3a0 0x7f3be008bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:26:09.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bdffff700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3be008b3d0 0x7f3be008aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:26:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bd7fff700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be019cfa0 0x7f3be008b8e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f3bc8006f00 tx=0x7f3bc800b940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bdd7fa700 1 -- 172.21.15.120:0/4247840279 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3bc800bd30 con 0x7f3be019cfa0 2021-04-09T18:26:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bdd7fa700 1 -- 172.21.15.120:0/4247840279 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc8006030 con 0x7f3be019cfa0 2021-04-09T18:26:09.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3bdd7fa700 1 -- 172.21.15.120:0/4247840279 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3bc8004590 con 0x7f3be019cfa0 2021-04-09T18:26:09.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3be6967700 1 -- 172.21.15.120:0/4247840279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be008c920 con 0x7f3be019cfa0 2021-04-09T18:26:09.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.935 7f3be6967700 1 -- 172.21.15.120:0/4247840279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be008c920 con 0x7f3be019cfa0 2021-04-09T18:26:09.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.936 7f3bdd7fa700 1 -- 172.21.15.120:0/4247840279 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3bc800a030 con 0x7f3be019cfa0 2021-04-09T18:26:09.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.936 7f3bdd7fa700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3bc40188c0 0x7f3bc401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:09.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.936 7f3bdd7fa700 1 -- 172.21.15.120:0/4247840279 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7f3bc80329f0 con 0x7f3be019cfa0 2021-04-09T18:26:09.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.936 7f3bdffff700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3bc40188c0 0x7f3bc401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:09.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.937 7f3bdffff700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3bc40188c0 0x7f3bc401adc0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:09.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.960 7f3be6967700 1 -- 172.21.15.120:0/4247840279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be017f360 con 0x7f3be019cfa0 2021-04-09T18:26:09.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:09.963 7f3bdd7fa700 1 -- 172.21.15.120:0/4247840279 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3bc802d840 con 0x7f3be019cfa0 2021-04-09T18:26:10.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.143 7f3be6967700 1 -- 172.21.15.120:0/4247840279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3be017f360 con 0x7f3be019cfa0 2021-04-09T18:26:10.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.143 7f3bdd7fa700 1 -- 172.21.15.120:0/4247840279 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+1768 (secure 0 0 0) 0x7f3bc802d840 con 0x7f3be019cfa0 2021-04-09T18:26:10.138 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2021-04-09T18:26:10.138 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:10.138 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:09.567170","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:10.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 -- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3bc40188c0 msgr2=0x7f3bc401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:10.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3bc40188c0 0x7f3bc401adc0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 -- 172.21.15.120:0/4247840279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be019cfa0 msgr2=0x7f3be008b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:10.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be019cfa0 0x7f3be008b8e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f3bc8006f00 tx=0x7f3bc800b940).stop 2021-04-09T18:26:10.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 -- 172.21.15.120:0/4247840279 shutdown_connections 2021-04-09T18:26:10.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be019d3a0 0x7f3be008bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3be019cfa0 0x7f3be008b8e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3bc40188c0 0x7f3bc401adc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 --2- 172.21.15.120:0/4247840279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3be008b3d0 0x7f3be008aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:10.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 -- 172.21.15.120:0/4247840279 >> 172.21.15.120:0/4247840279 conn(0x7f3be00945f0 msgr2=0x7f3be0097cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:10.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 -- 172.21.15.120:0/4247840279 shutdown_connections 2021-04-09T18:26:10.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:10.146 7f3be6967700 1 -- 172.21.15.120:0/4247840279 wait complete. 2021-04-09T18:26:10.150 INFO:tasks.mds_thrash.fs.[None]:no change 2021-04-09T18:26:12.086 INFO:tasks.workunit.client.0.smithi120.stdout:9/427: symlink d19/d24/d36/l8a 0 2021-04-09T18:26:12.089 INFO:tasks.workunit.client.0.smithi120.stdout:8/369: write d2/d3/d8/f1d [533973,16657] 0 2021-04-09T18:26:12.092 INFO:tasks.workunit.client.0.smithi120.stdout:1/495: dwrite d5/d64/d63/d86/f9c [0,4194304] 0 2021-04-09T18:26:12.093 INFO:tasks.workunit.client.0.smithi120.stdout:3/436: fsync d3/d5/d36/d3d/f6c 0 2021-04-09T18:26:12.095 INFO:tasks.workunit.client.0.smithi120.stdout:2/480: mkdir d13/d15/d35/d9f 0 2021-04-09T18:26:12.109 INFO:tasks.workunit.client.0.smithi120.stdout:5/514: creat d10/d12/d1b/fc2 x:0 0 0 2021-04-09T18:26:12.110 INFO:tasks.workunit.client.0.smithi120.stdout:7/292: write db/d2c/d34/f48 [267025,110] 0 2021-04-09T18:26:12.115 INFO:tasks.workunit.client.0.smithi120.stdout:6/410: truncate d6/d8/d1a/d36/d54/d41/d49/f4f 654924 0 2021-04-09T18:26:12.117 INFO:tasks.workunit.client.0.smithi120.stdout:4/390: rename f1a to d1f/d24/d6b/f82 0 2021-04-09T18:26:12.123 INFO:tasks.workunit.client.0.smithi120.stdout:1/496: fdatasync d5/d1f/f81 0 2021-04-09T18:26:12.135 INFO:tasks.workunit.client.0.smithi120.stdout:2/481: readlink d13/d7a/d80/d54/l5f 0 2021-04-09T18:26:12.138 INFO:tasks.workunit.client.0.smithi120.stdout:7/293: unlink db/d26/f60 0 2021-04-09T18:26:12.140 INFO:tasks.workunit.client.0.smithi120.stdout:1/497: fdatasync d5/f7 0 2021-04-09T18:26:12.142 INFO:tasks.workunit.client.0.smithi120.stdout:8/370: link d2/d3/f5a d2/d3/d50/d4b/f73 0 2021-04-09T18:26:12.144 INFO:tasks.workunit.client.0.smithi120.stdout:4/391: dwrite d1f/d24/f46 [0,4194304] 0 2021-04-09T18:26:12.147 INFO:tasks.workunit.client.0.smithi120.stdout:3/437: dread d3/d5/d36/d1e/d38/f44 [0,4194304] 0 2021-04-09T18:26:12.148 INFO:tasks.workunit.client.0.smithi120.stdout:0/379: rename d0/d2/dd/f5e to d0/d52/f6e 0 2021-04-09T18:26:12.150 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:12.151 INFO:tasks.workunit.client.0.smithi120.stdout:9/428: dread d19/d24/d37/d40/d89/f53 [0,4194304] 0 2021-04-09T18:26:12.156 INFO:tasks.workunit.client.0.smithi120.stdout:2/482: chown d13/d7a/d80/d48/d58/f8c 23179 1 2021-04-09T18:26:12.158 INFO:tasks.workunit.client.0.smithi120.stdout:1/498: dwrite d5/d64/d63/d86/f9c [4194304,4194304] 0 2021-04-09T18:26:12.163 INFO:tasks.workunit.client.0.smithi120.stdout:7/294: creat db/d2c/d30/d59/f68 x:0 0 0 2021-04-09T18:26:12.170 INFO:tasks.workunit.client.0.smithi120.stdout:0/380: fdatasync d0/d2/f26 0 2021-04-09T18:26:12.173 INFO:tasks.workunit.client.0.smithi120.stdout:9/429: chown d19/d2c/d5b/l68 349351 1 2021-04-09T18:26:12.173 INFO:tasks.workunit.client.0.smithi120.stdout:6/411: rename d6/d8/d1a/d36/d54/d31/d37/d61/d7a to d6/d8/db/d92 0 2021-04-09T18:26:12.187 INFO:tasks.workunit.client.0.smithi120.stdout:1/499: fdatasync d5/d1f/d22/d24/f41 0 2021-04-09T18:26:12.187 INFO:tasks.workunit.client.0.smithi120.stdout:4/392: dwrite d1f/d24/f26 [0,4194304] 0 2021-04-09T18:26:12.189 INFO:tasks.workunit.client.0.smithi120.stdout:7/295: write db/f1b [3208207,95219] 0 2021-04-09T18:26:12.195 INFO:tasks.workunit.client.0.smithi120.stdout:4/393: chown d1f/l22 5464055 1 2021-04-09T18:26:12.198 INFO:tasks.workunit.client.0.smithi120.stdout:0/381: write d0/d2/d4/f13 [1614130,27876] 0 2021-04-09T18:26:12.203 INFO:tasks.workunit.client.0.smithi120.stdout:6/412: mkdir d6/d8/db/d12/d93 0 2021-04-09T18:26:12.205 INFO:tasks.workunit.client.0.smithi120.stdout:7/296: chown db/d26/f2d 80757 1 2021-04-09T18:26:12.211 INFO:tasks.workunit.client.0.smithi120.stdout:2/483: truncate d13/f1c 10011972 0 2021-04-09T18:26:12.213 INFO:tasks.workunit.client.0.smithi120.stdout:1/500: dread - d5/d1f/d22/d2b/f78 zero size 2021-04-09T18:26:12.219 INFO:tasks.workunit.client.0.smithi120.stdout:0/382: fdatasync d0/f41 0 2021-04-09T18:26:12.224 INFO:tasks.workunit.client.0.smithi120.stdout:5/515: dread d10/d12/d1b/d1f/d84/d44/f49 [0,4194304] 0 2021-04-09T18:26:12.224 INFO:tasks.workunit.client.0.smithi120.stdout:7/297: chown db/d42/f65 5269890 1 2021-04-09T18:26:12.226 INFO:tasks.workunit.client.0.smithi120.stdout:9/430: creat d19/d24/d37/d40/d89/d29/d63/f8b x:0 0 0 2021-04-09T18:26:12.233 INFO:tasks.workunit.client.0.smithi120.stdout:5/516: chown d10/d12/d1b/f34 328 1 2021-04-09T18:26:12.238 INFO:tasks.workunit.client.0.smithi120.stdout:6/413: dwrite d6/d8/db/d2b/f6f [0,4194304] 0 2021-04-09T18:26:12.249 INFO:tasks.workunit.client.0.smithi120.stdout:3/438: link d3/d5/d36/d1e/d6b/d49/d4e/d54/f5f d3/d5/d36/d1e/d38/d61/f8f 0 2021-04-09T18:26:12.250 INFO:tasks.workunit.client.0.smithi120.stdout:4/394: getdents d1f/d2c/d3b 0 2021-04-09T18:26:12.251 INFO:tasks.workunit.client.0.smithi120.stdout:0/383: symlink d0/d5a/d62/l6f 0 2021-04-09T18:26:12.255 INFO:tasks.workunit.client.0.smithi120.stdout:3/439: mknod d3/d5/d36/d1e/d6b/d49/d5e/c90 1 2021-04-09T18:26:12.258 INFO:tasks.workunit.client.0.smithi120.stdout:4/395: mkdir d1f/d2c/d34/d83 0 2021-04-09T18:26:12.258 INFO:tasks.workunit.client.0.smithi120.stdout:1/501: write d5/d5c/f72 [345294,31194] 0 2021-04-09T18:26:12.259 INFO:tasks.workunit.client.0.smithi120.stdout:7/298: write f4 [1338887,76526] 0 2021-04-09T18:26:12.261 INFO:tasks.workunit.client.0.smithi120.stdout:2/484: write d13/d7a/d80/d48/d49/d64/f74 [98435,66938] 0 2021-04-09T18:26:12.267 INFO:tasks.workunit.client.0.smithi120.stdout:4/396: mkdir d1f/d2c/d3b/d84 0 2021-04-09T18:26:12.267 INFO:tasks.workunit.client.0.smithi120.stdout:6/414: mkdir d6/d8/d1a/d36/d54/d41/d49/d94 0 2021-04-09T18:26:12.269 INFO:tasks.workunit.client.0.smithi120.stdout:5/517: dwrite d10/d12/d1b/f34 [0,4194304] 0 2021-04-09T18:26:12.272 INFO:tasks.workunit.client.0.smithi120.stdout:9/431: dwrite d19/f38 [0,4194304] 0 2021-04-09T18:26:12.273 INFO:tasks.workunit.client.0.smithi120.stdout:0/384: fdatasync d0/d43/f66 0 2021-04-09T18:26:12.276 INFO:tasks.workunit.client.0.smithi120.stdout:1/502: creat d5/d1f/d22/d24/fa5 x:0 0 0 2021-04-09T18:26:12.280 INFO:tasks.workunit.client.0.smithi120.stdout:7/299: creat db/d38/f69 x:0 0 0 2021-04-09T18:26:12.296 INFO:tasks.workunit.client.0.smithi120.stdout:9/432: read d19/d24/d36/f6e [4522442,93122] 0 2021-04-09T18:26:12.304 INFO:tasks.workunit.client.0.smithi120.stdout:2/485: getdents d13/d7a/d80/d48/d49/d76 0 2021-04-09T18:26:12.305 INFO:tasks.workunit.client.0.smithi120.stdout:9/433: mknod d19/d24/c8c 1 2021-04-09T18:26:12.306 INFO:tasks.workunit.client.0.smithi120.stdout:5/518: stat d10/d12/d1b/d3a/d5b/d78/f81 0 2021-04-09T18:26:12.307 INFO:tasks.workunit.client.0.smithi120.stdout:0/385: symlink d0/d2/da/d23/l70 0 2021-04-09T18:26:12.321 INFO:tasks.workunit.client.0.smithi120.stdout:1/503: dwrite d5/d1f/d22/d24/f2f [0,4194304] 0 2021-04-09T18:26:12.321 INFO:tasks.workunit.client.0.smithi120.stdout:4/397: dwrite d1f/f71 [0,4194304] 0 2021-04-09T18:26:12.323 INFO:tasks.workunit.client.0.smithi120.stdout:4/398: read d1f/d24/f46 [3685800,102922] 0 2021-04-09T18:26:12.323 INFO:tasks.workunit.client.0.smithi120.stdout:0/386: truncate d0/d43/f66 444578 0 2021-04-09T18:26:12.326 INFO:tasks.workunit.client.0.smithi120.stdout:5/519: rmdir d10/d12/d1b/d1f/d84/d3d/d50/da9/db6 0 2021-04-09T18:26:12.330 INFO:tasks.workunit.client.0.smithi120.stdout:0/387: mknod d0/d52/c71 1 2021-04-09T18:26:12.342 INFO:tasks.workunit.client.0.smithi120.stdout:3/440: rename d3/de/d25/f15 to d3/d5/d36/d1e/d6b/d49/d4e/d54/f91 0 2021-04-09T18:26:12.345 INFO:tasks.workunit.client.0.smithi120.stdout:0/388: unlink d0/d2/l1a 0 2021-04-09T18:26:12.348 INFO:tasks.workunit.client.0.smithi120.stdout:4/399: creat d1f/d2c/d3b/d3e/d73/f85 x:0 0 0 2021-04-09T18:26:12.353 INFO:tasks.workunit.client.0.smithi120.stdout:5/520: link d10/d12/d1b/d1f/d84/f7b d10/d12/d1b/d1f/d84/d44/fc3 0 2021-04-09T18:26:12.353 INFO:tasks.workunit.client.0.smithi120.stdout:0/389: read d0/d2/d4/f59 [596394,53482] 0 2021-04-09T18:26:12.355 INFO:tasks.workunit.client.0.smithi120.stdout:6/415: rename d6/d8/d1a/d36/d54/d31/d37/l60 to d6/d8/d52/l95 0 2021-04-09T18:26:12.357 INFO:tasks.workunit.client.0.smithi120.stdout:0/390: mkdir d0/d5a/d62/d72 0 2021-04-09T18:26:12.358 INFO:tasks.workunit.client.0.smithi120.stdout:5/521: readlink d10/d12/d1b/d1f/d39/l5a 0 2021-04-09T18:26:12.363 INFO:tasks.workunit.client.0.smithi120.stdout:7/300: rename f7 to db/d38/d3c/f6a 0 2021-04-09T18:26:12.363 INFO:tasks.workunit.client.0.smithi120.stdout:1/504: write d5/f7 [2636146,64958] 0 2021-04-09T18:26:12.365 INFO:tasks.workunit.client.0.smithi120.stdout:6/416: symlink d6/d8/db/d2b/d68/l96 0 2021-04-09T18:26:12.367 INFO:tasks.workunit.client.0.smithi120.stdout:7/301: stat db/d26/d4c 0 2021-04-09T18:26:12.369 INFO:tasks.workunit.client.0.smithi120.stdout:6/417: chown d6/d8/db/d12/l77 3083 1 2021-04-09T18:26:12.373 INFO:tasks.workunit.client.0.smithi120.stdout:9/434: rename d19/d24/d37/d40/d89/l4c to d19/d24/d36/d47/d6f/l8d 0 2021-04-09T18:26:12.376 INFO:tasks.workunit.client.0.smithi120.stdout:9/435: read f14 [438504,128878] 0 2021-04-09T18:26:12.378 INFO:tasks.workunit.client.0.smithi120.stdout:3/441: rename d3/d5/f2c to d3/d5/d36/d1e/d38/d6d/f92 0 2021-04-09T18:26:12.384 INFO:tasks.workunit.client.0.smithi120.stdout:1/505: link d5/l4e d5/d64/d2d/d5a/la6 0 2021-04-09T18:26:12.385 INFO:tasks.workunit.client.0.smithi120.stdout:7/302: truncate db/d38/f69 875183 0 2021-04-09T18:26:12.389 INFO:tasks.workunit.client.0.smithi120.stdout:9/436: truncate d19/d24/d36/f6e 4917489 0 2021-04-09T18:26:12.390 INFO:tasks.workunit.client.0.smithi120.stdout:5/522: rename d10/f93 to d10/d12/d3b/fc4 0 2021-04-09T18:26:12.392 INFO:tasks.workunit.client.0.smithi120.stdout:7/303: unlink db/l1e 0 2021-04-09T18:26:12.397 INFO:tasks.workunit.client.0.smithi120.stdout:0/391: write d0/d52/f6d [541443,73403] 0 2021-04-09T18:26:12.402 INFO:tasks.workunit.client.0.smithi120.stdout:0/392: chown d0/f30 0 1 2021-04-09T18:26:12.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.387 7f17a6cdd700 1 Processor -- start 2021-04-09T18:26:12.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.387 7f17a6cdd700 1 -- start start 2021-04-09T18:26:12.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a6cdd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f17a00d7160 0x7f17a00d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:12.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a6cdd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f17a00d55a0 0x7f17a00d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:12.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a6cdd700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a00d6be0 con 0x7f17a00d5fc0 2021-04-09T18:26:12.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a6cdd700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a00d80f0 con 0x7f17a00d7160 2021-04-09T18:26:12.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a6cdd700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a01a2ac0 con 0x7f17a00d55a0 2021-04-09T18:26:12.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a4af9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f17a00d7160 0x7f17a00d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:12.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a4af9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f17a00d7160 0x7f17a00d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56586/0 (socket says 172.21.15.120:56586) 2021-04-09T18:26:12.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a4af9700 1 -- 172.21.15.120:0/3911607843 learned_addr learned my addr 172.21.15.120:0/3911607843 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:12.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f179ffff700 1 --2- 172.21.15.120:0/3911607843 >> v2:172.21.15.134:3300/0 conn(0x7f17a00d55a0 0x7f17a00d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:12.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a4af9700 1 -- 172.21.15.120:0/3911607843 >> v2:172.21.15.134:3300/0 conn(0x7f17a00d55a0 msgr2=0x7f17a00d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:12.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a4af9700 1 --2- 172.21.15.120:0/3911607843 >> v2:172.21.15.134:3300/0 conn(0x7f17a00d55a0 0x7f17a00d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a4af9700 1 -- 172.21.15.120:0/3911607843 >> v1:172.21.15.134:6789/0 conn(0x7f17a00d5fc0 legacy=0x7f17a00d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:12.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a4af9700 1 -- 172.21.15.120:0/3911607843 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a01ac1f0 con 0x7f17a00d7160 2021-04-09T18:26:12.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f17a4af9700 1 --2- 172.21.15.120:0/3911607843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a00d7160 0x7f17a00d7560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f1794006700 tx=0x7f1794009b80).ready entity=mon.0 client_cookie=a83b821014c48261 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:12.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f179f7fe700 1 -- 172.21.15.120:0/3911607843 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f179400c0c0 con 0x7f17a00d7160 2021-04-09T18:26:12.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f179f7fe700 1 -- 172.21.15.120:0/3911607843 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400c440 con 0x7f17a00d7160 2021-04-09T18:26:12.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.388 7f179f7fe700 1 -- 172.21.15.120:0/3911607843 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f179400c920 con 0x7f17a00d7160 2021-04-09T18:26:12.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.389 7f17a6cdd700 1 -- 172.21.15.120:0/3911607843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a00d7160 msgr2=0x7f17a00d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:12.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.389 7f17a6cdd700 1 --2- 172.21.15.120:0/3911607843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a00d7160 0x7f17a00d7560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f1794006700 tx=0x7f1794009b80).stop 2021-04-09T18:26:12.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.389 7f17a6cdd700 1 -- 172.21.15.120:0/3911607843 shutdown_connections 2021-04-09T18:26:12.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.389 7f17a6cdd700 1 --2- 172.21.15.120:0/3911607843 >> v2:172.21.15.134:3300/0 conn(0x7f17a00d55a0 0x7f17a00d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.389 7f17a6cdd700 1 --2- 172.21.15.120:0/3911607843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a00d7160 0x7f17a00d7560 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.389 7f17a6cdd700 1 -- 172.21.15.120:0/3911607843 >> 172.21.15.120:0/3911607843 conn(0x7f17a00d1590 msgr2=0x7f17a00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:12.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.389 7f17a6cdd700 1 -- 172.21.15.120:0/3911607843 shutdown_connections 2021-04-09T18:26:12.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.389 7f17a6cdd700 1 -- 172.21.15.120:0/3911607843 wait complete. 2021-04-09T18:26:12.411 INFO:tasks.workunit.client.0.smithi120.stdout:5/523: rename d10/l58 to d10/d12/d1b/d1f/lc5 0 2021-04-09T18:26:12.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.411 7f17a6cdd700 1 Processor -- start 2021-04-09T18:26:12.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.411 7f17a6cdd700 1 -- start start 2021-04-09T18:26:12.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a6cdd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a01a1510 0x7f17a00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:12.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a6cdd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a0191bf0 0x7f17a00b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:12.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a6cdd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17a00b7c80 0x7f17a0192540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:12.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a6cdd700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0192270 con 0x7f17a01a1510 2021-04-09T18:26:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a6cdd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a009d2e0 con 0x7f17a0191bf0 2021-04-09T18:26:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a6cdd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a009d500 con 0x7f17a00b7c80 2021-04-09T18:26:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a4af9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a01a1510 0x7f17a00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a4af9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a01a1510 0x7f17a00b7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56590/0 (socket says 172.21.15.120:56590) 2021-04-09T18:26:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a4af9700 1 -- 172.21.15.120:0/475445776 learned_addr learned my addr 172.21.15.120:0/475445776 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f179ffff700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a0191bf0 0x7f17a00b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a52fa700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17a00b7c80 0x7f17a0192540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a4af9700 1 -- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17a00b7c80 msgr2=0x7f17a0192540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a4af9700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17a00b7c80 0x7f17a0192540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a4af9700 1 -- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a0191bf0 msgr2=0x7f17a00b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:12.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.412 7f17a4af9700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a0191bf0 0x7f17a00b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.413 7f17a4af9700 1 -- 172.21.15.120:0/475445776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0192b60 con 0x7f17a01a1510 2021-04-09T18:26:12.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.413 7f179ffff700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a0191bf0 0x7f17a00b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:12.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.413 7f17a52fa700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17a00b7c80 0x7f17a0192540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:26:12.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.413 7f17a4af9700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a01a1510 0x7f17a00b7040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f179400b650 tx=0x7f179400b9f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:12.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.413 7f179d7fa700 1 -- 172.21.15.120:0/475445776 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f179400bde0 con 0x7f17a01a1510 2021-04-09T18:26:12.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.413 7f179d7fa700 1 -- 172.21.15.120:0/475445776 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17940091e0 con 0x7f17a01a1510 2021-04-09T18:26:12.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.413 7f179d7fa700 1 -- 172.21.15.120:0/475445776 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1794002220 con 0x7f17a01a1510 2021-04-09T18:26:12.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.413 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a0192b60 con 0x7f17a01a1510 2021-04-09T18:26:12.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.413 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a0192b60 con 0x7f17a01a1510 2021-04-09T18:26:12.420 INFO:tasks.workunit.client.0.smithi120.stdout:3/442: dread d3/d5/d36/f23 [4194304,4194304] 0 2021-04-09T18:26:12.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.414 7f179d7fa700 1 -- 172.21.15.120:0/475445776 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1794000c90 con 0x7f17a01a1510 2021-04-09T18:26:12.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.414 7f179d7fa700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17800188c0 0x7f178001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:12.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.414 7f179d7fa700 1 -- 172.21.15.120:0/475445776 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7f1794032ae0 con 0x7f17a01a1510 2021-04-09T18:26:12.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.415 7f179ffff700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17800188c0 0x7f178001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:12.422 INFO:tasks.workunit.client.0.smithi120.stdout:6/418: write d6/d8/db/d12/d22/f2a [826492,38346] 0 2021-04-09T18:26:12.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.415 7f179ffff700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17800188c0 0x7f178001adc0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:12.423 INFO:tasks.workunit.client.0.smithi120.stdout:6/419: chown d6/d8/d1a/d36/f5c 16339581 1 2021-04-09T18:26:12.423 INFO:tasks.workunit.client.0.smithi120.stdout:7/304: creat db/d42/d54/d5a/f6b x:0 0 0 2021-04-09T18:26:12.424 INFO:tasks.workunit.client.0.smithi120.stdout:1/506: truncate d5/d5c/f72 5031471 0 2021-04-09T18:26:12.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.432 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a0192220 con 0x7f17a01a1510 2021-04-09T18:26:12.426 INFO:tasks.workunit.client.0.smithi120.stdout:3/443: creat d3/d5/d36/d1e/d6b/d6a/d83/f93 x:0 0 0 2021-04-09T18:26:12.427 INFO:tasks.workunit.client.0.smithi120.stdout:6/420: read d6/d8/db/d12/d22/f40 [550734,35376] 0 2021-04-09T18:26:12.428 INFO:tasks.workunit.client.0.smithi120.stdout:1/507: mknod d5/d1f/d22/d24/ca7 1 2021-04-09T18:26:12.428 INFO:tasks.workunit.client.0.smithi120.stdout:5/524: truncate d10/f11 2451281 0 2021-04-09T18:26:12.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.436 7f179d7fa700 1 -- 172.21.15.120:0/475445776 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1794009f90 con 0x7f17a01a1510 2021-04-09T18:26:12.432 INFO:tasks.workunit.client.0.smithi120.stdout:9/437: write d19/d24/d37/d40/d89/d29/d63/f7d [452979,21015] 0 2021-04-09T18:26:12.438 INFO:tasks.workunit.client.0.smithi120.stdout:0/393: write d0/d2/dd/f38 [2374318,9755] 0 2021-04-09T18:26:12.443 INFO:tasks.workunit.client.0.smithi120.stdout:7/305: write db/d2c/d30/f52 [4514916,17595] 0 2021-04-09T18:26:12.445 INFO:tasks.workunit.client.0.smithi120.stdout:5/525: creat d10/d12/d1b/d1f/d39/dbb/fc6 x:0 0 0 2021-04-09T18:26:12.449 INFO:tasks.workunit.client.0.smithi120.stdout:7/306: chown db/d2c/d34/d5d 39949 1 2021-04-09T18:26:12.449 INFO:tasks.workunit.client.0.smithi120.stdout:6/421: rename d6/d7f to d6/d8/d3a/d56/d97 0 2021-04-09T18:26:12.453 INFO:tasks.workunit.client.0.smithi120.stdout:9/438: rename d19/d24/d36/l8a to d19/d81/l8e 0 2021-04-09T18:26:12.455 INFO:tasks.workunit.client.0.smithi120.stdout:3/444: symlink d3/d5/d36/d1e/d6b/d6a/l94 0 2021-04-09T18:26:12.456 INFO:tasks.workunit.client.0.smithi120.stdout:6/422: stat d6/d8/db/d2b/f2e 0 2021-04-09T18:26:12.456 INFO:tasks.workunit.client.0.smithi120.stdout:5/526: creat d10/d12/fc7 x:0 0 0 2021-04-09T18:26:12.460 INFO:tasks.workunit.client.0.smithi120.stdout:6/423: chown d6/d8/db/f7d 356979934 1 2021-04-09T18:26:12.463 INFO:tasks.workunit.client.0.smithi120.stdout:0/394: write d0/d2/f46 [649447,116495] 0 2021-04-09T18:26:12.465 INFO:tasks.workunit.client.0.smithi120.stdout:1/508: dwrite d5/d1f/d22/d2b/f47 [0,4194304] 0 2021-04-09T18:26:12.468 INFO:tasks.workunit.client.0.smithi120.stdout:6/424: mkdir d6/d8/d52/d98 0 2021-04-09T18:26:12.470 INFO:tasks.workunit.client.0.smithi120.stdout:3/445: truncate d3/d5/f4d 1451305 0 2021-04-09T18:26:12.475 INFO:tasks.workunit.client.0.smithi120.stdout:5/527: symlink d10/d12/d1b/d1f/d84/d44/d8c/da6/lc8 0 2021-04-09T18:26:12.476 INFO:tasks.workunit.client.0.smithi120.stdout:1/509: dread d5/d64/d63/f8f [0,4194304] 0 2021-04-09T18:26:12.485 INFO:tasks.workunit.client.0.smithi120.stdout:0/395: creat d0/d2/d4/f73 x:0 0 0 2021-04-09T18:26:12.487 INFO:tasks.workunit.client.0.smithi120.stdout:5/528: symlink d10/d12/d1b/d1f/d84/d44/lc9 0 2021-04-09T18:26:12.491 INFO:tasks.workunit.client.0.smithi120.stdout:7/307: mkdir db/d2c/d34/d6c 0 2021-04-09T18:26:12.495 INFO:tasks.workunit.client.0.smithi120.stdout:0/396: symlink d0/d5a/d62/l74 0 2021-04-09T18:26:12.497 INFO:tasks.workunit.client.0.smithi120.stdout:1/510: creat d5/d64/d2d/d5a/d8d/fa8 x:0 0 0 2021-04-09T18:26:12.501 INFO:tasks.workunit.client.0.smithi120.stdout:5/529: symlink d10/d12/d1b/d3a/d5b/lca 0 2021-04-09T18:26:12.501 INFO:tasks.workunit.client.0.smithi120.stdout:3/446: write d3/f29 [3930121,38149] 0 2021-04-09T18:26:12.503 INFO:tasks.workunit.client.0.smithi120.stdout:6/425: write d6/d8/db/d2b/d68/d6a/f8f [2060904,77262] 0 2021-04-09T18:26:12.513 INFO:tasks.workunit.client.0.smithi120.stdout:9/439: truncate d19/f38 7373331 0 2021-04-09T18:26:12.514 INFO:tasks.workunit.client.0.smithi120.stdout:7/308: dwrite db/f2f [0,4194304] 0 2021-04-09T18:26:12.515 INFO:tasks.workunit.client.0.smithi120.stdout:0/397: creat d0/d5a/d6c/f75 x:0 0 0 2021-04-09T18:26:12.516 INFO:tasks.workunit.client.0.smithi120.stdout:1/511: symlink d5/d1f/d22/d2b/la9 0 2021-04-09T18:26:12.519 INFO:tasks.workunit.client.0.smithi120.stdout:5/530: mkdir d10/d12/d1b/d1f/d84/d44/dcb 0 2021-04-09T18:26:12.532 INFO:tasks.workunit.client.0.smithi120.stdout:0/398: dwrite d0/d2/dd/f38 [0,4194304] 0 2021-04-09T18:26:12.533 INFO:tasks.workunit.client.0.smithi120.stdout:3/447: dwrite d3/d5/f28 [0,4194304] 0 2021-04-09T18:26:12.537 INFO:tasks.workunit.client.0.smithi120.stdout:5/531: write d10/d12/d1b/d1f/f79 [2510581,54319] 0 2021-04-09T18:26:12.537 INFO:tasks.workunit.client.0.smithi120.stdout:0/399: stat d0/d2/d4/l39 0 2021-04-09T18:26:12.538 INFO:tasks.workunit.client.0.smithi120.stdout:7/309: write db/d2c/f44 [1945898,76657] 0 2021-04-09T18:26:12.538 INFO:tasks.workunit.client.0.smithi120.stdout:1/512: write d5/d5c/f72 [5161961,39398] 0 2021-04-09T18:26:12.541 INFO:tasks.workunit.client.0.smithi120.stdout:0/400: dread - d0/d2/d4/f73 zero size 2021-04-09T18:26:12.546 INFO:tasks.workunit.client.0.smithi120.stdout:9/440: dwrite d19/f3d [0,4194304] 0 2021-04-09T18:26:12.547 INFO:tasks.workunit.client.0.smithi120.stdout:7/310: chown db/d26/d4c 1498843 1 2021-04-09T18:26:12.551 INFO:tasks.workunit.client.0.smithi120.stdout:5/532: dread - d10/d12/d1b/d1f/d39/f80 zero size 2021-04-09T18:26:12.551 INFO:tasks.workunit.client.0.smithi120.stdout:0/401: readlink d0/d5a/l64 0 2021-04-09T18:26:12.575 INFO:tasks.workunit.client.0.smithi120.stdout:3/448: symlink d3/d5/d36/d1e/d6b/d49/d5e/l95 0 2021-04-09T18:26:12.576 INFO:tasks.workunit.client.0.smithi120.stdout:6/426: dread d6/d8/db/d12/d22/f2a [0,4194304] 0 2021-04-09T18:26:12.579 INFO:tasks.workunit.client.0.smithi120.stdout:5/533: fdatasync d10/f11 0 2021-04-09T18:26:12.585 INFO:tasks.workunit.client.0.smithi120.stdout:0/402: creat d0/d2/d4/d5f/f76 x:0 0 0 2021-04-09T18:26:12.587 INFO:tasks.workunit.client.0.smithi120.stdout:9/441: creat d19/d24/d37/d40/f8f x:0 0 0 2021-04-09T18:26:12.588 INFO:tasks.workunit.client.0.smithi120.stdout:5/534: mkdir d10/d12/d1b/d1f/d84/d44/d8c/da6/dcc 0 2021-04-09T18:26:12.589 INFO:tasks.workunit.client.0.smithi120.stdout:1/513: dwrite d5/d64/d63/f8f [0,4194304] 0 2021-04-09T18:26:12.590 INFO:tasks.workunit.client.0.smithi120.stdout:3/449: creat d3/d5/d36/d1e/d6b/d49/d89/f96 x:0 0 0 2021-04-09T18:26:12.594 INFO:tasks.workunit.client.0.smithi120.stdout:9/442: chown d19/f32 36 1 2021-04-09T18:26:12.595 INFO:tasks.workunit.client.0.smithi120.stdout:5/535: chown d10/d12/d1b/d1f/d84/d44/f65 1101 1 2021-04-09T18:26:12.597 INFO:tasks.workunit.client.0.smithi120.stdout:0/403: fsync d0/d2/da/f19 0 2021-04-09T18:26:12.605 INFO:tasks.workunit.client.0.smithi120.stdout:9/443: rename d19/d2c/f46 to d19/d24/f90 0 2021-04-09T18:26:12.609 INFO:tasks.workunit.client.0.smithi120.stdout:0/404: creat d0/d5a/d62/d69/f77 x:0 0 0 2021-04-09T18:26:12.613 INFO:tasks.workunit.client.0.smithi120.stdout:3/450: unlink d3/d5/d36/d3d/f6c 0 2021-04-09T18:26:12.615 INFO:tasks.workunit.client.0.smithi120.stdout:5/536: dwrite d10/d12/d1b/d1f/d39/dbb/fc6 [0,4194304] 0 2021-04-09T18:26:12.617 INFO:tasks.workunit.client.0.smithi120.stdout:7/311: dread db/d2c/d30/f52 [0,4194304] 0 2021-04-09T18:26:12.618 INFO:tasks.workunit.client.0.smithi120.stdout:1/514: truncate d5/d1f/d22/d24/f2f 2623135 0 2021-04-09T18:26:12.620 INFO:tasks.workunit.client.0.smithi120.stdout:0/405: getdents d0/d5a 0 2021-04-09T18:26:12.629 INFO:tasks.workunit.client.0.smithi120.stdout:7/312: dwrite db/d42/d54/d5a/f6b [0,4194304] 0 2021-04-09T18:26:12.638 INFO:tasks.workunit.client.0.smithi120.stdout:9/444: creat d19/d24/d37/d40/d89/d29/d76/f91 x:0 0 0 2021-04-09T18:26:12.638 INFO:tasks.workunit.client.0.smithi120.stdout:5/537: write d10/d12/d1b/d1f/f64 [1475767,15880] 0 2021-04-09T18:26:12.639 INFO:tasks.workunit.client.0.smithi120.stdout:7/313: dwrite f4 [0,4194304] 0 2021-04-09T18:26:12.646 INFO:tasks.workunit.client.0.smithi120.stdout:9/445: creat d19/f92 x:0 0 0 2021-04-09T18:26:12.650 INFO:tasks.workunit.client.0.smithi120.stdout:3/451: rename d3/d5/d36/d1e/f39 to d3/d5/d36/d1e/d6b/d49/d89/d68/f97 0 2021-04-09T18:26:12.662 INFO:tasks.workunit.client.0.smithi120.stdout:5/538: unlink d10/d12/d1b/d1f/f57 0 2021-04-09T18:26:12.664 INFO:tasks.workunit.client.0.smithi120.stdout:3/452: symlink d3/de/l98 0 2021-04-09T18:26:12.669 INFO:tasks.workunit.client.0.smithi120.stdout:0/406: rename d0/d2/da/l10 to d0/d5a/d62/l78 0 2021-04-09T18:26:12.673 INFO:tasks.workunit.client.0.smithi120.stdout:1/515: dwrite d5/d64/d2d/f8b [0,4194304] 0 2021-04-09T18:26:12.675 INFO:tasks.workunit.client.0.smithi120.stdout:9/446: write d19/d24/d36/d47/f57 [1295157,111672] 0 2021-04-09T18:26:12.678 INFO:tasks.workunit.client.0.smithi120.stdout:5/539: dwrite d10/d12/d1b/fc2 [0,4194304] 0 2021-04-09T18:26:12.679 INFO:tasks.workunit.client.0.smithi120.stdout:1/516: mknod d5/caa 1 2021-04-09T18:26:12.679 INFO:tasks.workunit.client.0.smithi120.stdout:9/447: mknod d19/d2c/c93 1 2021-04-09T18:26:12.680 INFO:tasks.workunit.client.0.smithi120.stdout:7/314: truncate db/d2c/f44 1527348 0 2021-04-09T18:26:12.681 INFO:tasks.workunit.client.0.smithi120.stdout:1/517: mknod d5/d1f/d22/d87/cab 1 2021-04-09T18:26:12.682 INFO:tasks.workunit.client.0.smithi120.stdout:7/315: rmdir db/d2c 39 2021-04-09T18:26:12.682 INFO:tasks.workunit.client.0.smithi120.stdout:0/407: read d0/fc [1907764,69615] 0 2021-04-09T18:26:12.695 INFO:tasks.workunit.client.0.smithi120.stdout:7/316: dwrite db/f1b [0,4194304] 0 2021-04-09T18:26:12.703 INFO:tasks.workunit.client.0.smithi120.stdout:1/518: rename d5/l4e to d5/d50/d61/lac 0 2021-04-09T18:26:12.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.720 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17a0192220 con 0x7f17a01a1510 2021-04-09T18:26:12.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.721 7f179d7fa700 1 -- 172.21.15.120:0/475445776 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+1768 (secure 0 0 0) 0x7f179400bde0 con 0x7f17a01a1510 2021-04-09T18:26:12.715 INFO:tasks.workunit.client.0.smithi120.stdout:1/519: link d5/d1f/l21 d5/d64/d63/lad 0 2021-04-09T18:26:12.717 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2021-04-09T18:26:12.718 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:12.718 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:12.719 INFO:tasks.workunit.client.0.smithi120.stdout:1/520: creat d5/d50/fae x:0 0 0 2021-04-09T18:26:12.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17800188c0 msgr2=0x7f178001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:12.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17800188c0 0x7f178001adc0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a01a1510 msgr2=0x7f17a00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:12.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a01a1510 0x7f17a00b7040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f179400b650 tx=0x7f179400b9f0).stop 2021-04-09T18:26:12.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 shutdown_connections 2021-04-09T18:26:12.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17800188c0 0x7f178001adc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17a00b7c80 0x7f17a0192540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a0191bf0 0x7f17a00b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 --2- 172.21.15.120:0/475445776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a01a1510 0x7f17a00b7040 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 >> 172.21.15.120:0/475445776 conn(0x7f17a008f950 msgr2=0x7f17a008eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 shutdown_connections 2021-04-09T18:26:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:12.727 7f17a6cdd700 1 -- 172.21.15.120:0/475445776 wait complete. 2021-04-09T18:26:12.731 INFO:tasks.mds_thrash.fs.[None]:mds.b has gained rank=0, replacing gid=4839 2021-04-09T18:26:12.731 INFO:tasks.mds_thrash.fs.[None]:waiting for 9 secs before reviving mds.a 2021-04-09T18:26:12.732 INFO:tasks.workunit.client.0.smithi120.stdout:9/448: dread d19/d24/d37/d40/d89/d29/d63/f7d [0,4194304] 0 2021-04-09T18:26:12.734 INFO:tasks.workunit.client.0.smithi120.stdout:9/449: creat d19/d24/d37/f94 x:0 0 0 2021-04-09T18:26:12.737 INFO:tasks.workunit.client.0.smithi120.stdout:9/450: creat d19/d2c/f95 x:0 0 0 2021-04-09T18:26:12.742 INFO:tasks.workunit.client.0.smithi120.stdout:9/451: unlink d19/d24/d37/d40/d89/d29/d63/f71 0 2021-04-09T18:26:12.750 INFO:tasks.workunit.client.0.smithi120.stdout:9/452: truncate d19/d24/d37/d40/d89/f6b 639818 0 2021-04-09T18:26:12.762 INFO:tasks.workunit.client.0.smithi120.stdout:3/453: dread d3/d5/d36/d1e/d6b/f3f [0,4194304] 0 2021-04-09T18:26:12.765 INFO:tasks.workunit.client.0.smithi120.stdout:3/454: dread - d3/d5/d36/d1e/d38/f63 zero size 2021-04-09T18:26:12.836 INFO:tasks.workunit.client.0.smithi120.stdout:8/371: sync 2021-04-09T18:26:12.842 INFO:tasks.workunit.client.0.smithi120.stdout:8/372: creat d2/d3/d11/d2c/d44/f74 x:0 0 0 2021-04-09T18:26:12.852 INFO:tasks.workunit.client.0.smithi120.stdout:7/317: write db/f25 [3172232,32387] 0 2021-04-09T18:26:12.856 INFO:tasks.workunit.client.0.smithi120.stdout:5/540: dwrite d10/d12/d1b/d1f/d84/d44/f88 [0,4194304] 0 2021-04-09T18:26:12.858 INFO:tasks.workunit.client.0.smithi120.stdout:1/521: rmdir d5/d64/d63/d86/d93 0 2021-04-09T18:26:12.860 INFO:tasks.workunit.client.0.smithi120.stdout:1/522: write d5/d64/d2d/d5a/d8d/fa8 [742124,99508] 0 2021-04-09T18:26:12.862 INFO:tasks.workunit.client.0.smithi120.stdout:7/318: link db/f2f db/d38/f6d 0 2021-04-09T18:26:12.862 INFO:tasks.workunit.client.0.smithi120.stdout:1/523: chown d5/d1f/d22/d24 105661328 1 2021-04-09T18:26:12.864 INFO:tasks.workunit.client.0.smithi120.stdout:3/455: dread d3/d5/d36/d1e/f40 [0,4194304] 0 2021-04-09T18:26:12.870 INFO:tasks.workunit.client.0.smithi120.stdout:6/427: dread d6/d8/f26 [0,4194304] 0 2021-04-09T18:26:12.872 INFO:tasks.workunit.client.0.smithi120.stdout:6/428: chown d6/d8/db/d2b/d68/d6a 0 1 2021-04-09T18:26:12.878 INFO:tasks.workunit.client.0.smithi120.stdout:5/541: fdatasync d10/d12/d1b/d1f/d84/d3d/f3f 0 2021-04-09T18:26:12.878 INFO:tasks.workunit.client.0.smithi120.stdout:7/319: mkdir db/d38/d3c/d6e 0 2021-04-09T18:26:12.881 INFO:tasks.workunit.client.0.smithi120.stdout:3/456: dread d3/de/d25/f65 [0,4194304] 0 2021-04-09T18:26:12.884 INFO:tasks.workunit.client.0.smithi120.stdout:7/320: read - db/d42/d54/d5a/f64 zero size 2021-04-09T18:26:12.903 INFO:tasks.workunit.client.0.smithi120.stdout:5/542: rename d10/daa/fb5 to d10/d12/d1b/d3a/fcd 0 2021-04-09T18:26:12.904 INFO:tasks.workunit.client.0.smithi120.stdout:6/429: truncate d6/d8/d3a/f59 1273686 0 2021-04-09T18:26:12.905 INFO:tasks.workunit.client.0.smithi120.stdout:5/543: rmdir d10/d12/d1b/d1f/d84/d44 39 2021-04-09T18:26:12.911 INFO:tasks.workunit.client.0.smithi120.stdout:6/430: dread d6/d8/d52/d6c/f8e [0,4194304] 0 2021-04-09T18:26:12.913 INFO:tasks.workunit.client.0.smithi120.stdout:5/544: fdatasync d10/d12/d1b/d1f/f56 0 2021-04-09T18:26:13.034 INFO:tasks.workunit.client.0.smithi120.stdout:3/457: write d3/d5/d36/d1e/d6b/d49/d89/d68/f97 [141876,129324] 0 2021-04-09T18:26:13.045 INFO:tasks.workunit.client.0.smithi120.stdout:6/431: write d6/d8/d1a/d36/d54/d41/d49/f4f [532544,76548] 0 2021-04-09T18:26:13.046 INFO:tasks.workunit.client.0.smithi120.stdout:6/432: stat d6/d8/d1a/d36/d54/d31/d37/d61 0 2021-04-09T18:26:13.048 INFO:tasks.workunit.client.0.smithi120.stdout:5/545: write d10/d12/f77 [306123,25635] 0 2021-04-09T18:26:13.049 INFO:tasks.workunit.client.0.smithi120.stdout:3/458: creat d3/de/d25/f99 x:0 0 0 2021-04-09T18:26:13.054 INFO:tasks.workunit.client.0.smithi120.stdout:9/453: dread d19/d24/d37/d40/d89/f23 [0,4194304] 0 2021-04-09T18:26:13.070 INFO:tasks.workunit.client.0.smithi120.stdout:3/459: getdents d3/d5/d36/d1e/d38 0 2021-04-09T18:26:13.071 INFO:tasks.workunit.client.0.smithi120.stdout:3/460: dread - d3/d5/d36/d1e/d38/f63 zero size 2021-04-09T18:26:13.081 INFO:tasks.workunit.client.0.smithi120.stdout:1/524: dread d5/d50/f55 [0,4194304] 0 2021-04-09T18:26:13.085 INFO:tasks.workunit.client.0.smithi120.stdout:9/454: link d19/d81/l8e d19/d24/l96 0 2021-04-09T18:26:13.280 INFO:tasks.workunit.client.0.smithi120.stdout:3/461: dread d3/d5/d36/d1e/d6b/d49/d4e/d54/f7e [0,4194304] 0 2021-04-09T18:26:13.285 INFO:tasks.workunit.client.0.smithi120.stdout:9/455: creat d19/d24/d37/f97 x:0 0 0 2021-04-09T18:26:13.289 INFO:tasks.workunit.client.0.smithi120.stdout:3/462: getdents d3/d5/d36/d1e/d38 0 2021-04-09T18:26:13.291 INFO:tasks.workunit.client.0.smithi120.stdout:9/456: unlink d19/d24/f5e 0 2021-04-09T18:26:13.293 INFO:tasks.workunit.client.0.smithi120.stdout:9/457: mknod d19/d24/d36/d47/c98 1 2021-04-09T18:26:13.296 INFO:tasks.workunit.client.0.smithi120.stdout:3/463: getdents d3/d5/d36/d1e/d6b/d49/d5e/d80 0 2021-04-09T18:26:13.298 INFO:tasks.workunit.client.0.smithi120.stdout:9/458: read - d19/d24/d37/d40/d89/d52/f59 zero size 2021-04-09T18:26:13.300 INFO:tasks.workunit.client.0.smithi120.stdout:3/464: stat d3/d5/d36/d1e/d6b/d6a/d83/f93 0 2021-04-09T18:26:13.304 INFO:tasks.workunit.client.0.smithi120.stdout:3/465: read d3/d5/d36/d1e/d38/d6d/f92 [5104386,17073] 0 2021-04-09T18:26:13.306 INFO:tasks.workunit.client.0.smithi120.stdout:8/373: unlink d2/d27/f69 0 2021-04-09T18:26:13.310 INFO:tasks.workunit.client.0.smithi120.stdout:8/374: read - d2/d3/d11/d2c/d44/f74 zero size 2021-04-09T18:26:13.349 INFO:tasks.workunit.client.0.smithi120.stdout:2/486: sync 2021-04-09T18:26:13.349 INFO:tasks.workunit.client.0.smithi120.stdout:4/400: sync 2021-04-09T18:26:13.350 INFO:tasks.workunit.client.0.smithi120.stdout:3/466: mkdir d3/d5/d36/d1e/d38/d61/d9a 0 2021-04-09T18:26:13.361 INFO:tasks.workunit.client.0.smithi120.stdout:6/433: dwrite d6/d8/f10 [0,4194304] 0 2021-04-09T18:26:13.363 INFO:tasks.workunit.client.0.smithi120.stdout:4/401: creat d1f/d2c/f86 x:0 0 0 2021-04-09T18:26:13.504 INFO:tasks.workunit.client.0.smithi120.stdout:3/467: creat d3/d5/d36/d1e/d6b/d6a/d83/f9b x:0 0 0 2021-04-09T18:26:13.509 INFO:tasks.workunit.client.0.smithi120.stdout:5/546: dwrite d10/f16 [4194304,4194304] 0 2021-04-09T18:26:13.519 INFO:tasks.workunit.client.0.smithi120.stdout:6/434: symlink d6/d8/d1a/d36/d5a/l99 0 2021-04-09T18:26:13.523 INFO:tasks.workunit.client.0.smithi120.stdout:1/525: dwrite d5/d1f/d22/d2b/f62 [0,4194304] 0 2021-04-09T18:26:13.532 INFO:tasks.workunit.client.0.smithi120.stdout:9/459: dwrite d19/d24/d37/d40/f56 [0,4194304] 0 2021-04-09T18:26:13.533 INFO:tasks.workunit.client.0.smithi120.stdout:6/435: creat d6/d8/d1a/d36/d54/d31/d37/d61/f9a x:0 0 0 2021-04-09T18:26:13.537 INFO:tasks.workunit.client.0.smithi120.stdout:2/487: dwrite f9 [0,4194304] 0 2021-04-09T18:26:13.537 INFO:tasks.workunit.client.0.smithi120.stdout:2/488: chown d13/d15 970 1 2021-04-09T18:26:13.553 INFO:tasks.workunit.client.0.smithi120.stdout:0/408: sync 2021-04-09T18:26:13.557 INFO:tasks.workunit.client.0.smithi120.stdout:9/460: chown d19/d24/d37/d40/d89/f80 271 1 2021-04-09T18:26:13.558 INFO:tasks.workunit.client.0.smithi120.stdout:6/436: symlink d6/d8/db/d2b/l9b 0 2021-04-09T18:26:13.558 INFO:tasks.workunit.client.0.smithi120.stdout:0/409: mknod d0/d2/da/c79 1 2021-04-09T18:26:13.558 INFO:tasks.workunit.client.0.smithi120.stdout:1/526: truncate d5/d1f/d22/d2b/f78 966357 0 2021-04-09T18:26:13.561 INFO:tasks.workunit.client.0.smithi120.stdout:3/468: dwrite d3/de/d25/f1f [0,4194304] 0 2021-04-09T18:26:13.569 INFO:tasks.workunit.client.0.smithi120.stdout:9/461: mkdir d19/d2c/d5b/d99 0 2021-04-09T18:26:13.573 INFO:tasks.workunit.client.0.smithi120.stdout:2/489: rename d13/d7a/d80/d48/d49/d64/f8b to d13/d7a/d80/d54/fa0 0 2021-04-09T18:26:13.575 INFO:tasks.workunit.client.0.smithi120.stdout:3/469: fsync d3/d5/d36/d1e/d6b/d49/d4e/d54/f75 0 2021-04-09T18:26:13.582 INFO:tasks.workunit.client.0.smithi120.stdout:2/490: dwrite d13/d7a/d80/d48/d49/d64/f74 [0,4194304] 0 2021-04-09T18:26:13.584 INFO:tasks.workunit.client.0.smithi120.stdout:3/470: mkdir d3/d5/d36/d1e/d6b/d49/d5e/d80/d9c 0 2021-04-09T18:26:13.585 INFO:tasks.workunit.client.0.smithi120.stdout:5/547: dwrite d10/d12/d1b/d1f/d39/dab/fb3 [0,4194304] 0 2021-04-09T18:26:13.595 INFO:tasks.workunit.client.0.smithi120.stdout:0/410: write d0/d2/da/f2c [3818752,100123] 0 2021-04-09T18:26:13.598 INFO:tasks.workunit.client.0.smithi120.stdout:3/471: dread - d3/d5/d36/d1e/d6b/d49/d4e/f8c zero size 2021-04-09T18:26:13.601 INFO:tasks.workunit.client.0.smithi120.stdout:5/548: dread d10/f16 [4194304,4194304] 0 2021-04-09T18:26:13.610 INFO:tasks.workunit.client.0.smithi120.stdout:9/462: write d19/d24/d36/d47/f4e [6625524,48557] 0 2021-04-09T18:26:13.612 INFO:tasks.workunit.client.0.smithi120.stdout:6/437: rename d6/d8/db/d12/d22/l38 to d6/d8/d52/d6c/l9c 0 2021-04-09T18:26:13.615 INFO:tasks.workunit.client.0.smithi120.stdout:2/491: mknod d13/d61/d7c/d98/ca1 1 2021-04-09T18:26:13.623 INFO:tasks.workunit.client.0.smithi120.stdout:0/411: dread d0/d2/d4/f59 [0,4194304] 0 2021-04-09T18:26:13.629 INFO:tasks.workunit.client.0.smithi120.stdout:7/321: sync 2021-04-09T18:26:13.630 INFO:tasks.workunit.client.0.smithi120.stdout:8/375: sync 2021-04-09T18:26:13.630 INFO:tasks.workunit.client.0.smithi120.stdout:3/472: creat d3/d5/d36/d1e/d6b/d49/d5e/f9d x:0 0 0 2021-04-09T18:26:13.631 INFO:tasks.workunit.client.0.smithi120.stdout:2/492: read d13/f47 [521987,121201] 0 2021-04-09T18:26:13.632 INFO:tasks.workunit.client.0.smithi120.stdout:5/549: dread - d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b/fa7 zero size 2021-04-09T18:26:13.632 INFO:tasks.workunit.client.0.smithi120.stdout:0/412: dwrite d0/d2/f46 [0,4194304] 0 2021-04-09T18:26:13.635 INFO:tasks.workunit.client.0.smithi120.stdout:9/463: creat d19/d24/d37/d40/d89/d29/d76/f9a x:0 0 0 2021-04-09T18:26:13.636 INFO:tasks.workunit.client.0.smithi120.stdout:1/527: rename d5/d1f/d22 to d5/d5c/d75/daf 0 2021-04-09T18:26:13.645 INFO:tasks.workunit.client.0.smithi120.stdout:5/550: dread - d10/d12/d1b/d3a/f74 zero size 2021-04-09T18:26:13.649 INFO:tasks.workunit.client.0.smithi120.stdout:7/322: mkdir db/d2c/d34/d6c/d6f 0 2021-04-09T18:26:13.653 INFO:tasks.workunit.client.0.smithi120.stdout:1/528: fsync d5/d5c/d75/daf/d2b/f78 0 2021-04-09T18:26:13.655 INFO:tasks.workunit.client.0.smithi120.stdout:7/323: stat db/d2c/d34/f41 0 2021-04-09T18:26:13.656 INFO:tasks.workunit.client.0.smithi120.stdout:5/551: dwrite d10/d12/d1b/d1f/f71 [0,4194304] 0 2021-04-09T18:26:13.661 INFO:tasks.workunit.client.0.smithi120.stdout:6/438: write d6/d8/d1a/d36/d54/d41/d49/f7c [372787,29858] 0 2021-04-09T18:26:13.663 INFO:tasks.workunit.client.0.smithi120.stdout:9/464: creat d19/d24/d2e/f9b x:0 0 0 2021-04-09T18:26:13.668 INFO:tasks.workunit.client.0.smithi120.stdout:0/413: dread d0/d52/f6d [0,4194304] 0 2021-04-09T18:26:13.669 INFO:tasks.workunit.client.0.smithi120.stdout:4/402: sync 2021-04-09T18:26:13.675 INFO:tasks.workunit.client.0.smithi120.stdout:8/376: rename d2/d3/d50/l59 to d2/d3/d50/d64/l75 0 2021-04-09T18:26:13.676 INFO:tasks.workunit.client.0.smithi120.stdout:2/493: truncate d13/d7a/d80/d54/f60 375838 0 2021-04-09T18:26:13.683 INFO:tasks.workunit.client.0.smithi120.stdout:8/377: dread - d2/d3/f5f zero size 2021-04-09T18:26:13.687 INFO:tasks.workunit.client.0.smithi120.stdout:3/473: dwrite d3/d5/d36/d1e/d6b/d49/d73/f84 [0,4194304] 0 2021-04-09T18:26:13.688 INFO:tasks.workunit.client.0.smithi120.stdout:9/465: mkdir d19/d24/d36/d9c 0 2021-04-09T18:26:13.688 INFO:tasks.workunit.client.0.smithi120.stdout:7/324: link db/f1b db/d2c/d34/f70 0 2021-04-09T18:26:13.689 INFO:tasks.workunit.client.0.smithi120.stdout:7/325: chown db/d2c/d34/f48 24539 1 2021-04-09T18:26:13.690 INFO:tasks.workunit.client.0.smithi120.stdout:5/552: mknod d10/d12/d1b/d1f/d84/d44/d8c/da3/cce 1 2021-04-09T18:26:13.694 INFO:tasks.workunit.client.0.smithi120.stdout:4/403: mkdir d1f/d2c/d30/d87 0 2021-04-09T18:26:13.696 INFO:tasks.workunit.client.0.smithi120.stdout:0/414: creat d0/d2/da/f7a x:0 0 0 2021-04-09T18:26:13.697 INFO:tasks.workunit.client.0.smithi120.stdout:1/529: dwrite d5/d1f/f96 [0,4194304] 0 2021-04-09T18:26:13.699 INFO:tasks.workunit.client.0.smithi120.stdout:6/439: dwrite d6/fc [8388608,4194304] 0 2021-04-09T18:26:13.707 INFO:tasks.workunit.client.0.smithi120.stdout:3/474: mkdir d3/de/d87/d9e 0 2021-04-09T18:26:13.709 INFO:tasks.workunit.client.0.smithi120.stdout:3/475: read - d3/de/d25/f99 zero size 2021-04-09T18:26:13.709 INFO:tasks.workunit.client.0.smithi120.stdout:2/494: dwrite f6 [4194304,4194304] 0 2021-04-09T18:26:13.711 INFO:tasks.workunit.client.0.smithi120.stdout:8/378: unlink d2/d3/d50/d64/l75 0 2021-04-09T18:26:13.719 INFO:tasks.workunit.client.0.smithi120.stdout:5/553: creat d10/d12/d1b/d1f/d84/d44/dcb/fcf x:0 0 0 2021-04-09T18:26:13.727 INFO:tasks.workunit.client.0.smithi120.stdout:5/554: dwrite d10/d12/d1b/f34 [4194304,4194304] 0 2021-04-09T18:26:13.732 INFO:tasks.workunit.client.0.smithi120.stdout:4/404: dread d1f/d2c/d3b/f5e [0,4194304] 0 2021-04-09T18:26:13.733 INFO:tasks.workunit.client.0.smithi120.stdout:3/476: mknod d3/c9f 1 2021-04-09T18:26:13.741 INFO:tasks.workunit.client.0.smithi120.stdout:8/379: mknod d2/d3/d8/c76 1 2021-04-09T18:26:13.741 INFO:tasks.workunit.client.0.smithi120.stdout:2/495: mkdir d13/d61/d7c/d98/da2 0 2021-04-09T18:26:13.741 INFO:tasks.workunit.client.0.smithi120.stdout:9/466: getdents d19/d24/d36 0 2021-04-09T18:26:13.743 INFO:tasks.workunit.client.0.smithi120.stdout:1/530: rename d5/d1f/f81 to d5/d64/d2d/d5a/fb0 0 2021-04-09T18:26:13.744 INFO:tasks.workunit.client.0.smithi120.stdout:4/405: dread d1f/d24/d6b/f82 [0,4194304] 0 2021-04-09T18:26:13.744 INFO:tasks.workunit.client.0.smithi120.stdout:1/531: fdatasync d5/f7 0 2021-04-09T18:26:13.750 INFO:tasks.workunit.client.0.smithi120.stdout:5/555: symlink d10/d12/d1b/d1f/d39/ld0 0 2021-04-09T18:26:13.751 INFO:tasks.workunit.client.0.smithi120.stdout:5/556: chown d10/d12/d1b/d3a/d5b 460792260 1 2021-04-09T18:26:13.753 INFO:tasks.workunit.client.0.smithi120.stdout:9/467: mkdir d19/d24/d36/d9d 0 2021-04-09T18:26:13.756 INFO:tasks.workunit.client.0.smithi120.stdout:8/380: write d2/f2d [1723230,70183] 0 2021-04-09T18:26:13.760 INFO:tasks.workunit.client.0.smithi120.stdout:0/415: getdents d0/d52/d56 0 2021-04-09T18:26:13.763 INFO:tasks.workunit.client.0.smithi120.stdout:6/440: truncate d6/d8/d1a/d36/d5a/f8d 845350 0 2021-04-09T18:26:13.764 INFO:tasks.workunit.client.0.smithi120.stdout:2/496: write d13/d15/f9c [4319886,46469] 0 2021-04-09T18:26:13.775 INFO:tasks.workunit.client.0.smithi120.stdout:3/477: creat d3/d5/d36/d1e/d6b/d49/d73/fa0 x:0 0 0 2021-04-09T18:26:13.780 INFO:tasks.workunit.client.0.smithi120.stdout:0/416: fsync d0/f3c 0 2021-04-09T18:26:13.783 INFO:tasks.workunit.client.0.smithi120.stdout:3/478: dread - d3/d5/d36/d1e/d6b/d49/f7c zero size 2021-04-09T18:26:13.784 INFO:tasks.workunit.client.0.smithi120.stdout:5/557: write d10/d12/f90 [461851,84769] 0 2021-04-09T18:26:13.785 INFO:tasks.workunit.client.0.smithi120.stdout:0/417: mkdir d0/d2/d7b 0 2021-04-09T18:26:13.790 INFO:tasks.workunit.client.0.smithi120.stdout:8/381: truncate d2/f2d 1294113 0 2021-04-09T18:26:13.791 INFO:tasks.workunit.client.0.smithi120.stdout:6/441: dread d6/d8/d3a/f59 [0,4194304] 0 2021-04-09T18:26:13.792 INFO:tasks.workunit.client.0.smithi120.stdout:2/497: write d13/d7a/d80/f7d [884724,79934] 0 2021-04-09T18:26:13.792 INFO:tasks.workunit.client.0.smithi120.stdout:4/406: dwrite d1f/f23 [4194304,4194304] 0 2021-04-09T18:26:13.806 INFO:tasks.workunit.client.0.smithi120.stdout:1/532: dwrite d5/d50/d61/f7e [0,4194304] 0 2021-04-09T18:26:13.812 INFO:tasks.workunit.client.0.smithi120.stdout:9/468: dwrite fb [0,4194304] 0 2021-04-09T18:26:13.815 INFO:tasks.workunit.client.0.smithi120.stdout:1/533: mknod d5/d64/d63/cb1 1 2021-04-09T18:26:13.815 INFO:tasks.workunit.client.0.smithi120.stdout:3/479: mkdir d3/d5/d36/d1e/d6b/d49/d89/d68/da1 0 2021-04-09T18:26:13.818 INFO:tasks.workunit.client.0.smithi120.stdout:4/407: chown d1f/d2c/d30/l6f 63 1 2021-04-09T18:26:13.820 INFO:tasks.workunit.client.0.smithi120.stdout:6/442: fsync d6/d8/db/d12/d22/f2a 0 2021-04-09T18:26:13.825 INFO:tasks.workunit.client.0.smithi120.stdout:2/498: dread d13/d15/f24 [0,4194304] 0 2021-04-09T18:26:13.834 INFO:tasks.workunit.client.0.smithi120.stdout:1/534: dread d5/d64/d2d/f8b [0,4194304] 0 2021-04-09T18:26:13.834 INFO:tasks.workunit.client.0.smithi120.stdout:1/535: stat d5/d1f/f96 0 2021-04-09T18:26:13.834 INFO:tasks.workunit.client.0.smithi120.stdout:0/418: dread d0/d2/f26 [0,4194304] 0 2021-04-09T18:26:13.835 INFO:tasks.workunit.client.0.smithi120.stdout:5/558: dread fd [0,4194304] 0 2021-04-09T18:26:13.839 INFO:tasks.workunit.client.0.smithi120.stdout:4/408: mknod d1f/d2c/d30/c88 1 2021-04-09T18:26:13.840 INFO:tasks.workunit.client.0.smithi120.stdout:9/469: mkdir d19/d24/d9e 0 2021-04-09T18:26:13.841 INFO:tasks.workunit.client.0.smithi120.stdout:3/480: mknod d3/de/d25/ca2 1 2021-04-09T18:26:13.841 INFO:tasks.workunit.client.0.smithi120.stdout:6/443: readlink d6/d8/d1a/d36/d54/d31/d37/d61/l69 0 2021-04-09T18:26:13.847 INFO:tasks.workunit.client.0.smithi120.stdout:0/419: write d0/d2/d4/f59 [819854,22040] 0 2021-04-09T18:26:13.847 INFO:tasks.workunit.client.0.smithi120.stdout:6/444: symlink d6/d8/db/d92/l9d 0 2021-04-09T18:26:13.849 INFO:tasks.workunit.client.0.smithi120.stdout:4/409: dwrite d1f/f23 [8388608,4194304] 0 2021-04-09T18:26:13.850 INFO:tasks.workunit.client.0.smithi120.stdout:5/559: creat d10/d12/d1b/d1f/d84/d44/d8c/fd1 x:0 0 0 2021-04-09T18:26:13.854 INFO:tasks.workunit.client.0.smithi120.stdout:3/481: mkdir d3/d5/d36/d1e/d6b/d49/d4e/d54/da3 0 2021-04-09T18:26:13.855 INFO:tasks.workunit.client.0.smithi120.stdout:1/536: rename d5/d64/d63/lad to d5/d50/lb2 0 2021-04-09T18:26:13.857 INFO:tasks.workunit.client.0.smithi120.stdout:9/470: dread d19/d24/d37/d40/d89/d52/f7e [0,4194304] 0 2021-04-09T18:26:13.858 INFO:tasks.workunit.client.0.smithi120.stdout:8/382: creat d2/d3/d11/d6a/d3b/f77 x:0 0 0 2021-04-09T18:26:13.859 INFO:tasks.workunit.client.0.smithi120.stdout:1/537: dread d5/d5c/d75/daf/d2b/f47 [0,4194304] 0 2021-04-09T18:26:13.864 INFO:tasks.workunit.client.0.smithi120.stdout:9/471: fdatasync f17 0 2021-04-09T18:26:13.866 INFO:tasks.workunit.client.0.smithi120.stdout:1/538: mknod d5/d64/cb3 1 2021-04-09T18:26:13.868 INFO:tasks.workunit.client.0.smithi120.stdout:4/410: mkdir d1f/d2c/d34/d60/d7a/d89 0 2021-04-09T18:26:13.873 INFO:tasks.workunit.client.0.smithi120.stdout:6/445: rename d6/d8/db/d12/d22/f2a to d6/d8/d1a/d36/d54/d31/d37/d61/f9e 0 2021-04-09T18:26:13.879 INFO:tasks.workunit.client.0.smithi120.stdout:8/383: creat d2/d3/d50/f78 x:0 0 0 2021-04-09T18:26:13.882 INFO:tasks.workunit.client.0.smithi120.stdout:6/446: fdatasync d6/d8/d1a/d36/d54/d31/d37/d61/f9e 0 2021-04-09T18:26:13.883 INFO:tasks.workunit.client.0.smithi120.stdout:5/560: dwrite d10/d12/fbf [4194304,4194304] 0 2021-04-09T18:26:13.883 INFO:tasks.workunit.client.0.smithi120.stdout:8/384: chown d2/d3/d50/d4b 51 1 2021-04-09T18:26:13.885 INFO:tasks.workunit.client.0.smithi120.stdout:1/539: dread d5/d64/d2d/f70 [0,4194304] 0 2021-04-09T18:26:13.886 INFO:tasks.workunit.client.0.smithi120.stdout:3/482: dwrite d3/de/d25/f22 [0,4194304] 0 2021-04-09T18:26:13.886 INFO:tasks.workunit.client.0.smithi120.stdout:4/411: creat d1f/d2c/d3b/d3e/d7c/f8a x:0 0 0 2021-04-09T18:26:13.887 INFO:tasks.workunit.client.0.smithi120.stdout:8/385: write d2/d3/d50/f78 [351347,4429] 0 2021-04-09T18:26:13.891 INFO:tasks.workunit.client.0.smithi120.stdout:5/561: symlink d10/ld2 0 2021-04-09T18:26:13.897 INFO:tasks.workunit.client.0.smithi120.stdout:8/386: read - d2/d3/d11/d6a/d3b/f77 zero size 2021-04-09T18:26:13.897 INFO:tasks.workunit.client.0.smithi120.stdout:4/412: stat d1f/d2c/d3b/d3e/f54 0 2021-04-09T18:26:13.898 INFO:tasks.workunit.client.0.smithi120.stdout:5/562: rmdir d10/d12/d1b/d1f/d84 39 2021-04-09T18:26:13.901 INFO:tasks.workunit.client.0.smithi120.stdout:9/472: dwrite d19/d24/d36/d47/f57 [0,4194304] 0 2021-04-09T18:26:13.901 INFO:tasks.workunit.client.0.smithi120.stdout:6/447: dread d6/d8/db/d12/d22/f40 [0,4194304] 0 2021-04-09T18:26:13.903 INFO:tasks.workunit.client.0.smithi120.stdout:1/540: creat d5/d64/d2d/d5a/d8d/fb4 x:0 0 0 2021-04-09T18:26:13.911 INFO:tasks.workunit.client.0.smithi120.stdout:6/448: fsync d6/d8/d1a/d36/f5c 0 2021-04-09T18:26:13.915 INFO:tasks.workunit.client.0.smithi120.stdout:9/473: symlink d19/d24/d2e/l9f 0 2021-04-09T18:26:13.915 INFO:tasks.workunit.client.0.smithi120.stdout:1/541: mkdir d5/d64/d2d/db5 0 2021-04-09T18:26:13.915 INFO:tasks.workunit.client.0.smithi120.stdout:5/563: dwrite d10/d12/d1b/d1f/f79 [0,4194304] 0 2021-04-09T18:26:13.918 INFO:tasks.workunit.client.0.smithi120.stdout:1/542: write d5/d5c/d75/daf/d2b/f62 [2632812,50917] 0 2021-04-09T18:26:13.923 INFO:tasks.workunit.client.0.smithi120.stdout:6/449: creat d6/d8/db/d12/d93/f9f x:0 0 0 2021-04-09T18:26:13.935 INFO:tasks.workunit.client.0.smithi120.stdout:8/387: dread d2/d3/d3c/d4f/f5b [0,4194304] 0 2021-04-09T18:26:13.935 INFO:tasks.workunit.client.0.smithi120.stdout:9/474: symlink d19/d2c/d5b/d99/la0 0 2021-04-09T18:26:13.936 INFO:tasks.workunit.client.0.smithi120.stdout:4/413: dwrite d1f/d2c/d34/f66 [0,4194304] 0 2021-04-09T18:26:13.941 INFO:tasks.workunit.client.0.smithi120.stdout:5/564: dread d10/d12/f2e [0,4194304] 0 2021-04-09T18:26:13.957 INFO:tasks.workunit.client.0.smithi120.stdout:4/414: fdatasync d1f/d2c/d34/f51 0 2021-04-09T18:26:13.960 INFO:tasks.workunit.client.0.smithi120.stdout:9/475: write d19/d24/d37/f5f [128677,109904] 0 2021-04-09T18:26:13.961 INFO:tasks.workunit.client.0.smithi120.stdout:6/450: dwrite d6/d8/db/f39 [4194304,4194304] 0 2021-04-09T18:26:13.970 INFO:tasks.workunit.client.0.smithi120.stdout:9/476: mknod d19/d24/d36/d47/d6f/ca1 1 2021-04-09T18:26:13.972 INFO:tasks.workunit.client.0.smithi120.stdout:8/388: truncate d2/d3/d11/d6a/d3b/f67 251260 0 2021-04-09T18:26:13.978 INFO:tasks.workunit.client.0.smithi120.stdout:8/389: stat d2/d3/d11/d6a/d3b/f2b 0 2021-04-09T18:26:13.980 INFO:tasks.workunit.client.0.smithi120.stdout:5/565: getdents d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b 0 2021-04-09T18:26:13.983 INFO:tasks.workunit.client.0.smithi120.stdout:8/390: mknod d2/d3/d11/d6a/d3b/c79 1 2021-04-09T18:26:13.985 INFO:tasks.workunit.client.0.smithi120.stdout:4/415: rename d1f/d2c/f2e to d1f/d2c/d3b/d3e/d73/f8b 0 2021-04-09T18:26:13.991 INFO:tasks.workunit.client.0.smithi120.stdout:9/477: creat d19/d24/d37/d40/fa2 x:0 0 0 2021-04-09T18:26:13.992 INFO:tasks.workunit.client.0.smithi120.stdout:9/478: chown d19/d81 4271485 1 2021-04-09T18:26:13.992 INFO:tasks.workunit.client.0.smithi120.stdout:4/416: unlink d1f/d2c/d34/f66 0 2021-04-09T18:26:13.992 INFO:tasks.workunit.client.0.smithi120.stdout:9/479: dread - d19/d24/d37/d40/fa2 zero size 2021-04-09T18:26:13.993 INFO:tasks.workunit.client.0.smithi120.stdout:5/566: write d10/d12/d1b/f8b [148365,112533] 0 2021-04-09T18:26:13.993 INFO:tasks.workunit.client.0.smithi120.stdout:6/451: dwrite d6/d8/d1a/d36/d5a/d5d/d6e/f8b [0,4194304] 0 2021-04-09T18:26:13.994 INFO:tasks.workunit.client.0.smithi120.stdout:8/391: write d2/d3/d11/d6a/d3b/f47 [4198225,96043] 0 2021-04-09T18:26:13.998 INFO:tasks.workunit.client.0.smithi120.stdout:8/392: chown d2/d3/d3c/d4f 2 1 2021-04-09T18:26:14.000 INFO:tasks.workunit.client.0.smithi120.stdout:8/393: fdatasync d2/d3/d11/d2c/d44/f74 0 2021-04-09T18:26:14.002 INFO:tasks.workunit.client.0.smithi120.stdout:5/567: symlink d10/daa/ld3 0 2021-04-09T18:26:14.006 INFO:tasks.workunit.client.0.smithi120.stdout:9/480: write d19/d24/d37/d40/d89/d29/d76/f83 [1011546,71841] 0 2021-04-09T18:26:14.009 INFO:tasks.workunit.client.0.smithi120.stdout:4/417: write d1f/f32 [1713652,98924] 0 2021-04-09T18:26:14.011 INFO:tasks.workunit.client.0.smithi120.stdout:5/568: getdents d10/d12/d1b/d1f/d84 0 2021-04-09T18:26:14.013 INFO:tasks.workunit.client.0.smithi120.stdout:6/452: dwrite d6/d8/f26 [4194304,4194304] 0 2021-04-09T18:26:14.014 INFO:tasks.workunit.client.0.smithi120.stdout:9/481: fdatasync d19/d24/d36/d47/f5d 0 2021-04-09T18:26:14.021 INFO:tasks.workunit.client.0.smithi120.stdout:8/394: dwrite d2/d3/d8/f1d [0,4194304] 0 2021-04-09T18:26:14.021 INFO:tasks.workunit.client.0.smithi120.stdout:6/453: symlink d6/d8/d3a/la0 0 2021-04-09T18:26:14.022 INFO:tasks.workunit.client.0.smithi120.stdout:4/418: read d1f/d2c/d56/f72 [1024865,22501] 0 2021-04-09T18:26:14.022 INFO:tasks.workunit.client.0.smithi120.stdout:4/419: stat d1f/f23 0 2021-04-09T18:26:14.023 INFO:tasks.workunit.client.0.smithi120.stdout:8/395: readlink d2/d3/d11/d6a/d3b/l35 0 2021-04-09T18:26:14.028 INFO:tasks.workunit.client.0.smithi120.stdout:8/396: stat d2/d3/f58 0 2021-04-09T18:26:14.029 INFO:tasks.workunit.client.0.smithi120.stdout:4/420: mknod d1f/d2c/d3b/d3e/c8c 1 2021-04-09T18:26:14.033 INFO:tasks.workunit.client.0.smithi120.stdout:9/482: dwrite d19/d2c/f95 [0,4194304] 0 2021-04-09T18:26:14.036 INFO:tasks.workunit.client.0.smithi120.stdout:4/421: creat d1f/f8d x:0 0 0 2021-04-09T18:26:14.042 INFO:tasks.workunit.client.0.smithi120.stdout:3/483: dread d3/d5/d36/d1e/d6b/f79 [4194304,4194304] 0 2021-04-09T18:26:14.045 INFO:tasks.workunit.client.0.smithi120.stdout:3/484: write d3/d5/f28 [3286606,15111] 0 2021-04-09T18:26:14.046 INFO:tasks.workunit.client.0.smithi120.stdout:8/397: dwrite d2/d3/d11/d2c/d44/f74 [0,4194304] 0 2021-04-09T18:26:14.052 INFO:tasks.workunit.client.0.smithi120.stdout:5/569: dwrite d10/d12/d1b/d1f/d84/d44/f65 [0,4194304] 0 2021-04-09T18:26:14.053 INFO:tasks.workunit.client.0.smithi120.stdout:3/485: dread d3/d5/d36/d1e/f40 [0,4194304] 0 2021-04-09T18:26:14.057 INFO:tasks.workunit.client.0.smithi120.stdout:3/486: chown d3/de/l34 13 1 2021-04-09T18:26:14.058 INFO:tasks.workunit.client.0.smithi120.stdout:3/487: read d3/d5/f28 [2191637,99827] 0 2021-04-09T18:26:14.059 INFO:tasks.workunit.client.0.smithi120.stdout:4/422: write d1f/d24/f3c [868612,52585] 0 2021-04-09T18:26:14.062 INFO:tasks.workunit.client.0.smithi120.stdout:3/488: write d3/f29 [1627275,52143] 0 2021-04-09T18:26:14.063 INFO:tasks.workunit.client.0.smithi120.stdout:9/483: dwrite d19/d24/d2e/f9b [0,4194304] 0 2021-04-09T18:26:14.065 INFO:tasks.workunit.client.0.smithi120.stdout:5/570: mkdir d10/d12/d1b/d1f/d84/d44/d8c/da6/dcc/dd4 0 2021-04-09T18:26:14.067 INFO:tasks.workunit.client.0.smithi120.stdout:6/454: dwrite d6/d8/d1a/d36/d5a/d5d/d6e/f71 [0,4194304] 0 2021-04-09T18:26:14.069 INFO:tasks.workunit.client.0.smithi120.stdout:9/484: unlink d19/f32 0 2021-04-09T18:26:14.078 INFO:tasks.workunit.client.0.smithi120.stdout:8/398: getdents d2/d37 0 2021-04-09T18:26:14.079 INFO:tasks.workunit.client.0.smithi120.stdout:6/455: chown d6/d8/db/d2b/d68/d6a/d74 16177574 1 2021-04-09T18:26:14.079 INFO:tasks.workunit.client.0.smithi120.stdout:9/485: mknod d19/d81/ca3 1 2021-04-09T18:26:14.083 INFO:tasks.workunit.client.0.smithi120.stdout:9/486: readlink l10 0 2021-04-09T18:26:14.084 INFO:tasks.workunit.client.0.smithi120.stdout:8/399: chown d2/d3/d8/l61 16 1 2021-04-09T18:26:14.085 INFO:tasks.workunit.client.0.smithi120.stdout:6/456: chown d6/d8/d1a/d36/d5a/f87 20189958 1 2021-04-09T18:26:14.089 INFO:tasks.workunit.client.0.smithi120.stdout:8/400: rmdir d2/d37/d3e 39 2021-04-09T18:26:14.090 INFO:tasks.workunit.client.0.smithi120.stdout:7/326: sync 2021-04-09T18:26:14.099 INFO:tasks.workunit.client.0.smithi120.stdout:4/423: write d1f/d24/d6b/f57 [262963,36538] 0 2021-04-09T18:26:14.101 INFO:tasks.workunit.client.0.smithi120.stdout:3/489: dwrite d3/f70 [4194304,4194304] 0 2021-04-09T18:26:14.107 INFO:tasks.workunit.client.0.smithi120.stdout:6/457: symlink d6/d8/d1a/d36/la1 0 2021-04-09T18:26:14.113 INFO:tasks.workunit.client.0.smithi120.stdout:3/490: dwrite d3/d5/d36/d1e/d38/f44 [0,4194304] 0 2021-04-09T18:26:14.113 INFO:tasks.workunit.client.0.smithi120.stdout:5/571: truncate d10/d12/d3b/f76 1071148 0 2021-04-09T18:26:14.117 INFO:tasks.workunit.client.0.smithi120.stdout:5/572: chown d10/d12/d1b/d1f/d39/fb2 0 1 2021-04-09T18:26:14.126 INFO:tasks.workunit.client.0.smithi120.stdout:5/573: fsync d10/d12/d1b/d1f/d84/f3e 0 2021-04-09T18:26:14.130 INFO:tasks.workunit.client.0.smithi120.stdout:9/487: write f16 [4489255,12516] 0 2021-04-09T18:26:14.130 INFO:tasks.workunit.client.0.smithi120.stdout:3/491: mkdir d3/d5/d36/d1e/d6b/d49/d5e/da4 0 2021-04-09T18:26:14.144 INFO:tasks.workunit.client.0.smithi120.stdout:5/574: unlink d10/d12/d3b/l43 0 2021-04-09T18:26:14.144 INFO:tasks.workunit.client.0.smithi120.stdout:7/327: creat db/d42/d54/f71 x:0 0 0 2021-04-09T18:26:14.147 INFO:tasks.workunit.client.0.smithi120.stdout:8/401: dread d2/d3/d50/f57 [0,4194304] 0 2021-04-09T18:26:14.148 INFO:tasks.workunit.client.0.smithi120.stdout:3/492: fsync d3/f6 0 2021-04-09T18:26:14.149 INFO:tasks.workunit.client.0.smithi120.stdout:5/575: mknod d10/daa/cd5 1 2021-04-09T18:26:14.150 INFO:tasks.workunit.client.0.smithi120.stdout:7/328: chown db/d38/f50 0 1 2021-04-09T18:26:14.151 INFO:tasks.workunit.client.0.smithi120.stdout:8/402: unlink d2/d3/d50/f78 0 2021-04-09T18:26:14.153 INFO:tasks.workunit.client.0.smithi120.stdout:4/424: dread d1f/d2c/d56/f5b [0,4194304] 0 2021-04-09T18:26:14.155 INFO:tasks.workunit.client.0.smithi120.stdout:8/403: rmdir d2 39 2021-04-09T18:26:14.155 INFO:tasks.workunit.client.0.smithi120.stdout:3/493: mknod d3/d5/d36/d1e/d6b/d49/d89/d86/ca5 1 2021-04-09T18:26:14.155 INFO:tasks.workunit.client.0.smithi120.stdout:6/458: dwrite d6/d8/d3a/d79/f7e [0,4194304] 0 2021-04-09T18:26:14.159 INFO:tasks.workunit.client.0.smithi120.stdout:9/488: write d19/d24/d37/d40/d89/f80 [1422783,98561] 0 2021-04-09T18:26:14.181 INFO:tasks.workunit.client.0.smithi120.stdout:6/459: unlink d6/d8/d1a/f50 0 2021-04-09T18:26:14.186 INFO:tasks.workunit.client.0.smithi120.stdout:8/404: rename d2/d3/d50/d4b to d2/d3/d50/d64/d7a 0 2021-04-09T18:26:14.189 INFO:tasks.workunit.client.0.smithi120.stdout:5/576: truncate d10/d12/d1b/d1f/f4e 48545 0 2021-04-09T18:26:14.189 INFO:tasks.workunit.client.0.smithi120.stdout:9/489: getdents d19/d24/d37 0 2021-04-09T18:26:14.191 INFO:tasks.workunit.client.0.smithi120.stdout:6/460: read d6/d8/db/f24 [39469,26265] 0 2021-04-09T18:26:14.192 INFO:tasks.workunit.client.0.smithi120.stdout:3/494: dread d3/d5/d36/d1e/d38/d6d/f92 [4194304,4194304] 0 2021-04-09T18:26:14.193 INFO:tasks.workunit.client.0.smithi120.stdout:6/461: readlink d6/d8/l21 0 2021-04-09T18:26:14.195 INFO:tasks.workunit.client.0.smithi120.stdout:8/405: creat d2/d3/d50/d64/f7b x:0 0 0 2021-04-09T18:26:14.204 INFO:tasks.workunit.client.0.smithi120.stdout:5/577: truncate d10/d12/d1b/d1f/d84/d44/d8c/da6/fbc 612038 0 2021-04-09T18:26:14.215 INFO:tasks.workunit.client.0.smithi120.stdout:3/495: dread d3/d5/d36/d3d/f6e [0,4194304] 0 2021-04-09T18:26:14.217 INFO:tasks.workunit.client.0.smithi120.stdout:5/578: rmdir d10/d12/d1b/d1f/d84/d44/d8c/da6/dcc 39 2021-04-09T18:26:14.225 INFO:tasks.workunit.client.0.smithi120.stdout:3/496: rename d3/d5/d36/d1e/d6b/d49/d4e/d54/da3 to d3/de/da6 0 2021-04-09T18:26:14.225 INFO:tasks.workunit.client.0.smithi120.stdout:8/406: dread d2/d37/d3e/d42/f53 [0,4194304] 0 2021-04-09T18:26:14.230 INFO:tasks.workunit.client.0.smithi120.stdout:7/329: dwrite db/f29 [0,4194304] 0 2021-04-09T18:26:14.238 INFO:tasks.workunit.client.0.smithi120.stdout:8/407: rename d2/d3/d50/d64 to d2/d37/d3e/d7c 0 2021-04-09T18:26:14.239 INFO:tasks.workunit.client.0.smithi120.stdout:6/462: dwrite d6/d8/db/f7d [0,4194304] 0 2021-04-09T18:26:14.243 INFO:tasks.workunit.client.0.smithi120.stdout:8/408: dread - d2/d3/d11/d6a/d3b/f72 zero size 2021-04-09T18:26:14.247 INFO:tasks.workunit.client.0.smithi120.stdout:5/579: dwrite d10/d12/d1b/d1f/d84/d3d/d50/fa5 [4194304,4194304] 0 2021-04-09T18:26:14.247 INFO:tasks.workunit.client.0.smithi120.stdout:3/497: write f1 [2382228,96297] 0 2021-04-09T18:26:14.252 INFO:tasks.workunit.client.0.smithi120.stdout:3/498: write d3/d5/d36/d1e/d6b/f79 [4001694,59464] 0 2021-04-09T18:26:14.255 INFO:tasks.workunit.client.0.smithi120.stdout:8/409: mknod d2/d3/d3c/c7d 1 2021-04-09T18:26:14.257 INFO:tasks.workunit.client.0.smithi120.stdout:3/499: fdatasync d3/de/d25/f99 0 2021-04-09T18:26:14.258 INFO:tasks.workunit.client.0.smithi120.stdout:7/330: creat db/d2c/d30/f72 x:0 0 0 2021-04-09T18:26:14.265 INFO:tasks.workunit.client.0.smithi120.stdout:6/463: dread d6/d8/db/d2b/d68/d6a/f8f [0,4194304] 0 2021-04-09T18:26:14.270 INFO:tasks.workunit.client.0.smithi120.stdout:6/464: creat d6/d8/db/d2b/d68/d6a/d74/fa2 x:0 0 0 2021-04-09T18:26:14.284 INFO:tasks.workunit.client.0.smithi120.stdout:8/410: dread d2/d3/d8/f65 [0,4194304] 0 2021-04-09T18:26:14.295 INFO:tasks.workunit.client.0.smithi120.stdout:5/580: dwrite d10/d12/f1a [0,4194304] 0 2021-04-09T18:26:14.298 INFO:tasks.workunit.client.0.smithi120.stdout:8/411: creat d2/d37/f7e x:0 0 0 2021-04-09T18:26:14.309 INFO:tasks.workunit.client.0.smithi120.stdout:3/500: dwrite d3/d5/d36/d1e/d6b/d49/d4e/f6f [0,4194304] 0 2021-04-09T18:26:14.315 INFO:tasks.workunit.client.0.smithi120.stdout:7/331: dwrite db/d38/f40 [0,4194304] 0 2021-04-09T18:26:14.321 INFO:tasks.workunit.client.0.smithi120.stdout:3/501: fdatasync d3/f37 0 2021-04-09T18:26:14.322 INFO:tasks.workunit.client.0.smithi120.stdout:7/332: symlink db/d38/d3c/d6e/l73 0 2021-04-09T18:26:14.326 INFO:tasks.workunit.client.0.smithi120.stdout:5/581: write d10/d12/d1b/d1f/d84/d3d/d50/f85 [4292967,110682] 0 2021-04-09T18:26:14.326 INFO:tasks.workunit.client.0.smithi120.stdout:6/465: truncate d6/d8/d1a/d36/d54/d31/f76 4198351 0 2021-04-09T18:26:14.331 INFO:tasks.workunit.client.0.smithi120.stdout:5/582: creat d10/daa/db4/fd6 x:0 0 0 2021-04-09T18:26:14.332 INFO:tasks.workunit.client.0.smithi120.stdout:6/466: symlink d6/d8/d3a/la3 0 2021-04-09T18:26:14.334 INFO:tasks.workunit.client.0.smithi120.stdout:7/333: rename db/d2c/d34/d6c to db/d38/d74 0 2021-04-09T18:26:14.335 INFO:tasks.workunit.client.0.smithi120.stdout:8/412: dwrite d2/d3/f60 [0,4194304] 0 2021-04-09T18:26:14.338 INFO:tasks.workunit.client.0.smithi120.stdout:5/583: chown d10/d12/f27 458 1 2021-04-09T18:26:14.341 INFO:tasks.workunit.client.0.smithi120.stdout:7/334: fdatasync db/d42/f43 0 2021-04-09T18:26:14.347 INFO:tasks.workunit.client.0.smithi120.stdout:5/584: unlink d10/d12/d1b/d1f/d39/dbb/fc6 0 2021-04-09T18:26:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:5/585: symlink d10/d12/d1b/d1f/d84/ld7 0 2021-04-09T18:26:14.353 INFO:tasks.workunit.client.0.smithi120.stdout:6/467: getdents d6/d8/db/d2b/d4d 0 2021-04-09T18:26:14.354 INFO:tasks.workunit.client.0.smithi120.stdout:3/502: write d3/d5/d36/d1e/d38/d6d/f92 [4393235,100462] 0 2021-04-09T18:26:14.357 INFO:tasks.workunit.client.0.smithi120.stdout:8/413: truncate d2/d3/f28 37255 0 2021-04-09T18:26:14.357 INFO:tasks.workunit.client.0.smithi120.stdout:6/468: rmdir d6/d8/d1a/d36/d54/d31/d37 39 2021-04-09T18:26:14.360 INFO:tasks.workunit.client.0.smithi120.stdout:3/503: dread d3/de/d25/f1f [0,4194304] 0 2021-04-09T18:26:14.361 INFO:tasks.workunit.client.0.smithi120.stdout:6/469: write d6/d8/d1a/d36/d54/d41/d49/f4f [1673133,50448] 0 2021-04-09T18:26:14.363 INFO:tasks.workunit.client.0.smithi120.stdout:7/335: write db/d42/f43 [409626,35644] 0 2021-04-09T18:26:14.366 INFO:tasks.workunit.client.0.smithi120.stdout:3/504: readlink d3/d5/d36/d1e/d6b/d49/d73/l8a 0 2021-04-09T18:26:14.370 INFO:tasks.workunit.client.0.smithi120.stdout:6/470: creat d6/d8/d1a/d36/d54/d31/d8a/fa4 x:0 0 0 2021-04-09T18:26:14.372 INFO:tasks.workunit.client.0.smithi120.stdout:6/471: mknod d6/d8/d52/d6c/ca5 1 2021-04-09T18:26:14.373 INFO:tasks.workunit.client.0.smithi120.stdout:7/336: creat db/d42/d54/d5a/f75 x:0 0 0 2021-04-09T18:26:14.377 INFO:tasks.workunit.client.0.smithi120.stdout:7/337: write db/d2c/d30/f52 [4202543,47501] 0 2021-04-09T18:26:14.380 INFO:tasks.workunit.client.0.smithi120.stdout:7/338: chown db/d2c/d34/f5b 30957851 1 2021-04-09T18:26:14.385 INFO:tasks.workunit.client.0.smithi120.stdout:6/472: truncate d6/d8/d1a/f34 1874196 0 2021-04-09T18:26:14.388 INFO:tasks.workunit.client.0.smithi120.stdout:6/473: write d6/d8/db/d2b/d68/d6a/d74/fa2 [266342,68734] 0 2021-04-09T18:26:14.392 INFO:tasks.workunit.client.0.smithi120.stdout:7/339: truncate db/d2c/f44 1383598 0 2021-04-09T18:26:14.395 INFO:tasks.workunit.client.0.smithi120.stdout:7/340: chown db/f1a 252 1 2021-04-09T18:26:14.396 INFO:tasks.workunit.client.0.smithi120.stdout:6/474: rename d6/d8/d52/d6c to d6/d8/db/da6 0 2021-04-09T18:26:14.399 INFO:tasks.workunit.client.0.smithi120.stdout:7/341: mkdir db/d38/d74/d6f/d76 0 2021-04-09T18:26:14.401 INFO:tasks.workunit.client.0.smithi120.stdout:6/475: symlink d6/d8/db/d92/la7 0 2021-04-09T18:26:14.403 INFO:tasks.workunit.client.0.smithi120.stdout:6/476: mkdir d6/d8/d52/da8 0 2021-04-09T18:26:14.406 INFO:tasks.workunit.client.0.smithi120.stdout:6/477: chown d6/d8/d1a/d36/d5a/d5d/d6e/f80 756 1 2021-04-09T18:26:14.406 INFO:tasks.workunit.client.0.smithi120.stdout:7/342: link db/d26/d4c/l4e db/d38/d74/l77 0 2021-04-09T18:26:14.408 INFO:tasks.workunit.client.0.smithi120.stdout:7/343: mknod db/d42/d54/c78 1 2021-04-09T18:26:14.409 INFO:tasks.workunit.client.0.smithi120.stdout:7/344: write db/d2c/d34/f41 [4142490,15080] 0 2021-04-09T18:26:14.412 INFO:tasks.workunit.client.0.smithi120.stdout:7/345: chown db/d26/d4c/d53/l56 21 1 2021-04-09T18:26:14.417 INFO:tasks.workunit.client.0.smithi120.stdout:5/586: chown d10/d12/d1b/d1f/d84/d44/d8c 45413 1 2021-04-09T18:26:14.419 INFO:tasks.workunit.client.0.smithi120.stdout:7/346: dwrite db/d42/f43 [0,4194304] 0 2021-04-09T18:26:14.420 INFO:tasks.workunit.client.0.smithi120.stdout:5/587: dread - d10/d12/d1b/d1f/d84/d44/d8c/fd1 zero size 2021-04-09T18:26:14.423 INFO:tasks.workunit.client.0.smithi120.stdout:7/347: getdents db/d26/d4c 0 2021-04-09T18:26:14.425 INFO:tasks.workunit.client.0.smithi120.stdout:7/348: stat db/d38/d3c/f3d 0 2021-04-09T18:26:14.447 INFO:tasks.workunit.client.0.smithi120.stdout:7/349: dread db/d2c/d34/f48 [0,4194304] 0 2021-04-09T18:26:14.450 INFO:tasks.workunit.client.0.smithi120.stdout:7/350: creat db/d2c/d34/f79 x:0 0 0 2021-04-09T18:26:14.670 INFO:tasks.workunit.client.0.smithi120.stdout:2/499: sync 2021-04-09T18:26:14.673 INFO:tasks.workunit.client.0.smithi120.stdout:2/500: mkdir d13/d7a/d80/d48/da3 0 2021-04-09T18:26:14.674 INFO:tasks.workunit.client.0.smithi120.stdout:2/501: write f4 [6874239,22215] 0 2021-04-09T18:26:14.679 INFO:tasks.workunit.client.0.smithi120.stdout:2/502: fdatasync f4 0 2021-04-09T18:26:14.681 INFO:tasks.workunit.client.0.smithi120.stdout:2/503: mknod d13/d61/d7c/d98/da2/ca4 1 2021-04-09T18:26:14.688 INFO:tasks.workunit.client.0.smithi120.stdout:2/504: link d13/f25 d13/d7a/d80/d48/d49/d64/d83/d94/fa5 0 2021-04-09T18:26:14.692 INFO:tasks.workunit.client.0.smithi120.stdout:2/505: getdents d13/d15/d35 0 2021-04-09T18:26:14.694 INFO:tasks.workunit.client.0.smithi120.stdout:2/506: symlink d13/d15/d35/d9f/la6 0 2021-04-09T18:26:14.696 INFO:tasks.workunit.client.0.smithi120.stdout:2/507: symlink d13/d15/d35/la7 0 2021-04-09T18:26:14.697 INFO:tasks.workunit.client.0.smithi120.stdout:2/508: stat d13/d61/f79 0 2021-04-09T18:26:14.703 INFO:tasks.workunit.client.0.smithi120.stdout:3/505: write d3/de/d25/f65 [1599664,124327] 0 2021-04-09T18:26:14.707 INFO:tasks.workunit.client.0.smithi120.stdout:3/506: creat d3/d5/d36/d1e/d38/d61/d9a/fa7 x:0 0 0 2021-04-09T18:26:14.711 INFO:tasks.workunit.client.0.smithi120.stdout:3/507: unlink d3/de/l88 0 2021-04-09T18:26:14.715 INFO:tasks.workunit.client.0.smithi120.stdout:3/508: creat d3/d5/d36/d1e/d6b/d49/fa8 x:0 0 0 2021-04-09T18:26:14.720 INFO:tasks.workunit.client.0.smithi120.stdout:3/509: dwrite d3/de/d25/f99 [0,4194304] 0 2021-04-09T18:26:14.721 INFO:tasks.workunit.client.0.smithi120.stdout:5/588: dread d10/d12/f3c [0,4194304] 0 2021-04-09T18:26:14.727 INFO:tasks.workunit.client.0.smithi120.stdout:3/510: creat d3/d5/d36/d1e/d6b/d49/fa9 x:0 0 0 2021-04-09T18:26:14.729 INFO:tasks.workunit.client.0.smithi120.stdout:6/478: write d6/d8/d1a/d36/d54/d31/f85 [715836,32498] 0 2021-04-09T18:26:14.730 INFO:tasks.workunit.client.0.smithi120.stdout:7/351: write db/d26/f45 [1834762,73964] 0 2021-04-09T18:26:14.733 INFO:tasks.workunit.client.0.smithi120.stdout:7/352: chown db/d2c/d34/f79 1353633943 1 2021-04-09T18:26:14.738 INFO:tasks.workunit.client.0.smithi120.stdout:7/353: mknod db/d42/d54/d5a/c7a 1 2021-04-09T18:26:14.739 INFO:tasks.workunit.client.0.smithi120.stdout:7/354: chown db/d2c 19 1 2021-04-09T18:26:14.739 INFO:tasks.workunit.client.0.smithi120.stdout:2/509: dwrite d13/d7a/d80/f45 [0,4194304] 0 2021-04-09T18:26:14.740 INFO:tasks.workunit.client.0.smithi120.stdout:7/355: chown db/d38/f50 1739391 1 2021-04-09T18:26:14.745 INFO:tasks.workunit.client.0.smithi120.stdout:3/511: getdents d3/d5/d36/d1e/d6b/d49/d5e/d80/d9c 0 2021-04-09T18:26:14.746 INFO:tasks.workunit.client.0.smithi120.stdout:6/479: unlink d6/d8/d1a/d36/f89 0 2021-04-09T18:26:14.746 INFO:tasks.workunit.client.0.smithi120.stdout:7/356: read db/f1b [3992713,89787] 0 2021-04-09T18:26:14.754 INFO:tasks.workunit.client.0.smithi120.stdout:7/357: creat db/d38/d74/f7b x:0 0 0 2021-04-09T18:26:14.754 INFO:tasks.workunit.client.0.smithi120.stdout:5/589: write d10/d12/f27 [7576889,53998] 0 2021-04-09T18:26:14.756 INFO:tasks.workunit.client.0.smithi120.stdout:7/358: write db/d42/d54/f71 [272709,126996] 0 2021-04-09T18:26:14.759 INFO:tasks.workunit.client.0.smithi120.stdout:2/510: creat d13/d7a/d80/d54/fa8 x:0 0 0 2021-04-09T18:26:14.763 INFO:tasks.workunit.client.0.smithi120.stdout:7/359: symlink db/d26/d4c/d53/l7c 0 2021-04-09T18:26:14.765 INFO:tasks.workunit.client.0.smithi120.stdout:5/590: unlink d10/d12/d1b/d1f/d84/d3d/d50/d94/lc0 0 2021-04-09T18:26:14.769 INFO:tasks.workunit.client.0.smithi120.stdout:5/591: read - d10/d12/d1b/d1f/d84/f3e zero size 2021-04-09T18:26:14.861 INFO:tasks.workunit.client.0.smithi120.stdout:4/425: sync 2021-04-09T18:26:14.861 INFO:tasks.workunit.client.0.smithi120.stdout:1/543: sync 2021-04-09T18:26:14.861 INFO:tasks.workunit.client.0.smithi120.stdout:9/490: sync 2021-04-09T18:26:14.862 INFO:tasks.workunit.client.0.smithi120.stdout:0/420: sync 2021-04-09T18:26:14.863 INFO:tasks.workunit.client.0.smithi120.stdout:1/544: mknod d5/d64/d2d/db5/cb6 1 2021-04-09T18:26:14.863 INFO:tasks.workunit.client.0.smithi120.stdout:5/592: readlink d10/d12/d1b/d1f/d84/d3d/l75 0 2021-04-09T18:26:14.863 INFO:tasks.workunit.client.0.smithi120.stdout:0/421: write d0/d2/da/f2c [3728268,39867] 0 2021-04-09T18:26:14.865 INFO:tasks.workunit.client.0.smithi120.stdout:1/545: readlink d5/d5c/d75/la4 0 2021-04-09T18:26:14.872 INFO:tasks.workunit.client.0.smithi120.stdout:3/512: dwrite d3/d5/d36/d1e/d6b/d49/d4e/d54/f75 [0,4194304] 0 2021-04-09T18:26:14.874 INFO:tasks.workunit.client.0.smithi120.stdout:1/546: chown d5/d5c/d75/daf/d6c/l71 3 1 2021-04-09T18:26:14.880 INFO:tasks.workunit.client.0.smithi120.stdout:2/511: dwrite fb [4194304,4194304] 0 2021-04-09T18:26:14.881 INFO:tasks.workunit.client.0.smithi120.stdout:5/593: truncate d10/d12/d1b/d1f/d84/f3e 751596 0 2021-04-09T18:26:14.883 INFO:tasks.workunit.client.0.smithi120.stdout:7/360: dwrite db/d42/f4b [0,4194304] 0 2021-04-09T18:26:14.885 INFO:tasks.workunit.client.0.smithi120.stdout:3/513: fdatasync d3/d5/d36/d1e/d6b/d49/d4e/f60 0 2021-04-09T18:26:14.885 INFO:tasks.workunit.client.0.smithi120.stdout:9/491: write d19/d24/d37/d40/d89/f20 [1103496,39285] 0 2021-04-09T18:26:14.886 INFO:tasks.workunit.client.0.smithi120.stdout:9/492: fsync f16 0 2021-04-09T18:26:14.890 INFO:tasks.workunit.client.0.smithi120.stdout:2/512: dread d13/d7a/d80/f45 [0,4194304] 0 2021-04-09T18:26:14.894 INFO:tasks.workunit.client.0.smithi120.stdout:5/594: dread - d10/d12/d1b/d1f/d84/fa0 zero size 2021-04-09T18:26:14.903 INFO:tasks.workunit.client.0.smithi120.stdout:2/513: dwrite d13/d7a/d80/d48/d49/d64/f74 [0,4194304] 0 2021-04-09T18:26:14.906 INFO:tasks.workunit.client.0.smithi120.stdout:5/595: dwrite d10/d12/fc7 [0,4194304] 0 2021-04-09T18:26:14.907 INFO:tasks.workunit.client.0.smithi120.stdout:3/514: dread d3/d5/d36/d1e/f40 [0,4194304] 0 2021-04-09T18:26:14.912 INFO:tasks.workunit.client.0.smithi120.stdout:0/422: write d0/d2/f5b [3745490,35262] 0 2021-04-09T18:26:14.913 INFO:tasks.workunit.client.0.smithi120.stdout:8/414: sync 2021-04-09T18:26:14.913 INFO:tasks.workunit.client.0.smithi120.stdout:6/480: sync 2021-04-09T18:26:14.920 INFO:tasks.workunit.client.0.smithi120.stdout:6/481: creat d6/d8/db/d12/d93/fa9 x:0 0 0 2021-04-09T18:26:14.924 INFO:tasks.workunit.client.0.smithi120.stdout:3/515: rename d3/d5/l2b to d3/d5/d36/d1e/laa 0 2021-04-09T18:26:14.925 INFO:tasks.workunit.client.0.smithi120.stdout:0/423: symlink d0/d5a/d62/d69/l7c 0 2021-04-09T18:26:14.936 INFO:tasks.workunit.client.0.smithi120.stdout:6/482: creat d6/d8/d52/faa x:0 0 0 2021-04-09T18:26:14.937 INFO:tasks.workunit.client.0.smithi120.stdout:5/596: write d10/d12/d1b/d1f/d84/fa0 [528700,51431] 0 2021-04-09T18:26:14.939 INFO:tasks.workunit.client.0.smithi120.stdout:3/516: mknod d3/d5/d36/d1e/d6b/d49/d73/cab 1 2021-04-09T18:26:14.943 INFO:tasks.workunit.client.0.smithi120.stdout:5/597: unlink d10/d12/f27 0 2021-04-09T18:26:14.945 INFO:tasks.workunit.client.0.smithi120.stdout:3/517: unlink d3/d5/d36/d3d/f6e 0 2021-04-09T18:26:14.947 INFO:tasks.workunit.client.0.smithi120.stdout:1/547: dread d5/d64/d2d/f3a [0,4194304] 0 2021-04-09T18:26:14.949 INFO:tasks.workunit.client.0.smithi120.stdout:9/493: dread f16 [0,4194304] 0 2021-04-09T18:26:14.959 INFO:tasks.workunit.client.0.smithi120.stdout:2/514: creat d13/d7a/d80/d48/d49/d64/d83/fa9 x:0 0 0 2021-04-09T18:26:14.961 INFO:tasks.workunit.client.0.smithi120.stdout:6/483: link d6/d8/d1a/d36/d5a/f8d d6/d8/db/d2b/d68/d6a/d74/fab 0 2021-04-09T18:26:14.963 INFO:tasks.workunit.client.0.smithi120.stdout:1/548: creat d5/fb7 x:0 0 0 2021-04-09T18:26:14.965 INFO:tasks.workunit.client.0.smithi120.stdout:9/494: creat d19/d24/fa4 x:0 0 0 2021-04-09T18:26:14.968 INFO:tasks.workunit.client.0.smithi120.stdout:1/549: chown d5/d64/la1 0 1 2021-04-09T18:26:14.970 INFO:tasks.workunit.client.0.smithi120.stdout:8/415: dwrite d2/d3/d11/d2c/f32 [0,4194304] 0 2021-04-09T18:26:14.973 INFO:tasks.workunit.client.0.smithi120.stdout:6/484: rename d6/d8/d52/d98 to d6/d8/db/dac 0 2021-04-09T18:26:14.980 INFO:tasks.workunit.client.0.smithi120.stdout:1/550: mkdir d5/d5c/d75/daf/db8 0 2021-04-09T18:26:14.981 INFO:tasks.workunit.client.0.smithi120.stdout:4/426: dread d1f/f23 [0,4194304] 0 2021-04-09T18:26:14.992 INFO:tasks.workunit.client.0.smithi120.stdout:8/416: creat d2/d3/d11/d6a/d3b/f7f x:0 0 0 2021-04-09T18:26:14.999 INFO:tasks.workunit.client.0.smithi120.stdout:1/551: truncate d5/fb7 7818 0 2021-04-09T18:26:15.001 INFO:tasks.workunit.client.0.smithi120.stdout:5/598: write d10/d12/d1b/d1f/d84/d3d/d50/f70 [4929824,10370] 0 2021-04-09T18:26:15.005 INFO:tasks.workunit.client.0.smithi120.stdout:8/417: creat d2/d3/d11/d6a/d3b/f80 x:0 0 0 2021-04-09T18:26:15.012 INFO:tasks.workunit.client.0.smithi120.stdout:5/599: read d10/d12/d1b/d1f/d84/d3d/d50/da9/fba [2882201,24675] 0 2021-04-09T18:26:15.013 INFO:tasks.workunit.client.0.smithi120.stdout:1/552: link d5/d5c/d75/daf/l38 d5/d64/d2d/d5a/lb9 0 2021-04-09T18:26:15.016 INFO:tasks.workunit.client.0.smithi120.stdout:1/553: mknod d5/d64/d63/cba 1 2021-04-09T18:26:15.016 INFO:tasks.workunit.client.0.smithi120.stdout:3/518: write d3/d5/d36/f23 [4828758,117785] 0 2021-04-09T18:26:15.019 INFO:tasks.workunit.client.0.smithi120.stdout:7/361: dread db/d2c/d34/f70 [0,4194304] 0 2021-04-09T18:26:15.019 INFO:tasks.workunit.client.0.smithi120.stdout:2/515: dread d13/f1d [0,4194304] 0 2021-04-09T18:26:15.024 INFO:tasks.workunit.client.0.smithi120.stdout:2/516: symlink d13/d7a/d80/d48/d49/d64/d9d/laa 0 2021-04-09T18:26:15.028 INFO:tasks.workunit.client.0.smithi120.stdout:9/495: dwrite d19/d2c/f3f [0,4194304] 0 2021-04-09T18:26:15.033 INFO:tasks.workunit.client.0.smithi120.stdout:6/485: dwrite d6/d8/d1a/d36/d54/d31/f76 [0,4194304] 0 2021-04-09T18:26:15.035 INFO:tasks.workunit.client.0.smithi120.stdout:9/496: truncate f7 166054 0 2021-04-09T18:26:15.041 INFO:tasks.workunit.client.0.smithi120.stdout:4/427: dwrite d1f/d2c/d34/f6d [0,4194304] 0 2021-04-09T18:26:15.045 INFO:tasks.workunit.client.0.smithi120.stdout:9/497: rmdir d19/d24/d37 39 2021-04-09T18:26:15.047 INFO:tasks.workunit.client.0.smithi120.stdout:4/428: chown d1f/d2c/d3b/f4c 63646 1 2021-04-09T18:26:15.060 INFO:tasks.workunit.client.0.smithi120.stdout:8/418: write d2/d3/d11/d6a/d3b/f33 [2884561,7529] 0 2021-04-09T18:26:15.063 INFO:tasks.workunit.client.0.smithi120.stdout:4/429: rename d1f/d24/d6b/f65 to d1f/d2c/d3b/f8e 0 2021-04-09T18:26:15.064 INFO:tasks.workunit.client.0.smithi120.stdout:5/600: write d10/d12/f24 [3156804,123733] 0 2021-04-09T18:26:15.072 INFO:tasks.workunit.client.0.smithi120.stdout:5/601: dread d10/d12/d1b/d1f/d84/d44/d8c/da6/fbc [0,4194304] 0 2021-04-09T18:26:15.075 INFO:tasks.workunit.client.0.smithi120.stdout:4/430: fsync d1f/d2c/d30/f7b 0 2021-04-09T18:26:15.075 INFO:tasks.workunit.client.0.smithi120.stdout:3/519: truncate d3/d5/d36/d1e/d38/d6d/f92 2850380 0 2021-04-09T18:26:15.077 INFO:tasks.workunit.client.0.smithi120.stdout:9/498: link d19/d24/d36/d47/f73 d19/d24/d37/d40/d89/d29/d76/fa5 0 2021-04-09T18:26:15.083 INFO:tasks.workunit.client.0.smithi120.stdout:5/602: creat d10/d12/d1b/d1f/d84/d44/d8c/fd8 x:0 0 0 2021-04-09T18:26:15.084 INFO:tasks.workunit.client.0.smithi120.stdout:8/419: truncate d2/d37/d3e/d7c/f7b 758675 0 2021-04-09T18:26:15.085 INFO:tasks.workunit.client.0.smithi120.stdout:5/603: dread - d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b/fa7 zero size 2021-04-09T18:26:15.087 INFO:tasks.workunit.client.0.smithi120.stdout:9/499: getdents d19/d81 0 2021-04-09T18:26:15.092 INFO:tasks.workunit.client.0.smithi120.stdout:6/486: write d6/d8/d1a/f34 [1613486,105847] 0 2021-04-09T18:26:15.093 INFO:tasks.workunit.client.0.smithi120.stdout:3/520: truncate d3/d5/d36/d1e/d6b/d49/d89/d68/f41 2778532 0 2021-04-09T18:26:15.093 INFO:tasks.workunit.client.0.smithi120.stdout:5/604: dwrite d10/d12/d1b/d1f/d84/f7b [0,4194304] 0 2021-04-09T18:26:15.097 INFO:tasks.workunit.client.0.smithi120.stdout:9/500: link d19/d2c/f3f d19/d24/d36/d9d/fa6 0 2021-04-09T18:26:15.097 INFO:tasks.workunit.client.0.smithi120.stdout:5/605: mknod d10/d12/d1b/d3a/cd9 1 2021-04-09T18:26:15.099 INFO:tasks.workunit.client.0.smithi120.stdout:9/501: fsync d19/d24/d37/d40/fa2 0 2021-04-09T18:26:15.101 INFO:tasks.workunit.client.0.smithi120.stdout:3/521: mkdir d3/d5/d36/dac 0 2021-04-09T18:26:15.104 INFO:tasks.workunit.client.0.smithi120.stdout:3/522: mknod d3/d5/d36/d1e/d6b/d49/d5e/d80/d9c/cad 1 2021-04-09T18:26:15.108 INFO:tasks.workunit.client.0.smithi120.stdout:6/487: dwrite d6/d8/f10 [0,4194304] 0 2021-04-09T18:26:15.113 INFO:tasks.workunit.client.0.smithi120.stdout:3/523: mknod d3/d5/d36/d1e/d38/d61/d9a/cae 1 2021-04-09T18:26:15.120 INFO:tasks.workunit.client.0.smithi120.stdout:9/502: mkdir d19/d24/d37/d40/d89/d52/da7 0 2021-04-09T18:26:15.125 INFO:tasks.workunit.client.0.smithi120.stdout:3/524: read d3/d5/d36/d1e/d6b/d49/d4e/f60 [2249772,6053] 0 2021-04-09T18:26:15.126 INFO:tasks.workunit.client.0.smithi120.stdout:5/606: link d10/d12/d1b/d1f/d84/d44/d8c/da3/fc1 d10/d12/d1b/fda 0 2021-04-09T18:26:15.131 INFO:tasks.workunit.client.0.smithi120.stdout:9/503: mkdir d19/d24/d36/da8 0 2021-04-09T18:26:15.136 INFO:tasks.workunit.client.0.smithi120.stdout:4/431: dwrite d1f/d2c/d3b/d3e/f48 [0,4194304] 0 2021-04-09T18:26:15.143 INFO:tasks.workunit.client.0.smithi120.stdout:8/420: write d2/d37/d3e/f5d [2684233,86827] 0 2021-04-09T18:26:15.144 INFO:tasks.workunit.client.0.smithi120.stdout:6/488: write d6/d8/d1a/d36/d54/d41/d49/f73 [1294291,120617] 0 2021-04-09T18:26:15.151 INFO:tasks.workunit.client.0.smithi120.stdout:6/489: dwrite d6/d8/db/f39 [0,4194304] 0 2021-04-09T18:26:15.154 INFO:tasks.workunit.client.0.smithi120.stdout:4/432: mkdir d1f/d2c/d34/d83/d8f 0 2021-04-09T18:26:15.155 INFO:tasks.workunit.client.0.smithi120.stdout:8/421: chown d2/d27/f41 4 1 2021-04-09T18:26:15.155 INFO:tasks.workunit.client.0.smithi120.stdout:5/607: creat d10/daa/db4/fdb x:0 0 0 2021-04-09T18:26:15.166 INFO:tasks.workunit.client.0.smithi120.stdout:6/490: dread d6/d8/db/f7d [0,4194304] 0 2021-04-09T18:26:15.178 INFO:tasks.workunit.client.0.smithi120.stdout:8/422: dread d2/d3/d11/d6a/d3b/f67 [0,4194304] 0 2021-04-09T18:26:15.181 INFO:tasks.workunit.client.0.smithi120.stdout:6/491: chown d6/d8/d1a/d36/d54/d41/d49/f58 1913402 1 2021-04-09T18:26:15.181 INFO:tasks.workunit.client.0.smithi120.stdout:4/433: getdents d1f/d2c/d3b/d3e/d73 0 2021-04-09T18:26:15.196 INFO:tasks.workunit.client.0.smithi120.stdout:3/525: write d3/d5/d36/d1e/d6b/d49/d4e/d54/f91 [4308951,66772] 0 2021-04-09T18:26:15.198 INFO:tasks.workunit.client.0.smithi120.stdout:3/526: dread - d3/d5/d36/d1e/d6b/d6a/d83/f9b zero size 2021-04-09T18:26:15.200 INFO:tasks.workunit.client.0.smithi120.stdout:9/504: dwrite d19/d24/d2e/f3c [0,4194304] 0 2021-04-09T18:26:15.203 INFO:tasks.workunit.client.0.smithi120.stdout:9/505: fsync d19/f74 0 2021-04-09T18:26:15.204 INFO:tasks.workunit.client.0.smithi120.stdout:4/434: read d1f/d24/f25 [264530,16055] 0 2021-04-09T18:26:15.207 INFO:tasks.workunit.client.0.smithi120.stdout:3/527: creat d3/de/d87/d9e/faf x:0 0 0 2021-04-09T18:26:15.211 INFO:tasks.workunit.client.0.smithi120.stdout:9/506: creat d19/d24/d36/d47/d4b/fa9 x:0 0 0 2021-04-09T18:26:15.219 INFO:tasks.workunit.client.0.smithi120.stdout:0/424: dread d0/d2/f46 [0,4194304] 0 2021-04-09T18:26:15.220 INFO:tasks.workunit.client.0.smithi120.stdout:4/435: link d1f/d2c/d3b/d3e/l5f d1f/d2c/d34/d60/d7a/d89/l90 0 2021-04-09T18:26:15.225 INFO:tasks.workunit.client.0.smithi120.stdout:9/507: creat d19/d24/d37/d40/faa x:0 0 0 2021-04-09T18:26:15.225 INFO:tasks.workunit.client.0.smithi120.stdout:9/508: dread - d19/d24/d37/f94 zero size 2021-04-09T18:26:15.228 INFO:tasks.workunit.client.0.smithi120.stdout:5/608: dwrite d10/d12/d1b/d3a/f74 [0,4194304] 0 2021-04-09T18:26:15.231 INFO:tasks.workunit.client.0.smithi120.stdout:9/509: rename d19/d24/d36/d47/f4e to d19/d24/d9e/fab 0 2021-04-09T18:26:15.232 INFO:tasks.workunit.client.0.smithi120.stdout:6/492: symlink d6/d8/db/d2b/d68/d6a/lad 0 2021-04-09T18:26:15.238 INFO:tasks.workunit.client.0.smithi120.stdout:5/609: mkdir d10/daa/ddc 0 2021-04-09T18:26:15.238 INFO:tasks.workunit.client.0.smithi120.stdout:9/510: unlink d19/d24/d37/d40/d89/d29/d63/f7d 0 2021-04-09T18:26:15.241 INFO:tasks.workunit.client.0.smithi120.stdout:5/610: chown d10/d12/d1b/d1f/d84/l9f 23 1 2021-04-09T18:26:15.251 INFO:tasks.workunit.client.0.smithi120.stdout:1/554: dread d5/d50/f98 [0,4194304] 0 2021-04-09T18:26:15.251 INFO:tasks.workunit.client.0.smithi120.stdout:6/493: symlink d6/d8/db/d2b/d68/d6a/d74/lae 0 2021-04-09T18:26:15.254 INFO:tasks.workunit.client.0.smithi120.stdout:8/423: link d2/d3/d11/d6a/f70 d2/d3/d3c/d4f/f81 0 2021-04-09T18:26:15.254 INFO:tasks.workunit.client.0.smithi120.stdout:6/494: rmdir d6 39 2021-04-09T18:26:15.256 INFO:tasks.workunit.client.0.smithi120.stdout:9/511: mkdir d19/d24/d37/d40/dac 0 2021-04-09T18:26:15.258 INFO:tasks.workunit.client.0.smithi120.stdout:9/512: readlink d19/d24/d37/l42 0 2021-04-09T18:26:15.259 INFO:tasks.workunit.client.0.smithi120.stdout:6/495: dread - d6/d8/d52/faa zero size 2021-04-09T18:26:15.264 INFO:tasks.workunit.client.0.smithi120.stdout:6/496: fdatasync d6/d8/db/d12/f4b 0 2021-04-09T18:26:15.271 INFO:tasks.workunit.client.0.smithi120.stdout:0/425: truncate d0/d2/d4/f13 2685947 0 2021-04-09T18:26:15.272 INFO:tasks.workunit.client.0.smithi120.stdout:0/426: chown d0/d2/da/f19 3 1 2021-04-09T18:26:15.275 INFO:tasks.workunit.client.0.smithi120.stdout:5/611: truncate d10/d12/d1b/d1f/f71 1009014 0 2021-04-09T18:26:15.277 INFO:tasks.workunit.client.0.smithi120.stdout:8/424: dwrite d2/d37/d3e/d42/f53 [0,4194304] 0 2021-04-09T18:26:15.278 INFO:tasks.workunit.client.0.smithi120.stdout:9/513: write d19/d24/d37/d40/d89/f23 [3213946,9478] 0 2021-04-09T18:26:15.281 INFO:tasks.workunit.client.0.smithi120.stdout:5/612: creat d10/d12/d1b/d1f/d84/d44/dcb/fdd x:0 0 0 2021-04-09T18:26:15.282 INFO:tasks.workunit.client.0.smithi120.stdout:9/514: readlink d19/d24/d37/d40/d89/d52/l66 0 2021-04-09T18:26:15.285 INFO:tasks.workunit.client.0.smithi120.stdout:9/515: stat d19/d24/d37/d40/d89/d29/d76/fa5 0 2021-04-09T18:26:15.290 INFO:tasks.workunit.client.0.smithi120.stdout:6/497: dread d6/d8/db/d2b/f2e [0,4194304] 0 2021-04-09T18:26:15.297 INFO:tasks.workunit.client.0.smithi120.stdout:0/427: write d0/d2/da/d23/f2f [914679,11285] 0 2021-04-09T18:26:15.302 INFO:tasks.workunit.client.0.smithi120.stdout:6/498: rename d6/d8/db/d2b/d68/d6a/f8f to d6/d8/d52/da8/faf 0 2021-04-09T18:26:15.308 INFO:tasks.workunit.client.0.smithi120.stdout:0/428: getdents d0/d2/d4/d5f/d61 0 2021-04-09T18:26:15.320 INFO:tasks.workunit.client.0.smithi120.stdout:8/425: write d2/d3/d11/d6a/d3b/f2b [1433349,124294] 0 2021-04-09T18:26:15.327 INFO:tasks.workunit.client.0.smithi120.stdout:8/426: truncate d2/d3/f5a 935099 0 2021-04-09T18:26:15.329 INFO:tasks.workunit.client.0.smithi120.stdout:8/427: chown d2/d37/l6c 13 1 2021-04-09T18:26:15.330 INFO:tasks.workunit.client.0.smithi120.stdout:5/613: dread d10/d12/d1b/d1f/f79 [0,4194304] 0 2021-04-09T18:26:15.335 INFO:tasks.workunit.client.0.smithi120.stdout:5/614: symlink d10/d12/d1b/d1f/d84/d44/d8c/da6/dcc/lde 0 2021-04-09T18:26:15.335 INFO:tasks.workunit.client.0.smithi120.stdout:9/516: write d19/f7a [996809,94633] 0 2021-04-09T18:26:15.337 INFO:tasks.workunit.client.0.smithi120.stdout:9/517: read d19/d24/d9e/fab [2712938,1049] 0 2021-04-09T18:26:15.341 INFO:tasks.workunit.client.0.smithi120.stdout:9/518: read d19/d24/d37/d40/d89/f6b [576115,38705] 0 2021-04-09T18:26:15.341 INFO:tasks.workunit.client.0.smithi120.stdout:0/429: chown d0/d2/d4/f13 717483 1 2021-04-09T18:26:15.342 INFO:tasks.workunit.client.0.smithi120.stdout:0/430: mknod d0/d52/c7d 1 2021-04-09T18:26:15.343 INFO:tasks.workunit.client.0.smithi120.stdout:9/519: creat d19/d81/fad x:0 0 0 2021-04-09T18:26:15.345 INFO:tasks.workunit.client.0.smithi120.stdout:0/431: creat d0/d2/da/f7e x:0 0 0 2021-04-09T18:26:15.346 INFO:tasks.workunit.client.0.smithi120.stdout:0/432: chown d0/f3c 44323 1 2021-04-09T18:26:15.347 INFO:tasks.workunit.client.0.smithi120.stdout:0/433: mknod d0/d2/da/c7f 1 2021-04-09T18:26:15.347 INFO:tasks.workunit.client.0.smithi120.stdout:0/434: fsync d0/d2/d4/f73 0 2021-04-09T18:26:15.348 INFO:tasks.workunit.client.0.smithi120.stdout:9/520: getdents d19/d24/d37/d40/d89/d29/d63 0 2021-04-09T18:26:15.349 INFO:tasks.workunit.client.0.smithi120.stdout:0/435: mknod d0/d2/da/c80 1 2021-04-09T18:26:15.349 INFO:tasks.workunit.client.0.smithi120.stdout:9/521: rmdir d19/d24/d36/d47/d6f 39 2021-04-09T18:26:15.355 INFO:tasks.workunit.client.0.smithi120.stdout:5/615: write d10/d12/d3b/f76 [585477,130676] 0 2021-04-09T18:26:15.358 INFO:tasks.workunit.client.0.smithi120.stdout:8/428: dwrite d2/d3/d11/d6a/f70 [0,4194304] 0 2021-04-09T18:26:15.359 INFO:tasks.workunit.client.0.smithi120.stdout:5/616: chown d10/d12/d1b/d1f/f29 24144 1 2021-04-09T18:26:15.363 INFO:tasks.workunit.client.0.smithi120.stdout:0/436: dwrite d0/d2/da/f19 [0,4194304] 0 2021-04-09T18:26:15.365 INFO:tasks.workunit.client.0.smithi120.stdout:8/429: dread d2/d3/f1a [0,4194304] 0 2021-04-09T18:26:15.365 INFO:tasks.workunit.client.0.smithi120.stdout:0/437: write d0/d5a/d62/d69/f77 [919394,90464] 0 2021-04-09T18:26:15.369 INFO:tasks.workunit.client.0.smithi120.stdout:0/438: chown d0/d2/da/l55 22919249 1 2021-04-09T18:26:15.380 INFO:tasks.workunit.client.0.smithi120.stdout:9/522: truncate d19/d2c/f95 5141957 0 2021-04-09T18:26:15.380 INFO:tasks.workunit.client.0.smithi120.stdout:8/430: unlink d2/f2d 0 2021-04-09T18:26:15.381 INFO:tasks.workunit.client.0.smithi120.stdout:0/439: mkdir d0/d2/d4/d5f/d81 0 2021-04-09T18:26:15.384 INFO:tasks.workunit.client.0.smithi120.stdout:8/431: unlink d2/d37/l49 0 2021-04-09T18:26:15.385 INFO:tasks.workunit.client.0.smithi120.stdout:9/523: mkdir d19/d24/d37/d40/d89/d52/da7/dae 0 2021-04-09T18:26:15.385 INFO:tasks.workunit.client.0.smithi120.stdout:0/440: mkdir d0/d2/d82 0 2021-04-09T18:26:15.387 INFO:tasks.workunit.client.0.smithi120.stdout:8/432: unlink d2/d3/f58 0 2021-04-09T18:26:15.392 INFO:tasks.workunit.client.0.smithi120.stdout:0/441: dwrite d0/d2/d4/f59 [0,4194304] 0 2021-04-09T18:26:15.416 INFO:tasks.workunit.client.0.smithi120.stdout:9/524: dread d19/d24/d37/d40/d89/f27 [0,4194304] 0 2021-04-09T18:26:15.420 INFO:tasks.workunit.client.0.smithi120.stdout:9/525: rename d19/f7a to d19/d24/faf 0 2021-04-09T18:26:15.421 INFO:tasks.workunit.client.0.smithi120.stdout:9/526: dread - d19/d24/d37/f86 zero size 2021-04-09T18:26:15.422 INFO:tasks.workunit.client.0.smithi120.stdout:9/527: fdatasync d19/d24/d37/d40/d89/f20 0 2021-04-09T18:26:15.425 INFO:tasks.workunit.client.0.smithi120.stdout:0/442: dread d0/d52/f6d [0,4194304] 0 2021-04-09T18:26:15.427 INFO:tasks.workunit.client.0.smithi120.stdout:9/528: fsync d19/d24/d37/d40/d89/d29/f2b 0 2021-04-09T18:26:15.428 INFO:tasks.workunit.client.0.smithi120.stdout:9/529: mknod d19/cb0 1 2021-04-09T18:26:15.429 INFO:tasks.workunit.client.0.smithi120.stdout:9/530: dread - d19/d24/d37/d40/d89/d52/f59 zero size 2021-04-09T18:26:15.432 INFO:tasks.workunit.client.0.smithi120.stdout:9/531: mkdir d19/d24/d37/d40/d89/d52/da7/db1 0 2021-04-09T18:26:15.433 INFO:tasks.workunit.client.0.smithi120.stdout:5/617: truncate d10/d12/f90 249042 0 2021-04-09T18:26:15.437 INFO:tasks.workunit.client.0.smithi120.stdout:9/532: getdents d19/d24/d37/d40/dac 0 2021-04-09T18:26:15.441 INFO:tasks.workunit.client.0.smithi120.stdout:8/433: write d2/d3/d11/ff [4354884,46701] 0 2021-04-09T18:26:15.448 INFO:tasks.workunit.client.0.smithi120.stdout:9/533: rename d19/d24/d37/d40/d89/f23 to d19/d81/fb2 0 2021-04-09T18:26:15.448 INFO:tasks.workunit.client.0.smithi120.stdout:7/362: sync 2021-04-09T18:26:15.456 INFO:tasks.workunit.client.0.smithi120.stdout:9/534: link d19/l25 d19/d24/d36/lb3 0 2021-04-09T18:26:15.458 INFO:tasks.workunit.client.0.smithi120.stdout:5/618: dwrite d10/d12/d1b/d1f/d84/d44/f49 [0,4194304] 0 2021-04-09T18:26:15.465 INFO:tasks.workunit.client.0.smithi120.stdout:9/535: creat d19/d24/d36/d9d/fb4 x:0 0 0 2021-04-09T18:26:15.466 INFO:tasks.workunit.client.0.smithi120.stdout:9/536: mknod d19/d24/cb5 1 2021-04-09T18:26:15.468 INFO:tasks.workunit.client.0.smithi120.stdout:5/619: getdents d10/d12/d3b 0 2021-04-09T18:26:15.469 INFO:tasks.workunit.client.0.smithi120.stdout:7/363: dread f4 [0,4194304] 0 2021-04-09T18:26:15.475 INFO:tasks.workunit.client.0.smithi120.stdout:9/537: rename d19/d24/d36/d47/f5d to d19/d24/d37/d40/d89/d29/d63/fb6 0 2021-04-09T18:26:15.481 INFO:tasks.workunit.client.0.smithi120.stdout:9/538: symlink d19/d24/d37/d40/d89/d52/da7/db1/lb7 0 2021-04-09T18:26:15.483 INFO:tasks.workunit.client.0.smithi120.stdout:5/620: getdents d10/d12/d1b/d1f/d84/d44/dcb 0 2021-04-09T18:26:15.490 INFO:tasks.workunit.client.0.smithi120.stdout:5/621: getdents d10/d12/d1b/d1f/d84/d44/dcb 0 2021-04-09T18:26:15.491 INFO:tasks.workunit.client.0.smithi120.stdout:5/622: dread - d10/daa/db4/fd6 zero size 2021-04-09T18:26:15.492 INFO:tasks.workunit.client.0.smithi120.stdout:9/539: rmdir d19/d24/d37/d40/d89/d52/da7/dae 0 2021-04-09T18:26:15.493 INFO:tasks.workunit.client.0.smithi120.stdout:7/364: truncate db/d2c/d30/f39 795864 0 2021-04-09T18:26:15.494 INFO:tasks.workunit.client.0.smithi120.stdout:5/623: rmdir d10/d12/d1b/d1f/d84/d44/d8c/da6 39 2021-04-09T18:26:15.494 INFO:tasks.workunit.client.0.smithi120.stdout:7/365: chown db/f2f 3844 1 2021-04-09T18:26:15.495 INFO:tasks.workunit.client.0.smithi120.stdout:7/366: mknod db/d42/d54/c7d 1 2021-04-09T18:26:15.498 INFO:tasks.workunit.client.0.smithi120.stdout:9/540: dwrite d19/d24/d36/d9d/fb4 [0,4194304] 0 2021-04-09T18:26:15.499 INFO:tasks.workunit.client.0.smithi120.stdout:5/624: creat d10/d12/d1b/d1f/d84/d3d/d50/fdf x:0 0 0 2021-04-09T18:26:15.500 INFO:tasks.workunit.client.0.smithi120.stdout:8/434: write d2/f6e [137525,107477] 0 2021-04-09T18:26:15.502 INFO:tasks.workunit.client.0.smithi120.stdout:7/367: creat db/f7e x:0 0 0 2021-04-09T18:26:15.503 INFO:tasks.workunit.client.0.smithi120.stdout:5/625: mknod d10/d12/d1b/d1f/d84/ce0 1 2021-04-09T18:26:15.506 INFO:tasks.workunit.client.0.smithi120.stdout:7/368: mkdir db/d7f 0 2021-04-09T18:26:15.507 INFO:tasks.workunit.client.0.smithi120.stdout:9/541: creat d19/d24/d36/d9c/fb8 x:0 0 0 2021-04-09T18:26:15.513 INFO:tasks.workunit.client.0.smithi120.stdout:8/435: mknod d2/d37/c82 1 2021-04-09T18:26:15.516 INFO:tasks.workunit.client.0.smithi120.stdout:8/436: chown d2/d3/d11/d2c/d44/f74 51 1 2021-04-09T18:26:15.518 INFO:tasks.workunit.client.0.smithi120.stdout:8/437: read d2/d3/d11/d2c/f32 [23153,84373] 0 2021-04-09T18:26:15.520 INFO:tasks.workunit.client.0.smithi120.stdout:7/369: dwrite f4 [0,4194304] 0 2021-04-09T18:26:15.528 INFO:tasks.workunit.client.0.smithi120.stdout:8/438: creat d2/d3/d3c/d4f/f83 x:0 0 0 2021-04-09T18:26:15.528 INFO:tasks.workunit.client.0.smithi120.stdout:7/370: mknod db/d26/d4c/d53/c80 1 2021-04-09T18:26:15.528 INFO:tasks.workunit.client.0.smithi120.stdout:8/439: chown d2/d3/d11/d6a/d3b/f72 941344610 1 2021-04-09T18:26:15.528 INFO:tasks.workunit.client.0.smithi120.stdout:8/440: dread - d2/d3/d11/d6a/d3b/f72 zero size 2021-04-09T18:26:15.530 INFO:tasks.workunit.client.0.smithi120.stdout:8/441: stat d2/d27/f48 0 2021-04-09T18:26:15.534 INFO:tasks.workunit.client.0.smithi120.stdout:7/371: dwrite f4 [0,4194304] 0 2021-04-09T18:26:15.538 INFO:tasks.workunit.client.0.smithi120.stdout:7/372: unlink db/d26/f45 0 2021-04-09T18:26:15.538 INFO:tasks.workunit.client.0.smithi120.stdout:7/373: rmdir db/d26/d4c/d53 39 2021-04-09T18:26:15.540 INFO:tasks.workunit.client.0.smithi120.stdout:7/374: unlink db/d42/f4b 0 2021-04-09T18:26:15.550 INFO:tasks.workunit.client.0.smithi120.stdout:7/375: truncate db/d38/f69 6645 0 2021-04-09T18:26:15.559 INFO:tasks.workunit.client.0.smithi120.stdout:7/376: creat db/d42/f81 x:0 0 0 2021-04-09T18:26:15.569 INFO:tasks.workunit.client.0.smithi120.stdout:7/377: dread db/d26/f5e [0,4194304] 0 2021-04-09T18:26:15.577 INFO:tasks.workunit.client.0.smithi120.stdout:5/626: dwrite d10/d12/d1b/d3a/fcd [0,4194304] 0 2021-04-09T18:26:15.582 INFO:tasks.workunit.client.0.smithi120.stdout:8/442: mkdir d2/d3/d8/d84 0 2021-04-09T18:26:15.586 INFO:tasks.workunit.client.0.smithi120.stdout:5/627: creat d10/d12/d1b/d1f/d84/d3d/d50/da9/fe1 x:0 0 0 2021-04-09T18:26:15.590 INFO:tasks.workunit.client.0.smithi120.stdout:5/628: mknod d10/d12/d1b/d1f/d84/d44/d8c/da6/ce2 1 2021-04-09T18:26:15.592 INFO:tasks.workunit.client.0.smithi120.stdout:7/378: dread f6 [0,4194304] 0 2021-04-09T18:26:15.592 INFO:tasks.workunit.client.0.smithi120.stdout:8/443: link d2/d27/f41 d2/d3/d11/d6a/f85 0 2021-04-09T18:26:15.594 INFO:tasks.workunit.client.0.smithi120.stdout:5/629: dread - d10/d12/d1b/d1f/d84/d3d/fb7 zero size 2021-04-09T18:26:15.597 INFO:tasks.workunit.client.0.smithi120.stdout:8/444: getdents d2/d3/d3c 0 2021-04-09T18:26:15.598 INFO:tasks.workunit.client.0.smithi120.stdout:8/445: stat d2/d37/d3e 0 2021-04-09T18:26:15.603 INFO:tasks.workunit.client.0.smithi120.stdout:7/379: fsync db/d42/f81 0 2021-04-09T18:26:15.612 INFO:tasks.workunit.client.0.smithi120.stdout:7/380: link db/d26/d4c/l4e db/d2c/d34/l82 0 2021-04-09T18:26:15.613 INFO:tasks.workunit.client.0.smithi120.stdout:7/381: write db/d42/d54/d5a/f6b [4969016,29780] 0 2021-04-09T18:26:15.618 INFO:tasks.workunit.client.0.smithi120.stdout:5/630: creat d10/d12/d1b/d1f/d39/dab/fe3 x:0 0 0 2021-04-09T18:26:15.619 INFO:tasks.workunit.client.0.smithi120.stdout:8/446: symlink d2/d3/d3c/l86 0 2021-04-09T18:26:15.620 INFO:tasks.workunit.client.0.smithi120.stdout:5/631: rmdir d10/d12/d1b/d1f/d84/d3d/d50 39 2021-04-09T18:26:15.626 INFO:tasks.workunit.client.0.smithi120.stdout:8/447: link d2/d27/f29 d2/d3/d11/d2c/f87 0 2021-04-09T18:26:15.627 INFO:tasks.workunit.client.0.smithi120.stdout:8/448: mknod d2/d3/d8/d84/c88 1 2021-04-09T18:26:15.634 INFO:tasks.workunit.client.0.smithi120.stdout:9/542: dread d19/d2c/f95 [0,4194304] 0 2021-04-09T18:26:15.639 INFO:tasks.workunit.client.0.smithi120.stdout:9/543: truncate d19/d24/d37/d40/d89/f80 2566480 0 2021-04-09T18:26:15.789 INFO:tasks.workunit.client.0.smithi120.stdout:7/382: write db/d2c/f44 [2133742,72454] 0 2021-04-09T18:26:15.793 INFO:tasks.workunit.client.0.smithi120.stdout:5/632: dread d10/d12/d3b/f86 [0,4194304] 0 2021-04-09T18:26:15.794 INFO:tasks.workunit.client.0.smithi120.stdout:7/383: rename db/d42/f81 to db/d38/d3c/d6e/f83 0 2021-04-09T18:26:15.795 INFO:tasks.workunit.client.0.smithi120.stdout:8/449: dread - d2/d3/d3c/f68 zero size 2021-04-09T18:26:15.797 INFO:tasks.workunit.client.0.smithi120.stdout:8/450: stat d2/d3/d11/d2c/f31 0 2021-04-09T18:26:15.799 INFO:tasks.workunit.client.0.smithi120.stdout:5/633: rename d10/d12/d1b/d1f/d39/ld0 to d10/d12/d1b/le4 0 2021-04-09T18:26:15.801 INFO:tasks.workunit.client.0.smithi120.stdout:5/634: write d10/d12/d1b/d1f/d84/d44/f49 [784623,26599] 0 2021-04-09T18:26:15.803 INFO:tasks.workunit.client.0.smithi120.stdout:8/451: rename d2/d3/d11/d2c/f32 to d2/d3/d11/d6a/d3b/f89 0 2021-04-09T18:26:15.806 INFO:tasks.workunit.client.0.smithi120.stdout:7/384: dwrite f6 [4194304,4194304] 0 2021-04-09T18:26:15.806 INFO:tasks.workunit.client.0.smithi120.stdout:5/635: fdatasync d10/d12/d1b/d1f/d84/f3e 0 2021-04-09T18:26:15.808 INFO:tasks.workunit.client.0.smithi120.stdout:7/385: write db/d2c/d34/f79 [530040,106230] 0 2021-04-09T18:26:15.812 INFO:tasks.workunit.client.0.smithi120.stdout:5/636: mkdir d10/d12/d1b/d1f/d84/d3d/d50/d94/de5 0 2021-04-09T18:26:15.814 INFO:tasks.workunit.client.0.smithi120.stdout:7/386: dwrite db/f7e [0,4194304] 0 2021-04-09T18:26:15.831 INFO:tasks.workunit.client.0.smithi120.stdout:5/637: truncate d10/d12/d1b/d1f/d84/d3d/f8e 806825 0 2021-04-09T18:26:15.832 INFO:tasks.workunit.client.0.smithi120.stdout:5/638: chown d10/f16 193135300 1 2021-04-09T18:26:15.834 INFO:tasks.workunit.client.0.smithi120.stdout:7/387: dwrite db/d2c/d30/f66 [0,4194304] 0 2021-04-09T18:26:15.835 INFO:tasks.workunit.client.0.smithi120.stdout:7/388: write db/f25 [1636542,20851] 0 2021-04-09T18:26:15.842 INFO:tasks.workunit.client.0.smithi120.stdout:7/389: link l9 db/d38/d74/d6f/d76/l84 0 2021-04-09T18:26:15.844 INFO:tasks.workunit.client.0.smithi120.stdout:5/639: write d10/d12/d1b/d1f/f59 [97953,98244] 0 2021-04-09T18:26:15.847 INFO:tasks.workunit.client.0.smithi120.stdout:5/640: chown d10/d12/la8 176118 1 2021-04-09T18:26:15.848 INFO:tasks.workunit.client.0.smithi120.stdout:5/641: write d10/d12/d1b/f8b [893103,68340] 0 2021-04-09T18:26:15.849 INFO:tasks.workunit.client.0.smithi120.stdout:5/642: stat d10/daa/ddc 0 2021-04-09T18:26:15.850 INFO:tasks.workunit.client.0.smithi120.stdout:7/390: truncate db/f1b 3193467 0 2021-04-09T18:26:15.859 INFO:tasks.workunit.client.0.smithi120.stdout:7/391: rename db/l14 to db/d42/l85 0 2021-04-09T18:26:15.860 INFO:tasks.workunit.client.0.smithi120.stdout:7/392: mknod db/d38/d74/d6f/c86 1 2021-04-09T18:26:15.861 INFO:tasks.workunit.client.0.smithi120.stdout:5/643: truncate d10/d12/d1b/d1f/d39/dab/fe3 574576 0 2021-04-09T18:26:15.862 INFO:tasks.workunit.client.0.smithi120.stdout:5/644: stat d10/daa/ddc 0 2021-04-09T18:26:15.867 INFO:tasks.workunit.client.0.smithi120.stdout:5/645: rename d10/d12/d1b/d1f/d84/d3d/l75 to d10/d12/d1b/d3a/le6 0 2021-04-09T18:26:15.870 INFO:tasks.workunit.client.0.smithi120.stdout:5/646: mknod d10/d12/d1b/d1f/ce7 1 2021-04-09T18:26:15.872 INFO:tasks.workunit.client.0.smithi120.stdout:7/393: write db/d42/d54/d5a/f64 [788864,15758] 0 2021-04-09T18:26:15.873 INFO:tasks.workunit.client.0.smithi120.stdout:8/452: dread d2/d3/d11/d6a/d3b/f47 [0,4194304] 0 2021-04-09T18:26:15.875 INFO:tasks.workunit.client.0.smithi120.stdout:8/453: chown d2/d37/d3e/d42 9798710 1 2021-04-09T18:26:15.876 INFO:tasks.workunit.client.0.smithi120.stdout:7/394: mknod db/d42/c87 1 2021-04-09T18:26:15.882 INFO:tasks.workunit.client.0.smithi120.stdout:2/517: sync 2021-04-09T18:26:15.882 INFO:tasks.workunit.client.0.smithi120.stdout:5/647: truncate d10/d12/d1b/fbd 5195489 0 2021-04-09T18:26:15.887 INFO:tasks.workunit.client.0.smithi120.stdout:8/454: rename d2/d3/f51 to d2/d3/f8a 0 2021-04-09T18:26:15.888 INFO:tasks.workunit.client.0.smithi120.stdout:5/648: write d10/d12/d1b/d1f/d84/d44/dcb/fcf [829590,89558] 0 2021-04-09T18:26:15.888 INFO:tasks.workunit.client.0.smithi120.stdout:5/649: dread - d10/d12/d1b/d1f/f56 zero size 2021-04-09T18:26:15.888 INFO:tasks.workunit.client.0.smithi120.stdout:2/518: creat d13/d7a/d80/d54/fab x:0 0 0 2021-04-09T18:26:15.889 INFO:tasks.workunit.client.0.smithi120.stdout:5/650: fdatasync d10/d12/d1b/d1f/d84/d44/d8c/da6/fbc 0 2021-04-09T18:26:15.893 INFO:tasks.workunit.client.0.smithi120.stdout:5/651: symlink d10/daa/db4/le8 0 2021-04-09T18:26:15.894 INFO:tasks.workunit.client.0.smithi120.stdout:8/455: truncate d2/d3/d11/d6a/d3b/f89 3627883 0 2021-04-09T18:26:15.898 INFO:tasks.workunit.client.0.smithi120.stdout:7/395: write db/d38/f6d [2897762,725] 0 2021-04-09T18:26:15.900 INFO:tasks.workunit.client.0.smithi120.stdout:8/456: creat d2/d3/f8b x:0 0 0 2021-04-09T18:26:15.901 INFO:tasks.workunit.client.0.smithi120.stdout:5/652: rename d10/d12/d1b/d3a/la4 to d10/d12/d1b/d1f/d84/d3d/le9 0 2021-04-09T18:26:15.902 INFO:tasks.workunit.client.0.smithi120.stdout:5/653: mknod d10/d12/cea 1 2021-04-09T18:26:15.903 INFO:tasks.workunit.client.0.smithi120.stdout:8/457: creat d2/d3/d11/d6a/f8c x:0 0 0 2021-04-09T18:26:15.906 INFO:tasks.workunit.client.0.smithi120.stdout:8/458: mkdir d2/d37/d8d 0 2021-04-09T18:26:15.910 INFO:tasks.workunit.client.0.smithi120.stdout:8/459: truncate d2/d3/f8b 888691 0 2021-04-09T18:26:15.911 INFO:tasks.workunit.client.0.smithi120.stdout:8/460: stat d2/d3/d11/d6a/d3b/f67 0 2021-04-09T18:26:15.980 INFO:tasks.workunit.client.0.smithi120.stdout:8/461: dread d2/d3/d8/f1d [0,4194304] 0 2021-04-09T18:26:15.984 INFO:tasks.workunit.client.0.smithi120.stdout:8/462: creat d2/d3/d3c/d4f/f8e x:0 0 0 2021-04-09T18:26:15.986 INFO:tasks.workunit.client.0.smithi120.stdout:8/463: chown d2/d3/f8a 27435 1 2021-04-09T18:26:15.990 INFO:tasks.workunit.client.0.smithi120.stdout:8/464: dwrite d2/d3/d11/d2c/d44/f74 [0,4194304] 0 2021-04-09T18:26:15.994 INFO:tasks.workunit.client.0.smithi120.stdout:2/519: dwrite d13/d7a/d80/d48/d58/f65 [0,4194304] 0 2021-04-09T18:26:16.009 INFO:tasks.workunit.client.0.smithi120.stdout:5/654: dwrite d10/d12/d3b/fc4 [0,4194304] 0 2021-04-09T18:26:16.024 INFO:tasks.workunit.client.0.smithi120.stdout:8/465: write d2/d27/f41 [526430,82672] 0 2021-04-09T18:26:16.026 INFO:tasks.workunit.client.0.smithi120.stdout:8/466: chown d2/d37/d3e/d42 60757164 1 2021-04-09T18:26:16.032 INFO:tasks.workunit.client.0.smithi120.stdout:5/655: dwrite d10/d12/d3b/f67 [0,4194304] 0 2021-04-09T18:26:16.034 INFO:tasks.workunit.client.0.smithi120.stdout:8/467: truncate d2/d3/d11/f26 745668 0 2021-04-09T18:26:16.036 INFO:tasks.workunit.client.0.smithi120.stdout:5/656: stat d10/d12/f19 0 2021-04-09T18:26:16.042 INFO:tasks.workunit.client.0.smithi120.stdout:8/468: dwrite d2/d3/f60 [0,4194304] 0 2021-04-09T18:26:16.052 INFO:tasks.workunit.client.0.smithi120.stdout:8/469: rename d2/d27/f41 to d2/d3/f8f 0 2021-04-09T18:26:16.063 INFO:tasks.workunit.client.0.smithi120.stdout:5/657: dwrite d10/d12/d1b/d3a/d5b/d78/f81 [0,4194304] 0 2021-04-09T18:26:16.065 INFO:tasks.workunit.client.0.smithi120.stdout:0/443: sync 2021-04-09T18:26:16.065 INFO:tasks.workunit.client.0.smithi120.stdout:6/499: sync 2021-04-09T18:26:16.065 INFO:tasks.workunit.client.0.smithi120.stdout:1/555: sync 2021-04-09T18:26:16.065 INFO:tasks.workunit.client.0.smithi120.stdout:3/528: sync 2021-04-09T18:26:16.065 INFO:tasks.workunit.client.0.smithi120.stdout:4/436: sync 2021-04-09T18:26:16.069 INFO:tasks.workunit.client.0.smithi120.stdout:0/444: stat d0/d2/l47 0 2021-04-09T18:26:16.069 INFO:tasks.workunit.client.0.smithi120.stdout:9/544: sync 2021-04-09T18:26:16.069 INFO:tasks.workunit.client.0.smithi120.stdout:3/529: fdatasync d3/d5/d36/d1e/d6b/f79 0 2021-04-09T18:26:16.069 INFO:tasks.workunit.client.0.smithi120.stdout:1/556: readlink d5/d5c/d75/daf/d2b/l9b 0 2021-04-09T18:26:16.079 INFO:tasks.workunit.client.0.smithi120.stdout:6/500: dwrite d6/d8/d52/faa [0,4194304] 0 2021-04-09T18:26:16.082 INFO:tasks.workunit.client.0.smithi120.stdout:1/557: symlink d5/d64/d2d/db5/lbb 0 2021-04-09T18:26:16.082 INFO:tasks.workunit.client.0.smithi120.stdout:9/545: creat d19/d24/d36/d47/d4b/fb9 x:0 0 0 2021-04-09T18:26:16.085 INFO:tasks.workunit.client.0.smithi120.stdout:3/530: creat d3/de/d25/fb0 x:0 0 0 2021-04-09T18:26:16.085 INFO:tasks.workunit.client.0.smithi120.stdout:4/437: write d1f/d2c/d30/f4d [3598567,124867] 0 2021-04-09T18:26:16.087 INFO:tasks.workunit.client.0.smithi120.stdout:3/531: dread - d3/de/d25/fb0 zero size 2021-04-09T18:26:16.095 INFO:tasks.workunit.client.0.smithi120.stdout:9/546: write d19/d24/d9e/fab [5228093,94126] 0 2021-04-09T18:26:16.097 INFO:tasks.workunit.client.0.smithi120.stdout:1/558: chown d5/d64/l95 7 1 2021-04-09T18:26:16.097 INFO:tasks.workunit.client.0.smithi120.stdout:5/658: link d10/d12/d1b/d1f/d84/d3d/d50/faf d10/d12/d1b/d1f/d84/d44/feb 0 2021-04-09T18:26:16.097 INFO:tasks.workunit.client.0.smithi120.stdout:8/470: truncate d2/d3/d11/ff 4244584 0 2021-04-09T18:26:16.098 INFO:tasks.workunit.client.0.smithi120.stdout:4/438: rmdir d1f/d2c/d30 39 2021-04-09T18:26:16.099 INFO:tasks.workunit.client.0.smithi120.stdout:3/532: unlink d3/de/l34 0 2021-04-09T18:26:16.103 INFO:tasks.workunit.client.0.smithi120.stdout:2/520: dread d13/d7a/d80/d48/d49/d64/d83/d94/fa5 [0,4194304] 0 2021-04-09T18:26:16.107 INFO:tasks.workunit.client.0.smithi120.stdout:3/533: unlink d3/de/d25/f65 0 2021-04-09T18:26:16.108 INFO:tasks.workunit.client.0.smithi120.stdout:8/471: rmdir d2/d3/d11/d2c/d44 39 2021-04-09T18:26:16.109 INFO:tasks.workunit.client.0.smithi120.stdout:1/559: creat d5/d64/d2d/db5/fbc x:0 0 0 2021-04-09T18:26:16.111 INFO:tasks.workunit.client.0.smithi120.stdout:9/547: rmdir d19/d24/d37/d40/dac 0 2021-04-09T18:26:16.112 INFO:tasks.workunit.client.0.smithi120.stdout:2/521: symlink d13/d7a/d80/d48/d49/d64/d83/d94/lac 0 2021-04-09T18:26:16.115 INFO:tasks.workunit.client.0.smithi120.stdout:9/548: chown d19/d24/d37/d40/d89/d52/da7 46251288 1 2021-04-09T18:26:16.115 INFO:tasks.workunit.client.0.smithi120.stdout:5/659: dread d10/d12/d1b/d1f/d84/d3d/f8e [0,4194304] 0 2021-04-09T18:26:16.116 INFO:tasks.workunit.client.0.smithi120.stdout:9/549: readlink d19/d2c/d5b/d99/la0 0 2021-04-09T18:26:16.118 INFO:tasks.workunit.client.0.smithi120.stdout:4/439: rename d1f/d24/f3c to d1f/d2c/d34/d60/d7a/d4f/f91 0 2021-04-09T18:26:16.119 INFO:tasks.workunit.client.0.smithi120.stdout:4/440: chown d1f/d2c/d34/d83 187025 1 2021-04-09T18:26:16.120 INFO:tasks.workunit.client.0.smithi120.stdout:4/441: stat d1f/d2c/d34/f51 0 2021-04-09T18:26:16.120 INFO:tasks.workunit.client.0.smithi120.stdout:6/501: dread d6/d8/d1a/d36/d54/f75 [0,4194304] 0 2021-04-09T18:26:16.122 INFO:tasks.workunit.client.0.smithi120.stdout:4/442: fdatasync d1f/d2c/d3b/d3e/d73/f85 0 2021-04-09T18:26:16.123 INFO:tasks.workunit.client.0.smithi120.stdout:7/396: sync 2021-04-09T18:26:16.123 INFO:tasks.workunit.client.0.smithi120.stdout:2/522: creat d13/d61/d7c/d98/fad x:0 0 0 2021-04-09T18:26:16.124 INFO:tasks.workunit.client.0.smithi120.stdout:3/534: truncate d3/d5/d36/d1e/d38/f63 279312 0 2021-04-09T18:26:16.126 INFO:tasks.workunit.client.0.smithi120.stdout:7/397: read db/f15 [2190190,43834] 0 2021-04-09T18:26:16.127 INFO:tasks.workunit.client.0.smithi120.stdout:8/472: link d2/d27/f2f d2/d37/d3e/d7c/f90 0 2021-04-09T18:26:16.128 INFO:tasks.workunit.client.0.smithi120.stdout:4/443: write d1f/d2c/d30/f4d [536395,55838] 0 2021-04-09T18:26:16.128 INFO:tasks.workunit.client.0.smithi120.stdout:1/560: rename d5/d64/l95 to d5/d5c/d75/lbd 0 2021-04-09T18:26:16.130 INFO:tasks.workunit.client.0.smithi120.stdout:5/660: link d10/d12/d1b/d3a/d5b/d78/f81 d10/d12/d1b/d3a/fec 0 2021-04-09T18:26:16.131 INFO:tasks.workunit.client.0.smithi120.stdout:6/502: mkdir d6/d8/db/d92/db0 0 2021-04-09T18:26:16.134 INFO:tasks.workunit.client.0.smithi120.stdout:6/503: write d6/d8/d1a/d36/d54/d41/d49/f4f [1512252,63538] 0 2021-04-09T18:26:16.135 INFO:tasks.workunit.client.0.smithi120.stdout:3/535: fdatasync d3/d5/f31 0 2021-04-09T18:26:16.136 INFO:tasks.workunit.client.0.smithi120.stdout:6/504: chown d6/fc 4967738 1 2021-04-09T18:26:16.136 INFO:tasks.workunit.client.0.smithi120.stdout:3/536: chown d3/d5/d36 3595 1 2021-04-09T18:26:16.138 INFO:tasks.workunit.client.0.smithi120.stdout:6/505: read d6/d8/db/d2b/f2e [7111941,15536] 0 2021-04-09T18:26:16.140 INFO:tasks.workunit.client.0.smithi120.stdout:9/550: dread d19/d24/d36/f6e [0,4194304] 0 2021-04-09T18:26:16.142 INFO:tasks.workunit.client.0.smithi120.stdout:4/444: rename d1f/d2c/d3b to d1f/d2c/d34/d60/d7a/d92 0 2021-04-09T18:26:16.144 INFO:tasks.workunit.client.0.smithi120.stdout:6/506: write d6/d8/db/f7d [783688,62383] 0 2021-04-09T18:26:16.145 INFO:tasks.workunit.client.0.smithi120.stdout:5/661: creat d10/d12/d1b/d1f/d84/d3d/d50/da9/fed x:0 0 0 2021-04-09T18:26:16.147 INFO:tasks.workunit.client.0.smithi120.stdout:7/398: truncate db/d26/f2e 1098947 0 2021-04-09T18:26:16.153 INFO:tasks.workunit.client.0.smithi120.stdout:0/445: dwrite d0/d2/d4/f13 [0,4194304] 0 2021-04-09T18:26:16.155 INFO:tasks.workunit.client.0.smithi120.stdout:5/662: dread d10/f11 [0,4194304] 0 2021-04-09T18:26:16.156 INFO:tasks.workunit.client.0.smithi120.stdout:7/399: write db/d42/d54/f71 [220452,45553] 0 2021-04-09T18:26:16.156 INFO:tasks.workunit.client.0.smithi120.stdout:3/537: dwrite d3/d5/d36/d1e/d6b/d6a/d83/f9b [0,4194304] 0 2021-04-09T18:26:16.158 INFO:tasks.workunit.client.0.smithi120.stdout:6/507: rmdir d6/d8/d1a/d36/d5a/d5d 39 2021-04-09T18:26:16.158 INFO:tasks.workunit.client.0.smithi120.stdout:0/446: chown d0/d5a/d62/d69 31829937 1 2021-04-09T18:26:16.159 INFO:tasks.workunit.client.0.smithi120.stdout:7/400: chown db/d2c 3514021 1 2021-04-09T18:26:16.161 INFO:tasks.workunit.client.0.smithi120.stdout:0/447: dread - d0/d5a/d6c/f75 zero size 2021-04-09T18:26:16.161 INFO:tasks.workunit.client.0.smithi120.stdout:5/663: write d10/d12/d1b/d1f/d84/fa0 [738637,103458] 0 2021-04-09T18:26:16.165 INFO:tasks.workunit.client.0.smithi120.stdout:2/523: rename d13/d7a/d80/d48/d49/d64/d83/d94 to d13/d15/d35/dae 0 2021-04-09T18:26:16.166 INFO:tasks.workunit.client.0.smithi120.stdout:3/538: mknod d3/d5/d36/d3d/cb1 1 2021-04-09T18:26:16.169 INFO:tasks.workunit.client.0.smithi120.stdout:4/445: creat d1f/d24/d6b/f93 x:0 0 0 2021-04-09T18:26:16.175 INFO:tasks.workunit.client.0.smithi120.stdout:5/664: dwrite d10/d12/d1b/d1f/d84/d3d/d50/f70 [4194304,4194304] 0 2021-04-09T18:26:16.178 INFO:tasks.workunit.client.0.smithi120.stdout:0/448: chown d0/d2/da/d23/d6b 49 1 2021-04-09T18:26:16.179 INFO:tasks.workunit.client.0.smithi120.stdout:2/524: chown d13/d7a/d80/d48/d58/l77 1 1 2021-04-09T18:26:16.180 INFO:tasks.workunit.client.0.smithi120.stdout:8/473: dwrite d2/d3/d3c/f68 [0,4194304] 0 2021-04-09T18:26:16.181 INFO:tasks.workunit.client.0.smithi120.stdout:9/551: write d19/d24/d37/d40/d89/f1f [552655,46647] 0 2021-04-09T18:26:16.184 INFO:tasks.workunit.client.0.smithi120.stdout:4/446: fdatasync d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f7f 0 2021-04-09T18:26:16.188 INFO:tasks.workunit.client.0.smithi120.stdout:0/449: dwrite d0/d2/dd/f38 [0,4194304] 0 2021-04-09T18:26:16.189 INFO:tasks.workunit.client.0.smithi120.stdout:8/474: dread d2/d3/d3c/f68 [0,4194304] 0 2021-04-09T18:26:16.190 INFO:tasks.workunit.client.0.smithi120.stdout:0/450: write d0/d2/f5b [3516603,87554] 0 2021-04-09T18:26:16.190 INFO:tasks.workunit.client.0.smithi120.stdout:9/552: write d19/d24/faf [1514377,11886] 0 2021-04-09T18:26:16.198 INFO:tasks.workunit.client.0.smithi120.stdout:7/401: write db/d38/f50 [7888016,32133] 0 2021-04-09T18:26:16.202 INFO:tasks.workunit.client.0.smithi120.stdout:9/553: mknod d19/d24/d36/cba 1 2021-04-09T18:26:16.203 INFO:tasks.workunit.client.0.smithi120.stdout:5/665: write d10/fae [819331,44517] 0 2021-04-09T18:26:16.204 INFO:tasks.workunit.client.0.smithi120.stdout:6/508: write d6/d8/db/d12/d22/f27 [3108177,43030] 0 2021-04-09T18:26:16.206 INFO:tasks.workunit.client.0.smithi120.stdout:4/447: symlink d1f/d2c/d34/d60/d7a/d89/l94 0 2021-04-09T18:26:16.210 INFO:tasks.workunit.client.0.smithi120.stdout:2/525: creat d13/d7a/d80/d54/faf x:0 0 0 2021-04-09T18:26:16.219 INFO:tasks.workunit.client.0.smithi120.stdout:5/666: stat d10/d12/d1b/d1f/f79 0 2021-04-09T18:26:16.219 INFO:tasks.workunit.client.0.smithi120.stdout:7/402: dwrite db/d42/d54/f71 [0,4194304] 0 2021-04-09T18:26:16.220 INFO:tasks.workunit.client.0.smithi120.stdout:9/554: dread - d19/d24/d37/d40/d89/d29/d76/fa5 zero size 2021-04-09T18:26:16.220 INFO:tasks.workunit.client.0.smithi120.stdout:3/539: truncate d3/d5/d36/d1e/d38/d61/d9a/fa7 425541 0 2021-04-09T18:26:16.221 INFO:tasks.workunit.client.0.smithi120.stdout:4/448: dread - d1f/d2c/d34/d60/d7a/d92/d3e/d73/f85 zero size 2021-04-09T18:26:16.221 INFO:tasks.workunit.client.0.smithi120.stdout:3/540: chown d3/d5/d36/d1e/d6b/d49/fa9 1235633 1 2021-04-09T18:26:16.225 INFO:tasks.workunit.client.0.smithi120.stdout:2/526: mknod d13/d15/d35/cb0 1 2021-04-09T18:26:16.225 INFO:tasks.workunit.client.0.smithi120.stdout:8/475: creat d2/d37/f91 x:0 0 0 2021-04-09T18:26:16.227 INFO:tasks.workunit.client.0.smithi120.stdout:7/403: rmdir db/d38/d74/d6f/d76 39 2021-04-09T18:26:16.228 INFO:tasks.workunit.client.0.smithi120.stdout:8/476: readlink d2/d3/d8/l61 0 2021-04-09T18:26:16.228 INFO:tasks.workunit.client.0.smithi120.stdout:4/449: unlink d1f/d2c/d34/d60/d7a/d92/f4c 0 2021-04-09T18:26:16.229 INFO:tasks.workunit.client.0.smithi120.stdout:8/477: stat d2/d3/d11/d2c/f31 0 2021-04-09T18:26:16.231 INFO:tasks.workunit.client.0.smithi120.stdout:4/450: dread - d1f/d2c/d34/d60/d7a/d92/d3e/d73/f85 zero size 2021-04-09T18:26:16.232 INFO:tasks.workunit.client.0.smithi120.stdout:4/451: write d1f/d24/f26 [3670413,22630] 0 2021-04-09T18:26:16.234 INFO:tasks.workunit.client.0.smithi120.stdout:7/404: dread - db/d2c/d30/d59/f68 zero size 2021-04-09T18:26:16.235 INFO:tasks.workunit.client.0.smithi120.stdout:9/555: symlink d19/d24/d36/d47/lbb 0 2021-04-09T18:26:16.235 INFO:tasks.workunit.client.0.smithi120.stdout:9/556: dread - d19/d81/fad zero size 2021-04-09T18:26:16.237 INFO:tasks.workunit.client.0.smithi120.stdout:6/509: creat d6/d8/d1a/d36/fb1 x:0 0 0 2021-04-09T18:26:16.238 INFO:tasks.workunit.client.0.smithi120.stdout:3/541: creat d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f/fb2 x:0 0 0 2021-04-09T18:26:16.240 INFO:tasks.workunit.client.0.smithi120.stdout:8/478: rmdir d2/d37/d3e/d7c/d7a 39 2021-04-09T18:26:16.245 INFO:tasks.workunit.client.0.smithi120.stdout:9/557: mkdir d19/d24/d37/dbc 0 2021-04-09T18:26:16.248 INFO:tasks.workunit.client.0.smithi120.stdout:8/479: dwrite d2/d3/d11/d6a/d3b/f2b [0,4194304] 0 2021-04-09T18:26:16.251 INFO:tasks.workunit.client.0.smithi120.stdout:4/452: creat d1f/d2c/d34/d60/d7a/d92/d84/f95 x:0 0 0 2021-04-09T18:26:16.255 INFO:tasks.workunit.client.0.smithi120.stdout:0/451: write d0/d52/d56/f5d [686936,25602] 0 2021-04-09T18:26:16.258 INFO:tasks.workunit.client.0.smithi120.stdout:3/542: creat d3/d5/d36/d1e/d6b/d49/d4e/d54/fb3 x:0 0 0 2021-04-09T18:26:16.265 INFO:tasks.workunit.client.0.smithi120.stdout:2/527: write d13/f2e [596357,38500] 0 2021-04-09T18:26:16.271 INFO:tasks.workunit.client.0.smithi120.stdout:5/667: dwrite d10/d12/d1b/d1f/d84/d44/d8c/da3/fc1 [0,4194304] 0 2021-04-09T18:26:16.273 INFO:tasks.workunit.client.0.smithi120.stdout:4/453: creat d1f/d2c/f96 x:0 0 0 2021-04-09T18:26:16.274 INFO:tasks.workunit.client.0.smithi120.stdout:7/405: dwrite db/d26/f2e [0,4194304] 0 2021-04-09T18:26:16.282 INFO:tasks.workunit.client.0.smithi120.stdout:6/510: mkdir d6/d8/d3a/d79/db2 0 2021-04-09T18:26:16.284 INFO:tasks.workunit.client.0.smithi120.stdout:2/528: mkdir d13/d7a/d80/d48/da3/db1 0 2021-04-09T18:26:16.284 INFO:tasks.workunit.client.0.smithi120.stdout:9/558: dread - d19/d24/d37/d40/f75 zero size 2021-04-09T18:26:16.291 INFO:tasks.workunit.client.0.smithi120.stdout:6/511: readlink d6/d8/d1a/d36/d5a/l99 0 2021-04-09T18:26:16.291 INFO:tasks.workunit.client.0.smithi120.stdout:3/543: fsync d3/d5/d36/d1e/d38/d61/f76 0 2021-04-09T18:26:16.292 INFO:tasks.workunit.client.0.smithi120.stdout:8/480: truncate d2/d3/d3c/d4f/f83 910936 0 2021-04-09T18:26:16.295 INFO:tasks.workunit.client.0.smithi120.stdout:4/454: symlink d1f/d2c/d34/d60/d7a/d89/l97 0 2021-04-09T18:26:16.297 INFO:tasks.workunit.client.0.smithi120.stdout:7/406: unlink l9 0 2021-04-09T18:26:16.300 INFO:tasks.workunit.client.0.smithi120.stdout:5/668: link d10/f16 d10/d12/fee 0 2021-04-09T18:26:16.302 INFO:tasks.workunit.client.0.smithi120.stdout:6/512: read d6/d8/db/d2b/d68/d6a/d74/fab [661566,49560] 0 2021-04-09T18:26:16.303 INFO:tasks.workunit.client.0.smithi120.stdout:2/529: dread d13/d7a/d80/d48/d58/f65 [0,4194304] 0 2021-04-09T18:26:16.307 INFO:tasks.workunit.client.0.smithi120.stdout:8/481: dwrite d2/d3/d3c/d4f/f8e [0,4194304] 0 2021-04-09T18:26:16.308 INFO:tasks.workunit.client.0.smithi120.stdout:6/513: fsync d6/d8/d1a/d36/fb1 0 2021-04-09T18:26:16.309 INFO:tasks.workunit.client.0.smithi120.stdout:0/452: dwrite d0/d2/d4/f29 [0,4194304] 0 2021-04-09T18:26:16.314 INFO:tasks.workunit.client.0.smithi120.stdout:4/455: creat d1f/d2c/d34/d60/d7a/f98 x:0 0 0 2021-04-09T18:26:16.315 INFO:tasks.workunit.client.0.smithi120.stdout:4/456: chown d1f 2083 1 2021-04-09T18:26:16.317 INFO:tasks.workunit.client.0.smithi120.stdout:5/669: creat d10/d12/d1b/d1f/d39/dbb/fef x:0 0 0 2021-04-09T18:26:16.318 INFO:tasks.workunit.client.0.smithi120.stdout:8/482: symlink d2/d3/d11/l92 0 2021-04-09T18:26:16.319 INFO:tasks.workunit.client.0.smithi120.stdout:0/453: dread d0/d2/d4/f13 [0,4194304] 0 2021-04-09T18:26:16.321 INFO:tasks.workunit.client.0.smithi120.stdout:4/457: readlink lc 0 2021-04-09T18:26:16.324 INFO:tasks.workunit.client.0.smithi120.stdout:9/559: dwrite d19/d24/d37/d40/d89/f53 [4194304,4194304] 0 2021-04-09T18:26:16.324 INFO:tasks.workunit.client.0.smithi120.stdout:8/483: chown d2/d3/f8b 410076546 1 2021-04-09T18:26:16.327 INFO:tasks.workunit.client.0.smithi120.stdout:6/514: creat d6/d8/d1a/d36/d5a/fb3 x:0 0 0 2021-04-09T18:26:16.334 INFO:tasks.workunit.client.0.smithi120.stdout:2/530: creat d13/d7a/d80/d48/d49/d64/d9d/fb2 x:0 0 0 2021-04-09T18:26:16.334 INFO:tasks.workunit.client.0.smithi120.stdout:9/560: chown d19/d24/d37/d40/d89/f53 994421051 1 2021-04-09T18:26:16.337 INFO:tasks.workunit.client.0.smithi120.stdout:5/670: mkdir d10/d12/d1b/d1f/d84/df0 0 2021-04-09T18:26:16.340 INFO:tasks.workunit.client.0.smithi120.stdout:7/407: dread f2 [4194304,4194304] 0 2021-04-09T18:26:16.340 INFO:tasks.workunit.client.0.smithi120.stdout:2/531: stat d13/d15/d35/f5b 0 2021-04-09T18:26:16.343 INFO:tasks.workunit.client.0.smithi120.stdout:2/532: dread - d13/d61/d7c/d98/fad zero size 2021-04-09T18:26:16.344 INFO:tasks.workunit.client.0.smithi120.stdout:9/561: write d19/d81/fb2 [1084298,131011] 0 2021-04-09T18:26:16.344 INFO:tasks.workunit.client.0.smithi120.stdout:4/458: fsync d1f/d2c/d34/d60/d7a/d92/d3e/f43 0 2021-04-09T18:26:16.345 INFO:tasks.workunit.client.0.smithi120.stdout:1/561: sync 2021-04-09T18:26:16.351 INFO:tasks.workunit.client.0.smithi120.stdout:5/671: fdatasync d10/d12/d1b/d1f/d84/d44/d8c/fd8 0 2021-04-09T18:26:16.351 INFO:tasks.workunit.client.0.smithi120.stdout:0/454: getdents d0/d2 0 2021-04-09T18:26:16.352 INFO:tasks.workunit.client.0.smithi120.stdout:5/672: chown d10/d12/d1b/d1f/d84/d44 8466852 1 2021-04-09T18:26:16.354 INFO:tasks.workunit.client.0.smithi120.stdout:3/544: dwrite d3/d5/d36/d1e/d6b/d49/d4e/f60 [0,4194304] 0 2021-04-09T18:26:16.359 INFO:tasks.workunit.client.0.smithi120.stdout:7/408: creat db/d7f/f88 x:0 0 0 2021-04-09T18:26:16.360 INFO:tasks.workunit.client.0.smithi120.stdout:2/533: symlink d13/d7a/d80/d48/d49/d64/lb3 0 2021-04-09T18:26:16.361 INFO:tasks.workunit.client.0.smithi120.stdout:3/545: symlink d3/de/da6/lb4 0 2021-04-09T18:26:16.363 INFO:tasks.workunit.client.0.smithi120.stdout:6/515: truncate d6/d8/f4c 2020550 0 2021-04-09T18:26:16.363 INFO:tasks.workunit.client.0.smithi120.stdout:0/455: dwrite d0/fc [8388608,4194304] 0 2021-04-09T18:26:16.370 INFO:tasks.workunit.client.0.smithi120.stdout:5/673: creat d10/d12/d1b/d1f/d84/d44/d8c/da6/ff1 x:0 0 0 2021-04-09T18:26:16.375 INFO:tasks.workunit.client.0.smithi120.stdout:0/456: fsync d0/d52/f6d 0 2021-04-09T18:26:16.378 INFO:tasks.workunit.client.0.smithi120.stdout:6/516: dwrite d6/d8/d1a/d36/d5a/fb3 [0,4194304] 0 2021-04-09T18:26:16.384 INFO:tasks.workunit.client.0.smithi120.stdout:7/409: rename db/f7e to db/d38/d74/d6f/f89 0 2021-04-09T18:26:16.386 INFO:tasks.workunit.client.0.smithi120.stdout:1/562: link d5/d64/d63/d86/f88 d5/d64/d2d/d5a/d8d/fbe 0 2021-04-09T18:26:16.388 INFO:tasks.workunit.client.0.smithi120.stdout:0/457: dread d0/d2/da/f19 [0,4194304] 0 2021-04-09T18:26:16.388 INFO:tasks.workunit.client.0.smithi120.stdout:4/459: dread d1f/d24/d6b/f57 [0,4194304] 0 2021-04-09T18:26:16.390 INFO:tasks.workunit.client.0.smithi120.stdout:0/458: readlink d0/d2/l47 0 2021-04-09T18:26:16.393 INFO:tasks.workunit.client.0.smithi120.stdout:0/459: chown d0/d2/f26 1625636 1 2021-04-09T18:26:16.396 INFO:tasks.workunit.client.0.smithi120.stdout:8/484: write d2/d27/f29 [2031825,107408] 0 2021-04-09T18:26:16.400 INFO:tasks.workunit.client.0.smithi120.stdout:3/546: creat d3/de/d25/d53/fb5 x:0 0 0 2021-04-09T18:26:16.401 INFO:tasks.workunit.client.0.smithi120.stdout:7/410: dwrite db/d38/d74/d6f/f89 [4194304,4194304] 0 2021-04-09T18:26:16.402 INFO:tasks.workunit.client.0.smithi120.stdout:6/517: symlink d6/d8/d1a/d36/d5a/lb4 0 2021-04-09T18:26:16.402 INFO:tasks.workunit.client.0.smithi120.stdout:4/460: mkdir d1f/d2c/d34/d60/d7a/d92/d84/d99 0 2021-04-09T18:26:16.405 INFO:tasks.workunit.client.0.smithi120.stdout:8/485: rmdir d2/d37/d3e/d42 39 2021-04-09T18:26:16.413 INFO:tasks.workunit.client.0.smithi120.stdout:5/674: creat d10/d12/d1b/d1f/d84/d44/d8c/ff2 x:0 0 0 2021-04-09T18:26:16.414 INFO:tasks.workunit.client.0.smithi120.stdout:1/563: rename d5/d64/d2d/db5/fbc to d5/d5c/d75/daf/d24/fbf 0 2021-04-09T18:26:16.415 INFO:tasks.workunit.client.0.smithi120.stdout:1/564: write d5/d1f/f96 [5113680,35368] 0 2021-04-09T18:26:16.419 INFO:tasks.workunit.client.0.smithi120.stdout:8/486: dwrite d2/d3/d11/d2c/f87 [0,4194304] 0 2021-04-09T18:26:16.421 INFO:tasks.workunit.client.0.smithi120.stdout:0/460: fdatasync d0/fc 0 2021-04-09T18:26:16.424 INFO:tasks.workunit.client.0.smithi120.stdout:7/411: creat db/d26/d4c/f8a x:0 0 0 2021-04-09T18:26:16.427 INFO:tasks.workunit.client.0.smithi120.stdout:6/518: creat d6/d8/d1a/fb5 x:0 0 0 2021-04-09T18:26:16.428 INFO:tasks.workunit.client.0.smithi120.stdout:2/534: dread d13/d7a/d80/f2b [0,4194304] 0 2021-04-09T18:26:16.431 INFO:tasks.workunit.client.0.smithi120.stdout:9/562: dwrite d19/d24/d37/d40/d89/f27 [0,4194304] 0 2021-04-09T18:26:16.439 INFO:tasks.workunit.client.0.smithi120.stdout:0/461: readlink d0/d2/d4/l21 0 2021-04-09T18:26:16.447 INFO:tasks.workunit.client.0.smithi120.stdout:0/462: dwrite d0/d2/da/f7e [0,4194304] 0 2021-04-09T18:26:16.448 INFO:tasks.workunit.client.0.smithi120.stdout:0/463: dread - d0/d5a/d6c/f75 zero size 2021-04-09T18:26:16.452 INFO:tasks.workunit.client.0.smithi120.stdout:6/519: symlink d6/d8/db/d92/db0/lb6 0 2021-04-09T18:26:16.455 INFO:tasks.workunit.client.0.smithi120.stdout:6/520: read - d6/d8/db/d12/d93/f9f zero size 2021-04-09T18:26:16.458 INFO:tasks.workunit.client.0.smithi120.stdout:1/565: creat d5/d5c/d75/daf/fc0 x:0 0 0 2021-04-09T18:26:16.459 INFO:tasks.workunit.client.0.smithi120.stdout:8/487: unlink d2/d37/d3e/d42/f53 0 2021-04-09T18:26:16.461 INFO:tasks.workunit.client.0.smithi120.stdout:4/461: truncate d1f/d2c/d34/f51 198798 0 2021-04-09T18:26:16.468 INFO:tasks.workunit.client.0.smithi120.stdout:6/521: read d6/d8/d1a/d36/d54/d31/f76 [1988279,91115] 0 2021-04-09T18:26:16.470 INFO:tasks.workunit.client.0.smithi120.stdout:1/566: read - d5/d64/f82 zero size 2021-04-09T18:26:16.471 INFO:tasks.workunit.client.0.smithi120.stdout:0/464: dread d0/d2/f60 [0,4194304] 0 2021-04-09T18:26:16.472 INFO:tasks.workunit.client.0.smithi120.stdout:8/488: unlink d2/d3/d11/d6a/d3b/f33 0 2021-04-09T18:26:16.473 INFO:tasks.workunit.client.0.smithi120.stdout:5/675: link d10/ld2 d10/d12/d1b/d1f/d84/d3d/d50/da9/lf3 0 2021-04-09T18:26:16.473 INFO:tasks.workunit.client.0.smithi120.stdout:0/465: fdatasync d0/d2/d4/f29 0 2021-04-09T18:26:16.476 INFO:tasks.workunit.client.0.smithi120.stdout:7/412: link db/d38/d3c/f6a db/d2c/d30/d59/f8b 0 2021-04-09T18:26:16.476 INFO:tasks.workunit.client.0.smithi120.stdout:4/462: symlink d1f/d24/l9a 0 2021-04-09T18:26:16.477 INFO:tasks.workunit.client.0.smithi120.stdout:0/466: dread - d0/d5a/d6c/f75 zero size 2021-04-09T18:26:16.477 INFO:tasks.workunit.client.0.smithi120.stdout:2/535: link d13/d8d/f99 d13/d7a/d80/d48/d49/d64/fb4 0 2021-04-09T18:26:16.478 INFO:tasks.workunit.client.0.smithi120.stdout:5/676: chown d10/d12/d1b/d1f/d84/ld7 2 1 2021-04-09T18:26:16.479 INFO:tasks.workunit.client.0.smithi120.stdout:6/522: rename d6/d8/d3a/d79 to d6/d8/d1a/db7 0 2021-04-09T18:26:16.479 INFO:tasks.workunit.client.0.smithi120.stdout:4/463: write d1f/f71 [2638013,120585] 0 2021-04-09T18:26:16.480 INFO:tasks.workunit.client.0.smithi120.stdout:2/536: chown d13/l70 36483831 1 2021-04-09T18:26:16.482 INFO:tasks.workunit.client.0.smithi120.stdout:2/537: dread - d13/d7a/d80/d48/d49/d64/d83/fa9 zero size 2021-04-09T18:26:16.483 INFO:tasks.workunit.client.0.smithi120.stdout:0/467: creat d0/d2/da/d23/d6b/f83 x:0 0 0 2021-04-09T18:26:16.485 INFO:tasks.workunit.client.0.smithi120.stdout:5/677: creat d10/d12/d3b/ff4 x:0 0 0 2021-04-09T18:26:16.487 INFO:tasks.workunit.client.0.smithi120.stdout:8/489: link d2/d3/d8/f1d d2/d3/d11/d2c/f93 0 2021-04-09T18:26:16.487 INFO:tasks.workunit.client.0.smithi120.stdout:9/563: dread d19/d2c/f3f [0,4194304] 0 2021-04-09T18:26:16.489 INFO:tasks.workunit.client.0.smithi120.stdout:3/547: dread d3/d5/d36/d1e/d6b/d49/d4e/d54/f75 [0,4194304] 0 2021-04-09T18:26:16.491 INFO:tasks.workunit.client.0.smithi120.stdout:7/413: creat db/d38/d3c/f8c x:0 0 0 2021-04-09T18:26:16.491 INFO:tasks.workunit.client.0.smithi120.stdout:1/567: rename d5/d5c/d75/la4 to d5/d50/lc1 0 2021-04-09T18:26:16.492 INFO:tasks.workunit.client.0.smithi120.stdout:4/464: unlink d1f/d24/d6b/f6e 0 2021-04-09T18:26:16.492 INFO:tasks.workunit.client.0.smithi120.stdout:0/468: symlink d0/l84 0 2021-04-09T18:26:16.498 INFO:tasks.workunit.client.0.smithi120.stdout:9/564: rename d19/d24/d36/d47/d4b/fa9 to d19/d24/d36/da8/fbd 0 2021-04-09T18:26:16.505 INFO:tasks.workunit.client.0.smithi120.stdout:7/414: rmdir db/d42 39 2021-04-09T18:26:16.509 INFO:tasks.workunit.client.0.smithi120.stdout:7/415: dread f6 [0,4194304] 0 2021-04-09T18:26:16.518 INFO:tasks.workunit.client.0.smithi120.stdout:9/565: dread - d19/d24/d37/d40/d89/d29/d63/fb6 zero size 2021-04-09T18:26:16.519 INFO:tasks.workunit.client.0.smithi120.stdout:5/678: getdents d10/d12/d1b/d3a/d5b 0 2021-04-09T18:26:16.522 INFO:tasks.workunit.client.0.smithi120.stdout:0/469: creat d0/d5a/d62/f85 x:0 0 0 2021-04-09T18:26:16.527 INFO:tasks.workunit.client.0.smithi120.stdout:4/465: getdents d1f/d2c/d34/d60/d7a/d92/d3e/d77 0 2021-04-09T18:26:16.529 INFO:tasks.workunit.client.0.smithi120.stdout:8/490: link d2/d3/d11/d2c/f87 d2/d3/d11/d6a/d3b/f94 0 2021-04-09T18:26:16.531 INFO:tasks.workunit.client.0.smithi120.stdout:7/416: write db/d26/d4c/d53/f57 [1217552,38225] 0 2021-04-09T18:26:16.532 INFO:tasks.workunit.client.0.smithi120.stdout:8/491: read d2/d37/d3e/f5d [3756541,5622] 0 2021-04-09T18:26:16.532 INFO:tasks.workunit.client.0.smithi120.stdout:8/492: stat d2/d3/d11/d6a/f85 0 2021-04-09T18:26:16.536 INFO:tasks.workunit.client.0.smithi120.stdout:0/470: fsync d0/d2/da/d23/f2f 0 2021-04-09T18:26:16.539 INFO:tasks.workunit.client.0.smithi120.stdout:1/568: write d5/d64/f82 [243845,86024] 0 2021-04-09T18:26:16.541 INFO:tasks.workunit.client.0.smithi120.stdout:9/566: mkdir d19/d24/d36/d47/dbe 0 2021-04-09T18:26:16.543 INFO:tasks.workunit.client.0.smithi120.stdout:9/567: write d19/d24/d37/d40/f56 [4481946,56948] 0 2021-04-09T18:26:16.543 INFO:tasks.workunit.client.0.smithi120.stdout:2/538: link d13/f73 d13/d61/d7c/fb5 0 2021-04-09T18:26:16.550 INFO:tasks.workunit.client.0.smithi120.stdout:8/493: unlink d2/d3/d11/d6a/d3b/f89 0 2021-04-09T18:26:16.558 INFO:tasks.workunit.client.0.smithi120.stdout:8/494: fsync d2/d3/d11/d6a/f85 0 2021-04-09T18:26:16.560 INFO:tasks.workunit.client.0.smithi120.stdout:7/417: getdents db/d2c 0 2021-04-09T18:26:16.560 INFO:tasks.workunit.client.0.smithi120.stdout:3/548: truncate d3/d5/d36/d1e/d6b/d49/d4e/d54/f75 4639127 0 2021-04-09T18:26:16.561 INFO:tasks.workunit.client.0.smithi120.stdout:1/569: dread d5/d5c/d75/daf/d24/f41 [0,4194304] 0 2021-04-09T18:26:16.562 INFO:tasks.workunit.client.0.smithi120.stdout:5/679: dwrite d10/d12/d1b/d1f/f71 [0,4194304] 0 2021-04-09T18:26:16.565 INFO:tasks.workunit.client.0.smithi120.stdout:1/570: write d5/d5c/f72 [4987844,118633] 0 2021-04-09T18:26:16.566 INFO:tasks.workunit.client.0.smithi120.stdout:9/568: write d19/d24/d37/d40/d89/d52/f59 [343052,124043] 0 2021-04-09T18:26:16.570 INFO:tasks.workunit.client.0.smithi120.stdout:5/680: read - d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b/fa7 zero size 2021-04-09T18:26:16.577 INFO:tasks.workunit.client.0.smithi120.stdout:2/539: dwrite d13/d8d/f8e [0,4194304] 0 2021-04-09T18:26:16.578 INFO:tasks.workunit.client.0.smithi120.stdout:1/571: creat d5/d5c/d75/fc2 x:0 0 0 2021-04-09T18:26:16.579 INFO:tasks.workunit.client.0.smithi120.stdout:5/681: chown d10/d12/d1b/d1f/l28 2196 1 2021-04-09T18:26:16.581 INFO:tasks.workunit.client.0.smithi120.stdout:5/682: chown d10/d12/d1b/d1f/f29 183 1 2021-04-09T18:26:16.581 INFO:tasks.workunit.client.0.smithi120.stdout:8/495: write d2/f39 [1711906,91279] 0 2021-04-09T18:26:16.583 INFO:tasks.workunit.client.0.smithi120.stdout:1/572: mkdir d5/d5c/d75/daf/d87/dc3 0 2021-04-09T18:26:16.586 INFO:tasks.workunit.client.0.smithi120.stdout:8/496: dread d2/d3/d8/f1d [0,4194304] 0 2021-04-09T18:26:16.586 INFO:tasks.workunit.client.0.smithi120.stdout:1/573: rmdir d5/d64/d63/d86 39 2021-04-09T18:26:16.587 INFO:tasks.workunit.client.0.smithi120.stdout:9/569: link d19/d24/d36/lb3 d19/d24/d36/d47/d6f/lbf 0 2021-04-09T18:26:16.588 INFO:tasks.workunit.client.0.smithi120.stdout:8/497: chown d2/d3/d11/d6a 50605 1 2021-04-09T18:26:16.594 INFO:tasks.workunit.client.0.smithi120.stdout:8/498: stat d2/d3/f28 0 2021-04-09T18:26:16.594 INFO:tasks.workunit.client.0.smithi120.stdout:3/549: write d3/d5/d36/d1e/d6b/d49/d89/d68/f41 [2374704,124161] 0 2021-04-09T18:26:16.595 INFO:tasks.workunit.client.0.smithi120.stdout:9/570: chown d19/d24/d37/f5f 9 1 2021-04-09T18:26:16.595 INFO:tasks.workunit.client.0.smithi120.stdout:5/683: dwrite d10/d12/d3b/f76 [0,4194304] 0 2021-04-09T18:26:16.601 INFO:tasks.workunit.client.0.smithi120.stdout:2/540: getdents d13/d7a/d80/d48 0 2021-04-09T18:26:16.603 INFO:tasks.workunit.client.0.smithi120.stdout:8/499: fdatasync d2/d3/d11/d6a/d3b/f7f 0 2021-04-09T18:26:16.603 INFO:tasks.workunit.client.0.smithi120.stdout:7/418: dread db/f25 [0,4194304] 0 2021-04-09T18:26:16.607 INFO:tasks.workunit.client.0.smithi120.stdout:7/419: write db/d2c/d34/f41 [1392935,93626] 0 2021-04-09T18:26:16.612 INFO:tasks.workunit.client.0.smithi120.stdout:1/574: rename d5/d1f/l5f to d5/d5c/d75/daf/d2b/lc4 0 2021-04-09T18:26:16.613 INFO:tasks.workunit.client.0.smithi120.stdout:3/550: symlink d3/d5/d36/d1e/d6b/d49/lb6 0 2021-04-09T18:26:16.616 INFO:tasks.workunit.client.0.smithi120.stdout:3/551: write d3/d5/d36/d1e/d6b/d49/fa9 [381837,18205] 0 2021-04-09T18:26:16.616 INFO:tasks.workunit.client.0.smithi120.stdout:8/500: symlink d2/d3/d11/l95 0 2021-04-09T18:26:16.617 INFO:tasks.workunit.client.0.smithi120.stdout:7/420: mknod db/d42/d54/c8d 1 2021-04-09T18:26:16.619 INFO:tasks.workunit.client.0.smithi120.stdout:9/571: link d19/d24/d36/d47/d6f/f7f d19/d24/d36/d9c/fc0 0 2021-04-09T18:26:16.622 INFO:tasks.workunit.client.0.smithi120.stdout:7/421: rename db/d26/d4c/f8a to db/d2c/f8e 0 2021-04-09T18:26:16.623 INFO:tasks.workunit.client.0.smithi120.stdout:8/501: dread d2/d3/f8b [0,4194304] 0 2021-04-09T18:26:16.628 INFO:tasks.workunit.client.0.smithi120.stdout:8/502: mknod d2/d37/d3e/d42/c96 1 2021-04-09T18:26:16.629 INFO:tasks.workunit.client.0.smithi120.stdout:5/684: dwrite d10/d12/d1b/d1f/d84/d3d/d50/d94/fac [0,4194304] 0 2021-04-09T18:26:16.631 INFO:tasks.workunit.client.0.smithi120.stdout:8/503: fsync d2/d3/d11/d6a/d3b/f80 0 2021-04-09T18:26:16.632 INFO:tasks.workunit.client.0.smithi120.stdout:9/572: symlink d19/d24/d37/d40/d89/d52/lc1 0 2021-04-09T18:26:16.633 INFO:tasks.workunit.client.0.smithi120.stdout:3/552: link d3/f6 d3/de/d87/fb7 0 2021-04-09T18:26:16.636 INFO:tasks.workunit.client.0.smithi120.stdout:8/504: write d2/d37/f91 [61642,107145] 0 2021-04-09T18:26:16.637 INFO:tasks.workunit.client.0.smithi120.stdout:2/541: dread d13/f72 [4194304,4194304] 0 2021-04-09T18:26:16.640 INFO:tasks.workunit.client.0.smithi120.stdout:9/573: dwrite d19/d24/d2e/f9b [4194304,4194304] 0 2021-04-09T18:26:16.644 INFO:tasks.workunit.client.0.smithi120.stdout:7/422: mknod db/d2c/d34/d5d/c8f 1 2021-04-09T18:26:16.645 INFO:tasks.workunit.client.0.smithi120.stdout:2/542: creat d13/d7a/d80/d48/da3/fb6 x:0 0 0 2021-04-09T18:26:16.647 INFO:tasks.workunit.client.0.smithi120.stdout:5/685: dread d10/d12/d1b/d1f/d39/f89 [0,4194304] 0 2021-04-09T18:26:16.649 INFO:tasks.workunit.client.0.smithi120.stdout:9/574: mknod d19/d2c/cc2 1 2021-04-09T18:26:16.649 INFO:tasks.workunit.client.0.smithi120.stdout:5/686: chown d10/d12/d1b/d3a/fec 459131585 1 2021-04-09T18:26:16.657 INFO:tasks.workunit.client.0.smithi120.stdout:2/543: chown d13/d15/l91 1529912 1 2021-04-09T18:26:16.658 INFO:tasks.workunit.client.0.smithi120.stdout:9/575: creat d19/d24/d37/d40/d89/d52/da7/fc3 x:0 0 0 2021-04-09T18:26:16.662 INFO:tasks.workunit.client.0.smithi120.stdout:9/576: dwrite d19/d24/d2e/f3c [4194304,4194304] 0 2021-04-09T18:26:16.662 INFO:tasks.workunit.client.0.smithi120.stdout:7/423: creat db/d42/f90 x:0 0 0 2021-04-09T18:26:16.665 INFO:tasks.workunit.client.0.smithi120.stdout:2/544: write d13/d7a/d80/d48/d58/f65 [1172827,65448] 0 2021-04-09T18:26:16.665 INFO:tasks.workunit.client.0.smithi120.stdout:9/577: mknod d19/d24/d37/d40/d89/d52/da7/db1/cc4 1 2021-04-09T18:26:16.666 INFO:tasks.workunit.client.0.smithi120.stdout:9/578: chown f14 8529 1 2021-04-09T18:26:16.676 INFO:tasks.workunit.client.0.smithi120.stdout:3/553: truncate d3/f29 2968359 0 2021-04-09T18:26:16.676 INFO:tasks.workunit.client.0.smithi120.stdout:7/424: dwrite db/f25 [0,4194304] 0 2021-04-09T18:26:16.677 INFO:tasks.workunit.client.0.smithi120.stdout:7/425: stat db/d26 0 2021-04-09T18:26:16.679 INFO:tasks.workunit.client.0.smithi120.stdout:7/426: read - db/d38/d74/f7b zero size 2021-04-09T18:26:16.680 INFO:tasks.workunit.client.0.smithi120.stdout:5/687: getdents d10/d12/d1b/d1f/d84/d3d 0 2021-04-09T18:26:16.688 INFO:tasks.workunit.client.0.smithi120.stdout:2/545: link d13/d7a/d80/d48/d49/d64/lb3 d13/d7a/d80/d48/lb7 0 2021-04-09T18:26:16.690 INFO:tasks.workunit.client.0.smithi120.stdout:7/427: dwrite db/d26/f5e [4194304,4194304] 0 2021-04-09T18:26:16.695 INFO:tasks.workunit.client.0.smithi120.stdout:7/428: symlink db/d26/l91 0 2021-04-09T18:26:16.708 INFO:tasks.workunit.client.0.smithi120.stdout:9/579: dwrite d19/d24/d37/d40/d89/d29/f5a [0,4194304] 0 2021-04-09T18:26:16.710 INFO:tasks.workunit.client.0.smithi120.stdout:3/554: read d3/d5/d36/d1e/d6b/d49/d4e/d54/f5f [339212,75508] 0 2021-04-09T18:26:16.713 INFO:tasks.workunit.client.0.smithi120.stdout:9/580: symlink d19/d24/d37/d40/d89/d52/da7/db1/lc5 0 2021-04-09T18:26:16.715 INFO:tasks.workunit.client.0.smithi120.stdout:7/429: getdents db/d2c/d30 0 2021-04-09T18:26:16.722 INFO:tasks.workunit.client.0.smithi120.stdout:7/430: write db/d26/d4c/d53/f57 [5051663,42549] 0 2021-04-09T18:26:16.724 INFO:tasks.workunit.client.0.smithi120.stdout:2/546: getdents d13/d7a/d80/d48 0 2021-04-09T18:26:16.728 INFO:tasks.workunit.client.0.smithi120.stdout:3/555: dwrite d3/de/d87/d9e/faf [0,4194304] 0 2021-04-09T18:26:16.729 INFO:tasks.workunit.client.0.smithi120.stdout:5/688: dwrite d10/d12/d1b/d1f/d39/dab/fb8 [0,4194304] 0 2021-04-09T18:26:16.734 INFO:tasks.workunit.client.0.smithi120.stdout:2/547: creat d13/d84/fb8 x:0 0 0 2021-04-09T18:26:16.735 INFO:tasks.workunit.client.0.smithi120.stdout:5/689: fsync d10/d12/d1b/d1f/d84/d3d/fb7 0 2021-04-09T18:26:16.736 INFO:tasks.workunit.client.0.smithi120.stdout:9/581: dread d19/d24/d37/d40/d89/d29/d76/f83 [0,4194304] 0 2021-04-09T18:26:16.738 INFO:tasks.workunit.client.0.smithi120.stdout:9/582: chown d19/d24/d36/d47/dbe 6776421 1 2021-04-09T18:26:16.739 INFO:tasks.workunit.client.0.smithi120.stdout:3/556: write d3/d5/d36/d1e/d6b/f3f [656325,55102] 0 2021-04-09T18:26:16.739 INFO:tasks.workunit.client.0.smithi120.stdout:5/690: fsync d10/f11 0 2021-04-09T18:26:16.741 INFO:tasks.workunit.client.0.smithi120.stdout:3/557: fsync d3/d5/d36/d1e/d6b/d49/fa9 0 2021-04-09T18:26:16.741 INFO:tasks.workunit.client.0.smithi120.stdout:9/583: rmdir d19/d2c/d5b 39 2021-04-09T18:26:16.753 INFO:tasks.workunit.client.0.smithi120.stdout:5/691: dread d10/d12/d3b/f67 [0,4194304] 0 2021-04-09T18:26:16.755 INFO:tasks.workunit.client.0.smithi120.stdout:7/431: dread db/d2c/d30/d59/f8b [0,4194304] 0 2021-04-09T18:26:16.758 INFO:tasks.workunit.client.0.smithi120.stdout:7/432: fsync db/d42/f90 0 2021-04-09T18:26:16.947 INFO:tasks.workunit.client.0.smithi120.stdout:9/584: unlink d19/d24/d2e/l65 0 2021-04-09T18:26:16.948 INFO:tasks.workunit.client.0.smithi120.stdout:2/548: dwrite d13/d15/d35/f5b [0,4194304] 0 2021-04-09T18:26:16.951 INFO:tasks.workunit.client.0.smithi120.stdout:9/585: symlink d19/d81/lc6 0 2021-04-09T18:26:16.952 INFO:tasks.workunit.client.0.smithi120.stdout:2/549: chown d13/d7a/d80/d48/d49/l6d 29834397 1 2021-04-09T18:26:16.958 INFO:tasks.workunit.client.0.smithi120.stdout:5/692: truncate d10/d12/d1b/d1f/d84/f7b 3064860 0 2021-04-09T18:26:16.958 INFO:tasks.workunit.client.0.smithi120.stdout:7/433: truncate db/d42/d54/f71 351626 0 2021-04-09T18:26:16.959 INFO:tasks.workunit.client.0.smithi120.stdout:7/434: mknod db/d2c/d34/d5d/c92 1 2021-04-09T18:26:16.963 INFO:tasks.workunit.client.0.smithi120.stdout:5/693: unlink d10/d12/d1b/d1f/d39/l99 0 2021-04-09T18:26:16.964 INFO:tasks.workunit.client.0.smithi120.stdout:7/435: symlink db/d42/l93 0 2021-04-09T18:26:16.967 INFO:tasks.workunit.client.0.smithi120.stdout:5/694: unlink d10/d12/d1b/d1f/f59 0 2021-04-09T18:26:16.971 INFO:tasks.workunit.client.0.smithi120.stdout:5/695: unlink d10/ld2 0 2021-04-09T18:26:16.995 INFO:tasks.workunit.client.0.smithi120.stdout:5/696: dread d10/d12/fee [4194304,4194304] 0 2021-04-09T18:26:17.005 INFO:tasks.workunit.client.0.smithi120.stdout:7/436: truncate db/d26/f2e 1043243 0 2021-04-09T18:26:17.008 INFO:tasks.workunit.client.0.smithi120.stdout:7/437: mkdir db/d38/d3c/d6e/d94 0 2021-04-09T18:26:17.009 INFO:tasks.workunit.client.0.smithi120.stdout:7/438: write db/d2c/f44 [2292511,663] 0 2021-04-09T18:26:17.011 INFO:tasks.workunit.client.0.smithi120.stdout:7/439: stat db/d42/f65 0 2021-04-09T18:26:17.013 INFO:tasks.workunit.client.0.smithi120.stdout:7/440: rmdir db/d38/d3c/d6e 39 2021-04-09T18:26:17.014 INFO:tasks.workunit.client.0.smithi120.stdout:7/441: fdatasync db/f25 0 2021-04-09T18:26:17.015 INFO:tasks.workunit.client.0.smithi120.stdout:5/697: write d10/d12/d1b/d1f/d84/d3d/d50/f83 [816628,50533] 0 2021-04-09T18:26:17.019 INFO:tasks.workunit.client.0.smithi120.stdout:7/442: dwrite db/d42/f90 [0,4194304] 0 2021-04-09T18:26:17.027 INFO:tasks.workunit.client.0.smithi120.stdout:7/443: creat db/f95 x:0 0 0 2021-04-09T18:26:17.032 INFO:tasks.workunit.client.0.smithi120.stdout:7/444: dwrite db/d26/d4c/d53/f57 [4194304,4194304] 0 2021-04-09T18:26:17.037 INFO:tasks.workunit.client.0.smithi120.stdout:7/445: dread db/d42/f90 [0,4194304] 0 2021-04-09T18:26:17.039 INFO:tasks.workunit.client.0.smithi120.stdout:7/446: rmdir db/d7f 39 2021-04-09T18:26:17.040 INFO:tasks.workunit.client.0.smithi120.stdout:5/698: truncate d10/d12/d1b/d1f/d39/dab/fb8 2160197 0 2021-04-09T18:26:17.041 INFO:tasks.workunit.client.0.smithi120.stdout:9/586: dread d19/d24/d2e/f9b [0,4194304] 0 2021-04-09T18:26:17.044 INFO:tasks.workunit.client.0.smithi120.stdout:7/447: symlink db/d38/d74/l96 0 2021-04-09T18:26:17.045 INFO:tasks.workunit.client.0.smithi120.stdout:9/587: stat d19/d24/d37/f94 0 2021-04-09T18:26:17.049 INFO:tasks.workunit.client.0.smithi120.stdout:9/588: creat d19/d24/d36/fc7 x:0 0 0 2021-04-09T18:26:17.051 INFO:tasks.workunit.client.0.smithi120.stdout:7/448: truncate db/f15 4146526 0 2021-04-09T18:26:17.052 INFO:tasks.workunit.client.0.smithi120.stdout:9/589: mkdir d19/d2c/dc8 0 2021-04-09T18:26:17.053 INFO:tasks.workunit.client.0.smithi120.stdout:7/449: symlink db/d38/d74/l97 0 2021-04-09T18:26:17.053 INFO:tasks.workunit.client.0.smithi120.stdout:9/590: mknod d19/d24/d37/d40/d89/d52/cc9 1 2021-04-09T18:26:17.054 INFO:tasks.workunit.client.0.smithi120.stdout:9/591: stat d19/d24/d37/d40/fa2 0 2021-04-09T18:26:17.058 INFO:tasks.workunit.client.0.smithi120.stdout:9/592: dread d19/d24/d37/d40/d89/f27 [0,4194304] 0 2021-04-09T18:26:17.068 INFO:tasks.workunit.client.0.smithi120.stdout:5/699: truncate d10/d12/d1b/d1f/d39/dab/fb3 2831654 0 2021-04-09T18:26:17.069 INFO:tasks.workunit.client.0.smithi120.stdout:7/450: truncate db/f2f 4800785 0 2021-04-09T18:26:17.071 INFO:tasks.workunit.client.0.smithi120.stdout:7/451: chown db/d2c/d34/f41 0 1 2021-04-09T18:26:17.071 INFO:tasks.workunit.client.0.smithi120.stdout:9/593: dwrite d19/d24/d37/f77 [0,4194304] 0 2021-04-09T18:26:17.072 INFO:tasks.workunit.client.0.smithi120.stdout:7/452: rmdir db/d26 39 2021-04-09T18:26:17.073 INFO:tasks.workunit.client.0.smithi120.stdout:5/700: read d10/d12/d1b/d3a/f9c [60969,46787] 0 2021-04-09T18:26:17.074 INFO:tasks.workunit.client.0.smithi120.stdout:9/594: creat d19/d81/fca x:0 0 0 2021-04-09T18:26:17.084 INFO:tasks.workunit.client.0.smithi120.stdout:6/523: sync 2021-04-09T18:26:17.085 INFO:tasks.workunit.client.0.smithi120.stdout:7/453: getdents db 0 2021-04-09T18:26:17.089 INFO:tasks.workunit.client.0.smithi120.stdout:6/524: write d6/d8/d1a/d36/d54/d31/d37/d61/f9a [414884,97819] 0 2021-04-09T18:26:17.090 INFO:tasks.workunit.client.0.smithi120.stdout:7/454: creat db/d26/d4c/f98 x:0 0 0 2021-04-09T18:26:17.092 INFO:tasks.workunit.client.0.smithi120.stdout:7/455: dread - db/d42/d54/d5a/f75 zero size 2021-04-09T18:26:17.092 INFO:tasks.workunit.client.0.smithi120.stdout:6/525: write d6/d8/db/f1b [2104191,7030] 0 2021-04-09T18:26:17.093 INFO:tasks.workunit.client.0.smithi120.stdout:5/701: dread d10/d12/d1b/d1f/f64 [0,4194304] 0 2021-04-09T18:26:17.095 INFO:tasks.workunit.client.0.smithi120.stdout:6/526: readlink d6/d8/db/d2b/d68/d6a/lad 0 2021-04-09T18:26:17.101 INFO:tasks.workunit.client.0.smithi120.stdout:7/456: creat db/d2c/f99 x:0 0 0 2021-04-09T18:26:17.107 INFO:tasks.workunit.client.0.smithi120.stdout:7/457: mknod db/d2c/c9a 1 2021-04-09T18:26:17.111 INFO:tasks.workunit.client.0.smithi120.stdout:5/702: getdents d10/d12/d1b/d3a 0 2021-04-09T18:26:17.114 INFO:tasks.workunit.client.0.smithi120.stdout:5/703: symlink d10/d12/d1b/d3a/lf5 0 2021-04-09T18:26:17.116 INFO:tasks.workunit.client.0.smithi120.stdout:7/458: truncate db/d42/f65 813110 0 2021-04-09T18:26:17.117 INFO:tasks.workunit.client.0.smithi120.stdout:7/459: readlink db/d38/l58 0 2021-04-09T18:26:17.129 INFO:tasks.workunit.client.0.smithi120.stdout:7/460: creat db/d26/d4c/f9b x:0 0 0 2021-04-09T18:26:17.135 INFO:tasks.workunit.client.0.smithi120.stdout:5/704: mkdir d10/d12/d1b/d1f/d84/d44/d8c/da3/df6 0 2021-04-09T18:26:17.137 INFO:tasks.workunit.client.0.smithi120.stdout:5/705: fdatasync d10/d12/d1b/d1f/f71 0 2021-04-09T18:26:17.140 INFO:tasks.workunit.client.0.smithi120.stdout:5/706: symlink d10/d12/d1b/d1f/d39/lf7 0 2021-04-09T18:26:17.142 INFO:tasks.workunit.client.0.smithi120.stdout:6/527: dread d6/d8/d1a/db7/f7e [0,4194304] 0 2021-04-09T18:26:17.146 INFO:tasks.workunit.client.0.smithi120.stdout:5/707: dread d10/d12/d1b/d1f/f71 [0,4194304] 0 2021-04-09T18:26:17.150 INFO:tasks.workunit.client.0.smithi120.stdout:6/528: read d6/d8/db/d2b/d4d/f8c [2848269,117745] 0 2021-04-09T18:26:17.150 INFO:tasks.workunit.client.0.smithi120.stdout:5/708: symlink d10/d12/d1b/d1f/d39/dbb/lf8 0 2021-04-09T18:26:17.159 INFO:tasks.workunit.client.0.smithi120.stdout:5/709: creat d10/d12/d1b/d1f/ff9 x:0 0 0 2021-04-09T18:26:17.162 INFO:tasks.workunit.client.0.smithi120.stdout:5/710: creat d10/d12/d1b/d1f/d84/d44/ffa x:0 0 0 2021-04-09T18:26:17.162 INFO:tasks.workunit.client.0.smithi120.stdout:5/711: chown d10/d12/fee 5236625 1 2021-04-09T18:26:17.164 INFO:tasks.workunit.client.0.smithi120.stdout:5/712: symlink d10/daa/db4/lfb 0 2021-04-09T18:26:17.171 INFO:tasks.workunit.client.0.smithi120.stdout:5/713: write d10/d12/d1b/d1f/d84/f7b [3742353,50332] 0 2021-04-09T18:26:17.175 INFO:tasks.workunit.client.0.smithi120.stdout:5/714: stat d10/d12/d1b/d1f/d84/d3d/d50/da9/lf3 0 2021-04-09T18:26:17.178 INFO:tasks.workunit.client.0.smithi120.stdout:5/715: creat d10/d12/d1b/d1f/d84/d44/d8c/ffc x:0 0 0 2021-04-09T18:26:17.180 INFO:tasks.workunit.client.0.smithi120.stdout:5/716: read d10/d12/d1b/d1f/d84/d44/f65 [1594466,15594] 0 2021-04-09T18:26:17.185 INFO:tasks.workunit.client.0.smithi120.stdout:5/717: creat d10/d12/d1b/d3a/ffd x:0 0 0 2021-04-09T18:26:17.185 INFO:tasks.workunit.client.0.smithi120.stdout:5/718: dread - d10/d12/d1b/d1f/ff9 zero size 2021-04-09T18:26:17.188 INFO:tasks.workunit.client.0.smithi120.stdout:5/719: creat d10/d12/d1b/d1f/d39/ffe x:0 0 0 2021-04-09T18:26:17.190 INFO:tasks.workunit.client.0.smithi120.stdout:5/720: rmdir d10/d12/d1b/d1f/d84/d44/d8c/da6 39 2021-04-09T18:26:17.191 INFO:tasks.workunit.client.0.smithi120.stdout:5/721: dread - d10/d12/d1b/d1f/d84/d44/dcb/fdd zero size 2021-04-09T18:26:17.193 INFO:tasks.workunit.client.0.smithi120.stdout:5/722: mkdir d10/d12/d1b/d1f/d39/dbb/dff 0 2021-04-09T18:26:17.194 INFO:tasks.workunit.client.0.smithi120.stdout:5/723: chown d10/d12/d1b/d1f/d84/d44/lc9 43842 1 2021-04-09T18:26:17.201 INFO:tasks.workunit.client.0.smithi120.stdout:5/724: symlink d10/d12/d1b/d3a/d5b/d78/l100 0 2021-04-09T18:26:17.203 INFO:tasks.workunit.client.0.smithi120.stdout:5/725: write d10/d12/d1b/d1f/d84/d44/f49 [2668388,67854] 0 2021-04-09T18:26:17.208 INFO:tasks.workunit.client.0.smithi120.stdout:5/726: dwrite d10/d12/f24 [0,4194304] 0 2021-04-09T18:26:17.210 INFO:tasks.workunit.client.0.smithi120.stdout:5/727: mknod d10/d12/d1b/d1f/d84/d3d/d50/d94/c101 1 2021-04-09T18:26:17.216 INFO:tasks.workunit.client.0.smithi120.stdout:5/728: truncate d10/d12/d1b/d3a/f91 239255 0 2021-04-09T18:26:17.221 INFO:tasks.workunit.client.0.smithi120.stdout:5/729: symlink d10/d12/d1b/d1f/d84/d44/d8c/da6/dcc/l102 0 2021-04-09T18:26:17.224 INFO:tasks.workunit.client.0.smithi120.stdout:5/730: mkdir d10/daa/db4/d103 0 2021-04-09T18:26:17.228 INFO:tasks.workunit.client.0.smithi120.stdout:5/731: symlink d10/d12/d1b/d1f/d84/d3d/d50/d94/de5/l104 0 2021-04-09T18:26:17.231 INFO:tasks.workunit.client.0.smithi120.stdout:5/732: symlink d10/daa/db4/d103/l105 0 2021-04-09T18:26:17.231 INFO:tasks.workunit.client.0.smithi120.stdout:5/733: rmdir d10/daa/db4/d103 39 2021-04-09T18:26:17.232 INFO:tasks.workunit.client.0.smithi120.stdout:5/734: dread - d10/d12/d1b/d1f/d39/ffe zero size 2021-04-09T18:26:17.235 INFO:tasks.workunit.client.0.smithi120.stdout:5/735: mkdir d10/d12/d1b/d1f/d39/d106 0 2021-04-09T18:26:17.236 INFO:tasks.workunit.client.0.smithi120.stdout:5/736: mknod d10/d12/d1b/d1f/d84/d3d/d50/c107 1 2021-04-09T18:26:17.264 INFO:tasks.workunit.client.0.smithi120.stdout:9/595: dread fb [0,4194304] 0 2021-04-09T18:26:17.268 INFO:tasks.workunit.client.0.smithi120.stdout:9/596: unlink d19/d24/d37/d40/d89/d52/l66 0 2021-04-09T18:26:17.271 INFO:tasks.workunit.client.0.smithi120.stdout:9/597: creat d19/d24/fcb x:0 0 0 2021-04-09T18:26:17.272 INFO:tasks.workunit.client.0.smithi120.stdout:9/598: dread - d19/d24/d36/d47/f73 zero size 2021-04-09T18:26:17.276 INFO:tasks.workunit.client.0.smithi120.stdout:9/599: dwrite d19/f3d [4194304,4194304] 0 2021-04-09T18:26:17.282 INFO:tasks.workunit.client.0.smithi120.stdout:9/600: truncate d19/d24/d36/d9c/fb8 210627 0 2021-04-09T18:26:17.284 INFO:tasks.workunit.client.0.smithi120.stdout:9/601: unlink d19/d24/d37/f77 0 2021-04-09T18:26:17.285 INFO:tasks.workunit.client.0.smithi120.stdout:9/602: chown d19/d24/d2e/f9b 2 1 2021-04-09T18:26:17.287 INFO:tasks.workunit.client.0.smithi120.stdout:9/603: dread - d19/d2c/f69 zero size 2021-04-09T18:26:17.363 INFO:tasks.workunit.client.0.smithi120.stdout:7/461: read db/d38/d3c/f3d [2800493,5238] 0 2021-04-09T18:26:17.364 INFO:tasks.workunit.client.0.smithi120.stdout:7/462: write db/f25 [2383018,25926] 0 2021-04-09T18:26:17.366 INFO:tasks.workunit.client.0.smithi120.stdout:9/604: rmdir d19/d24/d36/d9c 39 2021-04-09T18:26:17.368 INFO:tasks.workunit.client.0.smithi120.stdout:7/463: dread - db/d26/d4c/d53/f67 zero size 2021-04-09T18:26:17.369 INFO:tasks.workunit.client.0.smithi120.stdout:0/471: sync 2021-04-09T18:26:17.369 INFO:tasks.workunit.client.0.smithi120.stdout:8/505: sync 2021-04-09T18:26:17.369 INFO:tasks.workunit.client.0.smithi120.stdout:1/575: sync 2021-04-09T18:26:17.370 INFO:tasks.workunit.client.0.smithi120.stdout:4/466: sync 2021-04-09T18:26:17.373 INFO:tasks.workunit.client.0.smithi120.stdout:7/464: readlink db/d2c/d30/l63 0 2021-04-09T18:26:17.373 INFO:tasks.workunit.client.0.smithi120.stdout:7/465: chown db/d7f 11832716 1 2021-04-09T18:26:17.374 INFO:tasks.workunit.client.0.smithi120.stdout:8/506: unlink d2/d27/f48 0 2021-04-09T18:26:17.375 INFO:tasks.workunit.client.0.smithi120.stdout:0/472: write d0/f30 [963071,14358] 0 2021-04-09T18:26:17.375 INFO:tasks.workunit.client.0.smithi120.stdout:9/605: dread - d19/d24/d37/d40/d89/d52/f61 zero size 2021-04-09T18:26:17.376 INFO:tasks.workunit.client.0.smithi120.stdout:7/466: write db/d2c/f99 [177592,56220] 0 2021-04-09T18:26:17.377 INFO:tasks.workunit.client.0.smithi120.stdout:4/467: rmdir d1f/d2c/d34/d60/d7a/d92/d3e/d73 39 2021-04-09T18:26:17.380 INFO:tasks.workunit.client.0.smithi120.stdout:7/467: dread db/d38/f69 [0,4194304] 0 2021-04-09T18:26:17.381 INFO:tasks.workunit.client.0.smithi120.stdout:0/473: symlink d0/d2/da/l86 0 2021-04-09T18:26:17.384 INFO:tasks.workunit.client.0.smithi120.stdout:8/507: dwrite d2/d3/d3c/d4f/f81 [0,4194304] 0 2021-04-09T18:26:17.384 INFO:tasks.workunit.client.0.smithi120.stdout:1/576: rename d5/d5c/d75/daf/d24/l4f to d5/d1f/lc5 0 2021-04-09T18:26:17.386 INFO:tasks.workunit.client.0.smithi120.stdout:9/606: dread d19/d24/d37/f5f [0,4194304] 0 2021-04-09T18:26:17.390 INFO:tasks.workunit.client.0.smithi120.stdout:7/468: symlink db/d26/d4c/d53/l9c 0 2021-04-09T18:26:17.401 INFO:tasks.workunit.client.0.smithi120.stdout:0/474: mkdir d0/d43/d49/d87 0 2021-04-09T18:26:17.402 INFO:tasks.workunit.client.0.smithi120.stdout:7/469: dwrite db/d2c/d30/f72 [0,4194304] 0 2021-04-09T18:26:17.407 INFO:tasks.workunit.client.0.smithi120.stdout:1/577: creat d5/d64/d63/d86/da3/fc6 x:0 0 0 2021-04-09T18:26:17.410 INFO:tasks.workunit.client.0.smithi120.stdout:4/468: dread d1f/d2c/d34/d60/d7a/d92/f5e [0,4194304] 0 2021-04-09T18:26:17.414 INFO:tasks.workunit.client.0.smithi120.stdout:8/508: getdents d2/d3/d11/d6a/d3b 0 2021-04-09T18:26:17.414 INFO:tasks.workunit.client.0.smithi120.stdout:7/470: write db/d26/d4c/d53/f67 [221844,12514] 0 2021-04-09T18:26:17.422 INFO:tasks.workunit.client.0.smithi120.stdout:0/475: dwrite d0/d2/d4/f13 [4194304,4194304] 0 2021-04-09T18:26:17.426 INFO:tasks.workunit.client.0.smithi120.stdout:9/607: truncate d19/d24/d2e/f9b 7642859 0 2021-04-09T18:26:17.427 INFO:tasks.workunit.client.0.smithi120.stdout:9/608: mknod d19/d24/d36/d47/dbe/ccc 1 2021-04-09T18:26:17.429 INFO:tasks.workunit.client.0.smithi120.stdout:0/476: dread d0/d2/d4/f29 [0,4194304] 0 2021-04-09T18:26:17.431 INFO:tasks.workunit.client.0.smithi120.stdout:4/469: creat d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f9b x:0 0 0 2021-04-09T18:26:17.431 INFO:tasks.workunit.client.0.smithi120.stdout:0/477: write d0/f30 [3539819,115916] 0 2021-04-09T18:26:17.436 INFO:tasks.workunit.client.0.smithi120.stdout:1/578: truncate d5/d5c/d75/daf/d2b/f62 1360502 0 2021-04-09T18:26:17.436 INFO:tasks.workunit.client.0.smithi120.stdout:7/471: creat db/d26/d4c/f9d x:0 0 0 2021-04-09T18:26:17.438 INFO:tasks.workunit.client.0.smithi120.stdout:0/478: read d0/d52/f6d [245676,92264] 0 2021-04-09T18:26:17.440 INFO:tasks.workunit.client.0.smithi120.stdout:3/558: sync 2021-04-09T18:26:17.442 INFO:tasks.workunit.client.0.smithi120.stdout:2/550: sync 2021-04-09T18:26:17.445 INFO:tasks.workunit.client.0.smithi120.stdout:7/472: dread db/d2c/f99 [0,4194304] 0 2021-04-09T18:26:17.449 INFO:tasks.workunit.client.0.smithi120.stdout:4/470: write d1f/d2c/d56/f72 [474072,55443] 0 2021-04-09T18:26:17.453 INFO:tasks.workunit.client.0.smithi120.stdout:0/479: symlink d0/d43/l88 0 2021-04-09T18:26:17.453 INFO:tasks.workunit.client.0.smithi120.stdout:4/471: dread d1f/d2c/d34/d60/d7a/d92/f5e [0,4194304] 0 2021-04-09T18:26:17.455 INFO:tasks.workunit.client.0.smithi120.stdout:0/480: write d0/d2/f5b [2745567,23714] 0 2021-04-09T18:26:17.455 INFO:tasks.workunit.client.0.smithi120.stdout:9/609: truncate d19/d24/d37/d40/f8f 161391 0 2021-04-09T18:26:17.456 INFO:tasks.workunit.client.0.smithi120.stdout:3/559: creat d3/d5/d36/dac/fb8 x:0 0 0 2021-04-09T18:26:17.457 INFO:tasks.workunit.client.0.smithi120.stdout:9/610: chown d19/d24/d37/d40/d89/f20 4919554 1 2021-04-09T18:26:17.459 INFO:tasks.workunit.client.0.smithi120.stdout:2/551: mkdir d13/d15/d35/d9f/db9 0 2021-04-09T18:26:17.461 INFO:tasks.workunit.client.0.smithi120.stdout:4/472: fsync d1f/d24/f25 0 2021-04-09T18:26:17.463 INFO:tasks.workunit.client.0.smithi120.stdout:9/611: stat d19/d2c/d5b 0 2021-04-09T18:26:17.463 INFO:tasks.workunit.client.0.smithi120.stdout:0/481: read d0/d43/f66 [46373,110529] 0 2021-04-09T18:26:17.465 INFO:tasks.workunit.client.0.smithi120.stdout:0/482: read - d0/d2/d4/d5f/f76 zero size 2021-04-09T18:26:17.465 INFO:tasks.workunit.client.0.smithi120.stdout:1/579: write d5/d5c/d75/daf/d24/f68 [4718730,62930] 0 2021-04-09T18:26:17.466 INFO:tasks.workunit.client.0.smithi120.stdout:8/509: truncate d2/d37/d3e/d7c/d7a/f73 39366 0 2021-04-09T18:26:17.467 INFO:tasks.workunit.client.0.smithi120.stdout:5/737: sync 2021-04-09T18:26:17.467 INFO:tasks.workunit.client.0.smithi120.stdout:6/529: sync 2021-04-09T18:26:17.467 INFO:tasks.workunit.client.0.smithi120.stdout:7/473: creat db/d2c/d30/d59/f9e x:0 0 0 2021-04-09T18:26:17.472 INFO:tasks.workunit.client.0.smithi120.stdout:5/738: dread d10/d12/d1b/fda [0,4194304] 0 2021-04-09T18:26:17.473 INFO:tasks.workunit.client.0.smithi120.stdout:5/739: write d10/daa/db4/fd6 [259729,78913] 0 2021-04-09T18:26:17.475 INFO:tasks.workunit.client.0.smithi120.stdout:4/473: creat d1f/d24/f9c x:0 0 0 2021-04-09T18:26:17.480 INFO:tasks.workunit.client.0.smithi120.stdout:0/483: symlink d0/d2/da/d2e/l89 0 2021-04-09T18:26:17.480 INFO:tasks.workunit.client.0.smithi120.stdout:8/510: creat d2/d3/f97 x:0 0 0 2021-04-09T18:26:17.482 INFO:tasks.workunit.client.0.smithi120.stdout:1/580: rename d5/d50 to d5/d5c/d75/daf/dc7 0 2021-04-09T18:26:17.483 INFO:tasks.workunit.client.0.smithi120.stdout:4/474: mknod d1f/d2c/d34/d60/d7a/d92/d3e/d73/c9d 1 2021-04-09T18:26:17.484 INFO:tasks.workunit.client.0.smithi120.stdout:8/511: mknod d2/d3/c98 1 2021-04-09T18:26:17.485 INFO:tasks.workunit.client.0.smithi120.stdout:0/484: mknod d0/d2/da/d23/c8a 1 2021-04-09T18:26:17.486 INFO:tasks.workunit.client.0.smithi120.stdout:0/485: chown d0/d5a 26 1 2021-04-09T18:26:17.486 INFO:tasks.workunit.client.0.smithi120.stdout:7/474: creat db/d26/d4c/f9f x:0 0 0 2021-04-09T18:26:17.487 INFO:tasks.workunit.client.0.smithi120.stdout:0/486: dread - d0/d2/da/f7a zero size 2021-04-09T18:26:17.488 INFO:tasks.workunit.client.0.smithi120.stdout:6/530: getdents d6/d8/db/d12 0 2021-04-09T18:26:17.490 INFO:tasks.workunit.client.0.smithi120.stdout:9/612: truncate d19/d24/d37/f5f 286415 0 2021-04-09T18:26:17.490 INFO:tasks.workunit.client.0.smithi120.stdout:1/581: mknod d5/d5c/d75/daf/d87/cc8 1 2021-04-09T18:26:17.490 INFO:tasks.workunit.client.0.smithi120.stdout:6/531: write d6/d8/d1a/d36/d54/d41/d49/f73 [634687,47892] 0 2021-04-09T18:26:17.491 INFO:tasks.workunit.client.0.smithi120.stdout:4/475: creat d1f/d2c/d34/d60/d7a/d92/d84/d99/f9e x:0 0 0 2021-04-09T18:26:17.493 INFO:tasks.workunit.client.0.smithi120.stdout:4/476: read d1f/d24/f25 [620672,84405] 0 2021-04-09T18:26:17.494 INFO:tasks.workunit.client.0.smithi120.stdout:8/512: mkdir d2/d37/d3e/d7c/d99 0 2021-04-09T18:26:17.495 INFO:tasks.workunit.client.0.smithi120.stdout:7/475: symlink db/d2c/la0 0 2021-04-09T18:26:17.496 INFO:tasks.workunit.client.0.smithi120.stdout:8/513: write d2/d3/d3c/d4f/f81 [2110256,115516] 0 2021-04-09T18:26:17.496 INFO:tasks.workunit.client.0.smithi120.stdout:9/613: mkdir d19/d24/d36/da8/dcd 0 2021-04-09T18:26:17.498 INFO:tasks.workunit.client.0.smithi120.stdout:7/476: chown db/d2c/d34/d5d 10832 1 2021-04-09T18:26:17.499 INFO:tasks.workunit.client.0.smithi120.stdout:7/477: mknod db/ca1 1 2021-04-09T18:26:17.500 INFO:tasks.workunit.client.0.smithi120.stdout:6/532: stat d6/d8/db/d12/f18 0 2021-04-09T18:26:17.500 INFO:tasks.workunit.client.0.smithi120.stdout:1/582: read d5/d64/d2d/f6e [271166,19336] 0 2021-04-09T18:26:17.501 INFO:tasks.workunit.client.0.smithi120.stdout:6/533: stat d6/d8/db/d12 0 2021-04-09T18:26:17.502 INFO:tasks.workunit.client.0.smithi120.stdout:4/477: rename d1f/f32 to d1f/f9f 0 2021-04-09T18:26:17.504 INFO:tasks.workunit.client.0.smithi120.stdout:6/534: read d6/d8/db/da6/f8e [476347,35308] 0 2021-04-09T18:26:17.504 INFO:tasks.workunit.client.0.smithi120.stdout:0/487: truncate d0/d2/f60 872748 0 2021-04-09T18:26:17.506 INFO:tasks.workunit.client.0.smithi120.stdout:6/535: chown d6/d8/db/d2b/d68/d6a/d74/fab 5260 1 2021-04-09T18:26:17.508 INFO:tasks.workunit.client.0.smithi120.stdout:9/614: creat d19/d24/d36/d47/d4b/fce x:0 0 0 2021-04-09T18:26:17.510 INFO:tasks.workunit.client.0.smithi120.stdout:9/615: dread - d19/d24/d37/d40/d89/d29/d76/f9a zero size 2021-04-09T18:26:17.511 INFO:tasks.workunit.client.0.smithi120.stdout:6/536: mkdir d6/d8/db/d2b/d4d/db8 0 2021-04-09T18:26:17.514 INFO:tasks.workunit.client.0.smithi120.stdout:0/488: rename d0/d2/da/d2e to d0/d2/d4/d5f/d61/d8b 0 2021-04-09T18:26:17.515 INFO:tasks.workunit.client.0.smithi120.stdout:0/489: chown d0/d2/d4/l39 1858967116 1 2021-04-09T18:26:17.523 INFO:tasks.workunit.client.0.smithi120.stdout:7/478: link db/d38/d3c/d6e/f83 db/d42/d54/fa2 0 2021-04-09T18:26:17.531 INFO:tasks.workunit.client.0.smithi120.stdout:9/616: rmdir d19/d24/d37/dbc 0 2021-04-09T18:26:17.537 INFO:tasks.workunit.client.0.smithi120.stdout:1/583: rename d5/d5c/d75/daf/d24/f41 to d5/d5c/d75/daf/d2b/d8e/fc9 0 2021-04-09T18:26:17.540 INFO:tasks.workunit.client.0.smithi120.stdout:9/617: chown d19/l25 12408191 1 2021-04-09T18:26:17.540 INFO:tasks.workunit.client.0.smithi120.stdout:8/514: truncate d2/d3/d11/d6a/d3b/f47 2781127 0 2021-04-09T18:26:17.541 INFO:tasks.workunit.client.0.smithi120.stdout:7/479: link f2 db/fa3 0 2021-04-09T18:26:17.542 INFO:tasks.workunit.client.0.smithi120.stdout:7/480: fdatasync f4 0 2021-04-09T18:26:17.545 INFO:tasks.workunit.client.0.smithi120.stdout:0/490: link d0/d2/d4/d5f/d61/d8b/l58 d0/d2/d82/l8c 0 2021-04-09T18:26:17.550 INFO:tasks.workunit.client.0.smithi120.stdout:0/491: dwrite d0/d2/d4/f59 [0,4194304] 0 2021-04-09T18:26:17.678 INFO:tasks.workunit.client.0.smithi120.stdout:0/492: mkdir d0/d2/d8d 0 2021-04-09T18:26:17.680 INFO:tasks.workunit.client.0.smithi120.stdout:4/478: rename d1f/d2c/d30/d87 to d1f/d24/d42/da0 0 2021-04-09T18:26:17.684 INFO:tasks.workunit.client.0.smithi120.stdout:4/479: symlink d1f/d24/d42/da0/la1 0 2021-04-09T18:26:17.686 INFO:tasks.workunit.client.0.smithi120.stdout:4/480: dread d1f/d2c/d34/d60/d7a/d92/f5e [0,4194304] 0 2021-04-09T18:26:17.688 INFO:tasks.workunit.client.0.smithi120.stdout:1/584: truncate d5/d64/d2d/d5a/f9e 1024633 0 2021-04-09T18:26:17.690 INFO:tasks.workunit.client.0.smithi120.stdout:6/537: rename d6/d8/d1a/d36/la1 to d6/d8/d3a/lb9 0 2021-04-09T18:26:17.691 INFO:tasks.workunit.client.0.smithi120.stdout:0/493: rmdir d0/d2/da/d23 39 2021-04-09T18:26:17.691 INFO:tasks.workunit.client.0.smithi120.stdout:4/481: symlink d1f/d2c/d30/la2 0 2021-04-09T18:26:17.697 INFO:tasks.workunit.client.0.smithi120.stdout:4/482: symlink d1f/d2c/d34/d83/la3 0 2021-04-09T18:26:17.698 INFO:tasks.workunit.client.0.smithi120.stdout:7/481: truncate db/d2c/d30/d59/f9e 2529 0 2021-04-09T18:26:17.699 INFO:tasks.workunit.client.0.smithi120.stdout:4/483: write d1f/d24/f9c [831613,130427] 0 2021-04-09T18:26:17.699 INFO:tasks.workunit.client.0.smithi120.stdout:6/538: dwrite d6/d8/d52/da8/faf [0,4194304] 0 2021-04-09T18:26:17.709 INFO:tasks.workunit.client.0.smithi120.stdout:9/618: rename d19/d24/f28 to d19/d24/d37/d40/fcf 0 2021-04-09T18:26:17.710 INFO:tasks.workunit.client.0.smithi120.stdout:1/585: truncate d5/d64/d2d/d5a/d8d/fa8 875344 0 2021-04-09T18:26:17.710 INFO:tasks.workunit.client.0.smithi120.stdout:9/619: write f16 [5119219,76035] 0 2021-04-09T18:26:17.712 INFO:tasks.workunit.client.0.smithi120.stdout:6/539: dread d6/d8/d1a/d36/d54/d31/d37/d61/f9a [0,4194304] 0 2021-04-09T18:26:17.713 INFO:tasks.workunit.client.0.smithi120.stdout:0/494: dwrite d0/d52/f6e [0,4194304] 0 2021-04-09T18:26:17.720 INFO:tasks.workunit.client.0.smithi120.stdout:1/586: mknod d5/d64/d63/d86/da3/cca 1 2021-04-09T18:26:17.720 INFO:tasks.workunit.client.0.smithi120.stdout:0/495: mknod d0/d2/d4/c8e 1 2021-04-09T18:26:17.721 INFO:tasks.workunit.client.0.smithi120.stdout:0/496: chown d0/d2/d8d 1696 1 2021-04-09T18:26:17.726 INFO:tasks.workunit.client.0.smithi120.stdout:7/482: getdents db/d38/d74 0 2021-04-09T18:26:17.727 INFO:tasks.workunit.client.0.smithi120.stdout:3/560: sync 2021-04-09T18:26:17.735 INFO:tasks.workunit.client.0.smithi120.stdout:6/540: dread d6/d8/db/d2b/d68/d6a/d74/fa2 [0,4194304] 0 2021-04-09T18:26:17.735 INFO:tasks.workunit.client.0.smithi120.stdout:4/484: rename d1f/d24/d6b to d1f/d2c/d56/da4 0 2021-04-09T18:26:17.739 INFO:tasks.workunit.client.0.smithi120.stdout:9/620: link d19/d24/d37/d40/d89/f80 d19/d2c/d5b/fd0 0 2021-04-09T18:26:17.741 INFO:tasks.workunit.client.0.smithi120.stdout:3/561: dread d3/d5/d36/d1e/d6b/d49/d4e/d54/f75 [0,4194304] 0 2021-04-09T18:26:17.744 INFO:tasks.workunit.client.0.smithi120.stdout:9/621: mknod d19/d24/d2e/cd1 1 2021-04-09T18:26:17.747 INFO:tasks.workunit.client.0.smithi120.stdout:4/485: mkdir d1f/d2c/d56/d6a/da5 0 2021-04-09T18:26:17.750 INFO:tasks.workunit.client.0.smithi120.stdout:7/483: write db/d42/d54/f71 [369049,72735] 0 2021-04-09T18:26:17.750 INFO:tasks.workunit.client.0.smithi120.stdout:4/486: write d1f/d24/f9c [1059768,33691] 0 2021-04-09T18:26:17.752 INFO:tasks.workunit.client.0.smithi120.stdout:1/587: truncate d5/d5c/d75/daf/d24/f68 2668338 0 2021-04-09T18:26:17.752 INFO:tasks.workunit.client.0.smithi120.stdout:0/497: truncate d0/d52/d56/f5d 364489 0 2021-04-09T18:26:17.763 INFO:tasks.workunit.client.0.smithi120.stdout:0/498: stat d0/d2/d4/d5f/d61/d8b/l44 0 2021-04-09T18:26:17.763 INFO:tasks.workunit.client.0.smithi120.stdout:3/562: rmdir d3/d5/d36/d1e/d6b/d49/d5e/d80/d9c 0 2021-04-09T18:26:17.764 INFO:tasks.workunit.client.0.smithi120.stdout:1/588: link d5/d1f/f96 d5/d5c/d75/daf/d87/dc3/fcb 0 2021-04-09T18:26:17.766 INFO:tasks.workunit.client.0.smithi120.stdout:2/552: sync 2021-04-09T18:26:17.766 INFO:tasks.workunit.client.0.smithi120.stdout:5/740: sync 2021-04-09T18:26:17.770 INFO:tasks.workunit.client.0.smithi120.stdout:3/563: mkdir d3/d5/d36/d1e/d38/db9 0 2021-04-09T18:26:17.771 INFO:tasks.workunit.client.0.smithi120.stdout:6/541: truncate d6/d8/db/d12/d22/f27 3646442 0 2021-04-09T18:26:17.773 INFO:tasks.workunit.client.0.smithi120.stdout:0/499: rmdir d0/d2/dd 39 2021-04-09T18:26:17.779 INFO:tasks.workunit.client.0.smithi120.stdout:7/484: dread db/d2c/d34/f70 [0,4194304] 0 2021-04-09T18:26:17.779 INFO:tasks.workunit.client.0.smithi120.stdout:9/622: dread d19/f38 [4194304,4194304] 0 2021-04-09T18:26:17.781 INFO:tasks.workunit.client.0.smithi120.stdout:4/487: dwrite d1f/d2c/d56/f74 [0,4194304] 0 2021-04-09T18:26:17.809 INFO:tasks.workunit.client.0.smithi120.stdout:8/515: sync 2021-04-09T18:26:17.877 INFO:tasks.workunit.client.0.smithi120.stdout:5/741: getdents d10/d12/d1b/d1f/d84/d44/d8c/da6/dcc/dd4 0 2021-04-09T18:26:17.878 INFO:tasks.workunit.client.0.smithi120.stdout:5/742: dread - d10/d12/d1b/d1f/d84/d3d/fb7 zero size 2021-04-09T18:26:17.948 INFO:tasks.workunit.client.0.smithi120.stdout:6/542: write d6/d8/db/d12/f4b [1948480,9917] 0 2021-04-09T18:26:17.949 INFO:tasks.workunit.client.0.smithi120.stdout:3/564: rename d3/d5/d36/d1e/d6b/d49/d73 to d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba 0 2021-04-09T18:26:17.954 INFO:tasks.workunit.client.0.smithi120.stdout:7/485: dwrite db/d26/d4c/f98 [0,4194304] 0 2021-04-09T18:26:17.956 INFO:tasks.workunit.client.0.smithi120.stdout:1/589: creat d5/d64/d2d/d5a/d8d/fcc x:0 0 0 2021-04-09T18:26:17.957 INFO:tasks.workunit.client.0.smithi120.stdout:0/500: mkdir d0/d5a/d62/d8f 0 2021-04-09T18:26:17.959 INFO:tasks.workunit.client.0.smithi120.stdout:2/553: creat d13/d7a/d80/d48/d49/d64/fba x:0 0 0 2021-04-09T18:26:17.961 INFO:tasks.workunit.client.0.smithi120.stdout:9/623: mkdir d19/d24/d37/d40/dd2 0 2021-04-09T18:26:17.961 INFO:tasks.workunit.client.0.smithi120.stdout:2/554: chown d13/d7a/d80/d48/d49/d76/f82 126 1 2021-04-09T18:26:17.963 INFO:tasks.workunit.client.0.smithi120.stdout:4/488: mkdir d1f/d2c/d34/d60/d7a/d92/da6 0 2021-04-09T18:26:17.964 INFO:tasks.workunit.client.0.smithi120.stdout:8/516: creat d2/d37/d3e/d7c/d99/f9a x:0 0 0 2021-04-09T18:26:17.967 INFO:tasks.workunit.client.0.smithi120.stdout:5/743: symlink d10/d12/d3b/l108 0 2021-04-09T18:26:17.971 INFO:tasks.workunit.client.0.smithi120.stdout:3/565: dwrite d3/d5/f28 [0,4194304] 0 2021-04-09T18:26:17.973 INFO:tasks.workunit.client.0.smithi120.stdout:9/624: dwrite d19/d24/d37/d40/d89/d29/d76/f91 [0,4194304] 0 2021-04-09T18:26:17.974 INFO:tasks.workunit.client.0.smithi120.stdout:9/625: dread - d19/d81/fca zero size 2021-04-09T18:26:17.975 INFO:tasks.workunit.client.0.smithi120.stdout:2/555: mkdir d13/d7a/d80/d48/d49/d64/d9d/dbb 0 2021-04-09T18:26:17.976 INFO:tasks.workunit.client.0.smithi120.stdout:8/517: mkdir d2/d37/d8d/d9b 0 2021-04-09T18:26:17.978 INFO:tasks.workunit.client.0.smithi120.stdout:3/566: fdatasync d3/d5/d36/dac/fb8 0 2021-04-09T18:26:17.981 INFO:tasks.workunit.client.0.smithi120.stdout:0/501: chown d0/d2/d4/d5f/d61/d8b/l58 113493 1 2021-04-09T18:26:17.981 INFO:tasks.workunit.client.0.smithi120.stdout:2/556: rmdir d13/d61/d7c 39 2021-04-09T18:26:17.982 INFO:tasks.workunit.client.0.smithi120.stdout:4/489: dwrite d1f/d2c/d34/d60/d7a/d4f/f91 [0,4194304] 0 2021-04-09T18:26:17.996 INFO:tasks.workunit.client.0.smithi120.stdout:8/518: rmdir d2/d3 39 2021-04-09T18:26:18.000 INFO:tasks.workunit.client.0.smithi120.stdout:9/626: unlink d19/d24/d37/d40/f8f 0 2021-04-09T18:26:18.000 INFO:tasks.workunit.client.0.smithi120.stdout:7/486: truncate f2 1313079 0 2021-04-09T18:26:18.002 INFO:tasks.workunit.client.0.smithi120.stdout:2/557: chown d13/l20 442 1 2021-04-09T18:26:18.002 INFO:tasks.workunit.client.0.smithi120.stdout:0/502: mknod d0/d2/d4/d5f/c90 1 2021-04-09T18:26:18.004 INFO:tasks.workunit.client.0.smithi120.stdout:3/567: mkdir d3/d5/dbb 0 2021-04-09T18:26:18.006 INFO:tasks.workunit.client.0.smithi120.stdout:0/503: rmdir d0/d5a 39 2021-04-09T18:26:18.008 INFO:tasks.workunit.client.0.smithi120.stdout:2/558: mkdir d13/d15/d35/dbc 0 2021-04-09T18:26:18.011 INFO:tasks.workunit.client.0.smithi120.stdout:1/590: write d5/d5c/d75/daf/d24/f2f [2581066,118318] 0 2021-04-09T18:26:18.012 INFO:tasks.workunit.client.0.smithi120.stdout:0/504: mkdir d0/d43/d49/d91 0 2021-04-09T18:26:18.013 INFO:tasks.workunit.client.0.smithi120.stdout:1/591: chown d5/d64/d63/d86/da3 103797803 1 2021-04-09T18:26:18.015 INFO:tasks.workunit.client.0.smithi120.stdout:1/592: write d5/d64/d63/d86/f9c [5904555,25970] 0 2021-04-09T18:26:18.022 INFO:tasks.workunit.client.0.smithi120.stdout:7/487: rename db/d26/l32 to db/d26/la4 0 2021-04-09T18:26:18.022 INFO:tasks.workunit.client.0.smithi120.stdout:8/519: link d2/d3/d11/d6a/d3b/f7f d2/d3/d3c/d4f/f9c 0 2021-04-09T18:26:18.030 INFO:tasks.workunit.client.0.smithi120.stdout:0/505: fdatasync d0/f57 0 2021-04-09T18:26:18.032 INFO:tasks.workunit.client.0.smithi120.stdout:4/490: link d1f/d2c/d56/da4/l59 d1f/d2c/d56/d6a/la7 0 2021-04-09T18:26:18.036 INFO:tasks.workunit.client.0.smithi120.stdout:4/491: dread - d1f/f8d zero size 2021-04-09T18:26:18.036 INFO:tasks.workunit.client.0.smithi120.stdout:5/744: truncate d10/d12/d1b/d1f/f79 60119 0 2021-04-09T18:26:18.037 INFO:tasks.workunit.client.0.smithi120.stdout:1/593: creat d5/d64/d63/d86/fcd x:0 0 0 2021-04-09T18:26:18.038 INFO:tasks.workunit.client.0.smithi120.stdout:5/745: mknod d10/daa/db4/d103/c109 1 2021-04-09T18:26:18.041 INFO:tasks.workunit.client.0.smithi120.stdout:4/492: write d1f/d2c/d56/da4/f93 [767976,115853] 0 2021-04-09T18:26:18.043 INFO:tasks.workunit.client.0.smithi120.stdout:0/506: dread d0/d2/d4/f59 [0,4194304] 0 2021-04-09T18:26:18.043 INFO:tasks.workunit.client.0.smithi120.stdout:9/627: dwrite d19/d24/d36/d47/f73 [0,4194304] 0 2021-04-09T18:26:18.044 INFO:tasks.workunit.client.0.smithi120.stdout:8/520: dread d2/d3/f8a [0,4194304] 0 2021-04-09T18:26:18.046 INFO:tasks.workunit.client.0.smithi120.stdout:3/568: truncate d3/d5/d36/f23 5838222 0 2021-04-09T18:26:18.046 INFO:tasks.workunit.client.0.smithi120.stdout:2/559: write d13/d7a/d80/d54/f60 [1302286,17923] 0 2021-04-09T18:26:18.046 INFO:tasks.workunit.client.0.smithi120.stdout:7/488: dread db/d26/f2e [0,4194304] 0 2021-04-09T18:26:18.047 INFO:tasks.workunit.client.0.smithi120.stdout:4/493: readlink d1f/d2c/d30/la2 0 2021-04-09T18:26:18.049 INFO:tasks.workunit.client.0.smithi120.stdout:0/507: chown d0/f41 442 1 2021-04-09T18:26:18.049 INFO:tasks.workunit.client.0.smithi120.stdout:1/594: mknod d5/d5c/d75/daf/d24/cce 1 2021-04-09T18:26:18.049 INFO:tasks.workunit.client.0.smithi120.stdout:5/746: unlink d10/d12/d1b/d1f/f56 0 2021-04-09T18:26:18.050 INFO:tasks.workunit.client.0.smithi120.stdout:7/489: readlink db/d2c/d34/l82 0 2021-04-09T18:26:18.051 INFO:tasks.workunit.client.0.smithi120.stdout:8/521: chown d2/d3/d11/d2c/f93 40400 1 2021-04-09T18:26:18.058 INFO:tasks.workunit.client.0.smithi120.stdout:7/490: read db/d2c/d34/f70 [159436,122558] 0 2021-04-09T18:26:18.058 INFO:tasks.workunit.client.0.smithi120.stdout:1/595: mknod d5/d1f/ccf 1 2021-04-09T18:26:18.059 INFO:tasks.workunit.client.0.smithi120.stdout:4/494: mkdir d1f/d2c/d34/d60/d7a/d89/da8 0 2021-04-09T18:26:18.061 INFO:tasks.workunit.client.0.smithi120.stdout:3/569: chown d3/d5/d36/d1e/d6b/d49/d4e/d54/fb3 92329727 1 2021-04-09T18:26:18.062 INFO:tasks.workunit.client.0.smithi120.stdout:1/596: write d5/d5c/d75/daf/fc0 [812290,42460] 0 2021-04-09T18:26:18.069 INFO:tasks.workunit.client.0.smithi120.stdout:9/628: dread d19/d2c/f79 [0,4194304] 0 2021-04-09T18:26:18.071 INFO:tasks.workunit.client.0.smithi120.stdout:8/522: symlink d2/d3/d3c/d4f/l9d 0 2021-04-09T18:26:18.071 INFO:tasks.workunit.client.0.smithi120.stdout:6/543: dread d6/d8/db/d12/d22/f27 [0,4194304] 0 2021-04-09T18:26:18.072 INFO:tasks.workunit.client.0.smithi120.stdout:1/597: readlink d5/d64/l3b 0 2021-04-09T18:26:18.073 INFO:tasks.workunit.client.0.smithi120.stdout:2/560: rename d13/d84/fb8 to d13/fbd 0 2021-04-09T18:26:18.075 INFO:tasks.workunit.client.0.smithi120.stdout:4/495: link d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f9b d1f/d24/d42/da0/fa9 0 2021-04-09T18:26:18.077 INFO:tasks.workunit.client.0.smithi120.stdout:0/508: creat d0/d2/dd/f92 x:0 0 0 2021-04-09T18:26:18.080 INFO:tasks.workunit.client.0.smithi120.stdout:5/747: rename d10/d12/d1b/f8b to d10/d12/d1b/f10a 0 2021-04-09T18:26:18.081 INFO:tasks.workunit.client.0.smithi120.stdout:3/570: creat d3/de/fbc x:0 0 0 2021-04-09T18:26:18.083 INFO:tasks.workunit.client.0.smithi120.stdout:7/491: mkdir db/d38/d74/d6f/d76/da5 0 2021-04-09T18:26:18.089 INFO:tasks.workunit.client.0.smithi120.stdout:4/496: write d1f/f23 [4576547,47934] 0 2021-04-09T18:26:18.089 INFO:tasks.workunit.client.0.smithi120.stdout:1/598: creat d5/d5c/d75/daf/d87/dc3/fd0 x:0 0 0 2021-04-09T18:26:18.091 INFO:tasks.workunit.client.0.smithi120.stdout:4/497: fsync d1f/d2c/d34/d60/d7a/f98 0 2021-04-09T18:26:18.091 INFO:tasks.workunit.client.0.smithi120.stdout:0/509: fsync d0/d2/da/f7a 0 2021-04-09T18:26:18.096 INFO:tasks.workunit.client.0.smithi120.stdout:2/561: rename d13/d84/l88 to d13/d15/d35/d9f/db9/lbe 0 2021-04-09T18:26:18.098 INFO:tasks.workunit.client.0.smithi120.stdout:8/523: mkdir d2/d37/d3e/d42/d9e 0 2021-04-09T18:26:18.098 INFO:tasks.workunit.client.0.smithi120.stdout:5/748: dwrite d10/d12/d1b/d1f/f64 [0,4194304] 0 2021-04-09T18:26:18.101 INFO:tasks.workunit.client.0.smithi120.stdout:0/510: mknod d0/d2/d7b/c93 1 2021-04-09T18:26:18.101 INFO:tasks.workunit.client.0.smithi120.stdout:1/599: write d5/d5c/d75/daf/d24/fa5 [214589,83521] 0 2021-04-09T18:26:18.108 INFO:tasks.workunit.client.0.smithi120.stdout:6/544: truncate d6/d8/db/da6/f8e 1594830 0 2021-04-09T18:26:18.110 INFO:tasks.workunit.client.0.smithi120.stdout:5/749: dwrite d10/daa/db4/fdb [0,4194304] 0 2021-04-09T18:26:18.115 INFO:tasks.workunit.client.0.smithi120.stdout:1/600: mkdir d5/d64/d2d/db5/dd1 0 2021-04-09T18:26:18.116 INFO:tasks.workunit.client.0.smithi120.stdout:1/601: dread - d5/d64/d63/d86/fcd zero size 2021-04-09T18:26:18.125 INFO:tasks.workunit.client.0.smithi120.stdout:9/629: truncate d19/d24/d37/f86 53755 0 2021-04-09T18:26:18.128 INFO:tasks.workunit.client.0.smithi120.stdout:2/562: unlink d13/d15/l5a 0 2021-04-09T18:26:18.130 INFO:tasks.workunit.client.0.smithi120.stdout:6/545: rmdir d6 39 2021-04-09T18:26:18.135 INFO:tasks.workunit.client.0.smithi120.stdout:7/492: dwrite db/d26/f2d [0,4194304] 0 2021-04-09T18:26:18.137 INFO:tasks.workunit.client.0.smithi120.stdout:0/511: symlink d0/d2/d7b/l94 0 2021-04-09T18:26:18.137 INFO:tasks.workunit.client.0.smithi120.stdout:7/493: write db/d2c/d34/f41 [3761990,51004] 0 2021-04-09T18:26:18.138 INFO:tasks.workunit.client.0.smithi120.stdout:5/750: mkdir d10/d12/d1b/d1f/d84/d44/dcb/d10b 0 2021-04-09T18:26:18.143 INFO:tasks.workunit.client.0.smithi120.stdout:2/563: fdatasync d13/f72 0 2021-04-09T18:26:18.151 INFO:tasks.workunit.client.0.smithi120.stdout:4/498: dwrite d1f/d2c/d34/d60/d7a/d92/f8e [0,4194304] 0 2021-04-09T18:26:18.156 INFO:tasks.workunit.client.0.smithi120.stdout:8/524: dwrite d2/d3/d8/f6d [0,4194304] 0 2021-04-09T18:26:18.157 INFO:tasks.workunit.client.0.smithi120.stdout:8/525: fdatasync d2/f39 0 2021-04-09T18:26:18.160 INFO:tasks.workunit.client.0.smithi120.stdout:0/512: unlink d0/d5a/d62/l78 0 2021-04-09T18:26:18.163 INFO:tasks.workunit.client.0.smithi120.stdout:9/630: creat d19/d24/d37/d40/d89/d29/d63/fd3 x:0 0 0 2021-04-09T18:26:18.164 INFO:tasks.workunit.client.0.smithi120.stdout:1/602: dwrite d5/d5c/d75/daf/d2b/f47 [4194304,4194304] 0 2021-04-09T18:26:18.171 INFO:tasks.workunit.client.0.smithi120.stdout:2/564: symlink d13/d15/lbf 0 2021-04-09T18:26:18.173 INFO:tasks.workunit.client.0.smithi120.stdout:8/526: dwrite d2/d3/d11/d6a/f70 [0,4194304] 0 2021-04-09T18:26:18.175 INFO:tasks.workunit.client.0.smithi120.stdout:7/494: rename f6 to db/d2c/d30/d59/fa6 0 2021-04-09T18:26:18.177 INFO:tasks.workunit.client.0.smithi120.stdout:2/565: mknod d13/d7a/cc0 1 2021-04-09T18:26:18.178 INFO:tasks.workunit.client.0.smithi120.stdout:9/631: write d19/d24/d9e/fab [4146682,17476] 0 2021-04-09T18:26:18.182 INFO:tasks.workunit.client.0.smithi120.stdout:1/603: symlink d5/d5c/ld2 0 2021-04-09T18:26:18.185 INFO:tasks.workunit.client.0.smithi120.stdout:2/566: readlink d13/d15/l95 0 2021-04-09T18:26:18.187 INFO:tasks.workunit.client.0.smithi120.stdout:8/527: fdatasync d2/d27/f2f 0 2021-04-09T18:26:18.188 INFO:tasks.workunit.client.0.smithi120.stdout:4/499: link d1f/d2c/d56/da4/f82 d1f/d2c/d56/da4/faa 0 2021-04-09T18:26:18.189 INFO:tasks.workunit.client.0.smithi120.stdout:8/528: read d2/d3/f8b [430369,101748] 0 2021-04-09T18:26:18.192 INFO:tasks.workunit.client.0.smithi120.stdout:4/500: chown d1f/d2c/d34/d60/d7a/d92/d84/d99/f9e 7243 1 2021-04-09T18:26:18.193 INFO:tasks.workunit.client.0.smithi120.stdout:0/513: write d0/d43/f66 [1012639,33904] 0 2021-04-09T18:26:18.195 INFO:tasks.workunit.client.0.smithi120.stdout:2/567: mkdir d13/d15/d35/dbc/dc1 0 2021-04-09T18:26:18.195 INFO:tasks.workunit.client.0.smithi120.stdout:7/495: creat db/d26/d4c/d53/fa7 x:0 0 0 2021-04-09T18:26:18.196 INFO:tasks.workunit.client.0.smithi120.stdout:5/751: dwrite d10/d12/d1b/d3a/f9c [0,4194304] 0 2021-04-09T18:26:18.197 INFO:tasks.workunit.client.0.smithi120.stdout:1/604: creat d5/d1f/fd3 x:0 0 0 2021-04-09T18:26:18.203 INFO:tasks.workunit.client.0.smithi120.stdout:9/632: write d19/d24/d37/d40/d89/d29/f2b [4977802,41075] 0 2021-04-09T18:26:18.203 INFO:tasks.workunit.client.0.smithi120.stdout:1/605: rmdir d5/d5c/d75/daf/d87/dc3 39 2021-04-09T18:26:18.206 INFO:tasks.workunit.client.0.smithi120.stdout:9/633: dread - d19/d81/fad zero size 2021-04-09T18:26:18.207 INFO:tasks.workunit.client.0.smithi120.stdout:4/501: dwrite d1f/d2c/f86 [0,4194304] 0 2021-04-09T18:26:18.209 INFO:tasks.workunit.client.0.smithi120.stdout:5/752: fdatasync d10/d12/d1b/d3a/d5b/f8d 0 2021-04-09T18:26:18.211 INFO:tasks.workunit.client.0.smithi120.stdout:2/568: creat d13/d7a/d80/fc2 x:0 0 0 2021-04-09T18:26:18.212 INFO:tasks.workunit.client.0.smithi120.stdout:7/496: link db/d26/f5e db/d42/fa8 0 2021-04-09T18:26:18.214 INFO:tasks.workunit.client.0.smithi120.stdout:8/529: truncate d2/d3/d11/ff 5082844 0 2021-04-09T18:26:18.214 INFO:tasks.workunit.client.0.smithi120.stdout:1/606: stat d5/d64/d63/d86/f88 0 2021-04-09T18:26:18.219 INFO:tasks.workunit.client.0.smithi120.stdout:7/497: read db/d2c/d34/f41 [205538,107006] 0 2021-04-09T18:26:18.227 INFO:tasks.workunit.client.0.smithi120.stdout:1/607: chown d5/d5c/d75/daf/d2b/f62 3558045 1 2021-04-09T18:26:18.227 INFO:tasks.workunit.client.0.smithi120.stdout:1/608: write d5/d5c/f72 [4207977,11211] 0 2021-04-09T18:26:18.228 INFO:tasks.workunit.client.0.smithi120.stdout:9/634: creat d19/d24/d36/fd4 x:0 0 0 2021-04-09T18:26:18.229 INFO:tasks.workunit.client.0.smithi120.stdout:9/635: stat f17 0 2021-04-09T18:26:18.230 INFO:tasks.workunit.client.0.smithi120.stdout:9/636: mknod d19/d24/d37/d40/d89/d52/da7/cd5 1 2021-04-09T18:26:18.232 INFO:tasks.workunit.client.0.smithi120.stdout:5/753: rename d10/d12/d1b/f10a to d10/d12/d1b/f10c 0 2021-04-09T18:26:18.234 INFO:tasks.workunit.client.0.smithi120.stdout:2/569: rmdir d13/d15/d35/dbc/dc1 0 2021-04-09T18:26:18.236 INFO:tasks.workunit.client.0.smithi120.stdout:9/637: dwrite d19/d24/d36/d47/f73 [0,4194304] 0 2021-04-09T18:26:18.240 INFO:tasks.workunit.client.0.smithi120.stdout:5/754: symlink d10/d12/d1b/d1f/d84/d44/dcb/l10d 0 2021-04-09T18:26:18.243 INFO:tasks.workunit.client.0.smithi120.stdout:1/609: mkdir d5/d5c/d75/daf/d2b/dd4 0 2021-04-09T18:26:18.243 INFO:tasks.workunit.client.0.smithi120.stdout:0/514: truncate d0/d2/d4/f29 2775388 0 2021-04-09T18:26:18.262 INFO:tasks.workunit.client.0.smithi120.stdout:8/530: truncate d2/d3/f4c 502694 0 2021-04-09T18:26:18.263 INFO:tasks.workunit.client.0.smithi120.stdout:1/610: mknod d5/d5c/d75/daf/d87/dc3/cd5 1 2021-04-09T18:26:18.264 INFO:tasks.workunit.client.0.smithi120.stdout:7/498: truncate db/d38/d3c/d6e/f83 441276 0 2021-04-09T18:26:18.264 INFO:tasks.workunit.client.0.smithi120.stdout:8/531: write d2/f6e [414775,12301] 0 2021-04-09T18:26:18.271 INFO:tasks.workunit.client.0.smithi120.stdout:1/611: mknod d5/cd6 1 2021-04-09T18:26:18.272 INFO:tasks.workunit.client.0.smithi120.stdout:8/532: dread - d2/d3/f97 zero size 2021-04-09T18:26:18.272 INFO:tasks.workunit.client.0.smithi120.stdout:1/612: write d5/d5c/d75/daf/dc7/d61/f7e [2179088,84076] 0 2021-04-09T18:26:18.272 INFO:tasks.workunit.client.0.smithi120.stdout:5/755: truncate d10/d12/f77 4669696 0 2021-04-09T18:26:18.272 INFO:tasks.workunit.client.0.smithi120.stdout:2/570: write d13/d15/f2d [987684,8233] 0 2021-04-09T18:26:18.273 INFO:tasks.workunit.client.0.smithi120.stdout:1/613: dread - d5/d1f/fd3 zero size 2021-04-09T18:26:18.274 INFO:tasks.workunit.client.0.smithi120.stdout:5/756: write d10/d12/f1a [127455,113335] 0 2021-04-09T18:26:18.283 INFO:tasks.workunit.client.0.smithi120.stdout:7/499: rename db/d42/f90 to db/d26/fa9 0 2021-04-09T18:26:18.286 INFO:tasks.workunit.client.0.smithi120.stdout:1/614: creat d5/d64/d2d/db5/fd7 x:0 0 0 2021-04-09T18:26:18.289 INFO:tasks.workunit.client.0.smithi120.stdout:2/571: getdents d13/d61/d7c/d98/da2 0 2021-04-09T18:26:18.290 INFO:tasks.workunit.client.0.smithi120.stdout:1/615: chown d5/d5c/d75/daf/d2b/d8e 1 1 2021-04-09T18:26:18.290 INFO:tasks.workunit.client.0.smithi120.stdout:5/757: creat d10/daa/f10e x:0 0 0 2021-04-09T18:26:18.290 INFO:tasks.workunit.client.0.smithi120.stdout:7/500: creat db/d42/d54/faa x:0 0 0 2021-04-09T18:26:18.292 INFO:tasks.workunit.client.0.smithi120.stdout:1/616: unlink d5/d1f/l1e 0 2021-04-09T18:26:18.310 INFO:tasks.workunit.client.0.smithi120.stdout:2/572: dread d13/f1d [0,4194304] 0 2021-04-09T18:26:18.315 INFO:tasks.workunit.client.0.smithi120.stdout:2/573: link d13/d15/d35/f3e d13/d84/fc3 0 2021-04-09T18:26:18.438 INFO:tasks.workunit.client.0.smithi120.stdout:7/501: dread db/f1a [0,4194304] 0 2021-04-09T18:26:18.439 INFO:tasks.workunit.client.0.smithi120.stdout:7/502: rmdir db/d26 39 2021-04-09T18:26:18.442 INFO:tasks.workunit.client.0.smithi120.stdout:0/515: dread d0/f57 [0,4194304] 0 2021-04-09T18:26:18.696 INFO:tasks.workunit.client.0.smithi120.stdout:3/571: sync 2021-04-09T18:26:18.701 INFO:tasks.workunit.client.0.smithi120.stdout:7/503: write db/f2f [5678781,94544] 0 2021-04-09T18:26:18.705 INFO:tasks.workunit.client.0.smithi120.stdout:3/572: dwrite d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/f84 [0,4194304] 0 2021-04-09T18:26:18.707 INFO:tasks.workunit.client.0.smithi120.stdout:7/504: readlink db/d26/d4c/d53/l7c 0 2021-04-09T18:26:18.709 INFO:tasks.workunit.client.0.smithi120.stdout:3/573: write d3/d5/d36/d1e/d6b/d49/d4e/f60 [995079,21603] 0 2021-04-09T18:26:18.710 INFO:tasks.workunit.client.0.smithi120.stdout:7/505: mkdir db/d38/dab 0 2021-04-09T18:26:18.712 INFO:tasks.workunit.client.0.smithi120.stdout:0/516: write d0/f41 [3920715,34987] 0 2021-04-09T18:26:18.715 INFO:tasks.workunit.client.0.smithi120.stdout:3/574: creat d3/d5/d36/d3d/fbd x:0 0 0 2021-04-09T18:26:18.716 INFO:tasks.workunit.client.0.smithi120.stdout:7/506: chown db/d26/d4c/d53/l56 0 1 2021-04-09T18:26:18.718 INFO:tasks.workunit.client.0.smithi120.stdout:7/507: mknod db/d7f/cac 1 2021-04-09T18:26:18.719 INFO:tasks.workunit.client.0.smithi120.stdout:3/575: write d3/d5/d36/d1e/d6b/d49/fa9 [1420160,57005] 0 2021-04-09T18:26:18.737 INFO:tasks.workunit.client.0.smithi120.stdout:0/517: dwrite d0/d5a/d62/d69/f77 [0,4194304] 0 2021-04-09T18:26:18.740 INFO:tasks.workunit.client.0.smithi120.stdout:0/518: unlink d0/d5a/d6c/f75 0 2021-04-09T18:26:18.750 INFO:tasks.workunit.client.0.smithi120.stdout:0/519: fsync d0/d2/da/f19 0 2021-04-09T18:26:18.762 INFO:tasks.workunit.client.0.smithi120.stdout:0/520: rename d0/d2/d4/d5f/d61/d8b/l58 to d0/l95 0 2021-04-09T18:26:18.763 INFO:tasks.workunit.client.0.smithi120.stdout:7/508: write db/d42/f65 [728790,10424] 0 2021-04-09T18:26:18.768 INFO:tasks.workunit.client.0.smithi120.stdout:7/509: stat db/d2c/f8e 0 2021-04-09T18:26:18.769 INFO:tasks.workunit.client.0.smithi120.stdout:4/502: sync 2021-04-09T18:26:18.771 INFO:tasks.workunit.client.0.smithi120.stdout:3/576: dwrite d3/d5/d36/d1e/d38/d61/f76 [0,4194304] 0 2021-04-09T18:26:18.773 INFO:tasks.workunit.client.0.smithi120.stdout:4/503: creat d1f/d24/d42/da0/fab x:0 0 0 2021-04-09T18:26:18.774 INFO:tasks.workunit.client.0.smithi120.stdout:7/510: creat db/d26/fad x:0 0 0 2021-04-09T18:26:18.774 INFO:tasks.workunit.client.0.smithi120.stdout:0/521: read d0/d2/f60 [750401,59974] 0 2021-04-09T18:26:18.775 INFO:tasks.workunit.client.0.smithi120.stdout:4/504: readlink d1f/d24/l5a 0 2021-04-09T18:26:18.776 INFO:tasks.workunit.client.0.smithi120.stdout:7/511: write db/d2c/d30/f72 [3455031,5756] 0 2021-04-09T18:26:18.778 INFO:tasks.workunit.client.0.smithi120.stdout:3/577: creat d3/fbe x:0 0 0 2021-04-09T18:26:18.783 INFO:tasks.workunit.client.0.smithi120.stdout:4/505: getdents d1f/d2c/d34/d60/d7a/d92/da6 0 2021-04-09T18:26:18.783 INFO:tasks.workunit.client.0.smithi120.stdout:4/506: stat d1f/d24/f25 0 2021-04-09T18:26:18.785 INFO:tasks.workunit.client.0.smithi120.stdout:3/578: dread d3/d5/f4d [0,4194304] 0 2021-04-09T18:26:18.791 INFO:tasks.workunit.client.0.smithi120.stdout:7/512: link db/d42/fa8 db/d38/d3c/fae 0 2021-04-09T18:26:18.792 INFO:tasks.workunit.client.0.smithi120.stdout:7/513: chown db/d26/d4c/l4e 516746 1 2021-04-09T18:26:18.793 INFO:tasks.workunit.client.0.smithi120.stdout:4/507: rename d1f/d2c/d34/d83/la3 to d1f/d2c/d56/lac 0 2021-04-09T18:26:18.794 INFO:tasks.workunit.client.0.smithi120.stdout:4/508: chown d1f/d2c/d34/d60/d7a/d4f 0 1 2021-04-09T18:26:18.797 INFO:tasks.workunit.client.0.smithi120.stdout:3/579: creat d3/d5/d36/d1e/d6b/fbf x:0 0 0 2021-04-09T18:26:18.804 INFO:tasks.workunit.client.0.smithi120.stdout:0/522: dwrite d0/d2/da/d23/f2f [0,4194304] 0 2021-04-09T18:26:18.806 INFO:tasks.workunit.client.0.smithi120.stdout:0/523: chown d0/d2/d4/f73 1255 1 2021-04-09T18:26:18.808 INFO:tasks.workunit.client.0.smithi120.stdout:6/546: sync 2021-04-09T18:26:18.808 INFO:tasks.workunit.client.0.smithi120.stdout:9/638: sync 2021-04-09T18:26:18.808 INFO:tasks.workunit.client.0.smithi120.stdout:1/617: sync 2021-04-09T18:26:18.808 INFO:tasks.workunit.client.0.smithi120.stdout:8/533: sync 2021-04-09T18:26:18.809 INFO:tasks.workunit.client.0.smithi120.stdout:5/758: sync 2021-04-09T18:26:18.809 INFO:tasks.workunit.client.0.smithi120.stdout:2/574: sync 2021-04-09T18:26:18.809 INFO:tasks.workunit.client.0.smithi120.stdout:3/580: fsync d3/d5/f74 0 2021-04-09T18:26:18.810 INFO:tasks.workunit.client.0.smithi120.stdout:4/509: mkdir d1f/d2c/d34/d60/dad 0 2021-04-09T18:26:18.813 INFO:tasks.workunit.client.0.smithi120.stdout:5/759: write d10/d12/d1b/d3a/f9c [3380609,23746] 0 2021-04-09T18:26:18.814 INFO:tasks.workunit.client.0.smithi120.stdout:9/639: write d19/d24/d37/d40/f56 [4346020,3202] 0 2021-04-09T18:26:18.814 INFO:tasks.workunit.client.0.smithi120.stdout:2/575: fsync d13/d7a/d80/f33 0 2021-04-09T18:26:18.820 INFO:tasks.workunit.client.0.smithi120.stdout:2/576: write d13/d7a/d80/d48/d49/d64/d9d/fb2 [573701,74839] 0 2021-04-09T18:26:18.827 INFO:tasks.workunit.client.0.smithi120.stdout:5/760: write d10/d12/d3b/f86 [4613641,74306] 0 2021-04-09T18:26:18.828 INFO:tasks.workunit.client.0.smithi120.stdout:7/514: truncate db/d26/d4c/f98 3445010 0 2021-04-09T18:26:18.836 INFO:tasks.workunit.client.0.smithi120.stdout:7/515: read db/d2c/d30/f72 [1927985,126702] 0 2021-04-09T18:26:18.842 INFO:tasks.workunit.client.0.smithi120.stdout:9/640: dwrite d19/d24/d37/d40/d89/d29/d76/f9a [0,4194304] 0 2021-04-09T18:26:18.844 INFO:tasks.workunit.client.0.smithi120.stdout:5/761: dread - d10/d12/d1b/d1f/d84/d3d/d50/da9/fed zero size 2021-04-09T18:26:18.846 INFO:tasks.workunit.client.0.smithi120.stdout:2/577: dwrite d13/d7a/d80/d54/fa8 [0,4194304] 0 2021-04-09T18:26:18.847 INFO:tasks.workunit.client.0.smithi120.stdout:6/547: dwrite d6/d8/d1a/db7/f91 [0,4194304] 0 2021-04-09T18:26:18.853 INFO:tasks.workunit.client.0.smithi120.stdout:4/510: write d1f/d24/f25 [1059154,17018] 0 2021-04-09T18:26:18.853 INFO:tasks.workunit.client.0.smithi120.stdout:0/524: dread d0/d2/dd/f38 [0,4194304] 0 2021-04-09T18:26:18.853 INFO:tasks.workunit.client.0.smithi120.stdout:9/641: rename d19/d81/fad to d19/d2c/dc8/fd6 0 2021-04-09T18:26:18.857 INFO:tasks.workunit.client.0.smithi120.stdout:9/642: chown d19/d2c/f3f 2007151912 1 2021-04-09T18:26:18.858 INFO:tasks.workunit.client.0.smithi120.stdout:2/578: mknod d13/d7a/d80/d48/d49/d64/d9d/cc4 1 2021-04-09T18:26:18.865 INFO:tasks.workunit.client.0.smithi120.stdout:3/581: dwrite d3/d5/f77 [0,4194304] 0 2021-04-09T18:26:18.871 INFO:tasks.workunit.client.0.smithi120.stdout:0/525: read d0/d5a/d62/d69/f77 [2402925,23419] 0 2021-04-09T18:26:18.872 INFO:tasks.workunit.client.0.smithi120.stdout:8/534: dread d2/d3/d11/d6a/d3b/f47 [0,4194304] 0 2021-04-09T18:26:18.877 INFO:tasks.workunit.client.0.smithi120.stdout:1/618: dwrite d5/d5c/d75/daf/d2b/d8e/fc9 [0,4194304] 0 2021-04-09T18:26:18.881 INFO:tasks.workunit.client.0.smithi120.stdout:9/643: mknod d19/d24/d37/d40/d89/d29/d63/cd7 1 2021-04-09T18:26:18.882 INFO:tasks.workunit.client.0.smithi120.stdout:9/644: chown f14 1017724987 1 2021-04-09T18:26:18.884 INFO:tasks.workunit.client.0.smithi120.stdout:0/526: creat d0/d2/d4/d5f/d61/f96 x:0 0 0 2021-04-09T18:26:18.885 INFO:tasks.workunit.client.0.smithi120.stdout:5/762: link d10/d12/d1b/d3a/f9c d10/d12/d1b/d1f/d84/d44/dcb/f10f 0 2021-04-09T18:26:18.886 INFO:tasks.workunit.client.0.smithi120.stdout:0/527: mknod d0/d2/d4/d5f/d61/d8b/c97 1 2021-04-09T18:26:18.888 INFO:tasks.workunit.client.0.smithi120.stdout:0/528: chown d0/fc 24 1 2021-04-09T18:26:18.890 INFO:tasks.workunit.client.0.smithi120.stdout:8/535: dread d2/d37/d3e/d7c/f7b [0,4194304] 0 2021-04-09T18:26:18.897 INFO:tasks.workunit.client.0.smithi120.stdout:9/645: mkdir d19/d24/dd8 0 2021-04-09T18:26:18.899 INFO:tasks.workunit.client.0.smithi120.stdout:0/529: dwrite d0/d52/f6d [0,4194304] 0 2021-04-09T18:26:18.899 INFO:tasks.workunit.client.0.smithi120.stdout:8/536: readlink d2/d37/l63 0 2021-04-09T18:26:18.900 INFO:tasks.workunit.client.0.smithi120.stdout:7/516: write db/fa3 [422313,16398] 0 2021-04-09T18:26:18.901 INFO:tasks.workunit.client.0.smithi120.stdout:8/537: fsync d2/d37/f91 0 2021-04-09T18:26:18.902 INFO:tasks.workunit.client.0.smithi120.stdout:3/582: rename d3/l57 to d3/de/d25/lc0 0 2021-04-09T18:26:18.903 INFO:tasks.workunit.client.0.smithi120.stdout:7/517: chown db/d2c/d30/f72 56171 1 2021-04-09T18:26:18.907 INFO:tasks.workunit.client.0.smithi120.stdout:7/518: write db/d38/d3c/f8c [847697,80892] 0 2021-04-09T18:26:18.908 INFO:tasks.workunit.client.0.smithi120.stdout:9/646: rename d19/d24/faf to d19/d24/dd8/fd9 0 2021-04-09T18:26:18.909 INFO:tasks.workunit.client.0.smithi120.stdout:7/519: unlink f2 0 2021-04-09T18:26:18.909 INFO:tasks.workunit.client.0.smithi120.stdout:2/579: dwrite d13/d15/d35/dae/fa5 [0,4194304] 0 2021-04-09T18:26:18.923 INFO:tasks.workunit.client.0.smithi120.stdout:8/538: link d2/d3/f60 d2/d3/d11/d2c/f9f 0 2021-04-09T18:26:18.923 INFO:tasks.workunit.client.0.smithi120.stdout:8/539: chown d2/d3/d8/f6d 290 1 2021-04-09T18:26:18.923 INFO:tasks.workunit.client.0.smithi120.stdout:2/580: chown d13/d7a/d80/d48/d49/l59 455796366 1 2021-04-09T18:26:18.924 INFO:tasks.workunit.client.0.smithi120.stdout:0/530: creat d0/d2/da/d23/d6b/f98 x:0 0 0 2021-04-09T18:26:18.924 INFO:tasks.workunit.client.0.smithi120.stdout:3/583: truncate d3/d5/f74 3614590 0 2021-04-09T18:26:18.925 INFO:tasks.workunit.client.0.smithi120.stdout:9/647: symlink d19/d24/d36/d47/d6f/lda 0 2021-04-09T18:26:18.927 INFO:tasks.workunit.client.0.smithi120.stdout:7/520: link db/d7f/f88 db/d38/faf 0 2021-04-09T18:26:18.928 INFO:tasks.workunit.client.0.smithi120.stdout:0/531: rmdir d0/d43 39 2021-04-09T18:26:18.929 INFO:tasks.workunit.client.0.smithi120.stdout:9/648: fdatasync d19/d24/d37/d40/d89/f53 0 2021-04-09T18:26:18.936 INFO:tasks.workunit.client.0.smithi120.stdout:2/581: creat d13/d15/fc5 x:0 0 0 2021-04-09T18:26:18.936 INFO:tasks.workunit.client.0.smithi120.stdout:8/540: creat d2/d37/d3e/fa0 x:0 0 0 2021-04-09T18:26:18.937 INFO:tasks.workunit.client.0.smithi120.stdout:8/541: readlink d2/d3/d3c/l86 0 2021-04-09T18:26:18.938 INFO:tasks.workunit.client.0.smithi120.stdout:8/542: chown d2/d3/d3c/d4f 124232 1 2021-04-09T18:26:18.941 INFO:tasks.workunit.client.0.smithi120.stdout:9/649: creat d19/d81/fdb x:0 0 0 2021-04-09T18:26:18.944 INFO:tasks.workunit.client.0.smithi120.stdout:7/521: rename db/d38/d74/f7b to db/d26/fb0 0 2021-04-09T18:26:18.945 INFO:tasks.workunit.client.0.smithi120.stdout:3/584: truncate d3/d5/d36/d1e/f40 1147899 0 2021-04-09T18:26:18.947 INFO:tasks.workunit.client.0.smithi120.stdout:3/585: write d3/d5/d36/dac/fb8 [811938,44320] 0 2021-04-09T18:26:18.951 INFO:tasks.workunit.client.0.smithi120.stdout:1/619: write d5/d1f/f96 [3324458,20793] 0 2021-04-09T18:26:18.955 INFO:tasks.workunit.client.0.smithi120.stdout:5/763: write d10/d12/fee [5158260,126954] 0 2021-04-09T18:26:18.955 INFO:tasks.workunit.client.0.smithi120.stdout:8/543: link d2/d3/d11/d6a/f8c d2/d3/d8/d84/fa1 0 2021-04-09T18:26:18.959 INFO:tasks.workunit.client.0.smithi120.stdout:3/586: fsync d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/fa0 0 2021-04-09T18:26:18.961 INFO:tasks.workunit.client.0.smithi120.stdout:6/548: dread d6/d8/d1a/d36/d5a/d5d/d6e/f71 [0,4194304] 0 2021-04-09T18:26:18.962 INFO:tasks.workunit.client.0.smithi120.stdout:8/544: mknod d2/d3/d11/d2c/d44/ca2 1 2021-04-09T18:26:18.965 INFO:tasks.workunit.client.0.smithi120.stdout:9/650: link f12 d19/d81/fdc 0 2021-04-09T18:26:18.969 INFO:tasks.workunit.client.0.smithi120.stdout:9/651: chown d19/d24/d36/d47/d6f/l8d 24831626 1 2021-04-09T18:26:18.970 INFO:tasks.workunit.client.0.smithi120.stdout:5/764: rename d10/d12/d1b/d1f/f79 to d10/d12/d1b/d1f/d84/d44/d8c/da6/f110 0 2021-04-09T18:26:18.972 INFO:tasks.workunit.client.0.smithi120.stdout:6/549: getdents d6/d8/d1a/d36/d54/d41/d49/d94 0 2021-04-09T18:26:18.973 INFO:tasks.workunit.client.0.smithi120.stdout:4/511: dread d1f/f71 [0,4194304] 0 2021-04-09T18:26:18.974 INFO:tasks.workunit.client.0.smithi120.stdout:3/587: creat d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/fc1 x:0 0 0 2021-04-09T18:26:18.974 INFO:tasks.workunit.client.0.smithi120.stdout:9/652: unlink d19/d81/fca 0 2021-04-09T18:26:18.975 INFO:tasks.workunit.client.0.smithi120.stdout:6/550: stat d6/d8/d1a/d36/d54/d41/d49/f4f 0 2021-04-09T18:26:18.981 INFO:tasks.workunit.client.0.smithi120.stdout:9/653: symlink d19/d24/d37/d40/ldd 0 2021-04-09T18:26:18.983 INFO:tasks.workunit.client.0.smithi120.stdout:6/551: dread d6/d8/d1a/d36/d5a/d5d/d6e/f71 [0,4194304] 0 2021-04-09T18:26:18.984 INFO:tasks.workunit.client.0.smithi120.stdout:7/522: dread db/d42/f43 [0,4194304] 0 2021-04-09T18:26:18.988 INFO:tasks.workunit.client.0.smithi120.stdout:9/654: symlink d19/d24/d37/d40/d89/d52/da7/db1/lde 0 2021-04-09T18:26:18.996 INFO:tasks.workunit.client.0.smithi120.stdout:1/620: dread d5/f7 [0,4194304] 0 2021-04-09T18:26:18.997 INFO:tasks.workunit.client.0.smithi120.stdout:1/621: chown d5/d64 444 1 2021-04-09T18:26:18.999 INFO:tasks.workunit.client.0.smithi120.stdout:2/582: dwrite d13/d61/d7c/fb5 [0,4194304] 0 2021-04-09T18:26:19.000 INFO:tasks.workunit.client.0.smithi120.stdout:2/583: mknod d13/d61/d7c/d98/da2/cc6 1 2021-04-09T18:26:19.011 INFO:tasks.workunit.client.0.smithi120.stdout:9/655: mkdir d19/d24/d36/d47/dbe/ddf 0 2021-04-09T18:26:19.013 INFO:tasks.workunit.client.0.smithi120.stdout:1/622: chown d5/d5c/d75/daf/dc7/lc1 99192 1 2021-04-09T18:26:19.017 INFO:tasks.workunit.client.0.smithi120.stdout:2/584: dwrite d13/d15/f2d [0,4194304] 0 2021-04-09T18:26:19.023 INFO:tasks.workunit.client.0.smithi120.stdout:8/545: dread d2/d3/d11/d2c/f93 [0,4194304] 0 2021-04-09T18:26:19.025 INFO:tasks.workunit.client.0.smithi120.stdout:3/588: truncate d3/de/d87/d9e/faf 2406643 0 2021-04-09T18:26:19.025 INFO:tasks.workunit.client.0.smithi120.stdout:2/585: mknod d13/d7a/d80/d48/d49/cc7 1 2021-04-09T18:26:19.031 INFO:tasks.workunit.client.0.smithi120.stdout:0/532: truncate d0/d2/d4/f59 1456859 0 2021-04-09T18:26:19.039 INFO:tasks.workunit.client.0.smithi120.stdout:1/623: dwrite d5/d5c/d75/daf/d87/dc3/fcb [0,4194304] 0 2021-04-09T18:26:19.039 INFO:tasks.workunit.client.0.smithi120.stdout:4/512: dwrite d1f/d24/f33 [0,4194304] 0 2021-04-09T18:26:19.041 INFO:tasks.workunit.client.0.smithi120.stdout:1/624: chown d5/d5c/d75/daf/dc7 11 1 2021-04-09T18:26:19.042 INFO:tasks.workunit.client.0.smithi120.stdout:8/546: dwrite d2/d3/d11/d2c/d44/f74 [4194304,4194304] 0 2021-04-09T18:26:19.042 INFO:tasks.workunit.client.0.smithi120.stdout:2/586: dwrite d13/d15/f2d [0,4194304] 0 2021-04-09T18:26:19.042 INFO:tasks.workunit.client.0.smithi120.stdout:0/533: write d0/d2/da/d23/f2f [1324562,57046] 0 2021-04-09T18:26:19.047 INFO:tasks.workunit.client.0.smithi120.stdout:3/589: chown d3/d5/d36/d1e/d38/d61/d9a/fa7 51688 1 2021-04-09T18:26:19.047 INFO:tasks.workunit.client.0.smithi120.stdout:6/552: rename d6/d8/d1a/d36/d5a/d5d/d6e/f71 to d6/d8/db/d12/d22/fba 0 2021-04-09T18:26:19.057 INFO:tasks.workunit.client.0.smithi120.stdout:6/553: dread d6/d8/d1a/d36/d54/d31/f85 [0,4194304] 0 2021-04-09T18:26:19.062 INFO:tasks.workunit.client.0.smithi120.stdout:7/523: truncate db/d38/f6d 3012467 0 2021-04-09T18:26:19.067 INFO:tasks.workunit.client.0.smithi120.stdout:8/547: mkdir d2/d3/d8/da3 0 2021-04-09T18:26:19.078 INFO:tasks.workunit.client.0.smithi120.stdout:9/656: truncate d19/d24/d37/d40/d89/d29/d63/f8b 451183 0 2021-04-09T18:26:19.078 INFO:tasks.workunit.client.0.smithi120.stdout:1/625: creat d5/d64/fd8 x:0 0 0 2021-04-09T18:26:19.084 INFO:tasks.workunit.client.0.smithi120.stdout:8/548: rename d2/d37/d3e/fa0 to d2/d3/d11/d6a/d3b/fa4 0 2021-04-09T18:26:19.090 INFO:tasks.workunit.client.0.smithi120.stdout:8/549: dread - d2/d3/d3c/d4f/f9c zero size 2021-04-09T18:26:19.092 INFO:tasks.workunit.client.0.smithi120.stdout:8/550: readlink d2/d3/d3c/l86 0 2021-04-09T18:26:19.093 INFO:tasks.workunit.client.0.smithi120.stdout:4/513: dwrite d1f/d2c/d34/d60/d7a/d92/d3e/d73/f8b [0,4194304] 0 2021-04-09T18:26:19.097 INFO:tasks.workunit.client.0.smithi120.stdout:3/590: write d3/de/f20 [2028192,17011] 0 2021-04-09T18:26:19.099 INFO:tasks.workunit.client.0.smithi120.stdout:1/626: mknod d5/d5c/d75/daf/d6c/cd9 1 2021-04-09T18:26:19.104 INFO:tasks.workunit.client.0.smithi120.stdout:1/627: read - d5/d5c/d75/daf/d24/fbf zero size 2021-04-09T18:26:19.104 INFO:tasks.workunit.client.0.smithi120.stdout:4/514: readlink d1f/d2c/d30/l7e 0 2021-04-09T18:26:19.114 INFO:tasks.workunit.client.0.smithi120.stdout:9/657: creat d19/d24/d37/d40/d89/d29/d76/fe0 x:0 0 0 2021-04-09T18:26:19.116 INFO:tasks.workunit.client.0.smithi120.stdout:4/515: mkdir d1f/d2c/d34/d60/d7a/d92/d84/d99/dae 0 2021-04-09T18:26:19.120 INFO:tasks.workunit.client.0.smithi120.stdout:9/658: readlink d19/l2d 0 2021-04-09T18:26:19.125 INFO:tasks.workunit.client.0.smithi120.stdout:0/534: dread d0/f41 [0,4194304] 0 2021-04-09T18:26:19.142 INFO:tasks.workunit.client.0.smithi120.stdout:7/524: dwrite db/d42/d54/fa2 [0,4194304] 0 2021-04-09T18:26:19.143 INFO:tasks.workunit.client.0.smithi120.stdout:0/535: creat d0/d5a/f99 x:0 0 0 2021-04-09T18:26:19.144 INFO:tasks.workunit.client.0.smithi120.stdout:4/516: dwrite d1f/d2c/d34/d60/d7a/d92/d3e/f54 [0,4194304] 0 2021-04-09T18:26:19.144 INFO:tasks.workunit.client.0.smithi120.stdout:8/551: truncate d2/d27/f29 1906089 0 2021-04-09T18:26:19.146 INFO:tasks.workunit.client.0.smithi120.stdout:1/628: getdents d5/d64/d63/d86/da3 0 2021-04-09T18:26:19.147 INFO:tasks.workunit.client.0.smithi120.stdout:8/552: readlink d2/d3/d11/l95 0 2021-04-09T18:26:19.148 INFO:tasks.workunit.client.0.smithi120.stdout:3/591: truncate d3/de/d25/f99 753294 0 2021-04-09T18:26:19.167 INFO:tasks.workunit.client.0.smithi120.stdout:1/629: symlink d5/d5c/d75/daf/d87/dc3/lda 0 2021-04-09T18:26:19.168 INFO:tasks.workunit.client.0.smithi120.stdout:8/553: rename d2/d3/f8f to d2/d37/d3e/d7c/d99/fa5 0 2021-04-09T18:26:19.168 INFO:tasks.workunit.client.0.smithi120.stdout:0/536: symlink d0/d2/d4/d5f/l9a 0 2021-04-09T18:26:19.172 INFO:tasks.workunit.client.0.smithi120.stdout:4/517: dwrite d1f/d2c/d34/d60/d7a/d92/d3e/d73/f8b [0,4194304] 0 2021-04-09T18:26:19.174 INFO:tasks.workunit.client.0.smithi120.stdout:7/525: write db/d2c/d30/f39 [769119,79028] 0 2021-04-09T18:26:19.174 INFO:tasks.workunit.client.0.smithi120.stdout:3/592: creat d3/d5/d36/d1e/d6b/d49/d89/d68/da1/fc2 x:0 0 0 2021-04-09T18:26:19.180 INFO:tasks.workunit.client.0.smithi120.stdout:8/554: symlink d2/d37/d3e/d42/d9e/la6 0 2021-04-09T18:26:19.182 INFO:tasks.workunit.client.0.smithi120.stdout:9/659: truncate d19/d2c/d5b/fd0 1193872 0 2021-04-09T18:26:19.182 INFO:tasks.workunit.client.0.smithi120.stdout:8/555: write d2/d3/d3c/d4f/f81 [1060440,68917] 0 2021-04-09T18:26:19.188 INFO:tasks.workunit.client.0.smithi120.stdout:7/526: write db/f1a [2948816,57497] 0 2021-04-09T18:26:19.189 INFO:tasks.workunit.client.0.smithi120.stdout:0/537: symlink d0/d5a/l9b 0 2021-04-09T18:26:19.194 INFO:tasks.workunit.client.0.smithi120.stdout:0/538: chown d0/d2/da/f19 15131 1 2021-04-09T18:26:19.197 INFO:tasks.workunit.client.0.smithi120.stdout:1/630: rename d5/d5c/d75/daf/d87/dc3/fd0 to d5/d64/d63/d86/fdb 0 2021-04-09T18:26:19.206 INFO:tasks.workunit.client.0.smithi120.stdout:7/527: chown db/d7f 588083904 1 2021-04-09T18:26:19.206 INFO:tasks.workunit.client.0.smithi120.stdout:9/660: rename d19/d24/d37/d40/f75 to d19/d24/d37/d40/d89/d52/da7/db1/fe1 0 2021-04-09T18:26:19.210 INFO:tasks.workunit.client.0.smithi120.stdout:3/593: write d3/d5/d36/d1e/d6b/d49/d89/f96 [70126,86622] 0 2021-04-09T18:26:19.212 INFO:tasks.workunit.client.0.smithi120.stdout:8/556: fsync d2/d3/d11/d6a/d3b/f94 0 2021-04-09T18:26:19.215 INFO:tasks.workunit.client.0.smithi120.stdout:9/661: mknod d19/d24/d36/d9c/ce2 1 2021-04-09T18:26:19.228 INFO:tasks.workunit.client.0.smithi120.stdout:0/539: dread d0/d2/f5b [0,4194304] 0 2021-04-09T18:26:19.229 INFO:tasks.workunit.client.0.smithi120.stdout:8/557: symlink d2/d3/d11/d2c/la7 0 2021-04-09T18:26:19.231 INFO:tasks.workunit.client.0.smithi120.stdout:7/528: mkdir db/d38/dab/db1 0 2021-04-09T18:26:19.232 INFO:tasks.workunit.client.0.smithi120.stdout:1/631: getdents d5/d5c/d75 0 2021-04-09T18:26:19.233 INFO:tasks.workunit.client.0.smithi120.stdout:1/632: mknod d5/d64/d63/d86/da3/cdc 1 2021-04-09T18:26:19.595 INFO:tasks.workunit.client.0.smithi120.stdout:0/540: creat d0/d2/f9c x:0 0 0 2021-04-09T18:26:19.600 INFO:tasks.workunit.client.0.smithi120.stdout:0/541: dwrite d0/d2/da/d23/d6b/f83 [0,4194304] 0 2021-04-09T18:26:19.608 INFO:tasks.workunit.client.0.smithi120.stdout:8/558: dwrite d2/d3/d11/d6a/d3b/f66 [0,4194304] 0 2021-04-09T18:26:19.610 INFO:tasks.workunit.client.0.smithi120.stdout:0/542: chown d0/d43/d49 735743093 1 2021-04-09T18:26:19.615 INFO:tasks.workunit.client.0.smithi120.stdout:8/559: dread d2/d3/d11/d2c/f93 [0,4194304] 0 2021-04-09T18:26:19.620 INFO:tasks.workunit.client.0.smithi120.stdout:3/594: truncate d3/de/d25/f22 2082150 0 2021-04-09T18:26:19.626 INFO:tasks.workunit.client.0.smithi120.stdout:1/633: truncate d5/d1f/f15 767410 0 2021-04-09T18:26:19.626 INFO:tasks.workunit.client.0.smithi120.stdout:1/634: write d5/d5c/d75/daf/fc0 [685154,17163] 0 2021-04-09T18:26:19.631 INFO:tasks.workunit.client.0.smithi120.stdout:5/765: sync 2021-04-09T18:26:19.633 INFO:tasks.workunit.client.0.smithi120.stdout:5/766: write d10/d12/d1b/d1f/d84/d3d/d50/d94/fac [3741574,6836] 0 2021-04-09T18:26:19.634 INFO:tasks.workunit.client.0.smithi120.stdout:7/529: truncate db/d26/f2d 3806194 0 2021-04-09T18:26:19.634 INFO:tasks.workunit.client.0.smithi120.stdout:5/767: chown d10/daa/db4/fd6 0 1 2021-04-09T18:26:19.635 INFO:tasks.workunit.client.0.smithi120.stdout:1/635: mknod d5/d5c/d75/daf/d6c/cdd 1 2021-04-09T18:26:19.640 INFO:tasks.workunit.client.0.smithi120.stdout:3/595: mkdir d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/dc3 0 2021-04-09T18:26:19.643 INFO:tasks.workunit.client.0.smithi120.stdout:5/768: mknod d10/d12/d1b/d1f/d84/d3d/d50/d94/c111 1 2021-04-09T18:26:19.644 INFO:tasks.workunit.client.0.smithi120.stdout:0/543: creat d0/d5a/d6c/f9d x:0 0 0 2021-04-09T18:26:19.646 INFO:tasks.workunit.client.0.smithi120.stdout:0/544: write d0/d52/f6e [2653895,17497] 0 2021-04-09T18:26:19.652 INFO:tasks.workunit.client.0.smithi120.stdout:7/530: creat db/d2c/fb2 x:0 0 0 2021-04-09T18:26:19.772 INFO:tasks.workunit.client.0.smithi120.stdout:7/531: creat db/d2c/d30/fb3 x:0 0 0 2021-04-09T18:26:19.774 INFO:tasks.workunit.client.0.smithi120.stdout:3/596: getdents d3/d5/d36/d1e/d6b/d49/d4e/d54 0 2021-04-09T18:26:19.778 INFO:tasks.workunit.client.0.smithi120.stdout:7/532: symlink db/d38/d74/lb4 0 2021-04-09T18:26:19.780 INFO:tasks.workunit.client.0.smithi120.stdout:5/769: rename d10/d12/d1b/d1f/d84/d44/l97 to d10/d12/d1b/d1f/d39/dbb/dff/l112 0 2021-04-09T18:26:19.780 INFO:tasks.workunit.client.0.smithi120.stdout:0/545: getdents d0/d52 0 2021-04-09T18:26:19.781 INFO:tasks.workunit.client.0.smithi120.stdout:7/533: mknod db/d26/cb5 1 2021-04-09T18:26:19.782 INFO:tasks.workunit.client.0.smithi120.stdout:0/546: readlink d0/d43/l53 0 2021-04-09T18:26:19.787 INFO:tasks.workunit.client.0.smithi120.stdout:1/636: dwrite d5/d64/d2d/d5a/f9e [0,4194304] 0 2021-04-09T18:26:19.790 INFO:tasks.workunit.client.0.smithi120.stdout:0/547: write d0/d2/f5b [3920327,71130] 0 2021-04-09T18:26:19.792 INFO:tasks.workunit.client.0.smithi120.stdout:1/637: mknod d5/d5c/cde 1 2021-04-09T18:26:19.796 INFO:tasks.workunit.client.0.smithi120.stdout:7/534: creat db/d2c/fb6 x:0 0 0 2021-04-09T18:26:19.797 INFO:tasks.workunit.client.0.smithi120.stdout:5/770: rename d10/d12/la8 to d10/d12/d1b/d3a/d5b/d78/l113 0 2021-04-09T18:26:19.801 INFO:tasks.workunit.client.0.smithi120.stdout:0/548: mknod d0/d5a/c9e 1 2021-04-09T18:26:19.802 INFO:tasks.workunit.client.0.smithi120.stdout:0/549: stat d0/fc 0 2021-04-09T18:26:19.803 INFO:tasks.workunit.client.0.smithi120.stdout:1/638: mknod d5/d5c/d75/daf/d6c/cdf 1 2021-04-09T18:26:19.807 INFO:tasks.workunit.client.0.smithi120.stdout:0/550: rmdir d0/d5a/d6c 39 2021-04-09T18:26:19.809 INFO:tasks.workunit.client.0.smithi120.stdout:7/535: read db/f27 [3101622,63424] 0 2021-04-09T18:26:19.813 INFO:tasks.workunit.client.0.smithi120.stdout:0/551: chown d0/d5a/d62/d69/l7c 14879586 1 2021-04-09T18:26:19.815 INFO:tasks.workunit.client.0.smithi120.stdout:2/587: sync 2021-04-09T18:26:19.816 INFO:tasks.workunit.client.0.smithi120.stdout:6/554: sync 2021-04-09T18:26:19.818 INFO:tasks.workunit.client.0.smithi120.stdout:7/536: dread - db/d2c/d30/d59/f68 zero size 2021-04-09T18:26:19.819 INFO:tasks.workunit.client.0.smithi120.stdout:6/555: rmdir d6/d8/db/d2b/d4d 39 2021-04-09T18:26:19.819 INFO:tasks.workunit.client.0.smithi120.stdout:5/771: truncate d10/d12/d1b/d1f/d84/d44/dcb/f10f 3088508 0 2021-04-09T18:26:19.821 INFO:tasks.workunit.client.0.smithi120.stdout:0/552: mkdir d0/d2/d82/d9f 0 2021-04-09T18:26:19.825 INFO:tasks.workunit.client.0.smithi120.stdout:5/772: dread - d10/d12/d1b/d1f/d84/d3d/f5e zero size 2021-04-09T18:26:19.825 INFO:tasks.workunit.client.0.smithi120.stdout:3/597: dwrite d3/d5/d36/d1e/f40 [0,4194304] 0 2021-04-09T18:26:19.827 INFO:tasks.workunit.client.0.smithi120.stdout:5/773: readlink d10/daa/ld3 0 2021-04-09T18:26:19.827 INFO:tasks.workunit.client.0.smithi120.stdout:7/537: dwrite db/d26/fad [0,4194304] 0 2021-04-09T18:26:19.830 INFO:tasks.workunit.client.0.smithi120.stdout:3/598: stat d3/d5/d36/d1e/d38 0 2021-04-09T18:26:19.832 INFO:tasks.workunit.client.0.smithi120.stdout:7/538: read - db/d26/d4c/f9d zero size 2021-04-09T18:26:19.839 INFO:tasks.workunit.client.0.smithi120.stdout:1/639: dwrite d5/d5c/d75/daf/dc7/f98 [0,4194304] 0 2021-04-09T18:26:19.842 INFO:tasks.workunit.client.0.smithi120.stdout:7/539: chown db/d26/d4c/f98 912622645 1 2021-04-09T18:26:19.843 INFO:tasks.workunit.client.0.smithi120.stdout:5/774: creat d10/d12/d3b/f114 x:0 0 0 2021-04-09T18:26:19.845 INFO:tasks.workunit.client.0.smithi120.stdout:6/556: truncate d6/d8/d1a/d36/d54/d41/d49/f7c 227148 0 2021-04-09T18:26:19.845 INFO:tasks.workunit.client.0.smithi120.stdout:1/640: mknod d5/d5c/d75/daf/dc7/ce0 1 2021-04-09T18:26:19.845 INFO:tasks.workunit.client.0.smithi120.stdout:7/540: mknod db/d42/cb7 1 2021-04-09T18:26:19.850 INFO:tasks.workunit.client.0.smithi120.stdout:5/775: mkdir d10/d12/d1b/d1f/d39/dab/d115 0 2021-04-09T18:26:19.852 INFO:tasks.workunit.client.0.smithi120.stdout:1/641: creat d5/d64/d2d/fe1 x:0 0 0 2021-04-09T18:26:19.857 INFO:tasks.workunit.client.0.smithi120.stdout:5/776: mknod d10/d12/d1b/d1f/d84/d3d/d50/d94/c116 1 2021-04-09T18:26:19.859 INFO:tasks.workunit.client.0.smithi120.stdout:5/777: chown d10/d12/d1b/fda 13 1 2021-04-09T18:26:19.870 INFO:tasks.workunit.client.0.smithi120.stdout:6/557: creat d6/d8/d1a/d36/d54/d31/d37/d61/fbb x:0 0 0 2021-04-09T18:26:19.871 INFO:tasks.workunit.client.0.smithi120.stdout:3/599: dread d3/de/d25/d53/f66 [0,4194304] 0 2021-04-09T18:26:19.871 INFO:tasks.workunit.client.0.smithi120.stdout:2/588: write d13/d61/f89 [130144,105430] 0 2021-04-09T18:26:19.873 INFO:tasks.workunit.client.0.smithi120.stdout:7/541: dread db/d38/d3c/f6a [0,4194304] 0 2021-04-09T18:26:19.882 INFO:tasks.workunit.client.0.smithi120.stdout:6/558: dwrite d6/d8/db/d12/f4b [4194304,4194304] 0 2021-04-09T18:26:19.889 INFO:tasks.workunit.client.0.smithi120.stdout:1/642: dread d5/d5c/d75/daf/f2c [0,4194304] 0 2021-04-09T18:26:19.890 INFO:tasks.workunit.client.0.smithi120.stdout:6/559: symlink d6/d8/db/d2b/d68/d6a/d74/lbc 0 2021-04-09T18:26:19.891 INFO:tasks.workunit.client.0.smithi120.stdout:1/643: mknod d5/d5c/d75/daf/d87/ce2 1 2021-04-09T18:26:19.891 INFO:tasks.workunit.client.0.smithi120.stdout:1/644: chown d5/d64/d2d/db5 469620330 1 2021-04-09T18:26:19.894 INFO:tasks.workunit.client.0.smithi120.stdout:3/600: link d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/l7d d3/d5/d36/d1e/d6b/d6a/d83/lc4 0 2021-04-09T18:26:19.896 INFO:tasks.workunit.client.0.smithi120.stdout:1/645: readlink d5/d5c/d75/daf/dc7/d61/lac 0 2021-04-09T18:26:19.897 INFO:tasks.workunit.client.0.smithi120.stdout:1/646: chown d5/d64/d2d/d5a 1622740418 1 2021-04-09T18:26:19.898 INFO:tasks.workunit.client.0.smithi120.stdout:6/560: rename d6/d8/d1a/fb5 to d6/d8/db/d92/fbd 0 2021-04-09T18:26:19.903 INFO:tasks.workunit.client.0.smithi120.stdout:1/647: creat d5/d64/d2d/d5a/fe3 x:0 0 0 2021-04-09T18:26:19.904 INFO:tasks.workunit.client.0.smithi120.stdout:3/601: truncate d3/f70 3396226 0 2021-04-09T18:26:19.907 INFO:tasks.workunit.client.0.smithi120.stdout:1/648: mknod d5/d64/d2d/d5a/ce4 1 2021-04-09T18:26:19.908 INFO:tasks.workunit.client.0.smithi120.stdout:6/561: rename d6/d8/d1a/d36/d54/d31/d37/d61/f90 to d6/fbe 0 2021-04-09T18:26:19.910 INFO:tasks.workunit.client.0.smithi120.stdout:1/649: fdatasync d5/d5c/d75/daf/d2b/f78 0 2021-04-09T18:26:19.910 INFO:tasks.workunit.client.0.smithi120.stdout:6/562: symlink d6/d8/db/d12/d93/lbf 0 2021-04-09T18:26:19.913 INFO:tasks.workunit.client.0.smithi120.stdout:1/650: rmdir d5/d64/d2d/db5 39 2021-04-09T18:26:19.923 INFO:tasks.workunit.client.0.smithi120.stdout:5/778: truncate d10/d12/d1b/d1f/d84/d44/f88 2250403 0 2021-04-09T18:26:19.924 INFO:tasks.workunit.client.0.smithi120.stdout:9/662: sync 2021-04-09T18:26:19.924 INFO:tasks.workunit.client.0.smithi120.stdout:2/589: truncate d13/d7a/d80/d48/d58/f65 4636732 0 2021-04-09T18:26:19.929 INFO:tasks.workunit.client.0.smithi120.stdout:5/779: mknod d10/d12/d1b/d1f/d84/d44/c117 1 2021-04-09T18:26:19.932 INFO:tasks.workunit.client.0.smithi120.stdout:9/663: fdatasync d19/d24/d37/d40/d89/d29/d63/fb6 0 2021-04-09T18:26:19.937 INFO:tasks.workunit.client.0.smithi120.stdout:3/602: dwrite d3/d5/d36/d1e/d6b/d6a/d83/f93 [0,4194304] 0 2021-04-09T18:26:19.937 INFO:tasks.workunit.client.0.smithi120.stdout:7/542: truncate db/d2c/d34/f48 3331987 0 2021-04-09T18:26:19.938 INFO:tasks.workunit.client.0.smithi120.stdout:2/590: symlink d13/d7a/lc8 0 2021-04-09T18:26:19.939 INFO:tasks.workunit.client.0.smithi120.stdout:9/664: chown d19/d24/d37/d40/fcf 419 1 2021-04-09T18:26:19.944 INFO:tasks.workunit.client.0.smithi120.stdout:6/563: write d6/d8/db/f24 [566244,93223] 0 2021-04-09T18:26:19.948 INFO:tasks.workunit.client.0.smithi120.stdout:2/591: chown d13/d7a/d80/d48/d49/d64/fb4 374 1 2021-04-09T18:26:19.954 INFO:tasks.workunit.client.0.smithi120.stdout:2/592: write d13/d15/d35/dae/fa5 [4609462,46268] 0 2021-04-09T18:26:19.954 INFO:tasks.workunit.client.0.smithi120.stdout:1/651: dwrite d5/d5c/d75/daf/d24/f68 [0,4194304] 0 2021-04-09T18:26:19.956 INFO:tasks.workunit.client.0.smithi120.stdout:7/543: rename db/d38/d74/d6f/d76/l84 to db/d38/d74/lb8 0 2021-04-09T18:26:19.957 INFO:tasks.workunit.client.0.smithi120.stdout:4/518: dread d1f/f23 [4194304,4194304] 0 2021-04-09T18:26:19.961 INFO:tasks.workunit.client.0.smithi120.stdout:4/519: write d1f/d24/d42/da0/fab [11669,9613] 0 2021-04-09T18:26:19.967 INFO:tasks.workunit.client.0.smithi120.stdout:4/520: dread d1f/d2c/d34/d60/d7a/d92/d3e/d73/f8b [0,4194304] 0 2021-04-09T18:26:19.971 INFO:tasks.workunit.client.0.smithi120.stdout:6/564: creat d6/d8/d3a/d56/d97/fc0 x:0 0 0 2021-04-09T18:26:19.971 INFO:tasks.workunit.client.0.smithi120.stdout:1/652: creat d5/d5c/d75/fe5 x:0 0 0 2021-04-09T18:26:19.971 INFO:tasks.workunit.client.0.smithi120.stdout:3/603: truncate d3/d5/f28 295589 0 2021-04-09T18:26:19.976 INFO:tasks.workunit.client.0.smithi120.stdout:2/593: rename d13/d61/d7c/d98/da2 to d13/d7a/d80/dc9 0 2021-04-09T18:26:19.978 INFO:tasks.workunit.client.0.smithi120.stdout:3/604: readlink d3/d5/d36/d1e/laa 0 2021-04-09T18:26:19.978 INFO:tasks.workunit.client.0.smithi120.stdout:6/565: mknod d6/d8/d1a/d36/d54/d31/d37/cc1 1 2021-04-09T18:26:19.980 INFO:tasks.workunit.client.0.smithi120.stdout:4/521: symlink d1f/d2c/d34/d60/d7a/d92/laf 0 2021-04-09T18:26:19.980 INFO:tasks.workunit.client.0.smithi120.stdout:7/544: truncate db/d38/d3c/f6a 211524 0 2021-04-09T18:26:19.980 INFO:tasks.workunit.client.0.smithi120.stdout:6/566: dread - d6/d8/d1a/d36/d5a/f87 zero size 2021-04-09T18:26:19.981 INFO:tasks.workunit.client.0.smithi120.stdout:2/594: rmdir d13/d7a/d80/d48/d49/d64 39 2021-04-09T18:26:19.982 INFO:tasks.workunit.client.0.smithi120.stdout:2/595: chown d13/d7a/d80/d54/l5f 0 1 2021-04-09T18:26:19.993 INFO:tasks.workunit.client.0.smithi120.stdout:2/596: mknod d13/d7a/d80/d48/d49/d64/cca 1 2021-04-09T18:26:19.994 INFO:tasks.workunit.client.0.smithi120.stdout:3/605: getdents d3/d5/d36/d1e/d6b/d49/d5e/d80 0 2021-04-09T18:26:19.995 INFO:tasks.workunit.client.0.smithi120.stdout:2/597: write fb [8679492,112538] 0 2021-04-09T18:26:19.997 INFO:tasks.workunit.client.0.smithi120.stdout:2/598: readlink d13/d7a/d80/d48/d49/l6d 0 2021-04-09T18:26:19.998 INFO:tasks.workunit.client.0.smithi120.stdout:9/665: write d19/d2c/f48 [2186358,89388] 0 2021-04-09T18:26:20.003 INFO:tasks.workunit.client.0.smithi120.stdout:5/780: dwrite d10/d12/d1b/d1f/f4e [0,4194304] 0 2021-04-09T18:26:20.007 INFO:tasks.workunit.client.0.smithi120.stdout:1/653: write d5/d5c/d75/daf/dc7/d61/f7e [3943299,87338] 0 2021-04-09T18:26:20.008 INFO:tasks.workunit.client.0.smithi120.stdout:2/599: symlink d13/d15/lcb 0 2021-04-09T18:26:20.010 INFO:tasks.workunit.client.0.smithi120.stdout:8/560: sync 2021-04-09T18:26:20.015 INFO:tasks.workunit.client.0.smithi120.stdout:3/606: creat d3/d5/d36/d1e/d38/d6d/fc5 x:0 0 0 2021-04-09T18:26:20.020 INFO:tasks.workunit.client.0.smithi120.stdout:6/567: dwrite d6/d8/f26 [0,4194304] 0 2021-04-09T18:26:20.023 INFO:tasks.workunit.client.0.smithi120.stdout:9/666: getdents d19/d24/d36/d47 0 2021-04-09T18:26:20.023 INFO:tasks.workunit.client.0.smithi120.stdout:1/654: creat d5/d5c/fe6 x:0 0 0 2021-04-09T18:26:20.024 INFO:tasks.workunit.client.0.smithi120.stdout:3/607: symlink d3/d5/d36/dac/lc6 0 2021-04-09T18:26:20.026 INFO:tasks.workunit.client.0.smithi120.stdout:5/781: dwrite d10/d12/d1b/d1f/d84/d44/d8c/ff2 [0,4194304] 0 2021-04-09T18:26:20.028 INFO:tasks.workunit.client.0.smithi120.stdout:1/655: write d5/d64/d63/d86/fcd [836655,46847] 0 2021-04-09T18:26:20.030 INFO:tasks.workunit.client.0.smithi120.stdout:7/545: truncate db/f29 1064776 0 2021-04-09T18:26:20.031 INFO:tasks.workunit.client.0.smithi120.stdout:3/608: chown d3/de/d25/d53 5929 1 2021-04-09T18:26:20.033 INFO:tasks.workunit.client.0.smithi120.stdout:5/782: write d10/d12/d1b/d1f/f64 [1260316,19948] 0 2021-04-09T18:26:20.037 INFO:tasks.workunit.client.0.smithi120.stdout:1/656: rmdir d5/d64 39 2021-04-09T18:26:20.038 INFO:tasks.workunit.client.0.smithi120.stdout:3/609: chown d3/d5/d36/d1e/d6b/d6a/d83 66920 1 2021-04-09T18:26:20.042 INFO:tasks.workunit.client.0.smithi120.stdout:1/657: fdatasync d5/d5c/d75/daf/d24/f2f 0 2021-04-09T18:26:20.043 INFO:tasks.workunit.client.0.smithi120.stdout:4/522: truncate d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f7f 2877026 0 2021-04-09T18:26:20.046 INFO:tasks.workunit.client.0.smithi120.stdout:7/546: creat db/d42/d54/d5a/fb9 x:0 0 0 2021-04-09T18:26:20.050 INFO:tasks.workunit.client.0.smithi120.stdout:3/610: dwrite d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/fa0 [0,4194304] 0 2021-04-09T18:26:20.050 INFO:tasks.workunit.client.0.smithi120.stdout:1/658: readlink d5/d1f/l44 0 2021-04-09T18:26:20.059 INFO:tasks.workunit.client.0.smithi120.stdout:8/561: dwrite d2/d3/d11/d6a/d3b/f72 [0,4194304] 0 2021-04-09T18:26:20.060 INFO:tasks.workunit.client.0.smithi120.stdout:9/667: link d19/d24/d37/d40/d89/d52/da7/db1/fe1 d19/d24/d36/d47/d4b/fe3 0 2021-04-09T18:26:20.069 INFO:tasks.workunit.client.0.smithi120.stdout:3/611: mkdir d3/d5/d36/d1e/d6b/d6a/d83/dc7 0 2021-04-09T18:26:20.069 INFO:tasks.workunit.client.0.smithi120.stdout:3/612: mkdir d3/de/d87/dc8 0 2021-04-09T18:26:20.069 INFO:tasks.workunit.client.0.smithi120.stdout:2/600: rename d13/d7a/d80/f33 to d13/d8d/fcc 0 2021-04-09T18:26:20.079 INFO:tasks.workunit.client.0.smithi120.stdout:3/613: chown d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba 748 1 2021-04-09T18:26:20.080 INFO:tasks.workunit.client.0.smithi120.stdout:9/668: dwrite d19/d24/d36/d47/d4b/fb9 [0,4194304] 0 2021-04-09T18:26:20.108 INFO:tasks.workunit.client.0.smithi120.stdout:3/614: getdents d3/d5/dbb 0 2021-04-09T18:26:20.109 INFO:tasks.workunit.client.0.smithi120.stdout:4/523: rename d1f/d24/f25 to d1f/fb0 0 2021-04-09T18:26:20.110 INFO:tasks.workunit.client.0.smithi120.stdout:3/615: write d3/d5/d36/d1e/d6b/fbf [449505,39726] 0 2021-04-09T18:26:20.111 INFO:tasks.workunit.client.0.smithi120.stdout:6/568: truncate d6/d8/d1a/d36/d54/d41/d49/f73 47410 0 2021-04-09T18:26:20.112 INFO:tasks.workunit.client.0.smithi120.stdout:8/562: dread d2/d3/d11/d2c/f9f [0,4194304] 0 2021-04-09T18:26:20.114 INFO:tasks.workunit.client.0.smithi120.stdout:3/616: mknod d3/d5/d36/d1e/d38/cc9 1 2021-04-09T18:26:20.118 INFO:tasks.workunit.client.0.smithi120.stdout:4/524: dwrite d1f/d2c/d56/da4/f93 [0,4194304] 0 2021-04-09T18:26:20.119 INFO:tasks.workunit.client.0.smithi120.stdout:7/547: dread db/d38/f40 [0,4194304] 0 2021-04-09T18:26:20.119 INFO:tasks.workunit.client.0.smithi120.stdout:8/563: mknod d2/d3/d11/d2c/ca8 1 2021-04-09T18:26:20.119 INFO:tasks.workunit.client.0.smithi120.stdout:3/617: unlink d3/d5/d36/d1e/d38/d61/f8f 0 2021-04-09T18:26:20.121 INFO:tasks.workunit.client.0.smithi120.stdout:1/659: rename d5/d1f/lc5 to d5/d5c/d75/daf/db8/le7 0 2021-04-09T18:26:20.123 INFO:tasks.workunit.client.0.smithi120.stdout:3/618: dread - d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f/fb2 zero size 2021-04-09T18:26:20.129 INFO:tasks.workunit.client.0.smithi120.stdout:4/525: creat d1f/d2c/d34/d60/d7a/d92/d3e/d73/fb1 x:0 0 0 2021-04-09T18:26:20.133 INFO:tasks.workunit.client.0.smithi120.stdout:6/569: dwrite d6/d8/db/d12/d22/f40 [0,4194304] 0 2021-04-09T18:26:20.134 INFO:tasks.workunit.client.0.smithi120.stdout:1/660: dread d5/d64/d2d/d5a/f9e [0,4194304] 0 2021-04-09T18:26:20.137 INFO:tasks.workunit.client.0.smithi120.stdout:3/619: stat d3/d5/d36/d1e/d6b/d49/d4e/d54/f5f 0 2021-04-09T18:26:20.139 INFO:tasks.workunit.client.0.smithi120.stdout:2/601: rename d13/d7a/d80/f2b to d13/d15/d35/fcd 0 2021-04-09T18:26:20.144 INFO:tasks.workunit.client.0.smithi120.stdout:1/661: rmdir d5/d5c/d75/daf/dc7 39 2021-04-09T18:26:20.144 INFO:tasks.workunit.client.0.smithi120.stdout:4/526: write d1f/d2c/d34/d60/d7a/d92/d3e/d73/fb1 [30039,43135] 0 2021-04-09T18:26:20.145 INFO:tasks.workunit.client.0.smithi120.stdout:8/564: write d2/d3/f5a [437217,103654] 0 2021-04-09T18:26:20.146 INFO:tasks.workunit.client.0.smithi120.stdout:1/662: mknod d5/ce8 1 2021-04-09T18:26:20.147 INFO:tasks.workunit.client.0.smithi120.stdout:4/527: rmdir d1f/d2c/d34/d83 39 2021-04-09T18:26:20.147 INFO:tasks.workunit.client.0.smithi120.stdout:6/570: dwrite d6/d8/db/d12/d22/fba [0,4194304] 0 2021-04-09T18:26:20.150 INFO:tasks.workunit.client.0.smithi120.stdout:3/620: creat d3/de/d87/fca x:0 0 0 2021-04-09T18:26:20.153 INFO:tasks.workunit.client.0.smithi120.stdout:9/669: rename d19/d2c/d5b to d19/d24/de4 0 2021-04-09T18:26:20.155 INFO:tasks.workunit.client.0.smithi120.stdout:6/571: mkdir d6/d8/db/d12/d93/dc2 0 2021-04-09T18:26:20.155 INFO:tasks.workunit.client.0.smithi120.stdout:1/663: dwrite d5/d64/f82 [0,4194304] 0 2021-04-09T18:26:20.156 INFO:tasks.workunit.client.0.smithi120.stdout:3/621: stat d3/de/l21 0 2021-04-09T18:26:20.156 INFO:tasks.workunit.client.0.smithi120.stdout:9/670: chown d19/d24/d37/d40/d89/d52/da7/db1 437529197 1 2021-04-09T18:26:20.161 INFO:tasks.workunit.client.0.smithi120.stdout:4/528: unlink d1f/d2c/d56/da4/f82 0 2021-04-09T18:26:20.164 INFO:tasks.workunit.client.0.smithi120.stdout:9/671: stat d19/d24/d37/d40/l41 0 2021-04-09T18:26:20.164 INFO:tasks.workunit.client.0.smithi120.stdout:4/529: chown d1f/d2c/d34/d60/d7a/d92/d3e/f54 630 1 2021-04-09T18:26:20.165 INFO:tasks.workunit.client.0.smithi120.stdout:8/565: write d2/d3/d11/d2c/f87 [2359667,49133] 0 2021-04-09T18:26:20.169 INFO:tasks.workunit.client.0.smithi120.stdout:0/553: sync 2021-04-09T18:26:20.174 INFO:tasks.workunit.client.0.smithi120.stdout:6/572: mkdir d6/d8/db/d12/d93/dc2/dc3 0 2021-04-09T18:26:20.178 INFO:tasks.workunit.client.0.smithi120.stdout:7/548: rename db/d26/la4 to db/d38/d74/d6f/d76/lba 0 2021-04-09T18:26:20.178 INFO:tasks.workunit.client.0.smithi120.stdout:6/573: read d6/d8/db/d2b/f6f [1996853,109757] 0 2021-04-09T18:26:20.180 INFO:tasks.workunit.client.0.smithi120.stdout:7/549: read - db/d26/d4c/f9f zero size 2021-04-09T18:26:20.183 INFO:tasks.workunit.client.0.smithi120.stdout:7/550: chown db/d42/fa8 8208233 1 2021-04-09T18:26:20.184 INFO:tasks.workunit.client.0.smithi120.stdout:7/551: dread - db/d2c/fb6 zero size 2021-04-09T18:26:20.185 INFO:tasks.workunit.client.0.smithi120.stdout:3/622: write d3/d5/d36/d1e/d6b/f79 [384419,125962] 0 2021-04-09T18:26:20.191 INFO:tasks.workunit.client.0.smithi120.stdout:4/530: truncate d1f/d2c/d34/d60/d7a/f98 858298 0 2021-04-09T18:26:20.192 INFO:tasks.workunit.client.0.smithi120.stdout:7/552: chown db/fa3 120 1 2021-04-09T18:26:20.192 INFO:tasks.workunit.client.0.smithi120.stdout:1/664: dwrite d5/d64/d2d/d5a/fb0 [4194304,4194304] 0 2021-04-09T18:26:20.193 INFO:tasks.workunit.client.0.smithi120.stdout:3/623: read d3/f37 [2555772,120313] 0 2021-04-09T18:26:20.197 INFO:tasks.workunit.client.0.smithi120.stdout:4/531: write d1f/fb0 [296828,130892] 0 2021-04-09T18:26:20.198 INFO:tasks.workunit.client.0.smithi120.stdout:1/665: read d5/d5c/f72 [3314244,67958] 0 2021-04-09T18:26:20.198 INFO:tasks.workunit.client.0.smithi120.stdout:7/553: unlink db/d26/d4c/d53/l9c 0 2021-04-09T18:26:20.199 INFO:tasks.workunit.client.0.smithi120.stdout:3/624: chown d3/d5/d36/d1e/d6b/d49/d5e/l95 1410 1 2021-04-09T18:26:20.200 INFO:tasks.workunit.client.0.smithi120.stdout:4/532: read - d1f/d24/d42/da0/fa9 zero size 2021-04-09T18:26:20.201 INFO:tasks.workunit.client.0.smithi120.stdout:6/574: dwrite d6/d8/d1a/d36/d54/d31/f76 [4194304,4194304] 0 2021-04-09T18:26:20.204 INFO:tasks.workunit.client.0.smithi120.stdout:6/575: chown d6/d8/db/d12/d93/f9f 767 1 2021-04-09T18:26:20.206 INFO:tasks.workunit.client.0.smithi120.stdout:2/602: rename d13/d7a/d80/l96 to d13/d7a/d80/d48/d58/lce 0 2021-04-09T18:26:20.206 INFO:tasks.workunit.client.0.smithi120.stdout:7/554: symlink db/d42/d54/lbb 0 2021-04-09T18:26:20.208 INFO:tasks.workunit.client.0.smithi120.stdout:7/555: read db/d38/f69 [1893,119585] 0 2021-04-09T18:26:20.210 INFO:tasks.workunit.client.0.smithi120.stdout:8/566: rename d2/d3/d8/d84 to d2/d3/d11/d6a/d3b/d6b/da9 0 2021-04-09T18:26:20.214 INFO:tasks.workunit.client.0.smithi120.stdout:2/603: mkdir d13/d7a/d80/d48/d49/d64/d9d/dcf 0 2021-04-09T18:26:20.215 INFO:tasks.workunit.client.0.smithi120.stdout:4/533: dread - d1f/d2c/d34/d60/d7a/d4f/f79 zero size 2021-04-09T18:26:20.216 INFO:tasks.workunit.client.0.smithi120.stdout:4/534: chown d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f9b 12 1 2021-04-09T18:26:20.217 INFO:tasks.workunit.client.0.smithi120.stdout:0/554: rename d0/d2/da/d23/d6b to d0/d2/d4/d5f/d61/da0 0 2021-04-09T18:26:20.218 INFO:tasks.workunit.client.0.smithi120.stdout:7/556: mkdir db/d42/dbc 0 2021-04-09T18:26:20.218 INFO:tasks.workunit.client.0.smithi120.stdout:2/604: mknod d13/d15/d35/cd0 1 2021-04-09T18:26:20.220 INFO:tasks.workunit.client.0.smithi120.stdout:7/557: fdatasync db/f1a 0 2021-04-09T18:26:20.222 INFO:tasks.workunit.client.0.smithi120.stdout:7/558: chown db/d42/d54/d5a 139162 1 2021-04-09T18:26:20.222 INFO:tasks.workunit.client.0.smithi120.stdout:3/625: truncate d3/d5/d36/d1e/d6b/d49/d89/d68/da1/fc2 165193 0 2021-04-09T18:26:20.230 INFO:tasks.workunit.client.0.smithi120.stdout:8/567: dwrite d2/d37/d3e/d7c/d99/fa5 [0,4194304] 0 2021-04-09T18:26:20.231 INFO:tasks.workunit.client.0.smithi120.stdout:2/605: creat d13/d7a/d80/d48/d49/d64/fd1 x:0 0 0 2021-04-09T18:26:20.232 INFO:tasks.workunit.client.0.smithi120.stdout:4/535: getdents d1f/d2c/d56/da4 0 2021-04-09T18:26:20.233 INFO:tasks.workunit.client.0.smithi120.stdout:4/536: dread - d1f/d2c/d30/f7b zero size 2021-04-09T18:26:20.234 INFO:tasks.workunit.client.0.smithi120.stdout:7/559: rename db/d26/fad to db/d26/d4c/fbd 0 2021-04-09T18:26:20.242 INFO:tasks.workunit.client.0.smithi120.stdout:2/606: dread d13/d61/d7c/fb5 [0,4194304] 0 2021-04-09T18:26:20.244 INFO:tasks.workunit.client.0.smithi120.stdout:8/568: mkdir d2/d3/d11/d6a/daa 0 2021-04-09T18:26:20.248 INFO:tasks.workunit.client.0.smithi120.stdout:0/555: dwrite d0/d2/d4/f59 [0,4194304] 0 2021-04-09T18:26:20.252 INFO:tasks.workunit.client.0.smithi120.stdout:3/626: dwrite d3/d5/f28 [0,4194304] 0 2021-04-09T18:26:20.253 INFO:tasks.workunit.client.0.smithi120.stdout:7/560: dwrite db/d2c/f99 [0,4194304] 0 2021-04-09T18:26:20.254 INFO:tasks.workunit.client.0.smithi120.stdout:0/556: chown d0/d2/f26 2 1 2021-04-09T18:26:20.258 INFO:tasks.workunit.client.0.smithi120.stdout:8/569: rename d2/d3/d3c/d4f/f5b to d2/d37/d3e/d7c/fab 0 2021-04-09T18:26:20.261 INFO:tasks.workunit.client.0.smithi120.stdout:3/627: unlink d3/de/d87/fb7 0 2021-04-09T18:26:20.262 INFO:tasks.workunit.client.0.smithi120.stdout:8/570: write d2/f39 [1624845,31752] 0 2021-04-09T18:26:20.264 INFO:tasks.workunit.client.0.smithi120.stdout:7/561: dwrite db/d2c/d30/d59/f68 [0,4194304] 0 2021-04-09T18:26:20.269 INFO:tasks.workunit.client.0.smithi120.stdout:0/557: dwrite d0/d2/f46 [0,4194304] 0 2021-04-09T18:26:20.269 INFO:tasks.workunit.client.0.smithi120.stdout:7/562: write db/fa3 [1520387,131057] 0 2021-04-09T18:26:20.269 INFO:tasks.workunit.client.0.smithi120.stdout:8/571: read d2/d37/d3e/d7c/f7b [273128,28635] 0 2021-04-09T18:26:20.290 INFO:tasks.workunit.client.0.smithi120.stdout:0/558: chown d0/d43/l45 1 1 2021-04-09T18:26:20.301 INFO:tasks.workunit.client.0.smithi120.stdout:3/628: creat d3/d5/d36/d1e/d6b/d49/d89/d68/fcb x:0 0 0 2021-04-09T18:26:20.307 INFO:tasks.workunit.client.0.smithi120.stdout:0/559: link d0/d2/d4/d5f/d61/d8b/l89 d0/d2/d7b/la1 0 2021-04-09T18:26:20.307 INFO:tasks.workunit.client.0.smithi120.stdout:2/607: dread d13/d15/f2a [4194304,4194304] 0 2021-04-09T18:26:20.310 INFO:tasks.workunit.client.0.smithi120.stdout:0/560: write d0/d2/da/f7e [4349848,47852] 0 2021-04-09T18:26:20.313 INFO:tasks.workunit.client.0.smithi120.stdout:7/563: dread db/f1a [0,4194304] 0 2021-04-09T18:26:20.314 INFO:tasks.workunit.client.0.smithi120.stdout:7/564: write db/d26/d4c/d53/f67 [951379,50616] 0 2021-04-09T18:26:20.315 INFO:tasks.workunit.client.0.smithi120.stdout:7/565: stat db/d38/faf 0 2021-04-09T18:26:20.316 INFO:tasks.workunit.client.0.smithi120.stdout:7/566: chown db/f1a 23292599 1 2021-04-09T18:26:20.321 INFO:tasks.workunit.client.0.smithi120.stdout:3/629: getdents d3/de 0 2021-04-09T18:26:20.323 INFO:tasks.workunit.client.0.smithi120.stdout:3/630: readlink d3/d5/d36/d1e/laa 0 2021-04-09T18:26:20.323 INFO:tasks.workunit.client.0.smithi120.stdout:3/631: readlink d3/de/l21 0 2021-04-09T18:26:20.324 INFO:tasks.workunit.client.0.smithi120.stdout:2/608: write d13/d7a/d80/f44 [705368,79089] 0 2021-04-09T18:26:20.328 INFO:tasks.workunit.client.0.smithi120.stdout:3/632: unlink d3/d5/d36/d1e/d38/d6d/fc5 0 2021-04-09T18:26:20.330 INFO:tasks.workunit.client.0.smithi120.stdout:2/609: symlink d13/d7a/d80/d48/ld2 0 2021-04-09T18:26:20.330 INFO:tasks.workunit.client.0.smithi120.stdout:3/633: fsync d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f/fb2 0 2021-04-09T18:26:20.331 INFO:tasks.workunit.client.0.smithi120.stdout:2/610: write d13/d15/d35/dae/fa5 [1299799,79395] 0 2021-04-09T18:26:20.333 INFO:tasks.workunit.client.0.smithi120.stdout:7/567: getdents db/d42 0 2021-04-09T18:26:20.335 INFO:tasks.workunit.client.0.smithi120.stdout:3/634: mkdir d3/de/da6/dcc 0 2021-04-09T18:26:20.341 INFO:tasks.workunit.client.0.smithi120.stdout:3/635: mkdir d3/d5/d36/d1e/d6b/dcd 0 2021-04-09T18:26:20.343 INFO:tasks.workunit.client.0.smithi120.stdout:2/611: readlink d13/d7a/d80/d48/d49/l59 0 2021-04-09T18:26:20.343 INFO:tasks.workunit.client.0.smithi120.stdout:3/636: fdatasync d3/d5/d36/d1e/d6b/d49/d89/d68/f41 0 2021-04-09T18:26:20.345 INFO:tasks.workunit.client.0.smithi120.stdout:0/561: dread d0/d52/f6d [0,4194304] 0 2021-04-09T18:26:20.348 INFO:tasks.workunit.client.0.smithi120.stdout:3/637: write f1 [5379089,55186] 0 2021-04-09T18:26:20.349 INFO:tasks.workunit.client.0.smithi120.stdout:7/568: dwrite db/f1b [0,4194304] 0 2021-04-09T18:26:20.354 INFO:tasks.workunit.client.0.smithi120.stdout:7/569: fdatasync db/d2c/d30/d59/f68 0 2021-04-09T18:26:20.355 INFO:tasks.workunit.client.0.smithi120.stdout:0/562: dwrite d0/d5a/f99 [0,4194304] 0 2021-04-09T18:26:20.356 INFO:tasks.workunit.client.0.smithi120.stdout:0/563: dread - d0/d2/d4/d5f/f76 zero size 2021-04-09T18:26:20.357 INFO:tasks.workunit.client.0.smithi120.stdout:2/612: write d13/f47 [435910,88121] 0 2021-04-09T18:26:20.365 INFO:tasks.workunit.client.0.smithi120.stdout:2/613: symlink d13/d7a/d80/d48/d49/d64/d9d/ld3 0 2021-04-09T18:26:20.370 INFO:tasks.workunit.client.0.smithi120.stdout:3/638: truncate d3/d5/d36/d3d/fbd 872873 0 2021-04-09T18:26:20.375 INFO:tasks.workunit.client.0.smithi120.stdout:7/570: truncate db/d2c/d30/f72 444668 0 2021-04-09T18:26:20.378 INFO:tasks.workunit.client.0.smithi120.stdout:7/571: rmdir db/d26/d4c/d53 39 2021-04-09T18:26:20.381 INFO:tasks.workunit.client.0.smithi120.stdout:7/572: read db/d42/fa8 [8062188,31736] 0 2021-04-09T18:26:20.383 INFO:tasks.workunit.client.0.smithi120.stdout:0/564: symlink d0/d52/d56/la2 0 2021-04-09T18:26:20.389 INFO:tasks.workunit.client.0.smithi120.stdout:2/614: write d13/d15/f9c [4837924,124589] 0 2021-04-09T18:26:20.390 INFO:tasks.workunit.client.0.smithi120.stdout:3/639: creat d3/d5/d36/d1e/d38/d6d/fce x:0 0 0 2021-04-09T18:26:20.397 INFO:tasks.workunit.client.0.smithi120.stdout:0/565: creat d0/d2/d82/d9f/fa3 x:0 0 0 2021-04-09T18:26:20.398 INFO:tasks.workunit.client.0.smithi120.stdout:0/566: write d0/d2/d4/f73 [154070,30285] 0 2021-04-09T18:26:20.399 INFO:tasks.workunit.client.0.smithi120.stdout:7/573: dwrite db/f1b [0,4194304] 0 2021-04-09T18:26:20.401 INFO:tasks.workunit.client.0.smithi120.stdout:3/640: symlink d3/d5/d36/lcf 0 2021-04-09T18:26:20.410 INFO:tasks.workunit.client.0.smithi120.stdout:7/574: mknod db/d26/d4c/d53/cbe 1 2021-04-09T18:26:20.414 INFO:tasks.workunit.client.0.smithi120.stdout:0/567: symlink d0/d5a/d62/d8f/la4 0 2021-04-09T18:26:20.415 INFO:tasks.workunit.client.0.smithi120.stdout:0/568: mknod d0/d52/ca5 1 2021-04-09T18:26:20.417 INFO:tasks.workunit.client.0.smithi120.stdout:3/641: rename d3/d5/d36/d1e/d38/d61 to d3/d5/d36/d1e/d6b/d49/d89/dd0 0 2021-04-09T18:26:20.417 INFO:tasks.workunit.client.0.smithi120.stdout:2/615: dwrite d13/f72 [0,4194304] 0 2021-04-09T18:26:20.419 INFO:tasks.workunit.client.0.smithi120.stdout:7/575: mkdir db/dbf 0 2021-04-09T18:26:20.419 INFO:tasks.workunit.client.0.smithi120.stdout:0/569: write d0/f41 [538259,26408] 0 2021-04-09T18:26:20.423 INFO:tasks.workunit.client.0.smithi120.stdout:2/616: readlink d13/d15/d35/d9f/db9/lbe 0 2021-04-09T18:26:20.424 INFO:tasks.workunit.client.0.smithi120.stdout:0/570: rename d0/d52/d56 to d0/d52/d56/da6 22 2021-04-09T18:26:20.434 INFO:tasks.workunit.client.0.smithi120.stdout:7/576: fdatasync db/d26/fa9 0 2021-04-09T18:26:20.434 INFO:tasks.workunit.client.0.smithi120.stdout:0/571: stat d0/d2/d4/d5f/d61/d8b/l89 0 2021-04-09T18:26:20.434 INFO:tasks.workunit.client.0.smithi120.stdout:0/572: write d0/d2/d82/d9f/fa3 [317981,90082] 0 2021-04-09T18:26:20.440 INFO:tasks.workunit.client.0.smithi120.stdout:3/642: dwrite d3/d5/f31 [0,4194304] 0 2021-04-09T18:26:20.442 INFO:tasks.workunit.client.0.smithi120.stdout:0/573: dwrite d0/d2/da/f7e [0,4194304] 0 2021-04-09T18:26:20.453 INFO:tasks.workunit.client.0.smithi120.stdout:2/617: dread - d13/d7a/d80/d48/da3/fb6 zero size 2021-04-09T18:26:20.466 INFO:tasks.workunit.client.0.smithi120.stdout:7/577: symlink db/d26/d4c/lc0 0 2021-04-09T18:26:20.466 INFO:tasks.workunit.client.0.smithi120.stdout:6/576: dread d6/d8/f10 [0,4194304] 0 2021-04-09T18:26:20.471 INFO:tasks.workunit.client.0.smithi120.stdout:7/578: dwrite db/d2c/d34/f70 [0,4194304] 0 2021-04-09T18:26:20.476 INFO:tasks.workunit.client.0.smithi120.stdout:0/574: unlink d0/d5a/d6c/f9d 0 2021-04-09T18:26:20.476 INFO:tasks.workunit.client.0.smithi120.stdout:7/579: unlink db/d2c/la0 0 2021-04-09T18:26:20.477 INFO:tasks.workunit.client.0.smithi120.stdout:2/618: write d13/d7a/d80/d48/d49/d76/f82 [4745422,12974] 0 2021-04-09T18:26:20.482 INFO:tasks.workunit.client.0.smithi120.stdout:6/577: symlink d6/d8/d1a/d36/d54/d41/d49/lc4 0 2021-04-09T18:26:20.487 INFO:tasks.workunit.client.0.smithi120.stdout:3/643: dwrite d3/d5/d36/d1e/d38/f63 [0,4194304] 0 2021-04-09T18:26:20.499 INFO:tasks.workunit.client.0.smithi120.stdout:2/619: symlink d13/d7a/d80/d48/d49/d64/d9d/dcf/ld4 0 2021-04-09T18:26:20.500 INFO:tasks.workunit.client.0.smithi120.stdout:0/575: creat d0/d5a/d6c/fa7 x:0 0 0 2021-04-09T18:26:20.500 INFO:tasks.workunit.client.0.smithi120.stdout:6/578: creat d6/d8/db/d12/d93/dc2/dc3/fc5 x:0 0 0 2021-04-09T18:26:20.501 INFO:tasks.workunit.client.0.smithi120.stdout:3/644: dwrite d3/d5/d36/dac/fb8 [0,4194304] 0 2021-04-09T18:26:20.505 INFO:tasks.workunit.client.0.smithi120.stdout:7/580: dwrite db/d42/fa8 [0,4194304] 0 2021-04-09T18:26:20.505 INFO:tasks.workunit.client.0.smithi120.stdout:0/576: mknod d0/d5a/ca8 1 2021-04-09T18:26:20.506 INFO:tasks.workunit.client.0.smithi120.stdout:7/581: chown db/d42/dbc 10068436 1 2021-04-09T18:26:20.507 INFO:tasks.workunit.client.0.smithi120.stdout:6/579: mknod d6/d8/db/d2b/d4d/cc6 1 2021-04-09T18:26:20.507 INFO:tasks.workunit.client.0.smithi120.stdout:2/620: chown d13/d7a/d80/d48/d49/d64/d83/l9a 0 1 2021-04-09T18:26:20.509 INFO:tasks.workunit.client.0.smithi120.stdout:3/645: rmdir d3/de/da6 39 2021-04-09T18:26:20.510 INFO:tasks.workunit.client.0.smithi120.stdout:2/621: write d13/d7a/d80/d48/d49/d76/f82 [3671268,36567] 0 2021-04-09T18:26:20.510 INFO:tasks.workunit.client.0.smithi120.stdout:0/577: unlink d0/f57 0 2021-04-09T18:26:20.512 INFO:tasks.workunit.client.0.smithi120.stdout:2/622: write d13/d15/f9c [246223,52966] 0 2021-04-09T18:26:20.527 INFO:tasks.workunit.client.0.smithi120.stdout:3/646: creat d3/d5/d36/d1e/d6b/d49/d4e/d54/fd1 x:0 0 0 2021-04-09T18:26:20.545 INFO:tasks.workunit.client.0.smithi120.stdout:0/578: dread d0/d2/dd/f40 [0,4194304] 0 2021-04-09T18:26:20.547 INFO:tasks.workunit.client.0.smithi120.stdout:2/623: link d13/d7a/d80/d54/fab d13/d7a/d80/d48/d49/d64/d9d/dcf/fd5 0 2021-04-09T18:26:20.550 INFO:tasks.workunit.client.0.smithi120.stdout:0/579: chown d0/d2/d82/l8c 159696 1 2021-04-09T18:26:20.553 INFO:tasks.workunit.client.0.smithi120.stdout:2/624: mkdir d13/d7a/d80/d48/d49/d64/d9d/dbb/dd6 0 2021-04-09T18:26:20.555 INFO:tasks.workunit.client.0.smithi120.stdout:2/625: write d13/d7a/d80/fc2 [83190,104541] 0 2021-04-09T18:26:20.558 INFO:tasks.workunit.client.0.smithi120.stdout:7/582: dread db/d38/f6d [0,4194304] 0 2021-04-09T18:26:20.559 INFO:tasks.workunit.client.0.smithi120.stdout:0/580: creat d0/d2/da/fa9 x:0 0 0 2021-04-09T18:26:20.562 INFO:tasks.workunit.client.0.smithi120.stdout:7/583: symlink db/d42/d54/lc1 0 2021-04-09T18:26:20.563 INFO:tasks.workunit.client.0.smithi120.stdout:7/584: dread - db/d2c/fb6 zero size 2021-04-09T18:26:20.564 INFO:tasks.workunit.client.0.smithi120.stdout:2/626: getdents d13/d7a/d80/d48/d49 0 2021-04-09T18:26:20.566 INFO:tasks.workunit.client.0.smithi120.stdout:0/581: creat d0/d5a/d6c/faa x:0 0 0 2021-04-09T18:26:20.568 INFO:tasks.workunit.client.0.smithi120.stdout:7/585: creat db/d38/d74/fc2 x:0 0 0 2021-04-09T18:26:20.572 INFO:tasks.workunit.client.0.smithi120.stdout:7/586: symlink db/d2c/d34/d5d/lc3 0 2021-04-09T18:26:20.574 INFO:tasks.workunit.client.0.smithi120.stdout:0/582: creat d0/d5a/d62/d72/fab x:0 0 0 2021-04-09T18:26:20.576 INFO:tasks.workunit.client.0.smithi120.stdout:2/627: rmdir d13/d7a/d80/d48/da3/db1 0 2021-04-09T18:26:20.577 INFO:tasks.workunit.client.0.smithi120.stdout:2/628: write d13/d15/f2d [4820164,57878] 0 2021-04-09T18:26:20.578 INFO:tasks.workunit.client.0.smithi120.stdout:7/587: creat db/d42/d54/fc4 x:0 0 0 2021-04-09T18:26:20.580 INFO:tasks.workunit.client.0.smithi120.stdout:0/583: mkdir d0/d5a/d62/d69/dac 0 2021-04-09T18:26:20.582 INFO:tasks.workunit.client.0.smithi120.stdout:6/580: dread d6/d8/d1a/d36/d54/d41/d49/f7c [0,4194304] 0 2021-04-09T18:26:20.583 INFO:tasks.workunit.client.0.smithi120.stdout:2/629: symlink d13/d7a/d80/d48/d49/d64/ld7 0 2021-04-09T18:26:20.584 INFO:tasks.workunit.client.0.smithi120.stdout:6/581: dread - d6/d8/db/d12/d93/dc2/dc3/fc5 zero size 2021-04-09T18:26:20.585 INFO:tasks.workunit.client.0.smithi120.stdout:7/588: dread db/d26/d4c/fbd [0,4194304] 0 2021-04-09T18:26:20.591 INFO:tasks.workunit.client.0.smithi120.stdout:0/584: truncate d0/d2/d4/d5f/f76 890529 0 2021-04-09T18:26:20.592 INFO:tasks.workunit.client.0.smithi120.stdout:2/630: dwrite d13/d7a/d80/d48/d58/f8c [4194304,4194304] 0 2021-04-09T18:26:20.592 INFO:tasks.workunit.client.0.smithi120.stdout:0/585: chown d0/d5a/d62/d69 1 1 2021-04-09T18:26:20.593 INFO:tasks.workunit.client.0.smithi120.stdout:7/589: rename db/d42/d54/lbb to db/d26/d4c/lc5 0 2021-04-09T18:26:20.597 INFO:tasks.workunit.client.0.smithi120.stdout:0/586: dwrite d0/d2/f46 [4194304,4194304] 0 2021-04-09T18:26:20.598 INFO:tasks.workunit.client.0.smithi120.stdout:0/587: read - d0/d5a/d62/f85 zero size 2021-04-09T18:26:20.601 INFO:tasks.workunit.client.0.smithi120.stdout:0/588: write d0/d2/f60 [2409127,40045] 0 2021-04-09T18:26:20.601 INFO:tasks.workunit.client.0.smithi120.stdout:2/631: creat d13/d15/d35/d9f/db9/fd8 x:0 0 0 2021-04-09T18:26:20.606 INFO:tasks.workunit.client.0.smithi120.stdout:0/589: dwrite d0/d2/da/f7e [0,4194304] 0 2021-04-09T18:26:20.607 INFO:tasks.workunit.client.0.smithi120.stdout:6/582: dwrite d6/d8/db/d2b/f2e [4194304,4194304] 0 2021-04-09T18:26:20.608 INFO:tasks.workunit.client.0.smithi120.stdout:7/590: creat db/d2c/d30/d59/fc6 x:0 0 0 2021-04-09T18:26:20.611 INFO:tasks.workunit.client.0.smithi120.stdout:2/632: getdents d13/d15/d35 0 2021-04-09T18:26:20.613 INFO:tasks.workunit.client.0.smithi120.stdout:2/633: mknod d13/d15/d35/d9f/cd9 1 2021-04-09T18:26:20.619 INFO:tasks.workunit.client.0.smithi120.stdout:7/591: symlink db/d38/d3c/lc7 0 2021-04-09T18:26:20.621 INFO:tasks.workunit.client.0.smithi120.stdout:2/634: symlink d13/d7a/d80/d48/d49/lda 0 2021-04-09T18:26:20.627 INFO:tasks.workunit.client.0.smithi120.stdout:6/583: getdents d6/d8/db/d12/d93 0 2021-04-09T18:26:20.632 INFO:tasks.workunit.client.0.smithi120.stdout:7/592: creat db/d38/d74/d6f/d76/da5/fc8 x:0 0 0 2021-04-09T18:26:20.633 INFO:tasks.workunit.client.0.smithi120.stdout:7/593: fsync db/d2c/d30/f66 0 2021-04-09T18:26:20.639 INFO:tasks.workunit.client.0.smithi120.stdout:7/594: link db/f15 db/d2c/d30/d59/fc9 0 2021-04-09T18:26:20.644 INFO:tasks.workunit.client.0.smithi120.stdout:7/595: creat db/d38/fca x:0 0 0 2021-04-09T18:26:20.646 INFO:tasks.workunit.client.0.smithi120.stdout:7/596: symlink db/d26/d4c/lcb 0 2021-04-09T18:26:20.651 INFO:tasks.workunit.client.0.smithi120.stdout:7/597: mknod db/d38/d3c/ccc 1 2021-04-09T18:26:20.651 INFO:tasks.workunit.client.0.smithi120.stdout:7/598: fdatasync db/d42/d54/fc4 0 2021-04-09T18:26:20.655 INFO:tasks.workunit.client.0.smithi120.stdout:7/599: dwrite db/d26/d4c/f9f [0,4194304] 0 2021-04-09T18:26:20.662 INFO:tasks.workunit.client.0.smithi120.stdout:7/600: mknod db/d42/d54/ccd 1 2021-04-09T18:26:20.674 INFO:tasks.workunit.client.0.smithi120.stdout:7/601: getdents db/d42 0 2021-04-09T18:26:20.674 INFO:tasks.workunit.client.0.smithi120.stdout:7/602: stat f4 0 2021-04-09T18:26:20.676 INFO:tasks.workunit.client.0.smithi120.stdout:2/635: getdents d13/d7a/d80/d48/d49/d76 0 2021-04-09T18:26:20.677 INFO:tasks.workunit.client.0.smithi120.stdout:6/584: write d6/d8/d1a/db7/f91 [2964032,36397] 0 2021-04-09T18:26:20.677 INFO:tasks.workunit.client.0.smithi120.stdout:6/585: chown d6/d8/db/f7d 823089 1 2021-04-09T18:26:20.679 INFO:tasks.workunit.client.0.smithi120.stdout:3/647: dread d3/f29 [0,4194304] 0 2021-04-09T18:26:20.680 INFO:tasks.workunit.client.0.smithi120.stdout:2/636: creat d13/d7a/d80/d48/da3/fdb x:0 0 0 2021-04-09T18:26:20.682 INFO:tasks.workunit.client.0.smithi120.stdout:3/648: read d3/d5/d36/d1e/d6b/d49/d89/dd0/d9a/fa7 [318992,95646] 0 2021-04-09T18:26:20.684 INFO:tasks.workunit.client.0.smithi120.stdout:3/649: stat d3/d5/d36/d1e/d6b/d49/d4e/d54 0 2021-04-09T18:26:20.685 INFO:tasks.workunit.client.0.smithi120.stdout:6/586: rename d6/d8/d1a/db7 to d6/d8/d1a/dc7 0 2021-04-09T18:26:20.686 INFO:tasks.workunit.client.0.smithi120.stdout:2/637: creat d13/d7a/d80/d48/d49/fdc x:0 0 0 2021-04-09T18:26:20.691 INFO:tasks.workunit.client.0.smithi120.stdout:3/650: read d3/de/f1b [3915685,73763] 0 2021-04-09T18:26:20.692 INFO:tasks.workunit.client.0.smithi120.stdout:6/587: link d6/d8/d1a/d36/fb1 d6/d8/d1a/fc8 0 2021-04-09T18:26:20.695 INFO:tasks.workunit.client.0.smithi120.stdout:6/588: symlink d6/d8/db/dac/lc9 0 2021-04-09T18:26:20.697 INFO:tasks.workunit.client.0.smithi120.stdout:2/638: getdents d13/d7a/d80/d48/d49/d64 0 2021-04-09T18:26:20.698 INFO:tasks.workunit.client.0.smithi120.stdout:3/651: creat d3/d5/d36/d1e/d6b/d6a/fd2 x:0 0 0 2021-04-09T18:26:20.699 INFO:tasks.workunit.client.0.smithi120.stdout:3/652: rename d3/d5/d36/d1e to d3/d5/d36/d1e/d6b/dcd/dd3 22 2021-04-09T18:26:20.700 INFO:tasks.workunit.client.0.smithi120.stdout:2/639: fdatasync d13/f73 0 2021-04-09T18:26:20.705 INFO:tasks.workunit.client.0.smithi120.stdout:2/640: dwrite d13/d7a/d80/f44 [0,4194304] 0 2021-04-09T18:26:20.708 INFO:tasks.workunit.client.0.smithi120.stdout:3/653: rename d3/de/d25/d53 to d3/d5/d36/d1e/d6b/d6a/d83/dd4 0 2021-04-09T18:26:20.715 INFO:tasks.workunit.client.0.smithi120.stdout:6/589: truncate d6/d8/d1a/dc7/f91 2132091 0 2021-04-09T18:26:20.718 INFO:tasks.workunit.client.0.smithi120.stdout:3/654: creat d3/de/da6/dcc/fd5 x:0 0 0 2021-04-09T18:26:20.721 INFO:tasks.workunit.client.0.smithi120.stdout:2/641: truncate d13/d7a/d80/d48/d49/d64/f74 1970616 0 2021-04-09T18:26:20.723 INFO:tasks.workunit.client.0.smithi120.stdout:3/655: chown d3/d5/d36/d1e/d6b/d49/d89/d68/da1 0 1 2021-04-09T18:26:20.726 INFO:tasks.workunit.client.0.smithi120.stdout:2/642: chown d13/d15/f42 3139 1 2021-04-09T18:26:20.746 INFO:tasks.workunit.client.0.smithi120.stdout:6/590: truncate d6/fbe 4566787 0 2021-04-09T18:26:20.747 INFO:tasks.workunit.client.0.smithi120.stdout:2/643: dread d13/d7a/d80/d48/d58/f65 [0,4194304] 0 2021-04-09T18:26:20.748 INFO:tasks.workunit.client.0.smithi120.stdout:6/591: creat d6/d8/db/d92/db0/fca x:0 0 0 2021-04-09T18:26:20.750 INFO:tasks.workunit.client.0.smithi120.stdout:2/644: symlink d13/d7a/d80/d48/d49/d64/d9d/dcf/ldd 0 2021-04-09T18:26:20.751 INFO:tasks.workunit.client.0.smithi120.stdout:2/645: write d13/f73 [2162522,97145] 0 2021-04-09T18:26:20.756 INFO:tasks.workunit.client.0.smithi120.stdout:2/646: dwrite d13/d15/d35/dae/fa5 [0,4194304] 0 2021-04-09T18:26:20.759 INFO:tasks.workunit.client.0.smithi120.stdout:2/647: symlink d13/d15/d35/d9f/db9/lde 0 2021-04-09T18:26:20.763 INFO:tasks.workunit.client.0.smithi120.stdout:2/648: creat d13/d7a/d80/fdf x:0 0 0 2021-04-09T18:26:20.765 INFO:tasks.workunit.client.0.smithi120.stdout:2/649: creat d13/d8d/fe0 x:0 0 0 2021-04-09T18:26:20.766 INFO:tasks.workunit.client.0.smithi120.stdout:2/650: chown d13/d8d 1595823257 1 2021-04-09T18:26:20.767 INFO:tasks.workunit.client.0.smithi120.stdout:2/651: fdatasync d13/d7a/d80/fc2 0 2021-04-09T18:26:20.772 INFO:tasks.workunit.client.0.smithi120.stdout:2/652: truncate d13/d15/f69 2242596 0 2021-04-09T18:26:20.773 INFO:tasks.workunit.client.0.smithi120.stdout:2/653: chown d13/d7a/d80/d48/da3/fdb 159689 1 2021-04-09T18:26:20.779 INFO:tasks.workunit.client.0.smithi120.stdout:2/654: dwrite d13/d7a/d80/d48/d49/d76/f82 [4194304,4194304] 0 2021-04-09T18:26:20.781 INFO:tasks.workunit.client.0.smithi120.stdout:2/655: symlink d13/d15/d35/dbc/le1 0 2021-04-09T18:26:20.787 INFO:tasks.workunit.client.0.smithi120.stdout:2/656: getdents d13/d7a/d80/d48/d49/d64 0 2021-04-09T18:26:20.790 INFO:tasks.workunit.client.0.smithi120.stdout:2/657: rename d13/f25 to d13/d15/d35/dbc/fe2 0 2021-04-09T18:26:20.793 INFO:tasks.workunit.client.0.smithi120.stdout:2/658: mkdir d13/d7a/d80/d48/de3 0 2021-04-09T18:26:20.797 INFO:tasks.workunit.client.0.smithi120.stdout:2/659: symlink d13/d7a/d80/d48/d49/d64/d9d/dbb/le4 0 2021-04-09T18:26:20.799 INFO:tasks.workunit.client.0.smithi120.stdout:2/660: mkdir d13/d15/de5 0 2021-04-09T18:26:20.800 INFO:tasks.workunit.client.0.smithi120.stdout:2/661: stat d13/l63 0 2021-04-09T18:26:20.801 INFO:tasks.workunit.client.0.smithi120.stdout:2/662: write d13/d8d/fe0 [384159,103646] 0 2021-04-09T18:26:20.918 INFO:tasks.workunit.client.0.smithi120.stdout:5/783: sync 2021-04-09T18:26:20.920 INFO:tasks.workunit.client.0.smithi120.stdout:5/784: read d10/d12/d1b/d1f/f4e [3753616,118325] 0 2021-04-09T18:26:20.946 INFO:tasks.workunit.client.0.smithi120.stdout:6/592: dread d6/d8/d1a/d36/d5a/d5d/d6e/f80 [0,4194304] 0 2021-04-09T18:26:20.947 INFO:tasks.workunit.client.0.smithi120.stdout:5/785: dwrite d10/d12/d1b/d1f/d84/d3d/d50/f85 [0,4194304] 0 2021-04-09T18:26:20.948 INFO:tasks.workunit.client.0.smithi120.stdout:2/663: dwrite d13/d7a/d80/d48/d49/d64/d9d/dcf/fd5 [0,4194304] 0 2021-04-09T18:26:20.953 INFO:tasks.workunit.client.0.smithi120.stdout:2/664: unlink d13/d15/d35/d9f/db9/lde 0 2021-04-09T18:26:20.956 INFO:tasks.workunit.client.0.smithi120.stdout:5/786: dwrite d10/daa/db4/fdb [0,4194304] 0 2021-04-09T18:26:20.958 INFO:tasks.workunit.client.0.smithi120.stdout:6/593: rename d6/d8/db/d2b/d68/d6a/d74 to d6/d8/d3a/d56/dcb 0 2021-04-09T18:26:20.959 INFO:tasks.workunit.client.0.smithi120.stdout:5/787: chown d10/d12/d1b/d1f 13 1 2021-04-09T18:26:20.962 INFO:tasks.workunit.client.0.smithi120.stdout:6/594: stat d6/d8/d1a/d36/f5c 0 2021-04-09T18:26:20.969 INFO:tasks.workunit.client.0.smithi120.stdout:5/788: rename d10/d12/d1b/d3a/lf5 to d10/d12/d1b/d1f/d84/d3d/l118 0 2021-04-09T18:26:20.970 INFO:tasks.workunit.client.0.smithi120.stdout:6/595: mkdir d6/d8/d1a/d36/d54/d31/d37/dcc 0 2021-04-09T18:26:20.972 INFO:tasks.workunit.client.0.smithi120.stdout:6/596: mknod d6/d8/d52/da8/ccd 1 2021-04-09T18:26:20.978 INFO:tasks.workunit.client.0.smithi120.stdout:2/665: dwrite f9 [0,4194304] 0 2021-04-09T18:26:20.984 INFO:tasks.workunit.client.0.smithi120.stdout:5/789: dwrite d10/d12/d1b/d1f/d84/d44/d8c/da6/ff1 [0,4194304] 0 2021-04-09T18:26:20.988 INFO:tasks.workunit.client.0.smithi120.stdout:6/597: creat d6/d8/db/d12/d93/fce x:0 0 0 2021-04-09T18:26:20.990 INFO:tasks.workunit.client.0.smithi120.stdout:5/790: chown d10/d12/d1b/d1f/d84/d44/f49 603375 1 2021-04-09T18:26:20.993 INFO:tasks.workunit.client.0.smithi120.stdout:6/598: stat d6/d8/d1a/dc7/f91 0 2021-04-09T18:26:21.001 INFO:tasks.workunit.client.0.smithi120.stdout:6/599: mkdir d6/dcf 0 2021-04-09T18:26:21.003 INFO:tasks.workunit.client.0.smithi120.stdout:5/791: dwrite d10/daa/db4/fd6 [0,4194304] 0 2021-04-09T18:26:21.003 INFO:tasks.workunit.client.0.smithi120.stdout:2/666: link d13/d7a/d80/d48/d49/d64/fd1 d13/d7a/d80/d48/d49/d64/fe6 0 2021-04-09T18:26:21.008 INFO:tasks.workunit.client.0.smithi120.stdout:6/600: symlink d6/d8/db/ld0 0 2021-04-09T18:26:21.009 INFO:tasks.workunit.client.0.smithi120.stdout:5/792: getdents d10/d12/d1b/d1f/d84/df0 0 2021-04-09T18:26:21.023 INFO:tasks.workunit.client.0.smithi120.stdout:2/667: dwrite f6 [8388608,4194304] 0 2021-04-09T18:26:21.030 INFO:tasks.workunit.client.0.smithi120.stdout:2/668: getdents d13/d15/d35/d9f/db9 0 2021-04-09T18:26:21.031 INFO:tasks.workunit.client.0.smithi120.stdout:2/669: mknod d13/d7a/d80/dc9/ce7 1 2021-04-09T18:26:21.032 INFO:tasks.workunit.client.0.smithi120.stdout:2/670: mknod d13/d84/ce8 1 2021-04-09T18:26:21.033 INFO:tasks.workunit.client.0.smithi120.stdout:2/671: stat d13/d15/l91 0 2021-04-09T18:26:21.038 INFO:tasks.workunit.client.0.smithi120.stdout:2/672: creat d13/d7a/d80/d48/d49/d76/fe9 x:0 0 0 2021-04-09T18:26:21.039 INFO:tasks.workunit.client.0.smithi120.stdout:2/673: mknod d13/d61/d7c/cea 1 2021-04-09T18:26:21.042 INFO:tasks.workunit.client.0.smithi120.stdout:2/674: fsync d13/d7a/d80/d48/da3/fdb 0 2021-04-09T18:26:21.214 INFO:tasks.workunit.client.0.smithi120.stdout:6/601: dread d6/d8/d1a/d36/d54/d31/f86 [0,4194304] 0 2021-04-09T18:26:21.215 INFO:tasks.workunit.client.0.smithi120.stdout:6/602: chown d6/d8/db 0 1 2021-04-09T18:26:21.218 INFO:tasks.workunit.client.0.smithi120.stdout:6/603: dread - d6/d8/db/d12/d93/fce zero size 2021-04-09T18:26:21.221 INFO:tasks.workunit.client.0.smithi120.stdout:2/675: dread d13/d15/d35/f5b [0,4194304] 0 2021-04-09T18:26:21.224 INFO:tasks.workunit.client.0.smithi120.stdout:2/676: creat d13/d7a/d80/d48/d49/d64/d9d/dcf/feb x:0 0 0 2021-04-09T18:26:21.225 INFO:tasks.workunit.client.0.smithi120.stdout:2/677: read d13/f2e [1048106,13320] 0 2021-04-09T18:26:21.226 INFO:tasks.workunit.client.0.smithi120.stdout:2/678: chown d13/d7a/d80/d54/fab 77 1 2021-04-09T18:26:21.227 INFO:tasks.workunit.client.0.smithi120.stdout:6/604: truncate d6/d8/d1a/d36/d54/d31/f85 2187973 0 2021-04-09T18:26:21.229 INFO:tasks.workunit.client.0.smithi120.stdout:6/605: rmdir d6/d8/d1a/dc7 39 2021-04-09T18:26:21.230 INFO:tasks.workunit.client.0.smithi120.stdout:2/679: getdents d13/d15/d35/d9f/db9 0 2021-04-09T18:26:21.230 INFO:tasks.workunit.client.0.smithi120.stdout:2/680: write f9 [4088323,31707] 0 2021-04-09T18:26:21.231 INFO:tasks.workunit.client.0.smithi120.stdout:6/606: symlink d6/d8/d52/da8/ld1 0 2021-04-09T18:26:21.232 INFO:tasks.workunit.client.0.smithi120.stdout:6/607: chown d6/d8/d1a/d36/d5a/fb3 37983 1 2021-04-09T18:26:21.236 INFO:tasks.workunit.client.0.smithi120.stdout:2/681: dwrite d13/f1c [8388608,4194304] 0 2021-04-09T18:26:21.254 INFO:tasks.workunit.client.0.smithi120.stdout:2/682: write d13/d7a/d80/f7d [705079,82490] 0 2021-04-09T18:26:21.260 INFO:tasks.workunit.client.0.smithi120.stdout:2/683: write d13/d7a/d80/d48/d58/f65 [2605274,86521] 0 2021-04-09T18:26:21.265 INFO:tasks.workunit.client.0.smithi120.stdout:2/684: rmdir d13/d7a/d80/d48/d49 39 2021-04-09T18:26:21.266 INFO:tasks.workunit.client.0.smithi120.stdout:2/685: chown d13/d15/f2d 2134 1 2021-04-09T18:26:21.266 INFO:tasks.workunit.client.0.smithi120.stdout:6/608: dread d6/d8/db/d12/f18 [0,4194304] 0 2021-04-09T18:26:21.271 INFO:tasks.workunit.client.0.smithi120.stdout:6/609: creat d6/d8/db/d2b/d4d/db8/fd2 x:0 0 0 2021-04-09T18:26:21.276 INFO:tasks.workunit.client.0.smithi120.stdout:6/610: dwrite d6/d8/db/d2b/d4d/db8/fd2 [0,4194304] 0 2021-04-09T18:26:21.281 INFO:tasks.workunit.client.0.smithi120.stdout:2/686: dwrite d13/d7a/d80/d48/d49/d64/fe6 [0,4194304] 0 2021-04-09T18:26:21.283 INFO:tasks.workunit.client.0.smithi120.stdout:2/687: readlink d13/d15/l91 0 2021-04-09T18:26:21.289 INFO:tasks.workunit.client.0.smithi120.stdout:6/611: creat d6/d8/d1a/d36/d54/d31/d37/dcc/fd3 x:0 0 0 2021-04-09T18:26:21.291 INFO:tasks.workunit.client.0.smithi120.stdout:6/612: write d6/d8/db/d2b/f6f [8600894,43567] 0 2021-04-09T18:26:21.292 INFO:tasks.workunit.client.0.smithi120.stdout:6/613: mknod d6/d8/d1a/d36/d54/d41/cd4 1 2021-04-09T18:26:21.298 INFO:tasks.workunit.client.0.smithi120.stdout:2/688: rename d13/d61/d7c/d98 to d13/d7a/d80/d48/d49/d64/d9d/dec 0 2021-04-09T18:26:21.299 INFO:tasks.workunit.client.0.smithi120.stdout:2/689: stat d13 0 2021-04-09T18:26:21.301 INFO:tasks.workunit.client.0.smithi120.stdout:6/614: mkdir d6/d8/db/dd5 0 2021-04-09T18:26:21.302 INFO:tasks.workunit.client.0.smithi120.stdout:6/615: chown d6/d8/d1a/d36/d54/d31/f86 278107872 1 2021-04-09T18:26:21.304 INFO:tasks.workunit.client.0.smithi120.stdout:6/616: chown d6/d8/db/d2b/f6f 156 1 2021-04-09T18:26:21.304 INFO:tasks.workunit.client.0.smithi120.stdout:1/666: sync 2021-04-09T18:26:21.304 INFO:tasks.workunit.client.0.smithi120.stdout:8/572: sync 2021-04-09T18:26:21.305 INFO:tasks.workunit.client.0.smithi120.stdout:4/537: sync 2021-04-09T18:26:21.305 INFO:tasks.workunit.client.0.smithi120.stdout:9/672: sync 2021-04-09T18:26:21.306 INFO:tasks.workunit.client.0.smithi120.stdout:4/538: mknod d1f/d2c/d56/da4/cb2 1 2021-04-09T18:26:21.307 INFO:tasks.workunit.client.0.smithi120.stdout:8/573: chown d2/d3/d11 412513 1 2021-04-09T18:26:21.310 INFO:tasks.workunit.client.0.smithi120.stdout:4/539: fdatasync d1f/d2c/d56/da4/f57 0 2021-04-09T18:26:21.311 INFO:tasks.workunit.client.0.smithi120.stdout:8/574: symlink d2/d37/d3e/d42/d9e/lac 0 2021-04-09T18:26:21.313 INFO:tasks.workunit.client.0.smithi120.stdout:8/575: readlink d2/d3/d11/l92 0 2021-04-09T18:26:21.313 INFO:tasks.workunit.client.0.smithi120.stdout:4/540: rmdir d1f/d2c/d34/d60 39 2021-04-09T18:26:21.315 INFO:tasks.workunit.client.0.smithi120.stdout:1/667: dwrite d5/d5c/d75/fc2 [0,4194304] 0 2021-04-09T18:26:21.315 INFO:tasks.workunit.client.0.smithi120.stdout:9/673: getdents d19/d81 0 2021-04-09T18:26:21.316 INFO:tasks.workunit.client.0.smithi120.stdout:8/576: mknod d2/d3/d3c/cad 1 2021-04-09T18:26:21.319 INFO:tasks.workunit.client.0.smithi120.stdout:4/541: fdatasync d1f/d2c/d56/f5b 0 2021-04-09T18:26:21.325 INFO:tasks.workunit.client.0.smithi120.stdout:1/668: dwrite d5/d64/d2d/d5a/fb0 [8388608,4194304] 0 2021-04-09T18:26:21.326 INFO:tasks.workunit.client.0.smithi120.stdout:6/617: dwrite d6/f57 [0,4194304] 0 2021-04-09T18:26:21.327 INFO:tasks.workunit.client.0.smithi120.stdout:9/674: rename d19/d24/d37/d40/d89/d29/d63/fd3 to d19/d24/d36/d9d/fe5 0 2021-04-09T18:26:21.335 INFO:tasks.workunit.client.0.smithi120.stdout:9/675: readlink d19/d24/d36/d47/d4b/l62 0 2021-04-09T18:26:21.337 INFO:tasks.workunit.client.0.smithi120.stdout:1/669: fdatasync d5/d5c/d75/daf/d24/f83 0 2021-04-09T18:26:21.338 INFO:tasks.workunit.client.0.smithi120.stdout:6/618: rename d6/fbe to d6/d8/db/dac/fd6 0 2021-04-09T18:26:21.339 INFO:tasks.workunit.client.0.smithi120.stdout:6/619: stat d6/d8/db/dac/lc9 0 2021-04-09T18:26:21.352 INFO:tasks.workunit.client.0.smithi120.stdout:1/670: dwrite d5/d64/d2d/db5/fd7 [0,4194304] 0 2021-04-09T18:26:21.353 INFO:tasks.workunit.client.0.smithi120.stdout:1/671: chown d5/d64/d63/d86/da3 38364 1 2021-04-09T18:26:21.355 INFO:tasks.workunit.client.0.smithi120.stdout:9/676: truncate d19/d2c/f95 2501870 0 2021-04-09T18:26:21.355 INFO:tasks.workunit.client.0.smithi120.stdout:6/620: write d6/d8/d1a/d36/d54/d41/d49/f88 [773098,126710] 0 2021-04-09T18:26:21.359 INFO:tasks.workunit.client.0.smithi120.stdout:1/672: mknod d5/d5c/ce9 1 2021-04-09T18:26:21.361 INFO:tasks.workunit.client.0.smithi120.stdout:1/673: readlink d5/d64/d2d/d5a/la6 0 2021-04-09T18:26:21.372 INFO:tasks.workunit.client.0.smithi120.stdout:6/621: write d6/d8/d1a/d36/d54/d31/d8a/fa4 [251054,17450] 0 2021-04-09T18:26:21.372 INFO:tasks.workunit.client.0.smithi120.stdout:1/674: chown d5/d64/d2d/d5a/d8d/fa8 743799 1 2021-04-09T18:26:21.373 INFO:tasks.workunit.client.0.smithi120.stdout:6/622: mknod d6/d8/db/d2b/d4d/cd7 1 2021-04-09T18:26:21.378 INFO:tasks.workunit.client.0.smithi120.stdout:9/677: creat d19/d24/d36/d47/d4b/fe6 x:0 0 0 2021-04-09T18:26:21.379 INFO:tasks.workunit.client.0.smithi120.stdout:9/678: write d19/d2c/f48 [2304665,5669] 0 2021-04-09T18:26:21.380 INFO:tasks.workunit.client.0.smithi120.stdout:6/623: symlink d6/d8/d1a/d36/d54/d41/d49/ld8 0 2021-04-09T18:26:21.382 INFO:tasks.workunit.client.0.smithi120.stdout:9/679: write d19/d2c/dc8/fd6 [317411,127323] 0 2021-04-09T18:26:21.389 INFO:tasks.workunit.client.0.smithi120.stdout:1/675: truncate d5/d5c/d75/daf/d24/f83 1450333 0 2021-04-09T18:26:21.391 INFO:tasks.workunit.client.0.smithi120.stdout:1/676: read d5/d64/d2d/f3a [370960,1570] 0 2021-04-09T18:26:21.392 INFO:tasks.workunit.client.0.smithi120.stdout:6/624: dwrite d6/fc [8388608,4194304] 0 2021-04-09T18:26:21.395 INFO:tasks.workunit.client.0.smithi120.stdout:9/680: truncate d19/d24/d36/d9d/fa6 204243 0 2021-04-09T18:26:21.399 INFO:tasks.workunit.client.0.smithi120.stdout:1/677: creat d5/d5c/d75/daf/d87/fea x:0 0 0 2021-04-09T18:26:21.402 INFO:tasks.workunit.client.0.smithi120.stdout:9/681: dwrite d19/d24/d37/d40/d89/f1f [4194304,4194304] 0 2021-04-09T18:26:21.408 INFO:tasks.workunit.client.0.smithi120.stdout:6/625: getdents d6/d8/d1a/d36/d54/d31/d37 0 2021-04-09T18:26:21.408 INFO:tasks.workunit.client.0.smithi120.stdout:9/682: dwrite d19/d24/d37/d40/d89/d29/f5a [0,4194304] 0 2021-04-09T18:26:21.417 INFO:tasks.workunit.client.0.smithi120.stdout:1/678: rename d5/d5c/d75/daf/d24 to d5/d5c/d75/daf/dc7/d61/deb 0 2021-04-09T18:26:21.425 INFO:tasks.workunit.client.0.smithi120.stdout:9/683: write d19/d24/d37/d40/d89/f6b [873322,16959] 0 2021-04-09T18:26:21.431 INFO:tasks.workunit.client.0.smithi120.stdout:6/626: creat d6/d8/db/d2b/d68/d6a/fd9 x:0 0 0 2021-04-09T18:26:21.432 INFO:tasks.workunit.client.0.smithi120.stdout:1/679: chown d5/d5c/d75/daf/dc7/d61/deb 2067995 1 2021-04-09T18:26:21.433 INFO:tasks.workunit.client.0.smithi120.stdout:6/627: chown d6/d8/db/d12/d93/f9f 317543592 1 2021-04-09T18:26:21.434 INFO:tasks.workunit.client.0.smithi120.stdout:1/680: write d5/d64/f82 [1712211,122138] 0 2021-04-09T18:26:21.436 INFO:tasks.workunit.client.0.smithi120.stdout:1/681: write d5/d64/d2d/d5a/d8d/fcc [581588,90281] 0 2021-04-09T18:26:21.438 INFO:tasks.workunit.client.0.smithi120.stdout:9/684: creat d19/d24/d36/d9c/fe7 x:0 0 0 2021-04-09T18:26:21.440 INFO:tasks.workunit.client.0.smithi120.stdout:6/628: write d6/d8/d3a/d56/d97/fc0 [185905,3142] 0 2021-04-09T18:26:21.444 INFO:tasks.workunit.client.0.smithi120.stdout:9/685: readlink d19/d24/d37/d40/d89/d29/l33 0 2021-04-09T18:26:21.451 INFO:tasks.workunit.client.0.smithi120.stdout:1/682: getdents d5/d5c/d75/daf/d87/dc3 0 2021-04-09T18:26:21.455 INFO:tasks.workunit.client.0.smithi120.stdout:9/686: creat d19/d24/d37/d40/d89/fe8 x:0 0 0 2021-04-09T18:26:21.455 INFO:tasks.workunit.client.0.smithi120.stdout:2/690: dread d13/d7a/d80/d48/d49/d64/d9d/fb2 [0,4194304] 0 2021-04-09T18:26:21.457 INFO:tasks.workunit.client.0.smithi120.stdout:1/683: unlink d5/d64/d2d/f6e 0 2021-04-09T18:26:21.460 INFO:tasks.workunit.client.0.smithi120.stdout:2/691: mkdir d13/d15/d35/dae/ded 0 2021-04-09T18:26:21.462 INFO:tasks.workunit.client.0.smithi120.stdout:6/629: truncate d6/d8/db/f1b 5246867 0 2021-04-09T18:26:21.463 INFO:tasks.workunit.client.0.smithi120.stdout:2/692: read d13/d7a/d80/d54/f60 [61092,126672] 0 2021-04-09T18:26:21.466 INFO:tasks.workunit.client.0.smithi120.stdout:6/630: dread d6/fc [4194304,4194304] 0 2021-04-09T18:26:21.475 INFO:tasks.workunit.client.0.smithi120.stdout:9/687: truncate d19/d81/fb2 14108 0 2021-04-09T18:26:21.475 INFO:tasks.workunit.client.0.smithi120.stdout:6/631: write d6/d8/d1a/d36/f5c [77598,89212] 0 2021-04-09T18:26:21.480 INFO:tasks.workunit.client.0.smithi120.stdout:9/688: rmdir d19/d24/d36/d47 39 2021-04-09T18:26:21.487 INFO:tasks.workunit.client.0.smithi120.stdout:6/632: symlink d6/d8/d3a/d56/dcb/lda 0 2021-04-09T18:26:21.492 INFO:tasks.workunit.client.0.smithi120.stdout:6/633: creat d6/d8/d1a/d36/d54/d31/d8a/fdb x:0 0 0 2021-04-09T18:26:21.494 INFO:tasks.workunit.client.0.smithi120.stdout:6/634: chown d6/d8/d1a/d36/d54/d31/d8a/fa4 62660950 1 2021-04-09T18:26:21.497 INFO:tasks.workunit.client.0.smithi120.stdout:6/635: creat d6/d8/db/d2b/d4d/db8/fdc x:0 0 0 2021-04-09T18:26:21.499 INFO:tasks.workunit.client.0.smithi120.stdout:9/689: dread d19/d24/d37/d40/d89/f6b [0,4194304] 0 2021-04-09T18:26:21.501 INFO:tasks.workunit.client.0.smithi120.stdout:6/636: unlink d6/d8/f25 0 2021-04-09T18:26:21.503 INFO:tasks.workunit.client.0.smithi120.stdout:2/693: dread d13/d7a/d80/f2f [0,4194304] 0 2021-04-09T18:26:21.504 INFO:tasks.workunit.client.0.smithi120.stdout:9/690: rename d19/d24/de4/fd0 to d19/d24/d9e/fe9 0 2021-04-09T18:26:21.505 INFO:tasks.workunit.client.0.smithi120.stdout:6/637: mkdir d6/d8/d1a/d36/d54/d31/d37/ddd 0 2021-04-09T18:26:21.506 INFO:tasks.workunit.client.0.smithi120.stdout:9/691: creat d19/d24/d9e/fea x:0 0 0 2021-04-09T18:26:21.507 INFO:tasks.workunit.client.0.smithi120.stdout:9/692: readlink d19/l2d 0 2021-04-09T18:26:21.508 INFO:tasks.workunit.client.0.smithi120.stdout:3/656: sync 2021-04-09T18:26:21.508 INFO:tasks.workunit.client.0.smithi120.stdout:7/603: sync 2021-04-09T18:26:21.508 INFO:tasks.workunit.client.0.smithi120.stdout:0/590: sync 2021-04-09T18:26:21.509 INFO:tasks.workunit.client.0.smithi120.stdout:7/604: chown db/dbf 3419 1 2021-04-09T18:26:21.510 INFO:tasks.workunit.client.0.smithi120.stdout:7/605: chown f4 1235642 1 2021-04-09T18:26:21.512 INFO:tasks.workunit.client.0.smithi120.stdout:6/638: dwrite d6/d8/db/d12/d93/f9f [0,4194304] 0 2021-04-09T18:26:21.513 INFO:tasks.workunit.client.0.smithi120.stdout:0/591: creat d0/d5a/d62/d69/dac/fad x:0 0 0 2021-04-09T18:26:21.517 INFO:tasks.workunit.client.0.smithi120.stdout:9/693: dread d19/d24/d36/f6e [4194304,4194304] 0 2021-04-09T18:26:21.518 INFO:tasks.workunit.client.0.smithi120.stdout:3/657: write d3/d5/d36/f23 [6777739,120321] 0 2021-04-09T18:26:21.524 INFO:tasks.workunit.client.0.smithi120.stdout:0/592: dwrite d0/d2/f5b [0,4194304] 0 2021-04-09T18:26:21.529 INFO:tasks.workunit.client.0.smithi120.stdout:9/694: rename d19/l25 to d19/d24/d36/leb 0 2021-04-09T18:26:21.529 INFO:tasks.workunit.client.0.smithi120.stdout:7/606: truncate db/d38/d74/fc2 580821 0 2021-04-09T18:26:21.530 INFO:tasks.workunit.client.0.smithi120.stdout:0/593: symlink d0/d43/lae 0 2021-04-09T18:26:21.531 INFO:tasks.workunit.client.0.smithi120.stdout:9/695: mknod d19/d24/d37/d40/dd2/cec 1 2021-04-09T18:26:21.538 INFO:tasks.workunit.client.0.smithi120.stdout:7/607: getdents db/d38/dab/db1 0 2021-04-09T18:26:21.544 INFO:tasks.workunit.client.0.smithi120.stdout:0/594: creat d0/d5a/d6c/faf x:0 0 0 2021-04-09T18:26:21.544 INFO:tasks.workunit.client.0.smithi120.stdout:7/608: unlink db/d26/d4c/l4e 0 2021-04-09T18:26:21.550 INFO:tasks.workunit.client.0.smithi120.stdout:3/658: dwrite d3/d5/d36/d1e/d6b/d49/d89/dd0/d9a/fa7 [0,4194304] 0 2021-04-09T18:26:21.552 INFO:tasks.workunit.client.0.smithi120.stdout:7/609: rename f4 to db/dbf/fce 0 2021-04-09T18:26:21.558 INFO:tasks.workunit.client.0.smithi120.stdout:0/595: rename d0/d5a/d62/d8f/la4 to d0/d2/d4/d5f/d81/lb0 0 2021-04-09T18:26:21.560 INFO:tasks.workunit.client.0.smithi120.stdout:6/639: truncate d6/d8/d1a/d36/d54/d41/d49/f88 849730 0 2021-04-09T18:26:21.560 INFO:tasks.workunit.client.0.smithi120.stdout:0/596: chown d0/d5a/d62/d69/f77 192973910 1 2021-04-09T18:26:21.561 INFO:tasks.workunit.client.0.smithi120.stdout:6/640: chown d6/d8/l21 8 1 2021-04-09T18:26:21.562 INFO:tasks.workunit.client.0.smithi120.stdout:7/610: dwrite db/d2c/f44 [0,4194304] 0 2021-04-09T18:26:21.565 INFO:tasks.workunit.client.0.smithi120.stdout:0/597: write d0/d2/d4/f73 [436011,83688] 0 2021-04-09T18:26:21.565 INFO:tasks.workunit.client.0.smithi120.stdout:9/696: link d19/d24/d36/d47/d6f/lbf d19/d24/d37/d40/d89/d29/d63/led 0 2021-04-09T18:26:21.567 INFO:tasks.workunit.client.0.smithi120.stdout:0/598: write d0/d2/da/f7a [725149,12346] 0 2021-04-09T18:26:21.574 INFO:tasks.workunit.client.0.smithi120.stdout:3/659: mkdir d3/d5/d36/d1e/d6b/d6a/d83/dd6 0 2021-04-09T18:26:21.576 INFO:tasks.workunit.client.0.smithi120.stdout:1/684: dread d5/d5c/d75/daf/d87/dc3/fcb [4194304,4194304] 0 2021-04-09T18:26:21.577 INFO:tasks.workunit.client.0.smithi120.stdout:6/641: symlink d6/d8/db/d92/lde 0 2021-04-09T18:26:21.583 INFO:tasks.workunit.client.0.smithi120.stdout:0/599: creat d0/d43/fb1 x:0 0 0 2021-04-09T18:26:21.583 INFO:tasks.workunit.client.0.smithi120.stdout:3/660: chown d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba 1993 1 2021-04-09T18:26:21.584 INFO:tasks.workunit.client.0.smithi120.stdout:6/642: mkdir d6/d8/d52/ddf 0 2021-04-09T18:26:21.585 INFO:tasks.workunit.client.0.smithi120.stdout:3/661: chown d3/d5/d36/d1e/d6b/dcd 37808208 1 2021-04-09T18:26:21.586 INFO:tasks.workunit.client.0.smithi120.stdout:0/600: mkdir d0/d5a/db2 0 2021-04-09T18:26:21.588 INFO:tasks.workunit.client.0.smithi120.stdout:6/643: write d6/d8/d1a/d36/d54/d31/d8a/fa4 [299217,52751] 0 2021-04-09T18:26:21.593 INFO:tasks.workunit.client.0.smithi120.stdout:3/662: creat d3/d5/d36/d1e/d38/fd7 x:0 0 0 2021-04-09T18:26:21.596 INFO:tasks.workunit.client.0.smithi120.stdout:6/644: creat d6/d8/d52/ddf/fe0 x:0 0 0 2021-04-09T18:26:21.596 INFO:tasks.workunit.client.0.smithi120.stdout:7/611: dread db/d38/d3c/fae [4194304,4194304] 0 2021-04-09T18:26:21.597 INFO:tasks.workunit.client.0.smithi120.stdout:7/612: stat db/d26 0 2021-04-09T18:26:21.598 INFO:tasks.workunit.client.0.smithi120.stdout:3/663: mknod d3/d5/d36/cd8 1 2021-04-09T18:26:21.598 INFO:tasks.workunit.client.0.smithi120.stdout:0/601: creat d0/d2/d4/fb3 x:0 0 0 2021-04-09T18:26:21.599 INFO:tasks.workunit.client.0.smithi120.stdout:9/697: dwrite d19/d24/d36/d47/d6f/f7f [0,4194304] 0 2021-04-09T18:26:21.603 INFO:tasks.workunit.client.0.smithi120.stdout:7/613: write db/d26/d4c/d53/f57 [6268320,22643] 0 2021-04-09T18:26:21.604 INFO:tasks.workunit.client.0.smithi120.stdout:3/664: dread d3/f29 [0,4194304] 0 2021-04-09T18:26:21.607 INFO:tasks.workunit.client.0.smithi120.stdout:0/602: rename d0/d2/d4/d5f/d61/da0 to d0/d2/dd/db4 0 2021-04-09T18:26:21.607 INFO:tasks.workunit.client.0.smithi120.stdout:9/698: dwrite d19/d2c/dc8/fd6 [0,4194304] 0 2021-04-09T18:26:21.609 INFO:tasks.workunit.client.0.smithi120.stdout:3/665: mknod d3/d5/d36/d1e/d6b/d49/cd9 1 2021-04-09T18:26:21.609 INFO:tasks.workunit.client.0.smithi120.stdout:9/699: mknod d19/d24/d37/d40/dd2/cee 1 2021-04-09T18:26:21.610 INFO:tasks.workunit.client.0.smithi120.stdout:3/666: write d3/d5/d36/d1e/f40 [2878778,5274] 0 2021-04-09T18:26:21.613 INFO:tasks.workunit.client.0.smithi120.stdout:3/667: read - d3/d5/d36/d1e/d6b/d49/d4e/f8c zero size 2021-04-09T18:26:21.616 INFO:tasks.workunit.client.0.smithi120.stdout:6/645: truncate d6/d8/db/d2b/d4d/db8/fd2 3642805 0 2021-04-09T18:26:21.617 INFO:tasks.workunit.client.0.smithi120.stdout:0/603: creat d0/d2/fb5 x:0 0 0 2021-04-09T18:26:21.620 INFO:tasks.workunit.client.0.smithi120.stdout:6/646: chown d6/d8/db/d12/d93/dc2/dc3/fc5 7788612 1 2021-04-09T18:26:21.625 INFO:tasks.workunit.client.0.smithi120.stdout:7/614: rename db/f2b to db/d26/fcf 0 2021-04-09T18:26:21.628 INFO:tasks.workunit.client.0.smithi120.stdout:0/604: unlink d0/d5a/d62/l74 0 2021-04-09T18:26:21.631 INFO:tasks.workunit.client.0.smithi120.stdout:9/700: truncate d19/d24/d37/f5f 355966 0 2021-04-09T18:26:21.632 INFO:tasks.workunit.client.0.smithi120.stdout:3/668: getdents d3/d5/d36/d1e/d38/d6d 0 2021-04-09T18:26:21.637 INFO:tasks.workunit.client.0.smithi120.stdout:9/701: rmdir d19/d2c 39 2021-04-09T18:26:21.638 INFO:tasks.workunit.client.0.smithi120.stdout:9/702: write d19/d24/d37/d40/d89/fe8 [472134,6765] 0 2021-04-09T18:26:21.639 INFO:tasks.workunit.client.0.smithi120.stdout:0/605: symlink d0/d43/d49/d91/lb6 0 2021-04-09T18:26:21.639 INFO:tasks.workunit.client.0.smithi120.stdout:9/703: write d19/d24/d36/d9c/fc0 [3905272,61622] 0 2021-04-09T18:26:21.641 INFO:tasks.workunit.client.0.smithi120.stdout:7/615: link db/d2c/f44 db/d38/d74/fd0 0 2021-04-09T18:26:21.642 INFO:tasks.workunit.client.0.smithi120.stdout:6/647: write d6/d8/db/f39 [6166387,45637] 0 2021-04-09T18:26:21.643 INFO:tasks.workunit.client.0.smithi120.stdout:3/669: mkdir d3/d5/d36/d1e/d6b/d6a/d83/dd4/dda 0 2021-04-09T18:26:21.648 INFO:tasks.workunit.client.0.smithi120.stdout:7/616: symlink db/d42/d54/d5a/ld1 0 2021-04-09T18:26:21.648 INFO:tasks.workunit.client.0.smithi120.stdout:6/648: dread - d6/d8/d1a/d36/f3e zero size 2021-04-09T18:26:21.650 INFO:tasks.workunit.client.0.smithi120.stdout:3/670: unlink d3/de/f20 0 2021-04-09T18:26:21.652 INFO:tasks.workunit.client.0.smithi120.stdout:0/606: creat d0/d2/d4/d5f/d61/d8b/fb7 x:0 0 0 2021-04-09T18:26:21.656 INFO:tasks.workunit.client.0.smithi120.stdout:7/617: dwrite db/d26/d4c/f9f [0,4194304] 0 2021-04-09T18:26:21.657 INFO:tasks.workunit.client.0.smithi120.stdout:6/649: symlink d6/d8/db/da6/le1 0 2021-04-09T18:26:21.659 INFO:tasks.workunit.client.0.smithi120.stdout:0/607: dread d0/d2/f5b [0,4194304] 0 2021-04-09T18:26:21.660 INFO:tasks.workunit.client.0.smithi120.stdout:7/618: readlink db/d2c/l49 0 2021-04-09T18:26:21.661 INFO:tasks.workunit.client.0.smithi120.stdout:0/608: chown d0/d2/da/l55 427 1 2021-04-09T18:26:21.664 INFO:tasks.workunit.client.0.smithi120.stdout:0/609: fdatasync d0/f3c 0 2021-04-09T18:26:21.683 INFO:tasks.workunit.client.0.smithi120.stdout:9/704: dread d19/d24/d36/f45 [0,4194304] 0 2021-04-09T18:26:21.684 INFO:tasks.workunit.client.0.smithi120.stdout:7/619: dread db/d38/d74/fc2 [0,4194304] 0 2021-04-09T18:26:21.685 INFO:tasks.workunit.client.0.smithi120.stdout:9/705: chown d19/d24/d37/d40/d89/f53 1984 1 2021-04-09T18:26:21.686 INFO:tasks.workunit.client.0.smithi120.stdout:9/706: chown d19/d24/d36/d9d 211856 1 2021-04-09T18:26:21.687 INFO:tasks.workunit.client.0.smithi120.stdout:6/650: rename d6/d8/d1a/d36/d5a to d6/d8/db/d2b/de2 0 2021-04-09T18:26:21.692 INFO:tasks.workunit.client.0.smithi120.stdout:3/671: dwrite d3/d5/d36/d1e/d6b/d49/d4e/d54/f75 [4194304,4194304] 0 2021-04-09T18:26:21.692 INFO:tasks.workunit.client.0.smithi120.stdout:0/610: rename d0/d52/d56/la2 to d0/d2/d82/lb8 0 2021-04-09T18:26:21.695 INFO:tasks.workunit.client.0.smithi120.stdout:3/672: stat d3/d5/d36/d1e/d38/f63 0 2021-04-09T18:26:21.697 INFO:tasks.workunit.client.0.smithi120.stdout:7/620: dwrite db/d38/f40 [0,4194304] 0 2021-04-09T18:26:21.703 INFO:tasks.workunit.client.0.smithi120.stdout:0/611: link d0/d2/dd/f38 d0/d2/d82/d9f/fb9 0 2021-04-09T18:26:21.710 INFO:tasks.workunit.client.0.smithi120.stdout:9/707: rename d19/d24/d36/d47/f73 to d19/d24/d37/d40/d89/d52/fef 0 2021-04-09T18:26:21.711 INFO:tasks.workunit.client.0.smithi120.stdout:9/708: chown d19/d24/de4/d99 82114 1 2021-04-09T18:26:21.711 INFO:tasks.workunit.client.0.smithi120.stdout:6/651: dwrite d6/d8/db/d2b/d4d/f8c [0,4194304] 0 2021-04-09T18:26:21.717 INFO:tasks.workunit.client.0.smithi120.stdout:6/652: fsync d6/d8/f13 0 2021-04-09T18:26:21.717 INFO:tasks.workunit.client.0.smithi120.stdout:6/653: stat d6/d8/d52 0 2021-04-09T18:26:21.730 INFO:tasks.workunit.client.0.smithi120.stdout:9/709: creat d19/d24/d2e/ff0 x:0 0 0 2021-04-09T18:26:21.732 INFO:tasks.mds_thrash.fs.[None]:reviving mds.a 2021-04-09T18:26:21.732 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:26:21.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:26:21.736 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:26:21.736 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:21.737 INFO:tasks.workunit.client.0.smithi120.stdout:7/621: truncate db/dbf/fce 1493650 0 2021-04-09T18:26:21.744 INFO:tasks.workunit.client.0.smithi120.stdout:9/710: creat d19/d2c/ff1 x:0 0 0 2021-04-09T18:26:21.748 INFO:tasks.workunit.client.0.smithi120.stdout:7/622: mkdir db/d2c/d34/d5d/dd2 0 2021-04-09T18:26:21.750 INFO:tasks.workunit.client.0.smithi120.stdout:7/623: readlink db/d42/l85 0 2021-04-09T18:26:21.752 INFO:tasks.workunit.client.0.smithi120.stdout:7/624: write db/d42/d54/fa2 [4497044,98359] 0 2021-04-09T18:26:21.752 INFO:tasks.workunit.client.0.smithi120.stdout:3/673: dread d3/d5/d36/d3d/f8b [0,4194304] 0 2021-04-09T18:26:21.756 INFO:tasks.workunit.client.0.smithi120.stdout:9/711: write d19/d24/d37/d40/d89/d29/d76/fa5 [729044,66252] 0 2021-04-09T18:26:21.757 INFO:tasks.workunit.client.0.smithi120.stdout:6/654: dread d6/d8/d52/faa [0,4194304] 0 2021-04-09T18:26:21.760 INFO:tasks.workunit.client.0.smithi120.stdout:7/625: dread db/d2c/d30/d59/f8b [0,4194304] 0 2021-04-09T18:26:21.765 INFO:tasks.workunit.client.0.smithi120.stdout:9/712: chown f7 6 1 2021-04-09T18:26:21.767 INFO:tasks.workunit.client.0.smithi120.stdout:0/612: dwrite d0/d52/d56/f5d [0,4194304] 0 2021-04-09T18:26:21.769 INFO:tasks.workunit.client.0.smithi120.stdout:9/713: stat d19/d24/d36/f45 0 2021-04-09T18:26:21.770 INFO:tasks.workunit.client.0.smithi120.stdout:0/613: write d0/f41 [666527,38280] 0 2021-04-09T18:26:21.771 INFO:tasks.workunit.client.0.smithi120.stdout:6/655: mknod d6/d8/db/d12/d22/ce3 1 2021-04-09T18:26:21.774 INFO:tasks.workunit.client.0.smithi120.stdout:0/614: write d0/d43/fb1 [694769,10230] 0 2021-04-09T18:26:21.775 INFO:tasks.workunit.client.0.smithi120.stdout:9/714: readlink d19/d24/de4/l68 0 2021-04-09T18:26:21.775 INFO:tasks.workunit.client.0.smithi120.stdout:0/615: chown d0/d43/l45 56 1 2021-04-09T18:26:21.779 INFO:tasks.workunit.client.0.smithi120.stdout:6/656: chown d6/d8/d1a/l20 221901608 1 2021-04-09T18:26:21.780 INFO:tasks.workunit.client.0.smithi120.stdout:0/616: write d0/d2/dd/db4/f83 [545659,30492] 0 2021-04-09T18:26:21.782 INFO:tasks.workunit.client.0.smithi120.stdout:7/626: creat db/d38/d3c/fd3 x:0 0 0 2021-04-09T18:26:21.782 INFO:tasks.workunit.client.0.smithi120.stdout:6/657: write d6/d8/d52/ddf/fe0 [1041463,74234] 0 2021-04-09T18:26:21.783 INFO:tasks.workunit.client.0.smithi120.stdout:9/715: unlink d19/d81/fb2 0 2021-04-09T18:26:21.787 INFO:tasks.workunit.client.0.smithi120.stdout:6/658: mkdir d6/d8/db/d12/d93/dc2/dc3/de4 0 2021-04-09T18:26:21.801 INFO:tasks.workunit.client.0.smithi120.stdout:6/659: dwrite d6/d8/d1a/d36/d54/d31/f76 [4194304,4194304] 0 2021-04-09T18:26:21.808 INFO:tasks.workunit.client.0.smithi120.stdout:3/674: truncate d3/d5/f4d 5039000 0 2021-04-09T18:26:21.814 INFO:tasks.workunit.client.0.smithi120.stdout:0/617: dwrite d0/f3c [0,4194304] 0 2021-04-09T18:26:21.816 INFO:tasks.workunit.client.0.smithi120.stdout:7/627: dwrite db/f1b [0,4194304] 0 2021-04-09T18:26:21.853 INFO:tasks.workunit.client.0.smithi120.stdout:3/675: fdatasync d3/d5/d36/d3d/f8b 0 2021-04-09T18:26:21.857 INFO:tasks.workunit.client.0.smithi120.stdout:7/628: dwrite db/fa3 [0,4194304] 0 2021-04-09T18:26:21.865 INFO:tasks.workunit.client.0.smithi120.stdout:3/676: mkdir d3/d5/d36/d1e/d6b/d49/d89/d68/da1/ddb 0 2021-04-09T18:26:21.878 INFO:tasks.workunit.client.0.smithi120.stdout:5/793: sync 2021-04-09T18:26:21.892 INFO:tasks.workunit.client.0.smithi120.stdout:0/618: rename d0/d2/d4/f29 to d0/d5a/d62/d69/fba 0 2021-04-09T18:26:21.894 INFO:tasks.workunit.client.0.smithi120.stdout:5/794: truncate d10/d12/d1b/d3a/d5b/d78/f81 1339 0 2021-04-09T18:26:21.895 INFO:tasks.workunit.client.0.smithi120.stdout:0/619: mknod d0/d43/d49/cbb 1 2021-04-09T18:26:21.895 INFO:tasks.workunit.client.0.smithi120.stdout:5/795: chown d10/d12 124441 1 2021-04-09T18:26:21.905 INFO:tasks.workunit.client.0.smithi120.stdout:0/620: getdents d0/d43/d49/d91 0 2021-04-09T18:26:21.915 INFO:tasks.workunit.client.0.smithi120.stdout:0/621: write d0/d2/dd/f40 [2508450,38438] 0 2021-04-09T18:26:21.928 INFO:tasks.workunit.client.0.smithi120.stdout:7/629: dwrite db/f27 [4194304,4194304] 0 2021-04-09T18:26:21.928 INFO:tasks.workunit.client.0.smithi120.stdout:7/630: dread - db/d2c/d30/d59/fc6 zero size 2021-04-09T18:26:21.928 INFO:tasks.workunit.client.0.smithi120.stdout:7/631: readlink db/d2c/l35 0 2021-04-09T18:26:21.929 INFO:tasks.workunit.client.0.smithi120.stdout:3/677: dwrite d3/d5/d36/d1e/d6b/d49/d4e/d54/f5f [0,4194304] 0 2021-04-09T18:26:21.929 INFO:tasks.workunit.client.0.smithi120.stdout:3/678: chown d3/d5/d36/d1e/d6b/d49/d89/d68/da1 35 1 2021-04-09T18:26:21.930 INFO:tasks.workunit.client.0.smithi120.stdout:0/622: read - d0/d2/d4/d5f/d61/f96 zero size 2021-04-09T18:26:21.934 INFO:tasks.workunit.client.0.smithi120.stdout:3/679: unlink d3/l16 0 2021-04-09T18:26:21.934 INFO:tasks.workunit.client.0.smithi120.stdout:7/632: link db/d26/d4c/d53/f57 db/d26/d4c/fd4 0 2021-04-09T18:26:21.936 INFO:tasks.workunit.client.0.smithi120.stdout:7/633: mknod db/d42/d54/cd5 1 2021-04-09T18:26:21.940 INFO:tasks.workunit.client.0.smithi120.stdout:0/623: rename d0/d2/d4/d5f/d61/d8b/l3f to d0/d2/lbc 0 2021-04-09T18:26:21.949 INFO:tasks.workunit.client.0.smithi120.stdout:3/680: creat d3/de/d87/dc8/fdc x:0 0 0 2021-04-09T18:26:21.954 INFO:tasks.workunit.client.0.smithi120.stdout:6/660: dread d6/d8/db/d2b/de2/d5d/d6e/f8b [0,4194304] 0 2021-04-09T18:26:21.955 INFO:tasks.workunit.client.0.smithi120.stdout:0/624: rename d0/d2/da/f7e to d0/d2/da/d23/fbd 0 2021-04-09T18:26:21.960 INFO:tasks.workunit.client.0.smithi120.stdout:7/634: creat db/d38/d74/d6f/fd6 x:0 0 0 2021-04-09T18:26:21.960 INFO:tasks.workunit.client.0.smithi120.stdout:3/681: mknod d3/d5/d36/d1e/d6b/d49/cdd 1 2021-04-09T18:26:21.967 INFO:tasks.workunit.client.0.smithi120.stdout:3/682: rename d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f/fb2 to d3/d5/d36/d1e/d6b/d49/d4e/d54/fde 0 2021-04-09T18:26:21.970 INFO:tasks.workunit.client.0.smithi120.stdout:3/683: read d3/d5/d36/d1e/d6b/d6a/d83/f93 [892218,68910] 0 2021-04-09T18:26:21.975 INFO:tasks.workunit.client.0.smithi120.stdout:7/635: truncate db/d2c/d30/f66 3564509 0 2021-04-09T18:26:21.975 INFO:tasks.workunit.client.0.smithi120.stdout:6/661: dwrite d6/d8/d1a/d36/d54/d41/d49/f88 [0,4194304] 0 2021-04-09T18:26:21.976 INFO:tasks.workunit.client.0.smithi120.stdout:3/684: readlink d3/d5/d36/d1e/d6b/d49/d89/dd0/l85 0 2021-04-09T18:26:21.976 INFO:tasks.workunit.client.0.smithi120.stdout:3/685: chown d3/f37 21828007 1 2021-04-09T18:26:21.982 INFO:tasks.workunit.client.0.smithi120.stdout:7/636: unlink db/d38/d3c/fd3 0 2021-04-09T18:26:21.989 INFO:tasks.workunit.client.0.smithi120.stdout:6/662: getdents d6/d8/d52/ddf 0 2021-04-09T18:26:21.989 INFO:tasks.workunit.client.0.smithi120.stdout:7/637: chown db/d26/f2d 6473 1 2021-04-09T18:26:21.990 INFO:tasks.workunit.client.0.smithi120.stdout:3/686: rmdir d3/d5/d36/d1e/d6b/dcd 0 2021-04-09T18:26:21.990 INFO:tasks.workunit.client.0.smithi120.stdout:7/638: dread - db/d7f/f88 zero size 2021-04-09T18:26:21.992 INFO:tasks.workunit.client.0.smithi120.stdout:7/639: dread - db/d2c/fb6 zero size 2021-04-09T18:26:21.993 INFO:tasks.workunit.client.0.smithi120.stdout:6/663: mknod d6/d8/d1a/d36/d54/d31/d8a/ce5 1 2021-04-09T18:26:21.997 INFO:tasks.workunit.client.0.smithi120.stdout:7/640: getdents db/d42/dbc 0 2021-04-09T18:26:22.004 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2021-04-09T18:26:22.006 INFO:tasks.workunit.client.0.smithi120.stdout:7/641: mkdir db/d38/d3c/d6e/d94/dd7 0 2021-04-09T18:26:22.008 INFO:tasks.workunit.client.0.smithi120.stdout:3/687: truncate d3/d5/f8d 471686 0 2021-04-09T18:26:22.011 INFO:tasks.workunit.client.0.smithi120.stdout:7/642: creat db/d38/d3c/d6e/fd8 x:0 0 0 2021-04-09T18:26:22.021 INFO:tasks.workunit.client.0.smithi120.stdout:5/796: dread d10/d12/d1b/f34 [0,4194304] 0 2021-04-09T18:26:22.024 INFO:tasks.workunit.client.0.smithi120.stdout:5/797: chown d10/d12/d1b/d1f/d84/d44/f65 34254469 1 2021-04-09T18:26:22.025 INFO:tasks.workunit.client.0.smithi120.stdout:7/643: fsync db/d38/d3c/f3d 0 2021-04-09T18:26:22.029 INFO:tasks.workunit.client.0.smithi120.stdout:5/798: stat d10/d12/d1b/d1f/d39/l40 0 2021-04-09T18:26:22.030 INFO:tasks.workunit.client.0.smithi120.stdout:5/799: fsync d10/d12/d3b/f86 0 2021-04-09T18:26:22.031 INFO:tasks.workunit.client.0.smithi120.stdout:7/644: unlink db/d2c/f99 0 2021-04-09T18:26:22.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.026 7f0e6e8b8700 1 Processor -- start 2021-04-09T18:26:22.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.026 7f0e6e8b8700 1 -- start start 2021-04-09T18:26:22.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.027 7f0e6e8b8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e680d7160 0x7f0e680d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.027 7f0e6e8b8700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e680d55a0 0x7f0e680d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.027 7f0e6e8b8700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e680d6be0 con 0x7f0e680d5fc0 2021-04-09T18:26:22.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.027 7f0e6e8b8700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e680d80f0 con 0x7f0e680d55a0 2021-04-09T18:26:22.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.027 7f0e6e8b8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e681a2ac0 con 0x7f0e680d7160 2021-04-09T18:26:22.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.027 7f0e5ffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e680d55a0 0x7f0e680d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.027 7f0e6ced5700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0e680d5fc0 0x7f0e680d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51700/0 (socket says 172.21.15.120:51700) 2021-04-09T18:26:22.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.027 7f0e6ced5700 1 -- 172.21.15.120:0/180850658 learned_addr learned my addr 172.21.15.120:0/180850658 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:26:22.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.027 7f0e67fff700 1 --2- 172.21.15.120:0/180850658 >> v2:172.21.15.134:3300/0 conn(0x7f0e680d7160 0x7f0e680d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e5ffff700 1 -- 172.21.15.120:0/180850658 >> v2:172.21.15.134:3300/0 conn(0x7f0e680d7160 msgr2=0x7f0e680d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:22.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e5ffff700 1 --2- 172.21.15.120:0/180850658 >> v2:172.21.15.134:3300/0 conn(0x7f0e680d7160 0x7f0e680d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e5ffff700 1 -- 172.21.15.120:0/180850658 >> v1:172.21.15.120:6789/0 conn(0x7f0e680d5fc0 legacy=0x7f0e680d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e5ffff700 1 -- 172.21.15.120:0/180850658 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e681ac1f0 con 0x7f0e680d55a0 2021-04-09T18:26:22.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e67fff700 1 --2- 172.21.15.120:0/180850658 >> v2:172.21.15.134:3300/0 conn(0x7f0e680d7160 0x7f0e680d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:26:22.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e5ffff700 1 --2- 172.21.15.120:0/180850658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e680d55a0 0x7f0e680d59a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f0e50006650 tx=0x7f0e50009a80).ready entity=mon.0 client_cookie=d0bb49be2ce2f184 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e677fe700 1 -- 172.21.15.120:0/180850658 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e5000c0c0 con 0x7f0e680d55a0 2021-04-09T18:26:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e677fe700 1 -- 172.21.15.120:0/180850658 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000c3c0 con 0x7f0e680d55a0 2021-04-09T18:26:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e677fe700 1 -- 172.21.15.120:0/180850658 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e5000c820 con 0x7f0e680d55a0 2021-04-09T18:26:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e6e8b8700 1 -- 172.21.15.120:0/180850658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e680d55a0 msgr2=0x7f0e680d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.028 7f0e6e8b8700 1 --2- 172.21.15.120:0/180850658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e680d55a0 0x7f0e680d59a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f0e50006650 tx=0x7f0e50009a80).stop 2021-04-09T18:26:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.029 7f0e6e8b8700 1 -- 172.21.15.120:0/180850658 shutdown_connections 2021-04-09T18:26:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.029 7f0e6e8b8700 1 --2- 172.21.15.120:0/180850658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e680d55a0 0x7f0e680d59a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.029 7f0e6e8b8700 1 --2- 172.21.15.120:0/180850658 >> v2:172.21.15.134:3300/0 conn(0x7f0e680d7160 0x7f0e680d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.029 7f0e6e8b8700 1 -- 172.21.15.120:0/180850658 >> 172.21.15.120:0/180850658 conn(0x7f0e680d1590 msgr2=0x7f0e680d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.029 7f0e6e8b8700 1 -- 172.21.15.120:0/180850658 shutdown_connections 2021-04-09T18:26:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.029 7f0e6e8b8700 1 -- 172.21.15.120:0/180850658 wait complete. 2021-04-09T18:26:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.050 7f0e6e8b8700 1 Processor -- start 2021-04-09T18:26:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.050 7f0e6e8b8700 1 -- start start 2021-04-09T18:26:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.050 7f0e6e8b8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e680a6a90 0x7f0e68098770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.050 7f0e6e8b8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e681a0f50 0x7f0e681a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.050 7f0e6e8b8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e680b72d0 0x7f0e680b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.050 7f0e6e8b8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e681a1970 con 0x7f0e681a0f50 2021-04-09T18:26:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.050 7f0e6e8b8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680981f0 con 0x7f0e680b72d0 2021-04-09T18:26:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.050 7f0e6e8b8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680a3250 con 0x7f0e680a6a90 2021-04-09T18:26:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e5ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e681a0f50 0x7f0e681a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e6ced5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e680b72d0 0x7f0e680b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e5ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e681a0f50 0x7f0e681a1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56792/0 (socket says 172.21.15.120:56792) 2021-04-09T18:26:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e5ffff700 1 -- 172.21.15.120:0/324743646 learned_addr learned my addr 172.21.15.120:0/324743646 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:22.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e67fff700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e680a6a90 0x7f0e68098770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e5ffff700 1 -- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e680a6a90 msgr2=0x7f0e68098770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e5ffff700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e680a6a90 0x7f0e68098770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e5ffff700 1 -- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e680b72d0 msgr2=0x7f0e680b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e5ffff700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e680b72d0 0x7f0e680b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e5ffff700 1 -- 172.21.15.120:0/324743646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68097de0 con 0x7f0e681a0f50 2021-04-09T18:26:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e5ffff700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e681a0f50 0x7f0e681a1350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f0e5000b580 tx=0x7f0e5000b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e657fa700 1 -- 172.21.15.120:0/324743646 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e500063f0 con 0x7f0e681a0f50 2021-04-09T18:26:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e657fa700 1 -- 172.21.15.120:0/324743646 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000bd10 con 0x7f0e681a0f50 2021-04-09T18:26:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e657fa700 1 -- 172.21.15.120:0/324743646 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e50005560 con 0x7f0e681a0f50 2021-04-09T18:26:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e68097de0 con 0x7f0e681a0f50 2021-04-09T18:26:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.051 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e68097de0 con 0x7f0e681a0f50 2021-04-09T18:26:22.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.052 7f0e657fa700 1 -- 172.21.15.120:0/324743646 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0e50006030 con 0x7f0e681a0f50 2021-04-09T18:26:22.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.052 7f0e657fa700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e4c018930 0x7f0e4c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:22.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.052 7f0e657fa700 1 -- 172.21.15.120:0/324743646 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7f0e50032d20 con 0x7f0e681a0f50 2021-04-09T18:26:22.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.052 7f0e67fff700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e4c018930 0x7f0e4c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:22.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.053 7f0e67fff700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e4c018930 0x7f0e4c01ae10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:22.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.067 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e681829e0 con 0x7f0e681a0f50 2021-04-09T18:26:22.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.070 7f0e657fa700 1 -- 172.21.15.120:0/324743646 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0e500063f0 con 0x7f0e681a0f50 2021-04-09T18:26:22.073 INFO:tasks.workunit.client.0.smithi120.stdout:5/800: creat d10/d12/d1b/d1f/d39/dbb/f119 x:0 0 0 2021-04-09T18:26:22.076 INFO:tasks.workunit.client.0.smithi120.stdout:7/645: write db/d2c/d30/f66 [2230104,62241] 0 2021-04-09T18:26:22.102 INFO:tasks.workunit.client.0.smithi120.stdout:7/646: getdents db/dbf 0 2021-04-09T18:26:22.103 INFO:tasks.workunit.client.0.smithi120.stdout:5/801: link d10/d12/d1b/d1f/d84/d3d/l118 d10/d12/d1b/d1f/d39/dbb/l11a 0 2021-04-09T18:26:22.117 INFO:tasks.workunit.client.0.smithi120.stdout:7/647: fdatasync db/d2c/d34/f5b 0 2021-04-09T18:26:22.129 INFO:tasks.workunit.client.0.smithi120.stdout:7/648: creat db/d38/d3c/d6e/d94/dd7/fd9 x:0 0 0 2021-04-09T18:26:22.133 INFO:tasks.workunit.client.0.smithi120.stdout:7/649: creat db/d2c/d34/fda x:0 0 0 2021-04-09T18:26:22.133 INFO:tasks.workunit.client.0.smithi120.stdout:3/688: dread d3/d5/d36/d1e/d6b/f35 [0,4194304] 0 2021-04-09T18:26:22.136 INFO:tasks.workunit.client.0.smithi120.stdout:7/650: creat db/d42/fdb x:0 0 0 2021-04-09T18:26:22.138 INFO:tasks.workunit.client.0.smithi120.stdout:3/689: chown d3/d5/d36/d1e/d6b/d6a/d83/lc4 4197045 1 2021-04-09T18:26:22.138 INFO:tasks.workunit.client.0.smithi120.stdout:3/690: chown d3/de/f1b 25405 1 2021-04-09T18:26:22.141 INFO:tasks.workunit.client.0.smithi120.stdout:7/651: dwrite db/d26/d4c/f9b [0,4194304] 0 2021-04-09T18:26:22.143 INFO:tasks.workunit.client.0.smithi120.stdout:7/652: mknod db/d38/dab/db1/cdc 1 2021-04-09T18:26:22.151 INFO:tasks.workunit.client.0.smithi120.stdout:7/653: dwrite db/d26/f5e [0,4194304] 0 2021-04-09T18:26:22.153 INFO:tasks.workunit.client.0.smithi120.stdout:7/654: write db/d42/d54/fc4 [197809,55702] 0 2021-04-09T18:26:22.155 INFO:tasks.workunit.client.0.smithi120.stdout:3/691: symlink d3/d5/d36/d1e/d6b/d49/d89/d68/ldf 0 2021-04-09T18:26:22.158 INFO:tasks.workunit.client.0.smithi120.stdout:7/655: dread db/d26/f5e [0,4194304] 0 2021-04-09T18:26:22.188 INFO:tasks.workunit.client.0.smithi120.stdout:3/692: dread d3/d5/d36/d1e/d6b/d6a/d83/f93 [0,4194304] 0 2021-04-09T18:26:22.189 INFO:tasks.workunit.client.0.smithi120.stdout:7/656: rename db/d26/f2d to db/d38/d3c/d6e/fdd 0 2021-04-09T18:26:22.230 INFO:tasks.workunit.client.0.smithi120.stdout:8/577: sync 2021-04-09T18:26:22.233 INFO:tasks.workunit.client.0.smithi120.stdout:3/693: mknod d3/d5/d36/d1e/d6b/ce0 1 2021-04-09T18:26:22.236 INFO:tasks.workunit.client.0.smithi120.stdout:8/578: unlink d2/d37/d3e/d7c/fab 0 2021-04-09T18:26:22.238 INFO:tasks.workunit.client.0.smithi120.stdout:8/579: chown d2/d3/d11/d2c/f31 14 1 2021-04-09T18:26:22.262 INFO:tasks.workunit.client.0.smithi120.stdout:3/694: dread d3/d5/d36/d1e/d6b/d49/d89/dd0/f76 [0,4194304] 0 2021-04-09T18:26:22.269 INFO:tasks.workunit.client.0.smithi120.stdout:8/580: dread d2/d3/d3c/f68 [0,4194304] 0 2021-04-09T18:26:22.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.277 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e681829e0 con 0x7f0e681a0f50 2021-04-09T18:26:22.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.277 7f0e657fa700 1 -- 172.21.15.120:0/324743646 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+1768 (secure 0 0 0) 0x7f0e50006030 con 0x7f0e681a0f50 2021-04-09T18:26:22.271 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2021-04-09T18:26:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:22.271 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:22.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e4c018930 msgr2=0x7f0e4c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e4c018930 0x7f0e4c01ae10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e681a0f50 msgr2=0x7f0e681a1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:22.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e681a0f50 0x7f0e681a1350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f0e5000b580 tx=0x7f0e5000b920).stop 2021-04-09T18:26:22.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 shutdown_connections 2021-04-09T18:26:22.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e680b72d0 0x7f0e680b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e681a0f50 0x7f0e681a1350 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e4c018930 0x7f0e4c01ae10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 --2- 172.21.15.120:0/324743646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e680a6a90 0x7f0e68098770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:22.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 >> 172.21.15.120:0/324743646 conn(0x7f0e6818ed90 msgr2=0x7f0e68183460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:22.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 shutdown_connections 2021-04-09T18:26:22.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:22.280 7f0e6e8b8700 1 -- 172.21.15.120:0/324743646 wait complete. 2021-04-09T18:26:22.277 INFO:tasks.workunit.client.0.smithi120.stdout:8/581: dread d2/d3/d3c/d4f/f83 [0,4194304] 0 2021-04-09T18:26:22.282 INFO:tasks.workunit.client.0.smithi120.stdout:8/582: getdents d2/d3 0 2021-04-09T18:26:22.283 INFO:tasks.workunit.client.0.smithi120.stdout:3/695: write d3/de/d25/f1f [608638,96864] 0 2021-04-09T18:26:22.284 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-04-09T18:26:22.292 INFO:tasks.workunit.client.0.smithi120.stdout:8/583: write d2/d3/d11/d6a/d3b/f77 [907825,94187] 0 2021-04-09T18:26:22.298 INFO:tasks.workunit.client.0.smithi120.stdout:8/584: dwrite d2/d37/d3e/d7c/d99/f9a [0,4194304] 0 2021-04-09T18:26:22.300 INFO:tasks.workunit.client.0.smithi120.stdout:3/696: write d3/d5/d36/d1e/d6b/d49/d4e/f8c [40558,66270] 0 2021-04-09T18:26:22.308 INFO:tasks.workunit.client.0.smithi120.stdout:3/697: mkdir d3/de/da6/dcc/de1 0 2021-04-09T18:26:22.308 INFO:tasks.workunit.client.0.smithi120.stdout:8/585: dwrite d2/d3/d11/d6a/d3b/f66 [0,4194304] 0 2021-04-09T18:26:22.312 INFO:tasks.workunit.client.0.smithi120.stdout:8/586: mknod d2/d37/d3e/d42/d9e/cae 1 2021-04-09T18:26:22.313 INFO:tasks.workunit.client.0.smithi120.stdout:3/698: dwrite d3/d5/f31 [0,4194304] 0 2021-04-09T18:26:22.533 INFO:tasks.workunit.client.0.smithi120.stdout:2/694: sync 2021-04-09T18:26:22.533 INFO:tasks.workunit.client.0.smithi120.stdout:9/716: sync 2021-04-09T18:26:22.533 INFO:tasks.workunit.client.0.smithi120.stdout:4/542: sync 2021-04-09T18:26:22.533 INFO:tasks.workunit.client.0.smithi120.stdout:1/685: sync 2021-04-09T18:26:22.536 INFO:tasks.workunit.client.0.smithi120.stdout:9/717: read - d19/d24/d37/f94 zero size 2021-04-09T18:26:22.538 INFO:tasks.workunit.client.0.smithi120.stdout:9/718: stat d19/d24/d36/da8/fbd 0 2021-04-09T18:26:22.540 INFO:tasks.workunit.client.0.smithi120.stdout:2/695: dwrite d13/d7a/d80/d54/fa8 [0,4194304] 0 2021-04-09T18:26:22.541 INFO:tasks.workunit.client.0.smithi120.stdout:4/543: write d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f8a [981283,49114] 0 2021-04-09T18:26:22.542 INFO:tasks.workunit.client.0.smithi120.stdout:2/696: write d13/f72 [4681747,35528] 0 2021-04-09T18:26:22.544 INFO:tasks.workunit.client.0.smithi120.stdout:3/699: getdents d3/d5/d36/d1e/d38/d6d 0 2021-04-09T18:26:22.547 INFO:tasks.workunit.client.0.smithi120.stdout:9/719: write d19/d24/d36/f45 [2740840,31038] 0 2021-04-09T18:26:22.550 INFO:tasks.workunit.client.0.smithi120.stdout:4/544: creat d1f/d2c/d34/d60/d7a/d92/d3e/d77/fb3 x:0 0 0 2021-04-09T18:26:22.551 INFO:tasks.workunit.client.0.smithi120.stdout:3/700: mkdir d3/de/da6/de2 0 2021-04-09T18:26:22.554 INFO:tasks.workunit.client.0.smithi120.stdout:1/686: link d5/d5c/d75/lbd d5/d64/d63/lec 0 2021-04-09T18:26:22.559 INFO:tasks.workunit.client.0.smithi120.stdout:4/545: mknod d1f/d2c/d34/d60/d7a/d92/d3e/d7c/cb4 1 2021-04-09T18:26:22.564 INFO:tasks.workunit.client.0.smithi120.stdout:1/687: creat d5/d5c/fed x:0 0 0 2021-04-09T18:26:22.566 INFO:tasks.workunit.client.0.smithi120.stdout:9/720: rename d19/d24/d36/leb to d19/d24/d36/lf2 0 2021-04-09T18:26:22.567 INFO:tasks.workunit.client.0.smithi120.stdout:4/546: dwrite d1f/d2c/d56/f5b [0,4194304] 0 2021-04-09T18:26:22.569 INFO:tasks.workunit.client.0.smithi120.stdout:3/701: rename d3/d5/d36/d1e/d6b/d49/d4e/d54/f75 to d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f/fe3 0 2021-04-09T18:26:22.573 INFO:tasks.workunit.client.0.smithi120.stdout:9/721: mknod d19/d24/d36/d47/d6f/cf3 1 2021-04-09T18:26:22.574 INFO:tasks.workunit.client.0.smithi120.stdout:1/688: creat d5/d5c/d75/daf/d87/fee x:0 0 0 2021-04-09T18:26:22.576 INFO:tasks.workunit.client.0.smithi120.stdout:3/702: dread d3/d5/d36/d1e/d6b/d49/d4e/f8c [0,4194304] 0 2021-04-09T18:26:22.577 INFO:tasks.workunit.client.0.smithi120.stdout:2/697: dread d13/d15/d35/dae/fa5 [0,4194304] 0 2021-04-09T18:26:22.578 INFO:tasks.workunit.client.0.smithi120.stdout:9/722: mkdir d19/d2c/df4 0 2021-04-09T18:26:22.587 INFO:tasks.workunit.client.0.smithi120.stdout:4/547: write d1f/d2c/d34/d60/d7a/d92/d84/f95 [440459,31193] 0 2021-04-09T18:26:22.589 INFO:tasks.workunit.client.0.smithi120.stdout:4/548: chown d1f/d2c/d30/l6c 26 1 2021-04-09T18:26:22.591 INFO:tasks.workunit.client.0.smithi120.stdout:1/689: getdents d5/d5c/d75/daf/dc7/d61 0 2021-04-09T18:26:22.591 INFO:tasks.workunit.client.0.smithi120.stdout:2/698: read d13/d61/d7c/fb5 [2689505,124717] 0 2021-04-09T18:26:22.592 INFO:tasks.workunit.client.0.smithi120.stdout:9/723: symlink d19/d24/d36/d47/d4b/lf5 0 2021-04-09T18:26:22.594 INFO:tasks.workunit.client.0.smithi120.stdout:1/690: write d5/d5c/d75/daf/d87/dc3/fcb [1170733,55282] 0 2021-04-09T18:26:22.596 INFO:tasks.workunit.client.0.smithi120.stdout:1/691: fsync d5/d5c/d75/daf/dc7/fae 0 2021-04-09T18:26:22.618 INFO:tasks.workunit.client.0.smithi120.stdout:1/692: dwrite d5/d1f/fd3 [0,4194304] 0 2021-04-09T18:26:22.618 INFO:tasks.workunit.client.0.smithi120.stdout:0/625: sync 2021-04-09T18:26:22.619 INFO:tasks.workunit.client.0.smithi120.stdout:6/664: sync 2021-04-09T18:26:22.619 INFO:tasks.workunit.client.0.smithi120.stdout:5/802: sync 2021-04-09T18:26:22.619 INFO:tasks.workunit.client.0.smithi120.stdout:7/657: sync 2021-04-09T18:26:22.621 INFO:tasks.workunit.client.0.smithi120.stdout:7/658: fdatasync db/d38/d74/d6f/fd6 0 2021-04-09T18:26:22.622 INFO:tasks.workunit.client.0.smithi120.stdout:9/724: truncate d19/d24/d37/d40/d89/d29/d76/fe0 20237 0 2021-04-09T18:26:22.622 INFO:tasks.workunit.client.0.smithi120.stdout:5/803: fsync d10/d12/d1b/d1f/d84/d44/d8c/ffc 0 2021-04-09T18:26:22.624 INFO:tasks.workunit.client.0.smithi120.stdout:0/626: unlink d0/d2/d82/d9f/fb9 0 2021-04-09T18:26:22.625 INFO:tasks.workunit.client.0.smithi120.stdout:9/725: readlink d19/d24/d37/d40/d89/d29/l33 0 2021-04-09T18:26:22.626 INFO:tasks.workunit.client.0.smithi120.stdout:1/693: write d5/d64/d63/f8f [4339528,2490] 0 2021-04-09T18:26:22.627 INFO:tasks.workunit.client.0.smithi120.stdout:7/659: symlink db/d2c/d30/d59/lde 0 2021-04-09T18:26:22.632 INFO:tasks.workunit.client.0.smithi120.stdout:9/726: creat d19/d24/d37/d40/d89/d52/da7/ff6 x:0 0 0 2021-04-09T18:26:22.633 INFO:tasks.workunit.client.0.smithi120.stdout:6/665: link d6/d8/d1a/f34 d6/d8/db/d2b/de2/d5d/d6e/fe6 0 2021-04-09T18:26:22.633 INFO:tasks.workunit.client.0.smithi120.stdout:0/627: symlink d0/d2/da/d23/lbe 0 2021-04-09T18:26:22.636 INFO:tasks.workunit.client.0.smithi120.stdout:0/628: stat d0/d5a/d62/d69/f77 0 2021-04-09T18:26:22.639 INFO:tasks.workunit.client.0.smithi120.stdout:7/660: rename db/d38/d3c/d6e/f83 to db/d38/fdf 0 2021-04-09T18:26:22.640 INFO:tasks.workunit.client.0.smithi120.stdout:5/804: link d10/d12/d1b/d3a/d5b/fb1 d10/d12/d1b/d1f/d39/dbb/f11b 0 2021-04-09T18:26:22.641 INFO:tasks.workunit.client.0.smithi120.stdout:7/661: stat db/d38/f6d 0 2021-04-09T18:26:22.642 INFO:tasks.workunit.client.0.smithi120.stdout:5/805: chown d10/daa/f10e 243191958 1 2021-04-09T18:26:22.643 INFO:tasks.workunit.client.0.smithi120.stdout:2/699: dread d13/f1d [0,4194304] 0 2021-04-09T18:26:22.645 INFO:tasks.workunit.client.0.smithi120.stdout:9/727: dwrite d19/d24/d37/d40/d89/d29/f5a [0,4194304] 0 2021-04-09T18:26:22.648 INFO:tasks.workunit.client.0.smithi120.stdout:5/806: mknod d10/d12/d1b/d1f/d84/d44/dcb/d10b/c11c 1 2021-04-09T18:26:22.648 INFO:tasks.workunit.client.0.smithi120.stdout:6/666: creat d6/d8/d1a/d36/d54/d31/fe7 x:0 0 0 2021-04-09T18:26:22.648 INFO:tasks.workunit.client.0.smithi120.stdout:2/700: rmdir d13/d15 39 2021-04-09T18:26:22.649 INFO:tasks.workunit.client.0.smithi120.stdout:0/629: creat d0/d2/d4/fbf x:0 0 0 2021-04-09T18:26:22.650 INFO:tasks.workunit.client.0.smithi120.stdout:7/662: dread db/d42/f43 [0,4194304] 0 2021-04-09T18:26:22.652 INFO:tasks.workunit.client.0.smithi120.stdout:9/728: creat d19/d24/d37/d40/d89/d52/ff7 x:0 0 0 2021-04-09T18:26:22.653 INFO:tasks.workunit.client.0.smithi120.stdout:2/701: creat d13/d15/d35/fee x:0 0 0 2021-04-09T18:26:22.654 INFO:tasks.workunit.client.0.smithi120.stdout:5/807: rename d10/d12/d1b/d1f/d84/d44 to d10/daa/ddc/d11d 0 2021-04-09T18:26:22.657 INFO:tasks.workunit.client.0.smithi120.stdout:9/729: mknod d19/d24/d36/d47/d4b/cf8 1 2021-04-09T18:26:22.657 INFO:tasks.workunit.client.0.smithi120.stdout:2/702: write d13/d7a/d80/fc2 [35232,122339] 0 2021-04-09T18:26:22.658 INFO:tasks.workunit.client.0.smithi120.stdout:9/730: mknod d19/d24/cf9 1 2021-04-09T18:26:22.660 INFO:tasks.workunit.client.0.smithi120.stdout:0/630: dread d0/d2/f5b [0,4194304] 0 2021-04-09T18:26:22.662 INFO:tasks.workunit.client.0.smithi120.stdout:9/731: write d19/d24/d37/d40/d89/f53 [5076000,4589] 0 2021-04-09T18:26:22.666 INFO:tasks.workunit.client.0.smithi120.stdout:1/694: dwrite d5/d64/d2d/d5a/f6a [0,4194304] 0 2021-04-09T18:26:22.667 INFO:tasks.workunit.client.0.smithi120.stdout:7/663: rename db/d26/d4c/lc0 to db/d38/d74/le0 0 2021-04-09T18:26:22.674 INFO:tasks.workunit.client.0.smithi120.stdout:5/808: read d10/d12/d1b/d3a/fec [509,16699] 0 2021-04-09T18:26:22.683 INFO:tasks.workunit.client.0.smithi120.stdout:0/631: dread d0/d2/d82/d9f/fa3 [0,4194304] 0 2021-04-09T18:26:22.683 INFO:tasks.workunit.client.0.smithi120.stdout:1/695: creat d5/d5c/fef x:0 0 0 2021-04-09T18:26:22.686 INFO:tasks.workunit.client.0.smithi120.stdout:2/703: mknod d13/d15/d35/dbc/cef 1 2021-04-09T18:26:22.690 INFO:tasks.workunit.client.0.smithi120.stdout:0/632: mkdir d0/d2/dd/db4/dc0 0 2021-04-09T18:26:22.691 INFO:tasks.workunit.client.0.smithi120.stdout:1/696: dwrite d5/d5c/fed [0,4194304] 0 2021-04-09T18:26:22.693 INFO:tasks.workunit.client.0.smithi120.stdout:9/732: link d19/d24/l2f d19/d24/d37/d40/d89/d29/d63/lfa 0 2021-04-09T18:26:22.695 INFO:tasks.workunit.client.0.smithi120.stdout:5/809: rename d10/d12/d1b/d3a/f74 to d10/d12/d1b/d1f/d84/d3d/d50/d94/f11e 0 2021-04-09T18:26:22.696 INFO:tasks.workunit.client.0.smithi120.stdout:1/697: mknod d5/d5c/d75/daf/dc7/cf0 1 2021-04-09T18:26:22.697 INFO:tasks.workunit.client.0.smithi120.stdout:7/664: dwrite db/d2c/d34/f5b [0,4194304] 0 2021-04-09T18:26:22.702 INFO:tasks.workunit.client.0.smithi120.stdout:2/704: dwrite d13/d7a/d80/d54/faf [0,4194304] 0 2021-04-09T18:26:22.705 INFO:tasks.workunit.client.0.smithi120.stdout:9/733: unlink d19/d24/d37/d40/d89/d29/d76/fa5 0 2021-04-09T18:26:22.721 INFO:tasks.workunit.client.0.smithi120.stdout:9/734: dwrite d19/d24/d36/d47/d4b/fb9 [0,4194304] 0 2021-04-09T18:26:22.722 INFO:tasks.workunit.client.0.smithi120.stdout:2/705: rename d13/d7a/l7b to d13/d7a/d80/d48/d49/d64/d9d/dcf/lf0 0 2021-04-09T18:26:22.728 INFO:tasks.workunit.client.0.smithi120.stdout:5/810: truncate d10/d12/d1b/d1f/d39/fb2 616709 0 2021-04-09T18:26:22.728 INFO:tasks.workunit.client.0.smithi120.stdout:7/665: dwrite db/f29 [0,4194304] 0 2021-04-09T18:26:22.744 INFO:tasks.workunit.client.0.smithi120.stdout:1/698: truncate d5/d1f/fd3 555152 0 2021-04-09T18:26:22.745 INFO:tasks.workunit.client.0.smithi120.stdout:2/706: mkdir d13/d15/d35/d9f/df1 0 2021-04-09T18:26:22.747 INFO:tasks.workunit.client.0.smithi120.stdout:2/707: chown d13/d7a/lc8 995 1 2021-04-09T18:26:22.751 INFO:tasks.workunit.client.0.smithi120.stdout:0/633: truncate d0/d2/da/d23/fbd 466380 0 2021-04-09T18:26:22.753 INFO:tasks.workunit.client.0.smithi120.stdout:5/811: symlink d10/daa/ddc/d11d/l11f 0 2021-04-09T18:26:22.755 INFO:tasks.workunit.client.0.smithi120.stdout:7/666: mkdir db/d2c/d34/d5d/de1 0 2021-04-09T18:26:22.758 INFO:tasks.workunit.client.0.smithi120.stdout:3/703: dread d3/d5/d36/d1e/d6b/d49/fa9 [0,4194304] 0 2021-04-09T18:26:22.759 INFO:tasks.workunit.client.0.smithi120.stdout:5/812: mknod d10/d12/d1b/d1f/d39/d106/c120 1 2021-04-09T18:26:22.760 INFO:tasks.workunit.client.0.smithi120.stdout:1/699: symlink d5/d5c/d75/daf/dc7/d61/deb/lf1 0 2021-04-09T18:26:22.761 INFO:tasks.workunit.client.0.smithi120.stdout:0/634: mkdir d0/d2/d4/dc1 0 2021-04-09T18:26:22.762 INFO:tasks.workunit.client.0.smithi120.stdout:3/704: symlink d3/de/da6/le4 0 2021-04-09T18:26:22.763 INFO:tasks.workunit.client.0.smithi120.stdout:2/708: dwrite d13/d7a/d80/d48/d58/f8c [0,4194304] 0 2021-04-09T18:26:22.769 INFO:tasks.workunit.client.0.smithi120.stdout:1/700: creat d5/d5c/d75/daf/d2b/ff2 x:0 0 0 2021-04-09T18:26:22.782 INFO:tasks.workunit.client.0.smithi120.stdout:0/635: dwrite d0/d5a/f99 [0,4194304] 0 2021-04-09T18:26:22.782 INFO:tasks.workunit.client.0.smithi120.stdout:9/735: write d19/d24/d37/d40/fa2 [92086,18437] 0 2021-04-09T18:26:22.782 INFO:tasks.workunit.client.0.smithi120.stdout:5/813: truncate d10/d12/f3c 3549700 0 2021-04-09T18:26:22.783 INFO:tasks.workunit.client.0.smithi120.stdout:1/701: creat d5/d5c/d75/daf/db8/ff3 x:0 0 0 2021-04-09T18:26:22.813 INFO:tasks.workunit.client.0.smithi120.stdout:9/736: rmdir d19/d24/d36/da8 39 2021-04-09T18:26:22.817 INFO:tasks.workunit.client.0.smithi120.stdout:0/636: write d0/d5a/d62/d69/f77 [779191,28959] 0 2021-04-09T18:26:22.829 INFO:tasks.workunit.client.0.smithi120.stdout:8/587: sync 2021-04-09T18:26:22.830 INFO:tasks.workunit.client.0.smithi120.stdout:0/637: dwrite d0/d5a/d62/d72/fab [0,4194304] 0 2021-04-09T18:26:22.845 INFO:tasks.workunit.client.0.smithi120.stdout:5/814: fdatasync d10/d12/d1b/d3a/d5b/f8a 0 2021-04-09T18:26:22.845 INFO:tasks.workunit.client.0.smithi120.stdout:8/588: fsync d2/d3/d11/d6a/d3b/f47 0 2021-04-09T18:26:22.845 INFO:tasks.workunit.client.0.smithi120.stdout:2/709: truncate d13/d7a/d80/d48/d49/d64/d83/fa9 284659 0 2021-04-09T18:26:22.846 INFO:tasks.workunit.client.0.smithi120.stdout:5/815: write d10/d12/fee [4067040,111365] 0 2021-04-09T18:26:22.846 INFO:tasks.workunit.client.0.smithi120.stdout:9/737: truncate d19/d24/d36/d9d/fb4 3537685 0 2021-04-09T18:26:22.848 INFO:tasks.workunit.client.0.smithi120.stdout:0/638: creat d0/d2/dd/db4/dc0/fc2 x:0 0 0 2021-04-09T18:26:22.849 INFO:tasks.workunit.client.0.smithi120.stdout:2/710: chown d13/d15/d35/l8a 710471 1 2021-04-09T18:26:22.850 INFO:tasks.workunit.client.0.smithi120.stdout:0/639: readlink d0/l95 0 2021-04-09T18:26:22.853 INFO:tasks.workunit.client.0.smithi120.stdout:8/589: symlink d2/d37/d3e/d42/d9e/laf 0 2021-04-09T18:26:22.855 INFO:tasks.workunit.client.0.smithi120.stdout:8/590: chown d2/d37/d3e/d7c/f90 13291 1 2021-04-09T18:26:22.864 INFO:tasks.workunit.client.0.smithi120.stdout:5/816: symlink d10/d12/d1b/d1f/d39/dab/l121 0 2021-04-09T18:26:22.871 INFO:tasks.workunit.client.0.smithi120.stdout:4/549: sync 2021-04-09T18:26:22.871 INFO:tasks.workunit.client.0.smithi120.stdout:6/667: sync 2021-04-09T18:26:22.876 INFO:tasks.workunit.client.0.smithi120.stdout:6/668: creat d6/d8/db/d2b/de2/d5d/fe8 x:0 0 0 2021-04-09T18:26:22.883 INFO:tasks.workunit.client.0.smithi120.stdout:6/669: dwrite d6/d8/db/d2b/de2/d5d/d6e/f80 [0,4194304] 0 2021-04-09T18:26:22.890 INFO:tasks.workunit.client.0.smithi120.stdout:1/702: dwrite d5/d5c/d75/daf/dc7/f55 [4194304,4194304] 0 2021-04-09T18:26:22.900 INFO:tasks.workunit.client.0.smithi120.stdout:6/670: getdents d6/d8/d1a/dc7 0 2021-04-09T18:26:22.901 INFO:tasks.workunit.client.0.smithi120.stdout:6/671: readlink d6/d8/d3a/lb9 0 2021-04-09T18:26:22.902 INFO:tasks.workunit.client.0.smithi120.stdout:6/672: chown d6/d8/d3a/d56/dcb 532 1 2021-04-09T18:26:22.903 INFO:tasks.workunit.client.0.smithi120.stdout:1/703: creat d5/d5c/d75/daf/d2b/ff4 x:0 0 0 2021-04-09T18:26:22.915 INFO:tasks.workunit.client.0.smithi120.stdout:1/704: symlink d5/d64/lf5 0 2021-04-09T18:26:22.919 INFO:tasks.workunit.client.0.smithi120.stdout:1/705: creat d5/d5c/d75/daf/dc7/ff6 x:0 0 0 2021-04-09T18:26:22.924 INFO:tasks.workunit.client.0.smithi120.stdout:3/705: rename d3/d5/f28 to d3/d5/d36/d1e/d6b/d49/d89/dd0/fe5 0 2021-04-09T18:26:22.926 INFO:tasks.workunit.client.0.smithi120.stdout:0/640: rename d0 to d0/d2/dc3 22 2021-04-09T18:26:22.926 INFO:tasks.workunit.client.0.smithi120.stdout:1/706: write d5/d5c/d75/daf/dc7/d61/deb/f2f [532579,48967] 0 2021-04-09T18:26:22.936 INFO:tasks.workunit.client.0.smithi120.stdout:2/711: write d13/fbd [44474,88505] 0 2021-04-09T18:26:22.936 INFO:tasks.workunit.client.0.smithi120.stdout:9/738: write d19/d24/f55 [1205695,63057] 0 2021-04-09T18:26:22.937 INFO:tasks.workunit.client.0.smithi120.stdout:2/712: chown d13/d8d 5 1 2021-04-09T18:26:22.938 INFO:tasks.workunit.client.0.smithi120.stdout:8/591: write d2/d3/d11/f34 [1177818,28018] 0 2021-04-09T18:26:22.942 INFO:tasks.workunit.client.0.smithi120.stdout:2/713: write d13/d15/d35/f5b [6059920,94969] 0 2021-04-09T18:26:22.943 INFO:tasks.workunit.client.0.smithi120.stdout:8/592: dread - d2/d37/f7e zero size 2021-04-09T18:26:22.944 INFO:tasks.workunit.client.0.smithi120.stdout:2/714: write fb [9040192,24127] 0 2021-04-09T18:26:22.953 INFO:tasks.workunit.client.0.smithi120.stdout:5/817: dwrite d10/d12/d1b/d3a/d5b/fb1 [0,4194304] 0 2021-04-09T18:26:22.955 INFO:tasks.workunit.client.0.smithi120.stdout:2/715: fdatasync d13/d7a/d80/d48/d49/d64/d9d/dec/fad 0 2021-04-09T18:26:22.955 INFO:tasks.workunit.client.0.smithi120.stdout:8/593: fsync d2/d3/f28 0 2021-04-09T18:26:22.956 INFO:tasks.workunit.client.0.smithi120.stdout:9/739: getdents d19/d81 0 2021-04-09T18:26:22.957 INFO:tasks.workunit.client.0.smithi120.stdout:6/673: write d6/d8/d1a/d36/d54/d31/f53 [638791,276] 0 2021-04-09T18:26:22.958 INFO:tasks.workunit.client.0.smithi120.stdout:4/550: truncate d1f/d2c/d56/f74 411988 0 2021-04-09T18:26:22.959 INFO:tasks.workunit.client.0.smithi120.stdout:6/674: mknod d6/d8/d1a/dc7/db2/ce9 1 2021-04-09T18:26:22.959 INFO:tasks.workunit.client.0.smithi120.stdout:5/818: mknod d10/daa/ddc/d11d/d8c/da6/c122 1 2021-04-09T18:26:22.961 INFO:tasks.workunit.client.0.smithi120.stdout:2/716: mknod d13/d15/cf2 1 2021-04-09T18:26:22.969 INFO:tasks.workunit.client.0.smithi120.stdout:6/675: chown d6/d8/d52/da8 1756 1 2021-04-09T18:26:22.975 INFO:tasks.workunit.client.0.smithi120.stdout:4/551: chown d1f/d2c/d34/d60/d7a/d92/d3e/l5f 22108 1 2021-04-09T18:26:22.984 INFO:tasks.workunit.client.0.smithi120.stdout:6/676: rename d6/d8/d1a/d36/d54/d31/d8a/fdb to d6/d8/db/d2b/d68/fea 0 2021-04-09T18:26:22.985 INFO:tasks.workunit.client.0.smithi120.stdout:3/706: dread d3/d5/f74 [0,4194304] 0 2021-04-09T18:26:22.985 INFO:tasks.workunit.client.0.smithi120.stdout:8/594: creat d2/d3/d8/fb0 x:0 0 0 2021-04-09T18:26:22.986 INFO:tasks.workunit.client.0.smithi120.stdout:8/595: write d2/f39 [4621753,80314] 0 2021-04-09T18:26:22.989 INFO:tasks.workunit.client.0.smithi120.stdout:5/819: getdents d10/d12/d1b/d1f 0 2021-04-09T18:26:22.992 INFO:tasks.workunit.client.0.smithi120.stdout:6/677: dread d6/d8/db/f1b [4194304,4194304] 0 2021-04-09T18:26:22.994 INFO:tasks.workunit.client.0.smithi120.stdout:4/552: creat d1f/d2c/d34/d60/d7a/d4f/fb5 x:0 0 0 2021-04-09T18:26:22.996 INFO:tasks.workunit.client.0.smithi120.stdout:3/707: rename d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f/fe3 to d3/d5/d36/d1e/d38/d6d/fe6 0 2021-04-09T18:26:22.998 INFO:tasks.workunit.client.0.smithi120.stdout:7/667: dread db/d38/f6d [0,4194304] 0 2021-04-09T18:26:22.999 INFO:tasks.workunit.client.0.smithi120.stdout:4/553: mknod d1f/d2c/d34/d83/cb6 1 2021-04-09T18:26:22.999 INFO:tasks.workunit.client.0.smithi120.stdout:6/678: mkdir d6/d8/db/d2b/de2/d5d/deb 0 2021-04-09T18:26:23.000 INFO:tasks.workunit.client.0.smithi120.stdout:8/596: mkdir d2/d3/d3c/db1 0 2021-04-09T18:26:23.000 INFO:tasks.workunit.client.0.smithi120.stdout:7/668: write db/d42/d54/d5a/f75 [143184,110219] 0 2021-04-09T18:26:23.003 INFO:tasks.workunit.client.0.smithi120.stdout:5/820: link d10/d12/d1b/d1f/d84/d3d/d50/d94/fac d10/daa/ddc/d11d/d8c/f123 0 2021-04-09T18:26:23.007 INFO:tasks.workunit.client.0.smithi120.stdout:8/597: fsync d2/d3/d11/d6a/d3b/d6b/da9/fa1 0 2021-04-09T18:26:23.009 INFO:tasks.workunit.client.0.smithi120.stdout:7/669: rename db/f1b to db/d38/d3c/d6e/fe2 0 2021-04-09T18:26:23.009 INFO:tasks.workunit.client.0.smithi120.stdout:9/740: write d19/d24/d37/f94 [781784,103635] 0 2021-04-09T18:26:23.014 INFO:tasks.workunit.client.0.smithi120.stdout:8/598: read d2/d3/f8b [708364,126007] 0 2021-04-09T18:26:23.015 INFO:tasks.workunit.client.0.smithi120.stdout:9/741: rename f7 to d19/d24/d9e/ffb 0 2021-04-09T18:26:23.016 INFO:tasks.workunit.client.0.smithi120.stdout:6/679: creat d6/d8/db/d2b/de2/fec x:0 0 0 2021-04-09T18:26:23.017 INFO:tasks.workunit.client.0.smithi120.stdout:2/717: dwrite d13/d15/d35/f68 [0,4194304] 0 2021-04-09T18:26:23.023 INFO:tasks.workunit.client.0.smithi120.stdout:4/554: write d1f/d2c/d34/d60/d7a/d4f/f79 [434887,56776] 0 2021-04-09T18:26:23.026 INFO:tasks.workunit.client.0.smithi120.stdout:9/742: stat d19/d24/d37/f5f 0 2021-04-09T18:26:23.027 INFO:tasks.workunit.client.0.smithi120.stdout:6/680: mknod d6/d8/db/d2b/de2/ced 1 2021-04-09T18:26:23.028 INFO:tasks.workunit.client.0.smithi120.stdout:6/681: dread - d6/d8/db/d2b/d68/d6a/fd9 zero size 2021-04-09T18:26:23.033 INFO:tasks.workunit.client.0.smithi120.stdout:2/718: rename d13/d7a/d80/d48/d58/f67 to d13/d7a/d80/d48/d49/d76/ff3 0 2021-04-09T18:26:23.034 INFO:tasks.workunit.client.0.smithi120.stdout:3/708: truncate d3/de/d25/f1f 4009536 0 2021-04-09T18:26:23.036 INFO:tasks.workunit.client.0.smithi120.stdout:4/555: symlink d1f/d2c/d30/lb7 0 2021-04-09T18:26:23.038 INFO:tasks.workunit.client.0.smithi120.stdout:9/743: fsync d19/d24/d36/d47/f57 0 2021-04-09T18:26:23.043 INFO:tasks.workunit.client.0.smithi120.stdout:7/670: write db/d38/faf [947945,32408] 0 2021-04-09T18:26:23.050 INFO:tasks.workunit.client.0.smithi120.stdout:3/709: unlink d3/d5/d36/d1e/d6b/d49/d4e/l5a 0 2021-04-09T18:26:23.052 INFO:tasks.workunit.client.0.smithi120.stdout:8/599: write d2/d3/f23 [2710022,55214] 0 2021-04-09T18:26:23.059 INFO:tasks.workunit.client.0.smithi120.stdout:8/600: mknod d2/d37/cb2 1 2021-04-09T18:26:23.059 INFO:tasks.workunit.client.0.smithi120.stdout:0/641: dread d0/d2/f60 [0,4194304] 0 2021-04-09T18:26:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:7/671: rmdir db/d38/dab/db1 0 2021-04-09T18:26:23.062 INFO:tasks.workunit.client.0.smithi120.stdout:4/556: getdents d1f/d2c/d56/d6a 0 2021-04-09T18:26:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:2/719: dwrite d13/d7a/d80/d48/d49/d64/d83/fa9 [0,4194304] 0 2021-04-09T18:26:23.069 INFO:tasks.workunit.client.0.smithi120.stdout:7/672: symlink db/d42/le3 0 2021-04-09T18:26:23.070 INFO:tasks.workunit.client.0.smithi120.stdout:5/821: dread d10/daa/ddc/d11d/fc3 [0,4194304] 0 2021-04-09T18:26:23.070 INFO:tasks.workunit.client.0.smithi120.stdout:8/601: creat d2/d3/d11/d6a/d3b/d6b/da9/fb3 x:0 0 0 2021-04-09T18:26:23.071 INFO:tasks.workunit.client.0.smithi120.stdout:4/557: rmdir d1f/d2c/d34 39 2021-04-09T18:26:23.073 INFO:tasks.workunit.client.0.smithi120.stdout:9/744: link d19/d24/l96 d19/d24/de4/lfc 0 2021-04-09T18:26:23.074 INFO:tasks.workunit.client.0.smithi120.stdout:0/642: symlink d0/d2/d4/dc1/lc4 0 2021-04-09T18:26:23.075 INFO:tasks.workunit.client.0.smithi120.stdout:0/643: chown d0/d2/d4/d5f/d61/d8b 0 1 2021-04-09T18:26:23.076 INFO:tasks.workunit.client.0.smithi120.stdout:0/644: dread - d0/d2/fb5 zero size 2021-04-09T18:26:23.080 INFO:tasks.workunit.client.0.smithi120.stdout:9/745: creat d19/d24/de4/d99/ffd x:0 0 0 2021-04-09T18:26:23.098 INFO:tasks.workunit.client.0.smithi120.stdout:4/558: chown d1f/d2c/d34/d60/d7a/d92 71933538 1 2021-04-09T18:26:23.099 INFO:tasks.workunit.client.0.smithi120.stdout:0/645: symlink d0/d52/d56/lc5 0 2021-04-09T18:26:23.100 INFO:tasks.workunit.client.0.smithi120.stdout:5/822: creat d10/daa/ddc/d11d/d8c/da6/dcc/dd4/f124 x:0 0 0 2021-04-09T18:26:23.105 INFO:tasks.workunit.client.0.smithi120.stdout:9/746: readlink d19/d24/d36/lb3 0 2021-04-09T18:26:23.106 INFO:tasks.workunit.client.0.smithi120.stdout:3/710: dwrite d3/d5/f4d [4194304,4194304] 0 2021-04-09T18:26:23.108 INFO:tasks.workunit.client.0.smithi120.stdout:7/673: creat db/d38/d74/d6f/d76/fe4 x:0 0 0 2021-04-09T18:26:23.125 INFO:tasks.workunit.client.0.smithi120.stdout:8/602: dwrite d2/d3/f4c [0,4194304] 0 2021-04-09T18:26:23.125 INFO:tasks.workunit.client.0.smithi120.stdout:4/559: unlink d1f/f71 0 2021-04-09T18:26:23.127 INFO:tasks.workunit.client.0.smithi120.stdout:0/646: mkdir d0/d5a/d62/d69/dc6 0 2021-04-09T18:26:23.130 INFO:tasks.workunit.client.0.smithi120.stdout:5/823: dwrite d10/d12/fc7 [0,4194304] 0 2021-04-09T18:26:23.131 INFO:tasks.workunit.client.0.smithi120.stdout:9/747: symlink d19/d24/de4/lfe 0 2021-04-09T18:26:23.132 INFO:tasks.workunit.client.0.smithi120.stdout:9/748: chown d19/d24/de4 502900400 1 2021-04-09T18:26:23.132 INFO:tasks.workunit.client.0.smithi120.stdout:5/824: fdatasync d10/d12/d1b/d3a/d5b/fb1 0 2021-04-09T18:26:23.135 INFO:tasks.workunit.client.0.smithi120.stdout:4/560: dwrite d1f/d24/d42/da0/fab [0,4194304] 0 2021-04-09T18:26:23.145 INFO:tasks.workunit.client.0.smithi120.stdout:4/561: symlink d1f/d24/d42/da0/lb8 0 2021-04-09T18:26:23.145 INFO:tasks.workunit.client.0.smithi120.stdout:9/749: fdatasync d19/d2c/f95 0 2021-04-09T18:26:23.150 INFO:tasks.workunit.client.0.smithi120.stdout:5/825: symlink d10/d12/d1b/d3a/d5b/d78/l125 0 2021-04-09T18:26:23.151 INFO:tasks.workunit.client.0.smithi120.stdout:3/711: truncate d3/d5/d36/d1e/d6b/d6a/d83/dd4/fb5 532844 0 2021-04-09T18:26:23.153 INFO:tasks.workunit.client.0.smithi120.stdout:6/682: read d6/d8/d3a/f59 [407127,112120] 0 2021-04-09T18:26:23.153 INFO:tasks.workunit.client.0.smithi120.stdout:3/712: write d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/fc1 [407339,77710] 0 2021-04-09T18:26:23.156 INFO:tasks.workunit.client.0.smithi120.stdout:7/674: rename db/d2c/d30/l3b to db/d38/d74/le5 0 2021-04-09T18:26:23.157 INFO:tasks.workunit.client.0.smithi120.stdout:7/675: write db/f1a [814124,57421] 0 2021-04-09T18:26:23.159 INFO:tasks.workunit.client.0.smithi120.stdout:4/562: chown d1f/d2c/d34/d60/d7a/d92/f53 12866728 1 2021-04-09T18:26:23.163 INFO:tasks.workunit.client.0.smithi120.stdout:9/750: rename d19/d24/d37/d40/d89/d52/da7/db1/lb7 to d19/d24/d36/da8/dcd/lff 0 2021-04-09T18:26:23.165 INFO:tasks.workunit.client.0.smithi120.stdout:8/603: truncate d2/d3/d11/f1f 5024759 0 2021-04-09T18:26:23.166 INFO:tasks.workunit.client.0.smithi120.stdout:7/676: creat db/d38/dab/fe6 x:0 0 0 2021-04-09T18:26:23.167 INFO:tasks.workunit.client.0.smithi120.stdout:4/563: creat d1f/d2c/d34/d60/d7a/d92/d84/fb9 x:0 0 0 2021-04-09T18:26:23.168 INFO:tasks.workunit.client.0.smithi120.stdout:3/713: mkdir d3/de/d25/de7 0 2021-04-09T18:26:23.172 INFO:tasks.workunit.client.0.smithi120.stdout:3/714: symlink d3/le8 0 2021-04-09T18:26:23.173 INFO:tasks.workunit.client.0.smithi120.stdout:3/715: chown d3/de/f1b 100 1 2021-04-09T18:26:23.176 INFO:tasks.workunit.client.0.smithi120.stdout:8/604: creat d2/d37/d3e/d42/fb4 x:0 0 0 2021-04-09T18:26:23.179 INFO:tasks.workunit.client.0.smithi120.stdout:7/677: link db/f1a db/d26/d4c/fe7 0 2021-04-09T18:26:23.180 INFO:tasks.workunit.client.0.smithi120.stdout:4/564: creat d1f/d2c/d34/d60/fba x:0 0 0 2021-04-09T18:26:23.181 INFO:tasks.workunit.client.0.smithi120.stdout:8/605: creat d2/d37/d3e/d42/d9e/fb5 x:0 0 0 2021-04-09T18:26:23.181 INFO:tasks.workunit.client.0.smithi120.stdout:8/606: dread - d2/d37/d3e/d42/d9e/fb5 zero size 2021-04-09T18:26:23.185 INFO:tasks.workunit.client.0.smithi120.stdout:7/678: dwrite db/d42/d54/fa2 [0,4194304] 0 2021-04-09T18:26:23.211 INFO:tasks.workunit.client.0.smithi120.stdout:6/683: dread d6/d8/db/f39 [4194304,4194304] 0 2021-04-09T18:26:23.216 INFO:tasks.workunit.client.0.smithi120.stdout:4/565: dwrite d1f/f23 [4194304,4194304] 0 2021-04-09T18:26:23.323 INFO:tasks.workunit.client.0.smithi120.stdout:3/716: write d3/d5/d36/dac/fb8 [4178391,46472] 0 2021-04-09T18:26:23.326 INFO:tasks.workunit.client.0.smithi120.stdout:4/566: write d1f/d24/f26 [8157223,12422] 0 2021-04-09T18:26:23.328 INFO:tasks.workunit.client.0.smithi120.stdout:6/684: dread d6/d8/d3a/d56/d97/fc0 [0,4194304] 0 2021-04-09T18:26:23.328 INFO:tasks.workunit.client.0.smithi120.stdout:3/717: chown d3/d5/d36/d1e/d6b/d49/d89/dd0/l85 1271766521 1 2021-04-09T18:26:23.332 INFO:tasks.workunit.client.0.smithi120.stdout:8/607: dwrite d2/d3/f8a [0,4194304] 0 2021-04-09T18:26:23.337 INFO:tasks.workunit.client.0.smithi120.stdout:3/718: mkdir d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9 0 2021-04-09T18:26:23.337 INFO:tasks.workunit.client.0.smithi120.stdout:4/567: creat d1f/d2c/d34/fbb x:0 0 0 2021-04-09T18:26:23.341 INFO:tasks.workunit.client.0.smithi120.stdout:8/608: symlink d2/d37/lb6 0 2021-04-09T18:26:23.342 INFO:tasks.workunit.client.0.smithi120.stdout:4/568: creat d1f/d2c/d34/d83/fbc x:0 0 0 2021-04-09T18:26:23.343 INFO:tasks.workunit.client.0.smithi120.stdout:4/569: chown d1f/f23 214301697 1 2021-04-09T18:26:23.345 INFO:tasks.workunit.client.0.smithi120.stdout:3/719: mkdir d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/dc3/dea 0 2021-04-09T18:26:23.347 INFO:tasks.workunit.client.0.smithi120.stdout:6/685: truncate d6/d8/f13 2300488 0 2021-04-09T18:26:23.354 INFO:tasks.workunit.client.0.smithi120.stdout:3/720: symlink d3/d5/d36/leb 0 2021-04-09T18:26:23.361 INFO:tasks.workunit.client.0.smithi120.stdout:4/570: write d1f/d24/f9c [48131,77815] 0 2021-04-09T18:26:23.362 INFO:tasks.workunit.client.0.smithi120.stdout:4/571: chown d1f/d24/f26 158 1 2021-04-09T18:26:23.369 INFO:tasks.workunit.client.0.smithi120.stdout:4/572: dwrite d1f/fb0 [0,4194304] 0 2021-04-09T18:26:23.373 INFO:tasks.workunit.client.0.smithi120.stdout:9/751: read d19/d24/d9e/ffb [8726,112093] 0 2021-04-09T18:26:23.373 INFO:tasks.workunit.client.0.smithi120.stdout:9/752: write d19/d24/d36/fd4 [259466,67449] 0 2021-04-09T18:26:23.387 INFO:tasks.workunit.client.0.smithi120.stdout:6/686: dwrite d6/d8/d1a/dc7/f7e [0,4194304] 0 2021-04-09T18:26:23.391 INFO:tasks.workunit.client.0.smithi120.stdout:9/753: rename d19/d24/d2e/f3c to d19/d2c/dc8/f100 0 2021-04-09T18:26:23.393 INFO:tasks.workunit.client.0.smithi120.stdout:2/720: dread d13/f47 [0,4194304] 0 2021-04-09T18:26:23.402 INFO:tasks.workunit.client.0.smithi120.stdout:6/687: unlink d6/d8/db/d2b/f2e 0 2021-04-09T18:26:23.404 INFO:tasks.workunit.client.0.smithi120.stdout:2/721: dwrite d13/d7a/d80/d48/d49/d76/f82 [4194304,4194304] 0 2021-04-09T18:26:23.410 INFO:tasks.workunit.client.0.smithi120.stdout:4/573: link d1f/d24/f33 d1f/d2c/d30/fbd 0 2021-04-09T18:26:23.425 INFO:tasks.workunit.client.0.smithi120.stdout:4/574: mkdir d1f/d2c/d34/d60/d7a/d92/d84/dbe 0 2021-04-09T18:26:23.426 INFO:tasks.workunit.client.0.smithi120.stdout:5/826: dread d10/d12/fee [0,4194304] 0 2021-04-09T18:26:23.431 INFO:tasks.workunit.client.0.smithi120.stdout:2/722: unlink d13/d7a/d80/l6c 0 2021-04-09T18:26:23.435 INFO:tasks.workunit.client.0.smithi120.stdout:5/827: readlink d10/d12/d1b/d1f/d84/d3d/d50/l5d 0 2021-04-09T18:26:23.437 INFO:tasks.workunit.client.0.smithi120.stdout:2/723: dwrite d13/d7a/d80/d48/d58/f65 [4194304,4194304] 0 2021-04-09T18:26:23.439 INFO:tasks.workunit.client.0.smithi120.stdout:4/575: rename d1f/d2c/d34/fbb to d1f/d2c/d56/da4/fbf 0 2021-04-09T18:26:23.442 INFO:tasks.workunit.client.0.smithi120.stdout:8/609: truncate d2/d3/d11/f1f 4985420 0 2021-04-09T18:26:23.447 INFO:tasks.workunit.client.0.smithi120.stdout:5/828: read d10/fae [320491,48724] 0 2021-04-09T18:26:23.452 INFO:tasks.workunit.client.0.smithi120.stdout:2/724: mkdir d13/d84/df4 0 2021-04-09T18:26:23.452 INFO:tasks.workunit.client.0.smithi120.stdout:4/576: fsync d1f/f9f 0 2021-04-09T18:26:23.453 INFO:tasks.workunit.client.0.smithi120.stdout:9/754: write d19/d24/d37/d40/d89/d52/f59 [407879,14843] 0 2021-04-09T18:26:23.455 INFO:tasks.workunit.client.0.smithi120.stdout:8/610: dwrite d2/d3/d8/fb0 [0,4194304] 0 2021-04-09T18:26:23.461 INFO:tasks.workunit.client.0.smithi120.stdout:1/707: sync 2021-04-09T18:26:23.461 INFO:tasks.workunit.client.0.smithi120.stdout:5/829: symlink d10/daa/ddc/d11d/l126 0 2021-04-09T18:26:23.462 INFO:tasks.workunit.client.0.smithi120.stdout:6/688: dread d6/d8/f13 [0,4194304] 0 2021-04-09T18:26:23.463 INFO:tasks.workunit.client.0.smithi120.stdout:4/577: unlink d1f/d24/d42/da0/la1 0 2021-04-09T18:26:23.469 INFO:tasks.workunit.client.0.smithi120.stdout:9/755: unlink d19/l26 0 2021-04-09T18:26:23.470 INFO:tasks.workunit.client.0.smithi120.stdout:8/611: mknod d2/d37/d3e/d7c/d7a/cb7 1 2021-04-09T18:26:23.470 INFO:tasks.workunit.client.0.smithi120.stdout:6/689: creat d6/d8/db/d2b/d4d/fee x:0 0 0 2021-04-09T18:26:23.472 INFO:tasks.workunit.client.0.smithi120.stdout:8/612: mknod d2/d37/d3e/d42/d9e/cb8 1 2021-04-09T18:26:23.479 INFO:tasks.workunit.client.0.smithi120.stdout:1/708: creat d5/d5c/d75/daf/d2b/dd4/ff7 x:0 0 0 2021-04-09T18:26:23.481 INFO:tasks.workunit.client.0.smithi120.stdout:8/613: fsync d2/d37/d3e/d7c/f7b 0 2021-04-09T18:26:23.482 INFO:tasks.workunit.client.0.smithi120.stdout:8/614: chown d2/d3/d11 599008 1 2021-04-09T18:26:23.482 INFO:tasks.workunit.client.0.smithi120.stdout:8/615: chown d2/d37/d3e/d7c/d99 14080555 1 2021-04-09T18:26:23.483 INFO:tasks.workunit.client.0.smithi120.stdout:4/578: creat d1f/d2c/d34/d60/d7a/d92/da6/fc0 x:0 0 0 2021-04-09T18:26:23.489 INFO:tasks.workunit.client.0.smithi120.stdout:2/725: getdents d13/d7a/d80/d48/d49 0 2021-04-09T18:26:23.492 INFO:tasks.workunit.client.0.smithi120.stdout:8/616: creat d2/d37/d3e/fb9 x:0 0 0 2021-04-09T18:26:23.493 INFO:tasks.workunit.client.0.smithi120.stdout:8/617: write d2/d37/d3e/d7c/d99/f9a [809050,82188] 0 2021-04-09T18:26:23.494 INFO:tasks.workunit.client.0.smithi120.stdout:2/726: symlink d13/d7a/d80/dc9/lf5 0 2021-04-09T18:26:23.495 INFO:tasks.workunit.client.0.smithi120.stdout:5/830: write d10/d12/d1b/d1f/d39/f80 [822754,28550] 0 2021-04-09T18:26:23.496 INFO:tasks.workunit.client.0.smithi120.stdout:2/727: chown d13/d7a/d80/d48/d49/d64/d9d/dec 114 1 2021-04-09T18:26:23.499 INFO:tasks.workunit.client.0.smithi120.stdout:2/728: read d13/d15/f2a [9543428,50732] 0 2021-04-09T18:26:23.500 INFO:tasks.workunit.client.0.smithi120.stdout:8/618: rmdir d2/d37/d3e/d42 39 2021-04-09T18:26:23.507 INFO:tasks.workunit.client.0.smithi120.stdout:2/729: read d13/f18 [6587700,4290] 0 2021-04-09T18:26:23.509 INFO:tasks.workunit.client.0.smithi120.stdout:2/730: read d13/d7a/d80/d48/d49/d64/fb4 [278975,40890] 0 2021-04-09T18:26:23.513 INFO:tasks.workunit.client.0.smithi120.stdout:2/731: dwrite d13/d15/d35/f68 [4194304,4194304] 0 2021-04-09T18:26:23.514 INFO:tasks.workunit.client.0.smithi120.stdout:2/732: stat d13/d7a/d80/d48/da3/fb6 0 2021-04-09T18:26:23.516 INFO:tasks.workunit.client.0.smithi120.stdout:8/619: chown d2/d3/d8/l22 2788156 1 2021-04-09T18:26:23.518 INFO:tasks.workunit.client.0.smithi120.stdout:4/579: link d1f/d2c/d56/d6a/la7 d1f/d2c/d34/lc1 0 2021-04-09T18:26:23.584 INFO:tasks.workunit.client.0.smithi120.stdout:4/580: creat d1f/d2c/d34/d60/d7a/d4f/fc2 x:0 0 0 2021-04-09T18:26:23.588 INFO:tasks.workunit.client.0.smithi120.stdout:2/733: write d13/d15/d35/f3e [150216,14294] 0 2021-04-09T18:26:23.593 INFO:tasks.workunit.client.0.smithi120.stdout:8/620: dwrite d2/d3/d11/d6a/d3b/d6b/da9/fa1 [0,4194304] 0 2021-04-09T18:26:23.610 INFO:tasks.workunit.client.0.smithi120.stdout:8/621: dwrite d2/d37/d3e/d7c/d99/fa5 [0,4194304] 0 2021-04-09T18:26:23.618 INFO:tasks.workunit.client.0.smithi120.stdout:2/734: dread d13/d15/f24 [0,4194304] 0 2021-04-09T18:26:23.619 INFO:tasks.workunit.client.0.smithi120.stdout:8/622: write d2/d3/d3c/d4f/f8e [4577396,113416] 0 2021-04-09T18:26:23.621 INFO:tasks.workunit.client.0.smithi120.stdout:4/581: truncate d1f/d2c/d34/d60/d7a/d92/d3e/d77/fb3 82997 0 2021-04-09T18:26:23.624 INFO:tasks.workunit.client.0.smithi120.stdout:2/735: symlink d13/d7a/d80/d48/lf6 0 2021-04-09T18:26:23.624 INFO:tasks.workunit.client.0.smithi120.stdout:8/623: dread d2/d3/d3c/d4f/f83 [0,4194304] 0 2021-04-09T18:26:23.627 INFO:tasks.workunit.client.0.smithi120.stdout:2/736: fsync d13/d7a/d80/d54/fa0 0 2021-04-09T18:26:23.629 INFO:tasks.workunit.client.0.smithi120.stdout:8/624: creat d2/d37/fba x:0 0 0 2021-04-09T18:26:23.634 INFO:tasks.workunit.client.0.smithi120.stdout:8/625: mkdir d2/d3/d11/d6a/d3b/dbb 0 2021-04-09T18:26:23.638 INFO:tasks.workunit.client.0.smithi120.stdout:4/582: dread d1f/d2c/d34/d60/d7a/d92/d3e/d77/fb3 [0,4194304] 0 2021-04-09T18:26:23.640 INFO:tasks.workunit.client.0.smithi120.stdout:4/583: read - d1f/d2c/f96 zero size 2021-04-09T18:26:23.642 INFO:tasks.workunit.client.0.smithi120.stdout:8/626: rename d2/d37/f7e to d2/d3/d50/fbc 0 2021-04-09T18:26:23.645 INFO:tasks.workunit.client.0.smithi120.stdout:8/627: stat d2/d37/d3e/fb9 0 2021-04-09T18:26:23.647 INFO:tasks.workunit.client.0.smithi120.stdout:4/584: dwrite d1f/d2c/d34/d60/d7a/d4f/fc2 [0,4194304] 0 2021-04-09T18:26:23.648 INFO:tasks.workunit.client.0.smithi120.stdout:8/628: mkdir d2/d3/d11/dbd 0 2021-04-09T18:26:23.650 INFO:tasks.workunit.client.0.smithi120.stdout:4/585: stat d1f/d2c/d56/da4/l59 0 2021-04-09T18:26:23.659 INFO:tasks.workunit.client.0.smithi120.stdout:2/737: truncate d13/d15/d35/f5b 485144 0 2021-04-09T18:26:23.660 INFO:tasks.workunit.client.0.smithi120.stdout:2/738: chown d13/d7a/d80/d48/d49/d64/d9d/ld3 28997536 1 2021-04-09T18:26:23.681 INFO:tasks.workunit.client.0.smithi120.stdout:3/721: dread d3/d5/d36/d1e/d38/d6d/f92 [0,4194304] 0 2021-04-09T18:26:23.683 INFO:tasks.workunit.client.0.smithi120.stdout:3/722: dread d3/d5/d36/d1e/d6b/d49/d4e/f8c [0,4194304] 0 2021-04-09T18:26:23.685 INFO:tasks.workunit.client.0.smithi120.stdout:3/723: rename d3/d5/d36/d1e to d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/dc3/dec 22 2021-04-09T18:26:23.687 INFO:tasks.workunit.client.0.smithi120.stdout:3/724: read d3/de/f1b [2861552,75696] 0 2021-04-09T18:26:23.690 INFO:tasks.workunit.client.0.smithi120.stdout:3/725: fsync d3/de/d25/f22 0 2021-04-09T18:26:23.691 INFO:tasks.workunit.client.0.smithi120.stdout:3/726: write d3/d5/f4d [6794721,33975] 0 2021-04-09T18:26:23.698 INFO:tasks.workunit.client.0.smithi120.stdout:8/629: dwrite d2/d3/d11/d6a/d3b/f2b [4194304,4194304] 0 2021-04-09T18:26:23.700 INFO:tasks.workunit.client.0.smithi120.stdout:8/630: fdatasync d2/d37/d3e/d42/d9e/fb5 0 2021-04-09T18:26:23.702 INFO:tasks.workunit.client.0.smithi120.stdout:8/631: write d2/d3/d11/d6a/d3b/f72 [1744335,10035] 0 2021-04-09T18:26:23.708 INFO:tasks.workunit.client.0.smithi120.stdout:8/632: read - d2/d3/d11/d6a/d3b/f80 zero size 2021-04-09T18:26:23.711 INFO:tasks.workunit.client.0.smithi120.stdout:3/727: dread d3/de/d25/f22 [0,4194304] 0 2021-04-09T18:26:23.719 INFO:tasks.workunit.client.0.smithi120.stdout:3/728: creat d3/d5/d36/d1e/d6b/d49/d4e/fed x:0 0 0 2021-04-09T18:26:23.722 INFO:tasks.workunit.client.0.smithi120.stdout:3/729: fsync d3/d5/d36/d1e/d6b/d49/d89/d68/f41 0 2021-04-09T18:26:23.725 INFO:tasks.workunit.client.0.smithi120.stdout:3/730: write d3/d5/d36/d1e/d6b/d49/fa9 [1095443,5087] 0 2021-04-09T18:26:23.730 INFO:tasks.workunit.client.0.smithi120.stdout:3/731: truncate d3/d5/f74 4512447 0 2021-04-09T18:26:23.733 INFO:tasks.workunit.client.0.smithi120.stdout:3/732: write d3/d5/d36/d1e/d6b/d49/d4e/f8c [865742,97548] 0 2021-04-09T18:26:23.738 INFO:tasks.workunit.client.0.smithi120.stdout:3/733: unlink d3/d5/d36/d1e/d38/d6d/fe6 0 2021-04-09T18:26:23.740 INFO:tasks.workunit.client.0.smithi120.stdout:3/734: mknod d3/d5/d36/d1e/d6b/d49/d89/dd0/cee 1 2021-04-09T18:26:23.742 INFO:tasks.workunit.client.0.smithi120.stdout:3/735: dread - d3/d5/d36/d1e/d6b/d49/d5e/f9d zero size 2021-04-09T18:26:23.743 INFO:tasks.workunit.client.0.smithi120.stdout:4/586: dread d1f/d2c/d34/d60/d7a/d92/d3e/d73/f8b [0,4194304] 0 2021-04-09T18:26:23.743 INFO:tasks.workunit.client.0.smithi120.stdout:4/587: stat d1f/d2c/f86 0 2021-04-09T18:26:23.745 INFO:tasks.workunit.client.0.smithi120.stdout:3/736: getdents d3 0 2021-04-09T18:26:23.746 INFO:tasks.workunit.client.0.smithi120.stdout:4/588: symlink d1f/d2c/d34/d60/d7a/d92/da6/lc3 0 2021-04-09T18:26:23.749 INFO:tasks.workunit.client.0.smithi120.stdout:3/737: unlink d3/d5/d36/d1e/d6b/d49/d4e/d54/fde 0 2021-04-09T18:26:23.752 INFO:tasks.workunit.client.0.smithi120.stdout:4/589: dwrite d1f/d2c/d34/d60/d7a/d4f/fc2 [4194304,4194304] 0 2021-04-09T18:26:23.759 INFO:tasks.workunit.client.0.smithi120.stdout:4/590: creat d1f/d2c/d56/fc4 x:0 0 0 2021-04-09T18:26:23.764 INFO:tasks.workunit.client.0.smithi120.stdout:3/738: dread d3/d5/d36/d1e/d6b/d6a/d83/f93 [0,4194304] 0 2021-04-09T18:26:23.770 INFO:tasks.workunit.client.0.smithi120.stdout:3/739: unlink d3/d5/d36/d1e/d38/fd7 0 2021-04-09T18:26:23.774 INFO:tasks.workunit.client.0.smithi120.stdout:4/591: dread d1f/d2c/d30/f4d [0,4194304] 0 2021-04-09T18:26:23.775 INFO:tasks.workunit.client.0.smithi120.stdout:3/740: mknod d3/d5/d36/d1e/d6b/d6a/d83/dc7/cef 1 2021-04-09T18:26:23.778 INFO:tasks.workunit.client.0.smithi120.stdout:4/592: dread d1f/d2c/d30/f4d [0,4194304] 0 2021-04-09T18:26:23.781 INFO:tasks.workunit.client.0.smithi120.stdout:4/593: dread - d1f/d2c/d56/da4/fbf zero size 2021-04-09T18:26:23.786 INFO:tasks.workunit.client.0.smithi120.stdout:8/633: dwrite d2/d3/f28 [0,4194304] 0 2021-04-09T18:26:23.787 INFO:tasks.workunit.client.0.smithi120.stdout:4/594: truncate d1f/d2c/d34/f51 233997 0 2021-04-09T18:26:23.788 INFO:tasks.workunit.client.0.smithi120.stdout:4/595: chown d1f/d2c/d56/d6a/da5 1530 1 2021-04-09T18:26:23.790 INFO:tasks.workunit.client.0.smithi120.stdout:8/634: symlink d2/d37/d8d/d9b/lbe 0 2021-04-09T18:26:23.794 INFO:tasks.workunit.client.0.smithi120.stdout:4/596: mkdir d1f/d2c/d34/d60/d7a/d89/dc5 0 2021-04-09T18:26:23.802 INFO:tasks.workunit.client.0.smithi120.stdout:3/741: dwrite d3/de/d25/fb0 [0,4194304] 0 2021-04-09T18:26:23.806 INFO:tasks.workunit.client.0.smithi120.stdout:3/742: symlink d3/d5/d36/d1e/d6b/d49/d89/d68/da1/lf0 0 2021-04-09T18:26:23.807 INFO:tasks.workunit.client.0.smithi120.stdout:8/635: write d2/d3/d11/d6a/d3b/f47 [3166755,67826] 0 2021-04-09T18:26:23.817 INFO:tasks.workunit.client.0.smithi120.stdout:0/647: sync 2021-04-09T18:26:23.818 INFO:tasks.workunit.client.0.smithi120.stdout:8/636: rename d2/d3/d3c/db1 to d2/d3/d11/d6a/d3b/dbf 0 2021-04-09T18:26:23.820 INFO:tasks.workunit.client.0.smithi120.stdout:3/743: mkdir d3/d5/d36/d1e/df1 0 2021-04-09T18:26:23.828 INFO:tasks.workunit.client.0.smithi120.stdout:0/648: creat d0/d2/d4/fc7 x:0 0 0 2021-04-09T18:26:23.829 INFO:tasks.workunit.client.0.smithi120.stdout:0/649: readlink d0/d2/d7b/la1 0 2021-04-09T18:26:23.830 INFO:tasks.workunit.client.0.smithi120.stdout:3/744: link d3/d5/d36/d1e/laa d3/de/da6/dcc/lf2 0 2021-04-09T18:26:23.831 INFO:tasks.workunit.client.0.smithi120.stdout:0/650: mknod d0/d5a/d6c/cc8 1 2021-04-09T18:26:23.835 INFO:tasks.workunit.client.0.smithi120.stdout:0/651: dwrite d0/d2/dd/f40 [0,4194304] 0 2021-04-09T18:26:23.837 INFO:tasks.workunit.client.0.smithi120.stdout:0/652: dread - d0/d5a/d62/d69/dac/fad zero size 2021-04-09T18:26:23.838 INFO:tasks.workunit.client.0.smithi120.stdout:0/653: write d0/d2/d4/fb3 [615305,80474] 0 2021-04-09T18:26:23.839 INFO:tasks.workunit.client.0.smithi120.stdout:3/745: mknod d3/de/d25/cf3 1 2021-04-09T18:26:23.848 INFO:tasks.workunit.client.0.smithi120.stdout:0/654: symlink d0/d5a/lc9 0 2021-04-09T18:26:23.852 INFO:tasks.workunit.client.0.smithi120.stdout:2/739: dread d13/d61/f89 [0,4194304] 0 2021-04-09T18:26:23.855 INFO:tasks.workunit.client.0.smithi120.stdout:8/637: dread d2/d3/f1a [0,4194304] 0 2021-04-09T18:26:23.856 INFO:tasks.workunit.client.0.smithi120.stdout:0/655: mknod d0/d2/cca 1 2021-04-09T18:26:23.857 INFO:tasks.workunit.client.0.smithi120.stdout:2/740: creat d13/d7a/d80/d48/d49/ff7 x:0 0 0 2021-04-09T18:26:23.860 INFO:tasks.workunit.client.0.smithi120.stdout:4/597: dwrite d1f/f9f [0,4194304] 0 2021-04-09T18:26:23.863 INFO:tasks.workunit.client.0.smithi120.stdout:0/656: getdents d0/d43/d49/d87 0 2021-04-09T18:26:23.865 INFO:tasks.workunit.client.0.smithi120.stdout:8/638: creat d2/d3/fc0 x:0 0 0 2021-04-09T18:26:23.867 INFO:tasks.workunit.client.0.smithi120.stdout:0/657: dread d0/d5a/f99 [0,4194304] 0 2021-04-09T18:26:23.880 INFO:tasks.workunit.client.0.smithi120.stdout:0/658: unlink d0/l15 0 2021-04-09T18:26:23.880 INFO:tasks.workunit.client.0.smithi120.stdout:1/709: sync 2021-04-09T18:26:23.880 INFO:tasks.workunit.client.0.smithi120.stdout:6/690: sync 2021-04-09T18:26:23.880 INFO:tasks.workunit.client.0.smithi120.stdout:9/756: sync 2021-04-09T18:26:23.881 INFO:tasks.workunit.client.0.smithi120.stdout:7/679: sync 2021-04-09T18:26:23.881 INFO:tasks.workunit.client.0.smithi120.stdout:5/831: sync 2021-04-09T18:26:23.888 INFO:tasks.workunit.client.0.smithi120.stdout:0/659: dwrite d0/fc [4194304,4194304] 0 2021-04-09T18:26:23.889 INFO:tasks.workunit.client.0.smithi120.stdout:8/639: link d2/d3/d11/l5c d2/lc1 0 2021-04-09T18:26:23.891 INFO:tasks.workunit.client.0.smithi120.stdout:5/832: symlink d10/daa/ddc/d11d/d8c/da3/df6/l127 0 2021-04-09T18:26:23.895 INFO:tasks.workunit.client.0.smithi120.stdout:6/691: rename d6/d8/db/d2b/de2/d5d/deb to d6/d8/db/d12/d93/def 0 2021-04-09T18:26:23.896 INFO:tasks.workunit.client.0.smithi120.stdout:8/640: write d2/d3/d11/d6a/d3b/fa4 [5642,62308] 0 2021-04-09T18:26:23.906 INFO:tasks.workunit.client.0.smithi120.stdout:0/660: dwrite d0/d2/d4/d5f/d61/f96 [0,4194304] 0 2021-04-09T18:26:23.912 INFO:tasks.workunit.client.0.smithi120.stdout:4/598: dread d1f/d2c/d34/d60/d7a/d92/d84/f95 [0,4194304] 0 2021-04-09T18:26:23.912 INFO:tasks.workunit.client.0.smithi120.stdout:1/710: truncate d5/d5c/fef 478603 0 2021-04-09T18:26:23.913 INFO:tasks.workunit.client.0.smithi120.stdout:2/741: write d13/d7a/d80/d54/f60 [293074,14913] 0 2021-04-09T18:26:23.914 INFO:tasks.workunit.client.0.smithi120.stdout:3/746: dwrite d3/d5/d36/d1e/d38/f44 [0,4194304] 0 2021-04-09T18:26:23.918 INFO:tasks.workunit.client.0.smithi120.stdout:4/599: fdatasync d1f/d2c/d34/d60/d7a/d4f/fc2 0 2021-04-09T18:26:23.935 INFO:tasks.workunit.client.0.smithi120.stdout:9/757: dwrite d19/d24/d36/d9d/fb4 [0,4194304] 0 2021-04-09T18:26:23.936 INFO:tasks.workunit.client.0.smithi120.stdout:2/742: mkdir d13/d7a/d80/d48/de3/df8 0 2021-04-09T18:26:23.937 INFO:tasks.workunit.client.0.smithi120.stdout:5/833: dwrite d10/d12/d1b/d1f/d84/fa0 [0,4194304] 0 2021-04-09T18:26:23.937 INFO:tasks.workunit.client.0.smithi120.stdout:7/680: dwrite db/d2c/d30/d59/fa6 [8388608,4194304] 0 2021-04-09T18:26:23.942 INFO:tasks.workunit.client.0.smithi120.stdout:4/600: fsync d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f9b 0 2021-04-09T18:26:23.943 INFO:tasks.workunit.client.0.smithi120.stdout:6/692: truncate d6/d8/d1a/d36/d54/d31/d37/d61/f9a 144575 0 2021-04-09T18:26:23.946 INFO:tasks.workunit.client.0.smithi120.stdout:2/743: symlink d13/d7a/lf9 0 2021-04-09T18:26:23.946 INFO:tasks.workunit.client.0.smithi120.stdout:9/758: mkdir d19/d24/d37/d40/d89/d29/d101 0 2021-04-09T18:26:23.951 INFO:tasks.workunit.client.0.smithi120.stdout:2/744: write d13/f72 [1535325,11649] 0 2021-04-09T18:26:23.958 INFO:tasks.workunit.client.0.smithi120.stdout:6/693: mknod d6/d8/db/d2b/cf0 1 2021-04-09T18:26:23.958 INFO:tasks.workunit.client.0.smithi120.stdout:5/834: link d10/daa/db4/fdb d10/daa/ddc/d11d/f128 0 2021-04-09T18:26:23.970 INFO:tasks.workunit.client.0.smithi120.stdout:2/745: dwrite d13/f47 [0,4194304] 0 2021-04-09T18:26:23.974 INFO:tasks.workunit.client.0.smithi120.stdout:0/661: rename d0/d2/dd/f38 to d0/d2/d4/fcb 0 2021-04-09T18:26:23.979 INFO:tasks.workunit.client.0.smithi120.stdout:1/711: dwrite d5/fb7 [0,4194304] 0 2021-04-09T18:26:23.985 INFO:tasks.workunit.client.0.smithi120.stdout:0/662: symlink d0/d2/dd/lcc 0 2021-04-09T18:26:23.989 INFO:tasks.workunit.client.0.smithi120.stdout:7/681: rename db/d38/d74/fd0 to db/d38/fe8 0 2021-04-09T18:26:23.998 INFO:tasks.workunit.client.0.smithi120.stdout:4/601: dwrite d1f/d2c/d34/f51 [0,4194304] 0 2021-04-09T18:26:24.000 INFO:tasks.workunit.client.0.smithi120.stdout:0/663: dwrite d0/d2/f60 [0,4194304] 0 2021-04-09T18:26:24.010 INFO:tasks.workunit.client.0.smithi120.stdout:6/694: rename d6/d8/d1a/d36/d54/d41/d49/d94 to d6/d8/d1a/d36/d54/d31/df1 0 2021-04-09T18:26:24.014 INFO:tasks.workunit.client.0.smithi120.stdout:6/695: read d6/d8/f13 [309919,98224] 0 2021-04-09T18:26:24.027 INFO:tasks.workunit.client.0.smithi120.stdout:6/696: chown d6/d8/d1a/d36/d54/d31/d37/d61/f9e 0 1 2021-04-09T18:26:24.031 INFO:tasks.workunit.client.0.smithi120.stdout:6/697: mkdir d6/d8/d52/ddf/df2 0 2021-04-09T18:26:24.034 INFO:tasks.workunit.client.0.smithi120.stdout:5/835: rename d10/d12/d1b/d3a/d5b/d78/l100 to d10/daa/ddc/d11d/d8c/da6/l129 0 2021-04-09T18:26:24.036 INFO:tasks.workunit.client.0.smithi120.stdout:6/698: symlink d6/d8/d1a/d36/d54/d31/df1/lf3 0 2021-04-09T18:26:24.037 INFO:tasks.workunit.client.0.smithi120.stdout:6/699: write d6/d8/db/d2b/de2/d5d/d6e/f80 [1992594,117254] 0 2021-04-09T18:26:24.038 INFO:tasks.workunit.client.0.smithi120.stdout:9/759: rename d19/d24/d37/d40/d89/d29/d76/f91 to d19/d24/d36/d47/dbe/ddf/f102 0 2021-04-09T18:26:24.039 INFO:tasks.workunit.client.0.smithi120.stdout:9/760: readlink d19/d24/d36/d47/d6f/lbf 0 2021-04-09T18:26:24.041 INFO:tasks.workunit.client.0.smithi120.stdout:6/700: stat d6/d8/db/d92/db0 0 2021-04-09T18:26:24.046 INFO:tasks.workunit.client.0.smithi120.stdout:4/602: dwrite d1f/d2c/d34/d60/d7a/d92/d3e/d77/fb3 [0,4194304] 0 2021-04-09T18:26:24.051 INFO:tasks.workunit.client.0.smithi120.stdout:6/701: creat d6/d8/d1a/d36/d54/d31/d37/ff4 x:0 0 0 2021-04-09T18:26:24.051 INFO:tasks.workunit.client.0.smithi120.stdout:0/664: truncate d0/d2/da/f7a 676143 0 2021-04-09T18:26:24.055 INFO:tasks.workunit.client.0.smithi120.stdout:9/761: dwrite d19/d24/dd8/fd9 [0,4194304] 0 2021-04-09T18:26:24.062 INFO:tasks.workunit.client.0.smithi120.stdout:4/603: rename d1f/d2c/d34/d60/d7a/d89 to d1f/d2c/d30/dc6 0 2021-04-09T18:26:24.068 INFO:tasks.workunit.client.0.smithi120.stdout:5/836: dwrite d10/d12/d3b/fb0 [0,4194304] 0 2021-04-09T18:26:24.068 INFO:tasks.workunit.client.0.smithi120.stdout:4/604: unlink d1f/d2c/d34/d60/d7a/d92/d3e/f43 0 2021-04-09T18:26:24.072 INFO:tasks.workunit.client.0.smithi120.stdout:4/605: mknod d1f/d24/d42/cc7 1 2021-04-09T18:26:24.074 INFO:tasks.workunit.client.0.smithi120.stdout:9/762: rename d19/d24/f90 to d19/d24/d36/da8/f103 0 2021-04-09T18:26:24.084 INFO:tasks.workunit.client.0.smithi120.stdout:9/763: symlink d19/d24/d36/d47/d4b/l104 0 2021-04-09T18:26:24.085 INFO:tasks.workunit.client.0.smithi120.stdout:6/702: write d6/d8/db/dac/fd6 [5398227,41529] 0 2021-04-09T18:26:24.105 INFO:tasks.workunit.client.0.smithi120.stdout:4/606: link lc d1f/d2c/d56/lc8 0 2021-04-09T18:26:24.106 INFO:tasks.workunit.client.0.smithi120.stdout:9/764: symlink d19/d24/d37/d40/d89/d52/l105 0 2021-04-09T18:26:24.109 INFO:tasks.workunit.client.0.smithi120.stdout:6/703: link d6/d8/d1a/d36/d54/d41/d49/f7c d6/d8/db/d92/db0/ff5 0 2021-04-09T18:26:24.110 INFO:tasks.workunit.client.0.smithi120.stdout:9/765: fdatasync f12 0 2021-04-09T18:26:24.111 INFO:tasks.workunit.client.0.smithi120.stdout:4/607: dwrite d1f/d2c/d34/d60/d7a/d92/d3e/f54 [0,4194304] 0 2021-04-09T18:26:24.112 INFO:tasks.workunit.client.0.smithi120.stdout:9/766: dread - d19/d24/d36/d47/d4b/fe6 zero size 2021-04-09T18:26:24.113 INFO:tasks.workunit.client.0.smithi120.stdout:6/704: creat d6/d8/db/d12/d93/dc2/ff6 x:0 0 0 2021-04-09T18:26:24.119 INFO:tasks.workunit.client.0.smithi120.stdout:4/608: dread d1f/f23 [4194304,4194304] 0 2021-04-09T18:26:24.120 INFO:tasks.workunit.client.0.smithi120.stdout:9/767: mkdir d19/d24/dd8/d106 0 2021-04-09T18:26:24.123 INFO:tasks.workunit.client.0.smithi120.stdout:6/705: dwrite d6/d8/d1a/d36/d54/d31/fe7 [0,4194304] 0 2021-04-09T18:26:24.132 INFO:tasks.workunit.client.0.smithi120.stdout:5/837: dwrite d10/d12/fbf [0,4194304] 0 2021-04-09T18:26:24.132 INFO:tasks.workunit.client.0.smithi120.stdout:5/838: readlink d10/d12/d1b/d1f/d39/l40 0 2021-04-09T18:26:24.137 INFO:tasks.workunit.client.0.smithi120.stdout:5/839: readlink d10/daa/ddc/d11d/d8c/l5f 0 2021-04-09T18:26:24.138 INFO:tasks.workunit.client.0.smithi120.stdout:7/682: read db/d42/fa8 [497289,121516] 0 2021-04-09T18:26:24.140 INFO:tasks.workunit.client.0.smithi120.stdout:7/683: readlink db/d26/d4c/d53/l56 0 2021-04-09T18:26:24.156 INFO:tasks.workunit.client.0.smithi120.stdout:7/684: fsync db/dbf/fce 0 2021-04-09T18:26:24.157 INFO:tasks.workunit.client.0.smithi120.stdout:5/840: symlink d10/d12/d1b/d1f/d39/dab/d115/l12a 0 2021-04-09T18:26:24.161 INFO:tasks.workunit.client.0.smithi120.stdout:6/706: rename d6/d8/d3a/l63 to d6/d8/db/d12/d93/def/lf7 0 2021-04-09T18:26:24.161 INFO:tasks.workunit.client.0.smithi120.stdout:6/707: chown d6/d8/d52 1 1 2021-04-09T18:26:24.163 INFO:tasks.workunit.client.0.smithi120.stdout:6/708: dread - d6/d8/db/d2b/d4d/db8/fdc zero size 2021-04-09T18:26:24.164 INFO:tasks.workunit.client.0.smithi120.stdout:7/685: unlink db/f15 0 2021-04-09T18:26:24.170 INFO:tasks.workunit.client.0.smithi120.stdout:9/768: read d19/d24/d37/d40/f56 [3441625,45442] 0 2021-04-09T18:26:24.171 INFO:tasks.workunit.client.0.smithi120.stdout:5/841: mkdir d10/d12/d1b/d1f/d39/dbb/d12b 0 2021-04-09T18:26:24.187 INFO:tasks.workunit.client.0.smithi120.stdout:5/842: dread - d10/d12/d1b/d3a/ffd zero size 2021-04-09T18:26:24.189 INFO:tasks.workunit.client.0.smithi120.stdout:6/709: read d6/d8/d1a/d36/d54/d41/d49/f4f [962997,45970] 0 2021-04-09T18:26:24.189 INFO:tasks.workunit.client.0.smithi120.stdout:7/686: unlink db/d2c/d30/l63 0 2021-04-09T18:26:24.192 INFO:tasks.workunit.client.0.smithi120.stdout:5/843: creat d10/f12c x:0 0 0 2021-04-09T18:26:24.193 INFO:tasks.workunit.client.0.smithi120.stdout:6/710: chown d6/d8/db/d12/d93/f9f 1 1 2021-04-09T18:26:24.193 INFO:tasks.workunit.client.0.smithi120.stdout:7/687: fsync db/d38/d74/d6f/d76/fe4 0 2021-04-09T18:26:24.194 INFO:tasks.workunit.client.0.smithi120.stdout:1/712: dread d5/d64/d2d/f3a [4194304,4194304] 0 2021-04-09T18:26:24.201 INFO:tasks.workunit.client.0.smithi120.stdout:6/711: fsync d6/d8/db/d2b/de2/d5d/d6e/fe6 0 2021-04-09T18:26:24.207 INFO:tasks.workunit.client.0.smithi120.stdout:4/609: truncate d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f8a 1072588 0 2021-04-09T18:26:24.209 INFO:tasks.workunit.client.0.smithi120.stdout:4/610: chown d1f/d2c/d34/d60/d7a/d4f/f91 633564714 1 2021-04-09T18:26:24.211 INFO:tasks.workunit.client.0.smithi120.stdout:4/611: fsync d1f/f8d 0 2021-04-09T18:26:24.212 INFO:tasks.workunit.client.0.smithi120.stdout:1/713: link d5/d5c/d75/daf/dc7/lc1 d5/d5c/d75/daf/dc7/d61/deb/d7c/lf8 0 2021-04-09T18:26:24.217 INFO:tasks.workunit.client.0.smithi120.stdout:4/612: creat d1f/d2c/d34/d60/d7a/d92/d84/fc9 x:0 0 0 2021-04-09T18:26:24.220 INFO:tasks.workunit.client.0.smithi120.stdout:1/714: rename d5/d64/d63 to d5/d64/df9 0 2021-04-09T18:26:24.220 INFO:tasks.workunit.client.0.smithi120.stdout:6/712: dread d6/d8/db/d2b/f6f [0,4194304] 0 2021-04-09T18:26:24.225 INFO:tasks.workunit.client.0.smithi120.stdout:6/713: creat d6/ff8 x:0 0 0 2021-04-09T18:26:24.225 INFO:tasks.workunit.client.0.smithi120.stdout:4/613: dwrite d1f/f9f [4194304,4194304] 0 2021-04-09T18:26:24.226 INFO:tasks.workunit.client.0.smithi120.stdout:5/844: dwrite d10/d12/d1b/d1f/d84/d3d/d50/da9/fed [0,4194304] 0 2021-04-09T18:26:24.231 INFO:tasks.workunit.client.0.smithi120.stdout:4/614: mkdir d1f/d2c/d56/dca 0 2021-04-09T18:26:24.232 INFO:tasks.workunit.client.0.smithi120.stdout:1/715: dwrite d5/d5c/d75/daf/d2b/ff4 [0,4194304] 0 2021-04-09T18:26:24.233 INFO:tasks.workunit.client.0.smithi120.stdout:6/714: link d6/d8/db/d2b/de2/d5d/d6e/fe6 d6/d8/db/d2b/d4d/ff9 0 2021-04-09T18:26:24.245 INFO:tasks.workunit.client.0.smithi120.stdout:5/845: creat d10/daa/ddc/d11d/d8c/da6/dcc/f12d x:0 0 0 2021-04-09T18:26:24.245 INFO:tasks.workunit.client.0.smithi120.stdout:4/615: rename d1f/d24/d42/da0/fa9 to d1f/d2c/d34/d60/dad/fcb 0 2021-04-09T18:26:24.251 INFO:tasks.workunit.client.0.smithi120.stdout:1/716: mkdir d5/d5c/d75/daf/d2b/d8e/dfa 0 2021-04-09T18:26:24.255 INFO:tasks.workunit.client.0.smithi120.stdout:4/616: dwrite d1f/d24/f9c [0,4194304] 0 2021-04-09T18:26:24.256 INFO:tasks.workunit.client.0.smithi120.stdout:5/846: rmdir d10/d12/d1b/d1f/d84/df0 0 2021-04-09T18:26:24.260 INFO:tasks.workunit.client.0.smithi120.stdout:4/617: symlink d1f/d2c/d34/d60/d7a/d92/d3e/d77/lcc 0 2021-04-09T18:26:24.262 INFO:tasks.workunit.client.0.smithi120.stdout:4/618: chown d1f/d2c/d34/d60/d7a/d92/d3e/f54 1726227 1 2021-04-09T18:26:24.262 INFO:tasks.workunit.client.0.smithi120.stdout:7/688: dread db/d42/d54/d5a/f64 [0,4194304] 0 2021-04-09T18:26:24.263 INFO:tasks.workunit.client.0.smithi120.stdout:4/619: write d1f/d2c/d34/f51 [1128552,39226] 0 2021-04-09T18:26:24.264 INFO:tasks.workunit.client.0.smithi120.stdout:7/689: mknod db/d38/d3c/ce9 1 2021-04-09T18:26:24.268 INFO:tasks.workunit.client.0.smithi120.stdout:7/690: creat db/d38/d3c/d6e/fea x:0 0 0 2021-04-09T18:26:24.272 INFO:tasks.workunit.client.0.smithi120.stdout:4/620: creat d1f/d2c/d34/d60/d7a/d4f/fcd x:0 0 0 2021-04-09T18:26:24.272 INFO:tasks.workunit.client.0.smithi120.stdout:4/621: chown d1f/l22 13708013 1 2021-04-09T18:26:24.274 INFO:tasks.workunit.client.0.smithi120.stdout:4/622: read - d1f/d2c/d34/d60/d7a/d4f/fb5 zero size 2021-04-09T18:26:24.275 INFO:tasks.workunit.client.0.smithi120.stdout:4/623: stat d1f/d2c/d34/d60/d7a/d92/d3e/f48 0 2021-04-09T18:26:24.277 INFO:tasks.workunit.client.0.smithi120.stdout:4/624: write d1f/d2c/d34/d60/d7a/d92/d3e/d73/fb1 [849098,44436] 0 2021-04-09T18:26:24.281 INFO:tasks.workunit.client.0.smithi120.stdout:4/625: mkdir d1f/d2c/d34/d60/d7a/d4f/dce 0 2021-04-09T18:26:24.282 INFO:tasks.workunit.client.0.smithi120.stdout:4/626: readlink d1f/d24/l9a 0 2021-04-09T18:26:24.286 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:24.286 INFO:tasks.workunit.client.0.smithi120.stdout:4/627: symlink d1f/d2c/d34/d60/d7a/lcf 0 2021-04-09T18:26:24.289 INFO:tasks.workunit.client.0.smithi120.stdout:4/628: mkdir d1f/d2c/d34/d60/d7a/d92/d84/dd0 0 2021-04-09T18:26:24.328 INFO:tasks.workunit.client.0.smithi120.stdout:8/641: sync 2021-04-09T18:26:24.331 INFO:tasks.workunit.client.0.smithi120.stdout:8/642: creat d2/d3/d3c/fc2 x:0 0 0 2021-04-09T18:26:24.331 INFO:tasks.workunit.client.0.smithi120.stdout:8/643: stat d2/d3/f8a 0 2021-04-09T18:26:24.339 INFO:tasks.workunit.client.0.smithi120.stdout:8/644: dread d2/d3/d11/d6a/d3b/f77 [0,4194304] 0 2021-04-09T18:26:24.342 INFO:tasks.workunit.client.0.smithi120.stdout:8/645: dread d2/d37/d3e/d7c/d99/fa5 [0,4194304] 0 2021-04-09T18:26:24.345 INFO:tasks.workunit.client.0.smithi120.stdout:8/646: creat d2/d37/fc3 x:0 0 0 2021-04-09T18:26:24.395 INFO:tasks.workunit.client.0.smithi120.stdout:8/647: chown d2/d3/d11/d6a 1879 1 2021-04-09T18:26:24.398 INFO:tasks.workunit.client.0.smithi120.stdout:8/648: creat d2/d37/d3e/d7c/fc4 x:0 0 0 2021-04-09T18:26:24.400 INFO:tasks.workunit.client.0.smithi120.stdout:8/649: mkdir d2/d3/d8/dc5 0 2021-04-09T18:26:24.405 INFO:tasks.workunit.client.0.smithi120.stdout:8/650: truncate d2/d3/d3c/f68 3289285 0 2021-04-09T18:26:24.411 INFO:tasks.workunit.client.0.smithi120.stdout:8/651: dwrite d2/d3/d11/d6a/d3b/d6b/da9/fa1 [0,4194304] 0 2021-04-09T18:26:24.418 INFO:tasks.workunit.client.0.smithi120.stdout:8/652: dwrite d2/d37/d3e/d7c/d99/fa5 [0,4194304] 0 2021-04-09T18:26:24.432 INFO:tasks.workunit.client.0.smithi120.stdout:8/653: readlink d2/d3/d11/l92 0 2021-04-09T18:26:24.442 INFO:tasks.workunit.client.0.smithi120.stdout:8/654: unlink d2/d37/l6c 0 2021-04-09T18:26:24.452 INFO:tasks.workunit.client.0.smithi120.stdout:4/629: write d1f/d2c/d56/da4/faa [2914126,54943] 0 2021-04-09T18:26:24.463 INFO:tasks.workunit.client.0.smithi120.stdout:4/630: creat d1f/d2c/d30/dc6/da8/fd1 x:0 0 0 2021-04-09T18:26:24.463 INFO:tasks.workunit.client.0.smithi120.stdout:4/631: read d1f/d24/f9c [2034049,48203] 0 2021-04-09T18:26:24.473 INFO:tasks.workunit.client.0.smithi120.stdout:8/655: dwrite d2/d3/d11/ff [4194304,4194304] 0 2021-04-09T18:26:24.475 INFO:tasks.workunit.client.0.smithi120.stdout:8/656: mkdir d2/d37/d8d/dc6 0 2021-04-09T18:26:24.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.496 7fe004c89700 1 Processor -- start 2021-04-09T18:26:24.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.496 7fe004c89700 1 -- start start 2021-04-09T18:26:24.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.496 7fe004c89700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe0000d7160 0x7fe0000d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.496 7fe004c89700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe0000d55a0 0x7fe0000d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.496 7fe004c89700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0000d6be0 con 0x7fe0000d5fc0 2021-04-09T18:26:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.496 7fe004c89700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000d80f0 con 0x7fe0000d55a0 2021-04-09T18:26:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.496 7fe004c89700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0001a2ac0 con 0x7fe0000d7160 2021-04-09T18:26:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffe05d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe0000d55a0 0x7fe0000d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffe05d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe0000d55a0 0x7fe0000d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56850/0 (socket says 172.21.15.120:56850) 2021-04-09T18:26:24.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffe05d700 1 -- 172.21.15.120:0/1657458278 learned_addr learned my addr 172.21.15.120:0/1657458278 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:24.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffe85e700 1 --2- 172.21.15.120:0/1657458278 >> v2:172.21.15.134:3300/0 conn(0x7fe0000d7160 0x7fe0000d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffe05d700 1 -- 172.21.15.120:0/1657458278 >> v2:172.21.15.134:3300/0 conn(0x7fe0000d7160 msgr2=0x7fe0000d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:24.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffe05d700 1 --2- 172.21.15.120:0/1657458278 >> v2:172.21.15.134:3300/0 conn(0x7fe0000d7160 0x7fe0000d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffe05d700 1 -- 172.21.15.120:0/1657458278 >> v1:172.21.15.134:6789/0 conn(0x7fe0000d5fc0 legacy=0x7fe0000d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffe05d700 1 -- 172.21.15.120:0/1657458278 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0001ac1f0 con 0x7fe0000d55a0 2021-04-09T18:26:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffe05d700 1 --2- 172.21.15.120:0/1657458278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0000d55a0 0x7fe0000d59a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fdff4006700 tx=0x7fdff4009b00).ready entity=mon.0 client_cookie=63e971f2d6cbb653 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffd85c700 1 -- 172.21.15.120:0/1657458278 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdff400c0c0 con 0x7fe0000d55a0 2021-04-09T18:26:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffd85c700 1 -- 172.21.15.120:0/1657458278 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff400c400 con 0x7fe0000d55a0 2021-04-09T18:26:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fdffd85c700 1 -- 172.21.15.120:0/1657458278 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdff400c8e0 con 0x7fe0000d55a0 2021-04-09T18:26:24.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fe004c89700 1 -- 172.21.15.120:0/1657458278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0000d55a0 msgr2=0x7fe0000d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.497 7fe004c89700 1 --2- 172.21.15.120:0/1657458278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0000d55a0 0x7fe0000d59a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fdff4006700 tx=0x7fdff4009b00).stop 2021-04-09T18:26:24.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.499 7fe004c89700 1 -- 172.21.15.120:0/1657458278 shutdown_connections 2021-04-09T18:26:24.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.499 7fe004c89700 1 --2- 172.21.15.120:0/1657458278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0000d55a0 0x7fe0000d59a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.499 7fe004c89700 1 --2- 172.21.15.120:0/1657458278 >> v2:172.21.15.134:3300/0 conn(0x7fe0000d7160 0x7fe0000d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.499 7fe004c89700 1 -- 172.21.15.120:0/1657458278 >> 172.21.15.120:0/1657458278 conn(0x7fe0000d1590 msgr2=0x7fe0000d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:24.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.499 7fe004c89700 1 -- 172.21.15.120:0/1657458278 shutdown_connections 2021-04-09T18:26:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.499 7fe004c89700 1 -- 172.21.15.120:0/1657458278 wait complete. 2021-04-09T18:26:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.518 7fe004c89700 1 Processor -- start 2021-04-09T18:26:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.518 7fe004c89700 1 -- start start 2021-04-09T18:26:24.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fe004c89700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe000187380 0x7fe000189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fe004c89700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe000187780 0x7fe0000987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fe004c89700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe000189c50 0x7fe0000b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fe004c89700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00018ce60 con 0x7fe000187780 2021-04-09T18:26:24.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fe004c89700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000098e10 con 0x7fe000189c50 2021-04-09T18:26:24.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fe004c89700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe000099030 con 0x7fe000187380 2021-04-09T18:26:24.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe05d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe000187780 0x7fe0000987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe05d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe000187780 0x7fe0000987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56858/0 (socket says 172.21.15.120:56858) 2021-04-09T18:26:24.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe05d700 1 -- 172.21.15.120:0/1783392185 learned_addr learned my addr 172.21.15.120:0/1783392185 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:24.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdfff05f700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe000189c50 0x7fe0000b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe85e700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe000187380 0x7fe000189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe05d700 1 -- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe000187380 msgr2=0x7fe000189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe05d700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe000187380 0x7fe000189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe05d700 1 -- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe000189c50 msgr2=0x7fe0000b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe05d700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe000189c50 0x7fe0000b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe05d700 1 -- 172.21.15.120:0/1783392185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000b8b30 con 0x7fe000187780 2021-04-09T18:26:24.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdffe05d700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe000187780 0x7fe0000987f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fdff4006f20 tx=0x7fdff400b9e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdfef7fe700 1 -- 172.21.15.120:0/1783392185 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdff400bdd0 con 0x7fe000187780 2021-04-09T18:26:24.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdfef7fe700 1 -- 172.21.15.120:0/1783392185 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff4006440 con 0x7fe000187780 2021-04-09T18:26:24.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fe004c89700 1 -- 172.21.15.120:0/1783392185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0000b8b30 con 0x7fe000187780 2021-04-09T18:26:24.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.519 7fdfef7fe700 1 -- 172.21.15.120:0/1783392185 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdff40052e0 con 0x7fe000187780 2021-04-09T18:26:24.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.520 7fe004c89700 1 -- 172.21.15.120:0/1783392185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0000b8b30 con 0x7fe000187780 2021-04-09T18:26:24.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.520 7fdfef7fe700 1 -- 172.21.15.120:0/1783392185 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdff4006030 con 0x7fe000187780 2021-04-09T18:26:24.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.520 7fdfef7fe700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdfe4018930 0x7fdfe401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:24.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.520 7fdfef7fe700 1 -- 172.21.15.120:0/1783392185 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7fdff4032cf0 con 0x7fe000187780 2021-04-09T18:26:24.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.520 7fdffe85e700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdfe4018930 0x7fdfe401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:24.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.521 7fdffe85e700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdfe4018930 0x7fdfe401ae10 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:24.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.539 7fe004c89700 1 -- 172.21.15.120:0/1783392185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000189100 con 0x7fe000187780 2021-04-09T18:26:24.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.542 7fdfef7fe700 1 -- 172.21.15.120:0/1783392185 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdff4006030 con 0x7fe000187780 2021-04-09T18:26:24.550 INFO:tasks.workunit.client.0.smithi120.stdout:1/717: dread d5/d64/d2d/f3a [0,4194304] 0 2021-04-09T18:26:24.553 INFO:tasks.workunit.client.0.smithi120.stdout:1/718: unlink d5/d64/fd8 0 2021-04-09T18:26:24.556 INFO:tasks.workunit.client.0.smithi120.stdout:1/719: creat d5/d64/d2d/db5/dd1/ffb x:0 0 0 2021-04-09T18:26:24.556 INFO:tasks.workunit.client.0.smithi120.stdout:1/720: fsync d5/d64/df9/d86/fcd 0 2021-04-09T18:26:24.638 INFO:tasks.workunit.client.0.smithi120.stdout:3/747: sync 2021-04-09T18:26:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.727 7fe004c89700 1 -- 172.21.15.120:0/1783392185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe000189100 con 0x7fe000187780 2021-04-09T18:26:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.728 7fdfef7fe700 1 -- 172.21.15.120:0/1783392185 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+1768 (secure 0 0 0) 0x7fdff400bdd0 con 0x7fe000187780 2021-04-09T18:26:24.722 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2021-04-09T18:26:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:24.723 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 -- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdfe4018930 msgr2=0x7fdfe401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdfe4018930 0x7fdfe401ae10 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 -- 172.21.15.120:0/1783392185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe000187780 msgr2=0x7fe0000987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe000187780 0x7fe0000987f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fdff4006f20 tx=0x7fdff400b9e0).stop 2021-04-09T18:26:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 -- 172.21.15.120:0/1783392185 shutdown_connections 2021-04-09T18:26:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe000189c50 0x7fe0000b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe000187780 0x7fe0000987f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdfe4018930 0x7fdfe401ae10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 --2- 172.21.15.120:0/1783392185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe000187380 0x7fe000189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:24.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 -- 172.21.15.120:0/1783392185 >> 172.21.15.120:0/1783392185 conn(0x7fe00018dc90 msgr2=0x7fe00008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:24.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 -- 172.21.15.120:0/1783392185 shutdown_connections 2021-04-09T18:26:24.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:24.730 7fe004c89700 1 -- 172.21.15.120:0/1783392185 wait complete. 2021-04-09T18:26:24.733 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-04-09T18:26:24.776 INFO:tasks.workunit.client.0.smithi120.stdout:4/632: write d1f/f8d [481056,72802] 0 2021-04-09T18:26:24.814 INFO:tasks.workunit.client.0.smithi120.stdout:1/721: getdents d5/d5c/d75/daf/dc7 0 2021-04-09T18:26:24.815 INFO:tasks.workunit.client.0.smithi120.stdout:1/722: mknod d5/d64/d2d/db5/cfc 1 2021-04-09T18:26:24.815 INFO:tasks.workunit.client.0.smithi120.stdout:8/657: dwrite d2/d3/d11/d6a/d3b/f80 [0,4194304] 0 2021-04-09T18:26:24.816 INFO:tasks.workunit.client.0.smithi120.stdout:1/723: stat d5/d5c/d75/daf/dc7/d61/lac 0 2021-04-09T18:26:24.816 INFO:tasks.workunit.client.0.smithi120.stdout:4/633: symlink d1f/d2c/d30/dc6/da8/ld2 0 2021-04-09T18:26:24.817 INFO:tasks.workunit.client.0.smithi120.stdout:1/724: chown d5/d64/d2d/d5a/d8d/fbe 1 1 2021-04-09T18:26:24.817 INFO:tasks.workunit.client.0.smithi120.stdout:4/634: creat d1f/d2c/d34/d60/d7a/d92/d84/fd3 x:0 0 0 2021-04-09T18:26:24.818 INFO:tasks.workunit.client.0.smithi120.stdout:8/658: symlink d2/d3/d11/d6a/lc7 0 2021-04-09T18:26:24.821 INFO:tasks.workunit.client.0.smithi120.stdout:1/725: mknod d5/d64/df9/d86/cfd 1 2021-04-09T18:26:24.821 INFO:tasks.workunit.client.0.smithi120.stdout:6/715: sync 2021-04-09T18:26:24.821 INFO:tasks.workunit.client.0.smithi120.stdout:0/665: sync 2021-04-09T18:26:24.822 INFO:tasks.workunit.client.0.smithi120.stdout:7/691: sync 2021-04-09T18:26:24.822 INFO:tasks.workunit.client.0.smithi120.stdout:9/769: sync 2021-04-09T18:26:24.823 INFO:tasks.workunit.client.0.smithi120.stdout:9/770: mknod d19/d24/d37/d40/d89/d52/da7/c107 1 2021-04-09T18:26:24.823 INFO:tasks.workunit.client.0.smithi120.stdout:8/659: dwrite d2/d3/f5a [0,4194304] 0 2021-04-09T18:26:24.823 INFO:tasks.workunit.client.0.smithi120.stdout:4/635: truncate d1f/d2c/f96 327483 0 2021-04-09T18:26:24.824 INFO:tasks.workunit.client.0.smithi120.stdout:8/660: dread - d2/d3/d11/d6a/d3b/f7f zero size 2021-04-09T18:26:24.824 INFO:tasks.workunit.client.0.smithi120.stdout:9/771: dwrite d19/d24/d37/d40/d89/f53 [4194304,4194304] 0 2021-04-09T18:26:24.825 INFO:tasks.workunit.client.0.smithi120.stdout:9/772: write d19/d24/d37/f94 [1640886,62795] 0 2021-04-09T18:26:24.826 INFO:tasks.workunit.client.0.smithi120.stdout:1/726: truncate d5/d5c/fef 366673 0 2021-04-09T18:26:24.827 INFO:tasks.workunit.client.0.smithi120.stdout:0/666: write d0/f30 [2654986,27813] 0 2021-04-09T18:26:24.829 INFO:tasks.workunit.client.0.smithi120.stdout:4/636: unlink d1f/d24/d42/l50 0 2021-04-09T18:26:24.830 INFO:tasks.workunit.client.0.smithi120.stdout:6/716: rename d6/d8/db/d92/db0 to d6/d8/d1a/d36/d54/dfa 0 2021-04-09T18:26:24.858 INFO:tasks.workunit.client.0.smithi120.stdout:7/692: read db/d2c/d30/f52 [3205939,42688] 0 2021-04-09T18:26:24.859 INFO:tasks.workunit.client.0.smithi120.stdout:5/847: dread d10/f15 [0,4194304] 0 2021-04-09T18:26:24.861 INFO:tasks.workunit.client.0.smithi120.stdout:9/773: creat d19/d24/dd8/d106/f108 x:0 0 0 2021-04-09T18:26:24.861 INFO:tasks.workunit.client.0.smithi120.stdout:6/717: read - d6/d8/db/d12/d93/dc2/dc3/fc5 zero size 2021-04-09T18:26:24.861 INFO:tasks.workunit.client.0.smithi120.stdout:4/637: write d1f/d2c/d34/d60/d7a/d4f/fc2 [6493649,95789] 0 2021-04-09T18:26:24.862 INFO:tasks.workunit.client.0.smithi120.stdout:1/727: creat d5/d5c/d75/daf/d2b/dd4/ffe x:0 0 0 2021-04-09T18:26:24.863 INFO:tasks.workunit.client.0.smithi120.stdout:0/667: creat d0/d5a/d62/d69/dac/fcd x:0 0 0 2021-04-09T18:26:24.865 INFO:tasks.workunit.client.0.smithi120.stdout:0/668: mknod d0/d2/dd/db4/dc0/cce 1 2021-04-09T18:26:24.866 INFO:tasks.workunit.client.0.smithi120.stdout:6/718: mknod d6/d8/d1a/d36/d54/d31/cfb 1 2021-04-09T18:26:24.868 INFO:tasks.workunit.client.0.smithi120.stdout:1/728: rmdir d5/d64/d2d/db5/dd1 39 2021-04-09T18:26:24.870 INFO:tasks.workunit.client.0.smithi120.stdout:1/729: chown d5/d5c/d75/daf 60 1 2021-04-09T18:26:24.872 INFO:tasks.workunit.client.0.smithi120.stdout:9/774: write d19/d24/d36/fc7 [71262,30263] 0 2021-04-09T18:26:24.873 INFO:tasks.workunit.client.0.smithi120.stdout:4/638: dwrite d1f/d2c/d34/d60/d7a/d92/da6/fc0 [0,4194304] 0 2021-04-09T18:26:24.876 INFO:tasks.workunit.client.0.smithi120.stdout:2/746: dread d13/d61/d7c/fb5 [0,4194304] 0 2021-04-09T18:26:24.877 INFO:tasks.workunit.client.0.smithi120.stdout:4/639: dread - d1f/d2c/d34/d60/d7a/d92/d84/fc9 zero size 2021-04-09T18:26:24.882 INFO:tasks.workunit.client.0.smithi120.stdout:9/775: creat d19/d81/f109 x:0 0 0 2021-04-09T18:26:24.884 INFO:tasks.workunit.client.0.smithi120.stdout:2/747: write d13/d15/d35/dbc/fe2 [1105403,23924] 0 2021-04-09T18:26:24.885 INFO:tasks.workunit.client.0.smithi120.stdout:1/730: write d5/d5c/d75/daf/dc7/f58 [2575559,2835] 0 2021-04-09T18:26:24.886 INFO:tasks.workunit.client.0.smithi120.stdout:2/748: stat d13/f47 0 2021-04-09T18:26:24.886 INFO:tasks.workunit.client.0.smithi120.stdout:4/640: symlink d1f/d2c/d34/d60/d7a/d92/d84/ld4 0 2021-04-09T18:26:24.887 INFO:tasks.workunit.client.0.smithi120.stdout:6/719: write d6/d8/d1a/d36/d54/d41/d49/f73 [132331,119776] 0 2021-04-09T18:26:24.888 INFO:tasks.workunit.client.0.smithi120.stdout:1/731: stat d5/d64/d2d/d5a/d8d/fa8 0 2021-04-09T18:26:24.891 INFO:tasks.workunit.client.0.smithi120.stdout:9/776: readlink d19/l2a 0 2021-04-09T18:26:24.894 INFO:tasks.workunit.client.0.smithi120.stdout:2/749: dread - d13/d7a/d80/d54/f71 zero size 2021-04-09T18:26:24.894 INFO:tasks.workunit.client.0.smithi120.stdout:9/777: chown d19/d24/de4/d99/la0 74899 1 2021-04-09T18:26:24.895 INFO:tasks.workunit.client.0.smithi120.stdout:0/669: getdents d0/d2/d4/d5f 0 2021-04-09T18:26:24.896 INFO:tasks.workunit.client.0.smithi120.stdout:4/641: rmdir d1f/d2c/d34/d60/d7a/d92/d3e 39 2021-04-09T18:26:24.896 INFO:tasks.workunit.client.0.smithi120.stdout:2/750: mknod d13/d84/df4/cfa 1 2021-04-09T18:26:24.896 INFO:tasks.workunit.client.0.smithi120.stdout:0/670: chown d0/d5a/d62/d69/dac 95308 1 2021-04-09T18:26:24.897 INFO:tasks.workunit.client.0.smithi120.stdout:5/848: dread fd [0,4194304] 0 2021-04-09T18:26:24.898 INFO:tasks.workunit.client.0.smithi120.stdout:1/732: readlink d5/d5c/d75/daf/l76 0 2021-04-09T18:26:24.901 INFO:tasks.workunit.client.0.smithi120.stdout:2/751: readlink d13/l55 0 2021-04-09T18:26:24.904 INFO:tasks.workunit.client.0.smithi120.stdout:6/720: dwrite d6/d8/d1a/d36/f5c [0,4194304] 0 2021-04-09T18:26:24.907 INFO:tasks.workunit.client.0.smithi120.stdout:9/778: dwrite d19/d24/dd8/d106/f108 [0,4194304] 0 2021-04-09T18:26:24.908 INFO:tasks.workunit.client.0.smithi120.stdout:2/752: chown d13/d15/d35/fcd 65971 1 2021-04-09T18:26:24.909 INFO:tasks.workunit.client.0.smithi120.stdout:2/753: write d13/d84/fc3 [1347577,110920] 0 2021-04-09T18:26:24.915 INFO:tasks.workunit.client.0.smithi120.stdout:4/642: rename l0 to d1f/d2c/d30/ld5 0 2021-04-09T18:26:24.916 INFO:tasks.workunit.client.0.smithi120.stdout:2/754: write d13/f72 [1225704,77731] 0 2021-04-09T18:26:24.916 INFO:tasks.workunit.client.0.smithi120.stdout:1/733: rename d5 to d5/d5c/d75/daf/d2b/dd4/dff 22 2021-04-09T18:26:24.920 INFO:tasks.workunit.client.0.smithi120.stdout:9/779: symlink d19/d24/d2e/l10a 0 2021-04-09T18:26:24.921 INFO:tasks.workunit.client.0.smithi120.stdout:1/734: symlink d5/d5c/d75/daf/dc7/l100 0 2021-04-09T18:26:24.930 INFO:tasks.workunit.client.0.smithi120.stdout:5/849: rename d10/daa/ddc/d11d/f88 to d10/d12/d1b/d1f/d39/dab/f12e 0 2021-04-09T18:26:24.930 INFO:tasks.workunit.client.0.smithi120.stdout:5/850: fdatasync d10/daa/ddc/d11d/d8c/da6/dcc/dd4/f124 0 2021-04-09T18:26:24.933 INFO:tasks.workunit.client.0.smithi120.stdout:2/755: dwrite d13/d15/d35/fcd [0,4194304] 0 2021-04-09T18:26:24.935 INFO:tasks.workunit.client.0.smithi120.stdout:1/735: creat d5/d5c/d75/daf/d2b/d8e/dfa/f101 x:0 0 0 2021-04-09T18:26:24.939 INFO:tasks.workunit.client.0.smithi120.stdout:6/721: rename d6/d8/d3a/d56 to d6/d8/db/d2b/d4d/dfc 0 2021-04-09T18:26:24.941 INFO:tasks.workunit.client.0.smithi120.stdout:4/643: creat d1f/d2c/d34/d60/d7a/d92/d3e/d73/fd6 x:0 0 0 2021-04-09T18:26:24.941 INFO:tasks.workunit.client.0.smithi120.stdout:6/722: mknod d6/d8/db/d2b/d4d/db8/cfd 1 2021-04-09T18:26:24.942 INFO:tasks.workunit.client.0.smithi120.stdout:9/780: write d19/d24/d37/d40/d89/d52/fef [1910419,33464] 0 2021-04-09T18:26:24.959 INFO:tasks.workunit.client.0.smithi120.stdout:3/748: sync 2021-04-09T18:26:24.972 INFO:tasks.workunit.client.0.smithi120.stdout:5/851: rename d10/d12/d1b/d1f/d84/d3d/d50/l5d to d10/daa/ddc/d11d/dcb/l12f 0 2021-04-09T18:26:24.975 INFO:tasks.workunit.client.0.smithi120.stdout:4/644: dread d1f/d2c/f96 [0,4194304] 0 2021-04-09T18:26:24.978 INFO:tasks.workunit.client.0.smithi120.stdout:9/781: mknod d19/d2c/c10b 1 2021-04-09T18:26:24.981 INFO:tasks.workunit.client.0.smithi120.stdout:4/645: creat d1f/d2c/d34/d60/d7a/d92/d84/d99/fd7 x:0 0 0 2021-04-09T18:26:24.981 INFO:tasks.workunit.client.0.smithi120.stdout:9/782: fdatasync d19/d24/d37/d40/fcf 0 2021-04-09T18:26:24.985 INFO:tasks.workunit.client.0.smithi120.stdout:2/756: symlink d13/d7a/d80/d48/d49/d64/d9d/dbb/dd6/lfb 0 2021-04-09T18:26:24.987 INFO:tasks.workunit.client.0.smithi120.stdout:2/757: write d13/d15/d35/fcd [5042714,55853] 0 2021-04-09T18:26:24.991 INFO:tasks.workunit.client.0.smithi120.stdout:4/646: rename d1f/d2c/d30/dc6/l94 to d1f/d2c/d34/d60/d7a/d92/d84/dd0/ld8 0 2021-04-09T18:26:24.999 INFO:tasks.workunit.client.0.smithi120.stdout:2/758: mkdir d13/d7a/d80/d48/d49/d64/dfc 0 2021-04-09T18:26:25.000 INFO:tasks.workunit.client.0.smithi120.stdout:2/759: chown d13/d15/l95 533378877 1 2021-04-09T18:26:25.001 INFO:tasks.workunit.client.0.smithi120.stdout:5/852: truncate d10/d12/d1b/d1f/f71 3408336 0 2021-04-09T18:26:25.001 INFO:tasks.workunit.client.0.smithi120.stdout:4/647: symlink d1f/d2c/d30/dc6/ld9 0 2021-04-09T18:26:25.004 INFO:tasks.workunit.client.0.smithi120.stdout:2/760: write d13/d7a/d80/d54/faf [2685270,2454] 0 2021-04-09T18:26:25.006 INFO:tasks.workunit.client.0.smithi120.stdout:6/723: truncate d6/d8/db/d12/d22/f40 1103081 0 2021-04-09T18:26:25.007 INFO:tasks.workunit.client.0.smithi120.stdout:5/853: unlink d10/daa/ddc/d11d/lc9 0 2021-04-09T18:26:25.009 INFO:tasks.workunit.client.0.smithi120.stdout:4/648: rename d1f/d2c/d56/da4 to d1f/d2c/d30/dc6/dc5/dda 0 2021-04-09T18:26:25.011 INFO:tasks.workunit.client.0.smithi120.stdout:6/724: fsync d6/d8/f10 0 2021-04-09T18:26:25.014 INFO:tasks.workunit.client.0.smithi120.stdout:5/854: dread d10/d12/d3b/fb0 [0,4194304] 0 2021-04-09T18:26:25.014 INFO:tasks.workunit.client.0.smithi120.stdout:9/783: dread d19/d2c/f48 [0,4194304] 0 2021-04-09T18:26:25.017 INFO:tasks.workunit.client.0.smithi120.stdout:3/749: dread d3/f29 [0,4194304] 0 2021-04-09T18:26:25.019 INFO:tasks.workunit.client.0.smithi120.stdout:6/725: creat d6/d8/db/d2b/d4d/ffe x:0 0 0 2021-04-09T18:26:25.020 INFO:tasks.workunit.client.0.smithi120.stdout:5/855: readlink d10/d12/d1b/d1f/d84/l38 0 2021-04-09T18:26:25.021 INFO:tasks.workunit.client.0.smithi120.stdout:9/784: fsync d19/d24/d37/d40/fcf 0 2021-04-09T18:26:25.022 INFO:tasks.workunit.client.0.smithi120.stdout:6/726: write d6/d8/db/d2b/d68/d6a/fd9 [266729,111232] 0 2021-04-09T18:26:25.025 INFO:tasks.workunit.client.0.smithi120.stdout:4/649: dwrite d1f/d2c/f96 [0,4194304] 0 2021-04-09T18:26:25.028 INFO:tasks.workunit.client.0.smithi120.stdout:5/856: mkdir d10/daa/ddc/d11d/d8c/da6/dcc/dd4/d130 0 2021-04-09T18:26:25.032 INFO:tasks.workunit.client.0.smithi120.stdout:6/727: creat d6/d8/db/d12/d22/fff x:0 0 0 2021-04-09T18:26:25.035 INFO:tasks.workunit.client.0.smithi120.stdout:6/728: readlink d6/d8/d1a/l20 0 2021-04-09T18:26:25.035 INFO:tasks.workunit.client.0.smithi120.stdout:4/650: dwrite d1f/d2c/d30/dc6/dc5/dda/fbf [0,4194304] 0 2021-04-09T18:26:25.036 INFO:tasks.workunit.client.0.smithi120.stdout:9/785: truncate d19/d24/d37/d40/d89/d29/d63/fb6 21053 0 2021-04-09T18:26:25.038 INFO:tasks.workunit.client.0.smithi120.stdout:6/729: creat d6/d8/d52/f100 x:0 0 0 2021-04-09T18:26:25.041 INFO:tasks.workunit.client.0.smithi120.stdout:6/730: write d6/d8/db/d2b/de2/fec [16638,56867] 0 2021-04-09T18:26:25.054 INFO:tasks.workunit.client.0.smithi120.stdout:4/651: fsync d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f8a 0 2021-04-09T18:26:25.055 INFO:tasks.workunit.client.0.smithi120.stdout:6/731: write d6/d8/d1a/d36/d54/dfa/fca [622746,38606] 0 2021-04-09T18:26:25.055 INFO:tasks.workunit.client.0.smithi120.stdout:9/786: rename d19/d24/d37/d40/d89/d52/l105 to d19/d24/d37/d40/d89/d29/d63/l10c 0 2021-04-09T18:26:25.056 INFO:tasks.workunit.client.0.smithi120.stdout:3/750: dread d3/d5/d36/d1e/d6b/d49/d89/d68/f97 [0,4194304] 0 2021-04-09T18:26:25.056 INFO:tasks.workunit.client.0.smithi120.stdout:9/787: rmdir d19/d24/d36 39 2021-04-09T18:26:25.056 INFO:tasks.workunit.client.0.smithi120.stdout:6/732: rmdir d6/dcf 0 2021-04-09T18:26:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:3/751: creat d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/dc3/ff4 x:0 0 0 2021-04-09T18:26:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:4/652: write d1f/d2c/d34/d60/d7a/d4f/f91 [1332130,49671] 0 2021-04-09T18:26:25.059 INFO:tasks.workunit.client.0.smithi120.stdout:4/653: read d1f/d2c/d34/f51 [2554907,49900] 0 2021-04-09T18:26:25.060 INFO:tasks.workunit.client.0.smithi120.stdout:9/788: creat d19/d24/d37/d40/d89/d52/da7/f10d x:0 0 0 2021-04-09T18:26:25.060 INFO:tasks.workunit.client.0.smithi120.stdout:9/789: readlink l10 0 2021-04-09T18:26:25.061 INFO:tasks.workunit.client.0.smithi120.stdout:6/733: mkdir d6/d8/db/d2b/d4d/dfc/dcb/d101 0 2021-04-09T18:26:25.062 INFO:tasks.workunit.client.0.smithi120.stdout:4/654: write d1f/d2c/d34/d60/d7a/d92/da6/fc0 [1990962,66958] 0 2021-04-09T18:26:25.064 INFO:tasks.workunit.client.0.smithi120.stdout:9/790: read - d19/d24/fcb zero size 2021-04-09T18:26:25.065 INFO:tasks.workunit.client.0.smithi120.stdout:3/752: rename d3/de to d3/d5/df5 0 2021-04-09T18:26:25.067 INFO:tasks.workunit.client.0.smithi120.stdout:9/791: mknod d19/d24/d36/d47/c10e 1 2021-04-09T18:26:25.070 INFO:tasks.workunit.client.0.smithi120.stdout:4/655: rename d1f/d24/l81 to d1f/d2c/d34/d60/d7a/d92/d3e/ldb 0 2021-04-09T18:26:25.076 INFO:tasks.workunit.client.0.smithi120.stdout:9/792: creat d19/d24/d2e/f10f x:0 0 0 2021-04-09T18:26:25.079 INFO:tasks.workunit.client.0.smithi120.stdout:4/656: link d1f/f8d d1f/d2c/d34/d60/d7a/d92/d84/d99/fdc 0 2021-04-09T18:26:25.088 INFO:tasks.workunit.client.0.smithi120.stdout:4/657: write d1f/d2c/d34/d60/d7a/d92/d84/d99/fd7 [921780,35859] 0 2021-04-09T18:26:25.088 INFO:tasks.workunit.client.0.smithi120.stdout:3/753: unlink d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/f84 0 2021-04-09T18:26:25.097 INFO:tasks.workunit.client.0.smithi120.stdout:4/658: fsync d1f/d2c/d34/d60/d7a/d92/d84/f95 0 2021-04-09T18:26:25.101 INFO:tasks.workunit.client.0.smithi120.stdout:4/659: creat d1f/d2c/d34/d60/d7a/d92/d84/dd0/fdd x:0 0 0 2021-04-09T18:26:25.108 INFO:tasks.workunit.client.0.smithi120.stdout:9/793: write d19/d24/d37/d40/d89/d29/d63/f87 [2418257,9623] 0 2021-04-09T18:26:25.110 INFO:tasks.workunit.client.0.smithi120.stdout:4/660: creat d1f/d24/fde x:0 0 0 2021-04-09T18:26:25.111 INFO:tasks.workunit.client.0.smithi120.stdout:3/754: truncate f1 1159611 0 2021-04-09T18:26:25.130 INFO:tasks.workunit.client.0.smithi120.stdout:3/755: dwrite d3/d5/df5/fbc [0,4194304] 0 2021-04-09T18:26:25.136 INFO:tasks.workunit.client.0.smithi120.stdout:4/661: truncate d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f7f 2152807 0 2021-04-09T18:26:25.137 INFO:tasks.workunit.client.0.smithi120.stdout:4/662: fdatasync d1f/d2c/d34/d60/d7a/d4f/fc2 0 2021-04-09T18:26:25.138 INFO:tasks.workunit.client.0.smithi120.stdout:3/756: mkdir d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/df6 0 2021-04-09T18:26:25.152 INFO:tasks.workunit.client.0.smithi120.stdout:3/757: mknod d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f/cf7 1 2021-04-09T18:26:25.153 INFO:tasks.workunit.client.0.smithi120.stdout:3/758: write d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/dc3/ff4 [866509,72861] 0 2021-04-09T18:26:25.162 INFO:tasks.workunit.client.0.smithi120.stdout:4/663: creat d1f/d24/d42/fdf x:0 0 0 2021-04-09T18:26:25.233 INFO:tasks.workunit.client.0.smithi120.stdout:8/661: sync 2021-04-09T18:26:25.234 INFO:tasks.workunit.client.0.smithi120.stdout:3/759: write d3/d5/d36/d1e/d6b/d49/d89/d68/f97 [3963516,111785] 0 2021-04-09T18:26:25.236 INFO:tasks.workunit.client.0.smithi120.stdout:4/664: mkdir d1f/d2c/d56/de0 0 2021-04-09T18:26:25.251 INFO:tasks.workunit.client.0.smithi120.stdout:1/736: dread d5/d1f/fd3 [0,4194304] 0 2021-04-09T18:26:25.259 INFO:tasks.workunit.client.0.smithi120.stdout:8/662: symlink d2/d3/d3c/lc8 0 2021-04-09T18:26:25.263 INFO:tasks.workunit.client.0.smithi120.stdout:8/663: dwrite d2/d3/fc0 [0,4194304] 0 2021-04-09T18:26:25.265 INFO:tasks.workunit.client.0.smithi120.stdout:3/760: mkdir d3/d5/d36/d1e/d38/d6d/df8 0 2021-04-09T18:26:25.268 INFO:tasks.workunit.client.0.smithi120.stdout:8/664: dread d2/d3/fc0 [0,4194304] 0 2021-04-09T18:26:25.271 INFO:tasks.workunit.client.0.smithi120.stdout:8/665: chown d2/d3/d8 46968602 1 2021-04-09T18:26:25.272 INFO:tasks.workunit.client.0.smithi120.stdout:8/666: write d2/d37/d3e/d42/fb4 [980679,112441] 0 2021-04-09T18:26:25.274 INFO:tasks.workunit.client.0.smithi120.stdout:1/737: dwrite d5/d5c/d75/daf/dc7/f55 [0,4194304] 0 2021-04-09T18:26:25.291 INFO:tasks.workunit.client.0.smithi120.stdout:3/761: dread f1 [0,4194304] 0 2021-04-09T18:26:25.297 INFO:tasks.workunit.client.0.smithi120.stdout:9/794: dread d19/d24/d37/d40/d89/d29/d63/f87 [4194304,4194304] 0 2021-04-09T18:26:25.299 INFO:tasks.workunit.client.0.smithi120.stdout:1/738: creat d5/d64/d2d/db5/dd1/f102 x:0 0 0 2021-04-09T18:26:25.300 INFO:tasks.workunit.client.0.smithi120.stdout:3/762: creat d3/d5/df5/d25/de7/ff9 x:0 0 0 2021-04-09T18:26:25.307 INFO:tasks.workunit.client.0.smithi120.stdout:8/667: link d2/d37/lb6 d2/d3/d11/d6a/lc9 0 2021-04-09T18:26:25.323 INFO:tasks.workunit.client.0.smithi120.stdout:1/739: dread d5/d5c/d75/daf/d2b/f7a [0,4194304] 0 2021-04-09T18:26:25.324 INFO:tasks.workunit.client.0.smithi120.stdout:1/740: write d5/d5c/d75/daf/d87/fea [266835,96372] 0 2021-04-09T18:26:25.326 INFO:tasks.workunit.client.0.smithi120.stdout:1/741: fdatasync d5/d64/d2d/d5a/d8d/fcc 0 2021-04-09T18:26:25.330 INFO:tasks.workunit.client.0.smithi120.stdout:9/795: dwrite d19/d24/d36/f6e [0,4194304] 0 2021-04-09T18:26:25.332 INFO:tasks.workunit.client.0.smithi120.stdout:8/668: mknod d2/d37/d3e/d7c/cca 1 2021-04-09T18:26:25.334 INFO:tasks.workunit.client.0.smithi120.stdout:9/796: unlink d19/d2c/f48 0 2021-04-09T18:26:25.342 INFO:tasks.workunit.client.0.smithi120.stdout:8/669: dwrite d2/d3/d11/d2c/f9f [0,4194304] 0 2021-04-09T18:26:25.351 INFO:tasks.workunit.client.0.smithi120.stdout:8/670: read d2/d27/f2f [1178942,105824] 0 2021-04-09T18:26:25.386 INFO:tasks.workunit.client.0.smithi120.stdout:8/671: dread d2/d3/d8/f1d [0,4194304] 0 2021-04-09T18:26:25.390 INFO:tasks.workunit.client.0.smithi120.stdout:8/672: symlink d2/d3/d11/d6a/d3b/lcb 0 2021-04-09T18:26:25.392 INFO:tasks.workunit.client.0.smithi120.stdout:1/742: creat d5/d5c/d75/daf/f103 x:0 0 0 2021-04-09T18:26:25.400 INFO:tasks.workunit.client.0.smithi120.stdout:1/743: dread d5/d64/d2d/d5a/d8d/fa8 [0,4194304] 0 2021-04-09T18:26:25.405 INFO:tasks.workunit.client.0.smithi120.stdout:1/744: mkdir d5/d5c/d75/d104 0 2021-04-09T18:26:25.405 INFO:tasks.workunit.client.0.smithi120.stdout:9/797: getdents d19/d24/d36 0 2021-04-09T18:26:25.406 INFO:tasks.workunit.client.0.smithi120.stdout:8/673: rmdir d2/d3/d11/d6a/d3b/dbf 0 2021-04-09T18:26:25.407 INFO:tasks.workunit.client.0.smithi120.stdout:1/745: symlink d5/d1f/l105 0 2021-04-09T18:26:25.411 INFO:tasks.workunit.client.0.smithi120.stdout:8/674: truncate d2/d3/f1a 31732 0 2021-04-09T18:26:25.417 INFO:tasks.workunit.client.0.smithi120.stdout:9/798: dread d19/d24/d37/d40/d89/f1f [0,4194304] 0 2021-04-09T18:26:25.422 INFO:tasks.workunit.client.0.smithi120.stdout:0/671: sync 2021-04-09T18:26:25.422 INFO:tasks.workunit.client.0.smithi120.stdout:7/693: sync 2021-04-09T18:26:25.423 INFO:tasks.workunit.client.0.smithi120.stdout:0/672: dread - d0/d5a/d62/d69/dac/fad zero size 2021-04-09T18:26:25.424 INFO:tasks.workunit.client.0.smithi120.stdout:8/675: unlink d2/d3/d3c/lc8 0 2021-04-09T18:26:25.425 INFO:tasks.workunit.client.0.smithi120.stdout:8/676: dread - d2/d37/fba zero size 2021-04-09T18:26:25.427 INFO:tasks.workunit.client.0.smithi120.stdout:8/677: dread d2/d3/d3c/d4f/f83 [0,4194304] 0 2021-04-09T18:26:25.432 INFO:tasks.workunit.client.0.smithi120.stdout:8/678: dwrite d2/d3/d11/d6a/f8c [4194304,4194304] 0 2021-04-09T18:26:25.496 INFO:tasks.workunit.client.0.smithi120.stdout:4/665: dread d1f/d2c/d34/d60/d7a/d4f/fc2 [4194304,4194304] 0 2021-04-09T18:26:25.501 INFO:tasks.workunit.client.0.smithi120.stdout:8/679: link d2/lc1 d2/d37/d3e/d7c/d99/lcc 0 2021-04-09T18:26:25.501 INFO:tasks.workunit.client.0.smithi120.stdout:0/673: dwrite d0/d2/da/f7a [0,4194304] 0 2021-04-09T18:26:25.503 INFO:tasks.workunit.client.0.smithi120.stdout:4/666: write d1f/d2c/d34/f6d [3873708,48749] 0 2021-04-09T18:26:25.516 INFO:tasks.workunit.client.0.smithi120.stdout:8/680: fsync d2/d37/d3e/d7c/f7b 0 2021-04-09T18:26:25.516 INFO:tasks.workunit.client.0.smithi120.stdout:0/674: dread d0/d2/d4/fb3 [0,4194304] 0 2021-04-09T18:26:25.518 INFO:tasks.workunit.client.0.smithi120.stdout:8/681: fdatasync d2/f6e 0 2021-04-09T18:26:25.524 INFO:tasks.workunit.client.0.smithi120.stdout:0/675: mkdir d0/d2/d4/dc1/dcf 0 2021-04-09T18:26:25.525 INFO:tasks.workunit.client.0.smithi120.stdout:8/682: symlink d2/d3/d3c/lcd 0 2021-04-09T18:26:25.526 INFO:tasks.workunit.client.0.smithi120.stdout:0/676: fsync d0/d2/da/f2c 0 2021-04-09T18:26:25.535 INFO:tasks.workunit.client.0.smithi120.stdout:7/694: dread db/d26/d4c/fbd [0,4194304] 0 2021-04-09T18:26:25.536 INFO:tasks.workunit.client.0.smithi120.stdout:4/667: truncate d1f/d2c/d34/d60/d7a/d92/d84/fd3 48324 0 2021-04-09T18:26:25.606 INFO:tasks.workunit.client.0.smithi120.stdout:6/734: sync 2021-04-09T18:26:25.606 INFO:tasks.workunit.client.0.smithi120.stdout:2/761: sync 2021-04-09T18:26:25.606 INFO:tasks.workunit.client.0.smithi120.stdout:5/857: sync 2021-04-09T18:26:25.607 INFO:tasks.workunit.client.0.smithi120.stdout:3/763: sync 2021-04-09T18:26:25.608 INFO:tasks.workunit.client.0.smithi120.stdout:8/683: creat d2/d3/fce x:0 0 0 2021-04-09T18:26:25.610 INFO:tasks.workunit.client.0.smithi120.stdout:2/762: unlink d13/d7a/d80/d48/d49/ff7 0 2021-04-09T18:26:25.611 INFO:tasks.workunit.client.0.smithi120.stdout:6/735: symlink d6/d8/d1a/d36/d54/dfa/l102 0 2021-04-09T18:26:25.612 INFO:tasks.workunit.client.0.smithi120.stdout:7/695: dwrite db/d26/d4c/fd4 [4194304,4194304] 0 2021-04-09T18:26:25.612 INFO:tasks.workunit.client.0.smithi120.stdout:3/764: creat d3/d5/dbb/ffa x:0 0 0 2021-04-09T18:26:25.614 INFO:tasks.workunit.client.0.smithi120.stdout:5/858: unlink d10/daa/ddc/d11d/fc3 0 2021-04-09T18:26:25.614 INFO:tasks.workunit.client.0.smithi120.stdout:7/696: read - db/d38/fca zero size 2021-04-09T18:26:25.615 INFO:tasks.workunit.client.0.smithi120.stdout:2/763: rmdir d13/d7a/d80/d48 39 2021-04-09T18:26:25.616 INFO:tasks.workunit.client.0.smithi120.stdout:4/668: rename d1f/d2c/d56/f5b to d1f/d2c/d34/d60/d7a/d4f/fe1 0 2021-04-09T18:26:25.617 INFO:tasks.workunit.client.0.smithi120.stdout:8/684: mkdir d2/dcf 0 2021-04-09T18:26:25.623 INFO:tasks.workunit.client.0.smithi120.stdout:8/685: write d2/d37/d3e/d7c/d99/f9a [5063235,113061] 0 2021-04-09T18:26:25.630 INFO:tasks.workunit.client.0.smithi120.stdout:7/697: mknod db/d42/d54/ceb 1 2021-04-09T18:26:25.631 INFO:tasks.workunit.client.0.smithi120.stdout:7/698: readlink db/d42/le3 0 2021-04-09T18:26:25.633 INFO:tasks.workunit.client.0.smithi120.stdout:7/699: write db/d26/fa9 [3473947,26072] 0 2021-04-09T18:26:25.634 INFO:tasks.workunit.client.0.smithi120.stdout:6/736: rmdir d6/d8/d1a/d36/d54/d31/d37/dcc 39 2021-04-09T18:26:25.636 INFO:tasks.workunit.client.0.smithi120.stdout:2/764: write d13/d7a/d80/f45 [726651,17749] 0 2021-04-09T18:26:25.636 INFO:tasks.workunit.client.0.smithi120.stdout:5/859: read d10/d12/d1b/fc2 [3089498,101241] 0 2021-04-09T18:26:25.637 INFO:tasks.workunit.client.0.smithi120.stdout:3/765: unlink d3/d5/d36/d1e/d6b/d49/d89/l78 0 2021-04-09T18:26:25.641 INFO:tasks.workunit.client.0.smithi120.stdout:6/737: mknod d6/d8/db/d2b/c103 1 2021-04-09T18:26:25.641 INFO:tasks.workunit.client.0.smithi120.stdout:4/669: getdents d1f/d2c/d34/d60 0 2021-04-09T18:26:25.642 INFO:tasks.workunit.client.0.smithi120.stdout:1/746: sync 2021-04-09T18:26:25.643 INFO:tasks.workunit.client.0.smithi120.stdout:9/799: sync 2021-04-09T18:26:25.647 INFO:tasks.workunit.client.0.smithi120.stdout:8/686: write d2/d3/d3c/f68 [902851,94113] 0 2021-04-09T18:26:25.648 INFO:tasks.workunit.client.0.smithi120.stdout:5/860: fdatasync d10/d12/fee 0 2021-04-09T18:26:25.649 INFO:tasks.workunit.client.0.smithi120.stdout:4/670: chown d1f/d2c/d34/d60 249 1 2021-04-09T18:26:25.651 INFO:tasks.workunit.client.0.smithi120.stdout:7/700: dwrite db/d26/d4c/fd4 [4194304,4194304] 0 2021-04-09T18:26:25.658 INFO:tasks.workunit.client.0.smithi120.stdout:6/738: write d6/d8/d1a/d36/d54/f75 [376037,54295] 0 2021-04-09T18:26:25.665 INFO:tasks.workunit.client.0.smithi120.stdout:5/861: creat d10/d12/d1b/d1f/d39/dbb/dff/f131 x:0 0 0 2021-04-09T18:26:25.666 INFO:tasks.workunit.client.0.smithi120.stdout:8/687: getdents d2/d3/d11/d6a/daa 0 2021-04-09T18:26:25.666 INFO:tasks.workunit.client.0.smithi120.stdout:6/739: read d6/d8/d52/ddf/fe0 [945440,82127] 0 2021-04-09T18:26:25.667 INFO:tasks.workunit.client.0.smithi120.stdout:8/688: stat d2/f6e 0 2021-04-09T18:26:25.668 INFO:tasks.workunit.client.0.smithi120.stdout:7/701: write db/d42/d54/f71 [1321132,65528] 0 2021-04-09T18:26:25.669 INFO:tasks.workunit.client.0.smithi120.stdout:9/800: rename d19/d24/d36/d47/d6f/f82 to d19/d24/d36/da8/f110 0 2021-04-09T18:26:25.671 INFO:tasks.workunit.client.0.smithi120.stdout:3/766: truncate d3/d5/d36/d1e/d6b/d49/d4e/f6f 2497989 0 2021-04-09T18:26:25.679 INFO:tasks.workunit.client.0.smithi120.stdout:2/765: truncate d13/d7a/d80/d48/da3/fdb 1006031 0 2021-04-09T18:26:25.680 INFO:tasks.workunit.client.0.smithi120.stdout:4/671: creat d1f/d2c/d34/d60/d7a/d92/d3e/d7c/fe2 x:0 0 0 2021-04-09T18:26:25.681 INFO:tasks.workunit.client.0.smithi120.stdout:1/747: symlink d5/d5c/d75/daf/dc7/d61/deb/d7c/l106 0 2021-04-09T18:26:25.683 INFO:tasks.workunit.client.0.smithi120.stdout:7/702: creat db/d38/d74/d6f/d76/da5/fec x:0 0 0 2021-04-09T18:26:25.683 INFO:tasks.workunit.client.0.smithi120.stdout:3/767: dread - d3/fbe zero size 2021-04-09T18:26:25.686 INFO:tasks.workunit.client.0.smithi120.stdout:2/766: rmdir d13/d7a/d80/d48/d49 39 2021-04-09T18:26:25.687 INFO:tasks.workunit.client.0.smithi120.stdout:9/801: mkdir d19/d24/d2e/d111 0 2021-04-09T18:26:25.694 INFO:tasks.workunit.client.0.smithi120.stdout:7/703: write db/d42/f43 [6404107,116145] 0 2021-04-09T18:26:25.694 INFO:tasks.workunit.client.0.smithi120.stdout:6/740: rename d6/d8/db/d2b/de2/d5d/d6e/fe6 to d6/f104 0 2021-04-09T18:26:25.697 INFO:tasks.workunit.client.0.smithi120.stdout:9/802: dwrite d19/d24/d37/d40/d89/d52/ff7 [0,4194304] 0 2021-04-09T18:26:25.699 INFO:tasks.workunit.client.0.smithi120.stdout:8/689: dread d2/d27/f29 [0,4194304] 0 2021-04-09T18:26:25.700 INFO:tasks.workunit.client.0.smithi120.stdout:1/748: write d5/d64/df9/d86/da3/fc6 [799822,16621] 0 2021-04-09T18:26:25.704 INFO:tasks.workunit.client.0.smithi120.stdout:3/768: write d3/d5/d36/d1e/d6b/f3f [1710889,129790] 0 2021-04-09T18:26:25.705 INFO:tasks.workunit.client.0.smithi120.stdout:5/862: dwrite d10/d12/f3c [0,4194304] 0 2021-04-09T18:26:25.707 INFO:tasks.workunit.client.0.smithi120.stdout:3/769: dread - d3/d5/df5/da6/dcc/fd5 zero size 2021-04-09T18:26:25.709 INFO:tasks.workunit.client.0.smithi120.stdout:4/672: write d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f8a [494999,44162] 0 2021-04-09T18:26:25.719 INFO:tasks.workunit.client.0.smithi120.stdout:8/690: dread - d2/d3/f5f zero size 2021-04-09T18:26:25.721 INFO:tasks.workunit.client.0.smithi120.stdout:2/767: mkdir d13/d7a/d80/d48/d49/d76/dfd 0 2021-04-09T18:26:25.732 INFO:tasks.workunit.client.0.smithi120.stdout:6/741: rename d6/d8/d1a/dc7/f91 to d6/d8/d1a/dc7/f105 0 2021-04-09T18:26:25.733 INFO:tasks.workunit.client.0.smithi120.stdout:4/673: mkdir d1f/d2c/d34/d60/d7a/d4f/de3 0 2021-04-09T18:26:25.738 INFO:tasks.workunit.client.0.smithi120.stdout:7/704: dread db/d38/f6d [0,4194304] 0 2021-04-09T18:26:25.739 INFO:tasks.workunit.client.0.smithi120.stdout:5/863: truncate d10/d12/d1b/d1f/d84/d3d/d50/f70 7100700 0 2021-04-09T18:26:25.743 INFO:tasks.workunit.client.0.smithi120.stdout:9/803: dread d19/d24/d37/d40/d89/f80 [0,4194304] 0 2021-04-09T18:26:25.744 INFO:tasks.workunit.client.0.smithi120.stdout:2/768: truncate d13/d61/d7c/fb5 2452616 0 2021-04-09T18:26:25.747 INFO:tasks.workunit.client.0.smithi120.stdout:3/770: truncate d3/d5/d36/d1e/d38/d6d/f92 1796095 0 2021-04-09T18:26:25.748 INFO:tasks.workunit.client.0.smithi120.stdout:4/674: rename d1f/d2c/d34/d60/d7a/d92/d84/dbe to d1f/d2c/d34/d60/d7a/d4f/de4 0 2021-04-09T18:26:25.751 INFO:tasks.workunit.client.0.smithi120.stdout:4/675: chown d1f/d2c/d30/dc6/dc5/dda/faa 734076434 1 2021-04-09T18:26:25.751 INFO:tasks.workunit.client.0.smithi120.stdout:7/705: rmdir db/d42/dbc 0 2021-04-09T18:26:25.752 INFO:tasks.workunit.client.0.smithi120.stdout:8/691: dwrite d2/d3/d11/d6a/d3b/f7f [0,4194304] 0 2021-04-09T18:26:25.753 INFO:tasks.workunit.client.0.smithi120.stdout:7/706: chown db/d42/d54/d5a/f75 6 1 2021-04-09T18:26:25.755 INFO:tasks.workunit.client.0.smithi120.stdout:5/864: rename d10/d12/d1b/d1f/d39/dbb/dff/l112 to d10/d12/d1b/d1f/d84/d3d/d50/d94/de5/l132 0 2021-04-09T18:26:25.769 INFO:tasks.workunit.client.0.smithi120.stdout:9/804: getdents d19/d24/d36/d47 0 2021-04-09T18:26:25.770 INFO:tasks.workunit.client.0.smithi120.stdout:5/865: rmdir d10/daa/ddc/d11d/d8c/da3/df6 39 2021-04-09T18:26:25.770 INFO:tasks.workunit.client.0.smithi120.stdout:3/771: rmdir d3/d5/d36/d1e/d38/d6d/df8 0 2021-04-09T18:26:25.771 INFO:tasks.workunit.client.0.smithi120.stdout:8/692: link d2/d37/fc3 d2/d37/d8d/dc6/fd0 0 2021-04-09T18:26:25.772 INFO:tasks.workunit.client.0.smithi120.stdout:2/769: link d13/d8d/l9e d13/d7a/d80/d48/d49/d76/lfe 0 2021-04-09T18:26:25.773 INFO:tasks.workunit.client.0.smithi120.stdout:8/693: write d2/d3/d11/d6a/d3b/f7f [1583829,14152] 0 2021-04-09T18:26:25.779 INFO:tasks.workunit.client.0.smithi120.stdout:7/707: rmdir db/d2c/d34/d5d/de1 0 2021-04-09T18:26:25.780 INFO:tasks.workunit.client.0.smithi120.stdout:8/694: dwrite d2/d3/d11/ff [0,4194304] 0 2021-04-09T18:26:25.781 INFO:tasks.workunit.client.0.smithi120.stdout:4/676: write d1f/d2c/d34/d60/d7a/d92/d84/d99/fdc [55722,88609] 0 2021-04-09T18:26:25.782 INFO:tasks.workunit.client.0.smithi120.stdout:8/695: write d2/d37/fba [701424,38689] 0 2021-04-09T18:26:25.784 INFO:tasks.workunit.client.0.smithi120.stdout:5/866: rename d10/daa/ddc/d11d/d8c/da3/df6/l127 to d10/daa/db4/d103/l133 0 2021-04-09T18:26:25.796 INFO:tasks.workunit.client.0.smithi120.stdout:2/770: creat d13/d84/fff x:0 0 0 2021-04-09T18:26:25.798 INFO:tasks.workunit.client.0.smithi120.stdout:8/696: mkdir d2/d37/d3e/d7c/d7a/dd1 0 2021-04-09T18:26:25.799 INFO:tasks.workunit.client.0.smithi120.stdout:7/708: link db/d42/d54/d5a/ld1 db/d38/d3c/d6e/d94/led 0 2021-04-09T18:26:25.799 INFO:tasks.workunit.client.0.smithi120.stdout:9/805: truncate d19/d24/de4/d99/ffd 125722 0 2021-04-09T18:26:25.802 INFO:tasks.workunit.client.0.smithi120.stdout:5/867: read d10/d12/d1b/d1f/d84/f7b [2123750,97118] 0 2021-04-09T18:26:25.802 INFO:tasks.workunit.client.0.smithi120.stdout:7/709: readlink db/d38/d3c/l4a 0 2021-04-09T18:26:25.803 INFO:tasks.workunit.client.0.smithi120.stdout:9/806: symlink d19/d24/d37/d40/dd2/l112 0 2021-04-09T18:26:25.811 INFO:tasks.workunit.client.0.smithi120.stdout:5/868: rename d10/daa to d10/d12/d1b/d3a/d134 0 2021-04-09T18:26:25.812 INFO:tasks.workunit.client.0.smithi120.stdout:4/677: write d1f/d2c/d34/d60/d7a/d92/f53 [871778,122071] 0 2021-04-09T18:26:25.814 INFO:tasks.workunit.client.0.smithi120.stdout:7/710: rename db/d26/d4c/fd4 to db/d38/d3c/d6e/d94/dd7/fee 0 2021-04-09T18:26:25.822 INFO:tasks.workunit.client.0.smithi120.stdout:8/697: dwrite d2/d3/f5f [0,4194304] 0 2021-04-09T18:26:25.823 INFO:tasks.workunit.client.0.smithi120.stdout:7/711: mknod db/d26/cef 1 2021-04-09T18:26:25.823 INFO:tasks.workunit.client.0.smithi120.stdout:5/869: symlink d10/d12/d1b/d3a/l135 0 2021-04-09T18:26:25.825 INFO:tasks.workunit.client.0.smithi120.stdout:9/807: rename d19/d24/d9e/fab to d19/d24/d37/d40/f113 0 2021-04-09T18:26:25.827 INFO:tasks.workunit.client.0.smithi120.stdout:5/870: stat l6 0 2021-04-09T18:26:25.828 INFO:tasks.workunit.client.0.smithi120.stdout:8/698: mknod d2/d37/d3e/d7c/d7a/cd2 1 2021-04-09T18:26:25.829 INFO:tasks.workunit.client.0.smithi120.stdout:4/678: rename d1f/d2c/d34/d60/d7a/lcf to d1f/d2c/d34/d60/le5 0 2021-04-09T18:26:25.832 INFO:tasks.workunit.client.0.smithi120.stdout:7/712: creat db/d42/d54/d5a/ff0 x:0 0 0 2021-04-09T18:26:25.833 INFO:tasks.workunit.client.0.smithi120.stdout:2/771: dread d13/d15/f2d [0,4194304] 0 2021-04-09T18:26:25.835 INFO:tasks.workunit.client.0.smithi120.stdout:9/808: dwrite d19/d24/d36/d9d/fb4 [0,4194304] 0 2021-04-09T18:26:25.835 INFO:tasks.workunit.client.0.smithi120.stdout:8/699: write d2/d3/d3c/fc2 [261300,112579] 0 2021-04-09T18:26:25.845 INFO:tasks.workunit.client.0.smithi120.stdout:2/772: creat d13/d7a/d80/d48/de3/df8/f100 x:0 0 0 2021-04-09T18:26:25.848 INFO:tasks.workunit.client.0.smithi120.stdout:9/809: mkdir d19/d24/d36/d47/d6f/d114 0 2021-04-09T18:26:25.850 INFO:tasks.workunit.client.0.smithi120.stdout:5/871: dwrite d10/d12/d1b/d1f/d84/f7b [0,4194304] 0 2021-04-09T18:26:25.852 INFO:tasks.workunit.client.0.smithi120.stdout:2/773: rename d13/l22 to d13/d84/df4/l101 0 2021-04-09T18:26:25.853 INFO:tasks.workunit.client.0.smithi120.stdout:7/713: getdents db/d38/d74 0 2021-04-09T18:26:25.859 INFO:tasks.workunit.client.0.smithi120.stdout:8/700: write d2/d3/d11/f1f [5509333,49239] 0 2021-04-09T18:26:25.860 INFO:tasks.workunit.client.0.smithi120.stdout:7/714: fdatasync db/d2c/d30/d59/f68 0 2021-04-09T18:26:25.861 INFO:tasks.workunit.client.0.smithi120.stdout:9/810: write d19/d24/d36/d47/d4b/fce [791579,60160] 0 2021-04-09T18:26:25.862 INFO:tasks.workunit.client.0.smithi120.stdout:5/872: mkdir d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/d136 0 2021-04-09T18:26:25.862 INFO:tasks.workunit.client.0.smithi120.stdout:7/715: chown db/d26/d4c/lcb 2014631 1 2021-04-09T18:26:25.874 INFO:tasks.workunit.client.0.smithi120.stdout:2/774: getdents d13/d8d 0 2021-04-09T18:26:25.876 INFO:tasks.workunit.client.0.smithi120.stdout:5/873: creat d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/d136/f137 x:0 0 0 2021-04-09T18:26:25.879 INFO:tasks.workunit.client.0.smithi120.stdout:7/716: mkdir db/d26/df1 0 2021-04-09T18:26:25.887 INFO:tasks.workunit.client.0.smithi120.stdout:2/775: dwrite d13/f47 [0,4194304] 0 2021-04-09T18:26:25.888 INFO:tasks.workunit.client.0.smithi120.stdout:7/717: link db/d38/fe8 db/d38/ff2 0 2021-04-09T18:26:25.890 INFO:tasks.workunit.client.0.smithi120.stdout:7/718: dread - db/d38/d3c/d6e/d94/dd7/fd9 zero size 2021-04-09T18:26:25.891 INFO:tasks.workunit.client.0.smithi120.stdout:2/776: chown d13/d7a/d80/d48/d49/d64/lb3 81777 1 2021-04-09T18:26:25.896 INFO:tasks.workunit.client.0.smithi120.stdout:7/719: creat db/d2c/d34/ff3 x:0 0 0 2021-04-09T18:26:25.899 INFO:tasks.workunit.client.0.smithi120.stdout:5/874: dwrite d10/d12/d1b/d1f/f63 [0,4194304] 0 2021-04-09T18:26:25.899 INFO:tasks.workunit.client.0.smithi120.stdout:7/720: mknod db/d38/d74/d6f/d76/cf4 1 2021-04-09T18:26:25.900 INFO:tasks.workunit.client.0.smithi120.stdout:2/777: creat d13/d7a/d80/d48/d49/f102 x:0 0 0 2021-04-09T18:26:25.902 INFO:tasks.workunit.client.0.smithi120.stdout:7/721: write db/d2c/d30/d59/fc6 [185193,98436] 0 2021-04-09T18:26:25.909 INFO:tasks.workunit.client.0.smithi120.stdout:5/875: mkdir d10/d12/d1b/d1f/d39/dbb/dff/d138 0 2021-04-09T18:26:25.910 INFO:tasks.workunit.client.0.smithi120.stdout:7/722: symlink db/d42/lf5 0 2021-04-09T18:26:25.913 INFO:tasks.workunit.client.0.smithi120.stdout:7/723: chown db/d2c/d30/d59/fa6 37 1 2021-04-09T18:26:25.914 INFO:tasks.workunit.client.0.smithi120.stdout:5/876: creat d10/d12/d1b/d3a/d134/db4/d103/f139 x:0 0 0 2021-04-09T18:26:25.915 INFO:tasks.workunit.client.0.smithi120.stdout:7/724: symlink db/d38/dab/lf6 0 2021-04-09T18:26:25.919 INFO:tasks.workunit.client.0.smithi120.stdout:7/725: creat db/d26/df1/ff7 x:0 0 0 2021-04-09T18:26:25.921 INFO:tasks.workunit.client.0.smithi120.stdout:5/877: rename d10/d12/d1b/d1f/d84/f7b to d10/d12/d1b/f13a 0 2021-04-09T18:26:25.930 INFO:tasks.workunit.client.0.smithi120.stdout:5/878: creat d10/d12/d3b/f13b x:0 0 0 2021-04-09T18:26:25.931 INFO:tasks.workunit.client.0.smithi120.stdout:5/879: mknod d10/c13c 1 2021-04-09T18:26:25.933 INFO:tasks.workunit.client.0.smithi120.stdout:7/726: rename db/l17 to db/d2c/d34/d5d/lf8 0 2021-04-09T18:26:25.934 INFO:tasks.workunit.client.0.smithi120.stdout:5/880: mknod d10/d12/d1b/c13d 1 2021-04-09T18:26:25.934 INFO:tasks.workunit.client.0.smithi120.stdout:8/701: dread d2/d3/d11/f1f [4194304,4194304] 0 2021-04-09T18:26:25.935 INFO:tasks.workunit.client.0.smithi120.stdout:5/881: readlink d10/d12/d1b/d1f/d84/d3d/d50/d94/de5/l104 0 2021-04-09T18:26:25.936 INFO:tasks.workunit.client.0.smithi120.stdout:7/727: creat db/d38/d74/ff9 x:0 0 0 2021-04-09T18:26:25.937 INFO:tasks.workunit.client.0.smithi120.stdout:8/702: fsync d2/d27/f29 0 2021-04-09T18:26:25.938 INFO:tasks.workunit.client.0.smithi120.stdout:8/703: write d2/d3/d11/d6a/d3b/f80 [171020,5773] 0 2021-04-09T18:26:25.938 INFO:tasks.workunit.client.0.smithi120.stdout:0/677: dread d0/d52/f6e [0,4194304] 0 2021-04-09T18:26:25.939 INFO:tasks.workunit.client.0.smithi120.stdout:5/882: symlink d10/d12/d1b/d1f/d84/d3d/d50/da9/l13e 0 2021-04-09T18:26:25.940 INFO:tasks.workunit.client.0.smithi120.stdout:8/704: mknod d2/d37/d3e/cd3 1 2021-04-09T18:26:25.941 INFO:tasks.workunit.client.0.smithi120.stdout:2/778: write d13/d7a/d80/d54/f71 [151537,82726] 0 2021-04-09T18:26:25.947 INFO:tasks.workunit.client.0.smithi120.stdout:2/779: creat d13/d7a/d80/d48/de3/f103 x:0 0 0 2021-04-09T18:26:25.949 INFO:tasks.workunit.client.0.smithi120.stdout:2/780: rmdir d13/d15/d35/dbc 39 2021-04-09T18:26:25.951 INFO:tasks.workunit.client.0.smithi120.stdout:2/781: rmdir d13/d7a 39 2021-04-09T18:26:25.951 INFO:tasks.workunit.client.0.smithi120.stdout:0/678: truncate d0/d2/da/d23/fbd 1181385 0 2021-04-09T18:26:25.952 INFO:tasks.workunit.client.0.smithi120.stdout:2/782: chown d13/d15/f24 283090 1 2021-04-09T18:26:25.954 INFO:tasks.workunit.client.0.smithi120.stdout:2/783: dread - d13/d7a/d80/d48/da3/fb6 zero size 2021-04-09T18:26:25.955 INFO:tasks.workunit.client.0.smithi120.stdout:0/679: creat d0/d5a/fd0 x:0 0 0 2021-04-09T18:26:25.962 INFO:tasks.workunit.client.0.smithi120.stdout:5/883: dread d10/d12/d3b/f76 [0,4194304] 0 2021-04-09T18:26:25.966 INFO:tasks.workunit.client.0.smithi120.stdout:7/728: mkdir db/d38/d74/d6f/d76/dfa 0 2021-04-09T18:26:25.970 INFO:tasks.workunit.client.0.smithi120.stdout:0/680: dwrite d0/d2/d4/fb3 [0,4194304] 0 2021-04-09T18:26:25.972 INFO:tasks.workunit.client.0.smithi120.stdout:0/681: fsync d0/d2/da/f19 0 2021-04-09T18:26:25.981 INFO:tasks.workunit.client.0.smithi120.stdout:2/784: dwrite d13/d7a/d80/d48/d49/d76/ff3 [0,4194304] 0 2021-04-09T18:26:25.981 INFO:tasks.workunit.client.0.smithi120.stdout:0/682: rename d0/d2/d4/dc1/dcf to d0/d2/d8d/dd1 0 2021-04-09T18:26:25.986 INFO:tasks.workunit.client.0.smithi120.stdout:5/884: dwrite d10/fae [0,4194304] 0 2021-04-09T18:26:25.998 INFO:tasks.workunit.client.0.smithi120.stdout:0/683: mkdir d0/d2/dd/db4/dd2 0 2021-04-09T18:26:26.001 INFO:tasks.workunit.client.0.smithi120.stdout:2/785: symlink d13/d15/d35/l104 0 2021-04-09T18:26:26.005 INFO:tasks.workunit.client.0.smithi120.stdout:0/684: dwrite d0/d2/f46 [4194304,4194304] 0 2021-04-09T18:26:26.007 INFO:tasks.workunit.client.0.smithi120.stdout:2/786: symlink d13/d15/de5/l105 0 2021-04-09T18:26:26.008 INFO:tasks.workunit.client.0.smithi120.stdout:2/787: stat d13/d7a/d80/d48/d49/d64/fd1 0 2021-04-09T18:26:26.010 INFO:tasks.workunit.client.0.smithi120.stdout:1/749: sync 2021-04-09T18:26:26.014 INFO:tasks.workunit.client.0.smithi120.stdout:1/750: rmdir d5/d5c/d75/daf/d87/dc3 39 2021-04-09T18:26:26.015 INFO:tasks.workunit.client.0.smithi120.stdout:7/729: dread db/d2c/d30/d59/f8b [0,4194304] 0 2021-04-09T18:26:26.018 INFO:tasks.workunit.client.0.smithi120.stdout:0/685: getdents d0/d5a 0 2021-04-09T18:26:26.019 INFO:tasks.workunit.client.0.smithi120.stdout:5/885: write d10/d12/d1b/d1f/d84/d3d/d50/faf [777071,92106] 0 2021-04-09T18:26:26.020 INFO:tasks.workunit.client.0.smithi120.stdout:2/788: rename d13/d15/f69 to d13/d15/d35/dbc/f106 0 2021-04-09T18:26:26.064 INFO:tasks.workunit.client.0.smithi120.stdout:5/886: creat d10/d12/d1b/d1f/d84/d3d/d50/da9/f13f x:0 0 0 2021-04-09T18:26:26.067 INFO:tasks.workunit.client.0.smithi120.stdout:2/789: rename d13/d7a/d80/d48/d49/lda to d13/d7a/d80/d48/de3/l107 0 2021-04-09T18:26:26.068 INFO:tasks.workunit.client.0.smithi120.stdout:2/790: stat d13/f1c 0 2021-04-09T18:26:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:2/791: mknod d13/d61/c108 1 2021-04-09T18:26:26.071 INFO:tasks.workunit.client.0.smithi120.stdout:2/792: fdatasync d13/d7a/d80/fdf 0 2021-04-09T18:26:26.072 INFO:tasks.workunit.client.0.smithi120.stdout:2/793: stat d13/d7a/d80/d48/lf6 0 2021-04-09T18:26:26.081 INFO:tasks.workunit.client.0.smithi120.stdout:2/794: dwrite d13/d7a/d80/d48/de3/df8/f100 [0,4194304] 0 2021-04-09T18:26:26.084 INFO:tasks.workunit.client.0.smithi120.stdout:0/686: write d0/d5a/f99 [21336,110648] 0 2021-04-09T18:26:26.085 INFO:tasks.workunit.client.0.smithi120.stdout:2/795: fsync d13/d7a/d80/d48/d49/d64/d83/fa9 0 2021-04-09T18:26:26.089 INFO:tasks.workunit.client.0.smithi120.stdout:7/730: dread db/d38/d3c/d6e/fe2 [0,4194304] 0 2021-04-09T18:26:26.108 INFO:tasks.workunit.client.0.smithi120.stdout:2/796: creat d13/d15/d35/dbc/f109 x:0 0 0 2021-04-09T18:26:26.109 INFO:tasks.workunit.client.0.smithi120.stdout:2/797: write d13/d7a/d80/d54/faf [5045843,79764] 0 2021-04-09T18:26:26.110 INFO:tasks.workunit.client.0.smithi120.stdout:0/687: creat d0/d5a/d62/d69/fd3 x:0 0 0 2021-04-09T18:26:26.115 INFO:tasks.workunit.client.0.smithi120.stdout:0/688: symlink d0/d5a/d62/d8f/ld4 0 2021-04-09T18:26:26.118 INFO:tasks.workunit.client.0.smithi120.stdout:7/731: dread db/d42/f65 [0,4194304] 0 2021-04-09T18:26:26.118 INFO:tasks.workunit.client.0.smithi120.stdout:3/772: dread d3/d5/d36/dac/fb8 [0,4194304] 0 2021-04-09T18:26:26.121 INFO:tasks.workunit.client.0.smithi120.stdout:5/887: dwrite d10/d12/d1b/fbd [0,4194304] 0 2021-04-09T18:26:26.123 INFO:tasks.workunit.client.0.smithi120.stdout:7/732: creat db/d38/dab/ffb x:0 0 0 2021-04-09T18:26:26.133 INFO:tasks.workunit.client.0.smithi120.stdout:5/888: unlink d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/l102 0 2021-04-09T18:26:26.134 INFO:tasks.workunit.client.0.smithi120.stdout:7/733: dwrite db/d38/d3c/d6e/fd8 [0,4194304] 0 2021-04-09T18:26:26.146 INFO:tasks.workunit.client.0.smithi120.stdout:0/689: truncate d0/d5a/d6c/fa7 263659 0 2021-04-09T18:26:26.146 INFO:tasks.workunit.client.0.smithi120.stdout:5/889: stat d10/d12/d1b/d1f/d84/d3d/d50/da9/fe1 0 2021-04-09T18:26:26.151 INFO:tasks.workunit.client.0.smithi120.stdout:2/798: dwrite d13/d8d/f99 [0,4194304] 0 2021-04-09T18:26:26.156 INFO:tasks.workunit.client.0.smithi120.stdout:7/734: rename db/d42/d54/lc1 to db/d38/d3c/lfc 0 2021-04-09T18:26:26.156 INFO:tasks.workunit.client.0.smithi120.stdout:2/799: write d13/d7a/d80/d54/f71 [773305,113735] 0 2021-04-09T18:26:26.164 INFO:tasks.workunit.client.0.smithi120.stdout:2/800: chown d13/d7a/d80/d48/d49/d64/d83/l9a 110 1 2021-04-09T18:26:26.165 INFO:tasks.workunit.client.0.smithi120.stdout:7/735: dwrite db/d42/d54/f71 [0,4194304] 0 2021-04-09T18:26:26.166 INFO:tasks.workunit.client.0.smithi120.stdout:0/690: truncate d0/d2/d4/d5f/d61/d8b/fb7 947457 0 2021-04-09T18:26:26.167 INFO:tasks.workunit.client.0.smithi120.stdout:2/801: mknod d13/d7a/d80/d48/da3/c10a 1 2021-04-09T18:26:26.168 INFO:tasks.workunit.client.0.smithi120.stdout:0/691: chown d0/d2/da/d23/fbd 1 1 2021-04-09T18:26:26.169 INFO:tasks.workunit.client.0.smithi120.stdout:2/802: fdatasync d13/d7a/d80/d48/d49/d64/d83/fa9 0 2021-04-09T18:26:26.170 INFO:tasks.workunit.client.0.smithi120.stdout:2/803: chown d13/d7a/d80/fdf 1237646 1 2021-04-09T18:26:26.171 INFO:tasks.workunit.client.0.smithi120.stdout:7/736: dread db/d26/d4c/d53/f57 [4194304,4194304] 0 2021-04-09T18:26:26.172 INFO:tasks.workunit.client.0.smithi120.stdout:2/804: mknod d13/d7a/d80/dc9/c10b 1 2021-04-09T18:26:26.176 INFO:tasks.workunit.client.0.smithi120.stdout:0/692: rename d0/d2/d4/d5f/d61/f96 to d0/d2/fd5 0 2021-04-09T18:26:26.181 INFO:tasks.workunit.client.0.smithi120.stdout:7/737: link db/d38/fca db/d2c/d34/ffd 0 2021-04-09T18:26:26.187 INFO:tasks.workunit.client.0.smithi120.stdout:0/693: unlink d0/d2/d82/lb8 0 2021-04-09T18:26:26.189 INFO:tasks.workunit.client.0.smithi120.stdout:7/738: creat db/d7f/ffe x:0 0 0 2021-04-09T18:26:26.189 INFO:tasks.workunit.client.0.smithi120.stdout:7/739: stat db/dbf 0 2021-04-09T18:26:26.191 INFO:tasks.workunit.client.0.smithi120.stdout:2/805: rename d13/d7a/d80/d48/d49/d64/d9d/dcf to d13/d84/d10c 0 2021-04-09T18:26:26.193 INFO:tasks.workunit.client.0.smithi120.stdout:0/694: creat d0/d2/d4/d5f/d81/fd6 x:0 0 0 2021-04-09T18:26:26.195 INFO:tasks.workunit.client.0.smithi120.stdout:7/740: rename db/d26/fb0 to db/d38/d3c/d6e/d94/dd7/fff 0 2021-04-09T18:26:26.197 INFO:tasks.workunit.client.0.smithi120.stdout:0/695: mknod d0/d2/cd7 1 2021-04-09T18:26:26.197 INFO:tasks.workunit.client.0.smithi120.stdout:2/806: creat d13/d7a/d80/d48/de3/f10d x:0 0 0 2021-04-09T18:26:26.198 INFO:tasks.workunit.client.0.smithi120.stdout:7/741: mkdir db/d42/d100 0 2021-04-09T18:26:26.198 INFO:tasks.workunit.client.0.smithi120.stdout:0/696: mknod d0/d5a/d62/d69/cd8 1 2021-04-09T18:26:26.201 INFO:tasks.workunit.client.0.smithi120.stdout:7/742: creat db/d38/d3c/f101 x:0 0 0 2021-04-09T18:26:26.202 INFO:tasks.workunit.client.0.smithi120.stdout:0/697: creat d0/d43/fd9 x:0 0 0 2021-04-09T18:26:26.202 INFO:tasks.workunit.client.0.smithi120.stdout:5/890: dread d10/d12/d1b/d1f/f4e [0,4194304] 0 2021-04-09T18:26:26.204 INFO:tasks.workunit.client.0.smithi120.stdout:7/743: symlink db/d38/d74/d6f/l102 0 2021-04-09T18:26:26.205 INFO:tasks.workunit.client.0.smithi120.stdout:7/744: fdatasync db/d38/d3c/d6e/fd8 0 2021-04-09T18:26:26.206 INFO:tasks.workunit.client.0.smithi120.stdout:5/891: readlink d10/d12/d1b/d1f/d84/d3d/d50/l7f 0 2021-04-09T18:26:26.206 INFO:tasks.workunit.client.0.smithi120.stdout:0/698: getdents d0/d2/d8d/dd1 0 2021-04-09T18:26:26.209 INFO:tasks.workunit.client.0.smithi120.stdout:0/699: mkdir d0/d5a/d6c/dda 0 2021-04-09T18:26:26.212 INFO:tasks.workunit.client.0.smithi120.stdout:5/892: rename d10/d12/d1b/d1f/d84/d3d/fb7 to d10/f140 0 2021-04-09T18:26:26.214 INFO:tasks.workunit.client.0.smithi120.stdout:5/893: stat d10/d12/d1b/d3a/d5b/fb1 0 2021-04-09T18:26:26.218 INFO:tasks.workunit.client.0.smithi120.stdout:0/700: rename d0/d2/d4/d5f/l9a to d0/d52/ldb 0 2021-04-09T18:26:26.218 INFO:tasks.workunit.client.0.smithi120.stdout:0/701: chown d0/d2/f26 885648 1 2021-04-09T18:26:26.227 INFO:tasks.workunit.client.0.smithi120.stdout:0/702: symlink d0/d2/dd/db4/dd2/ldc 0 2021-04-09T18:26:26.231 INFO:tasks.workunit.client.0.smithi120.stdout:2/807: dread d13/d7a/d80/d48/d49/d64/fd1 [0,4194304] 0 2021-04-09T18:26:26.233 INFO:tasks.workunit.client.0.smithi120.stdout:3/773: dread d3/d5/df5/f1b [0,4194304] 0 2021-04-09T18:26:26.235 INFO:tasks.workunit.client.0.smithi120.stdout:2/808: rename d13/d8d to d13/d15/d35/d10e 0 2021-04-09T18:26:26.237 INFO:tasks.workunit.client.0.smithi120.stdout:3/774: creat d3/d5/df5/d87/dc8/ffb x:0 0 0 2021-04-09T18:26:26.238 INFO:tasks.workunit.client.0.smithi120.stdout:2/809: write d13/d15/d35/f3e [1545510,32866] 0 2021-04-09T18:26:26.240 INFO:tasks.workunit.client.0.smithi120.stdout:2/810: dread - d13/d7a/d80/d48/de3/f103 zero size 2021-04-09T18:26:26.244 INFO:tasks.workunit.client.0.smithi120.stdout:3/775: mkdir d3/d5/d36/d1e/d38/db9/dfc 0 2021-04-09T18:26:26.246 INFO:tasks.workunit.client.0.smithi120.stdout:2/811: creat d13/d15/d35/dae/f10f x:0 0 0 2021-04-09T18:26:26.247 INFO:tasks.workunit.client.0.smithi120.stdout:3/776: mkdir d3/d5/d36/d1e/d6b/d6a/d83/dd4/dda/dfd 0 2021-04-09T18:26:26.251 INFO:tasks.workunit.client.0.smithi120.stdout:2/812: dwrite d13/d7a/d80/d48/de3/f10d [0,4194304] 0 2021-04-09T18:26:26.254 INFO:tasks.workunit.client.0.smithi120.stdout:3/777: rename d3/d5/d36/d1e/d38/d6d to d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe 0 2021-04-09T18:26:26.254 INFO:tasks.workunit.client.0.smithi120.stdout:2/813: mknod d13/c110 1 2021-04-09T18:26:26.256 INFO:tasks.workunit.client.0.smithi120.stdout:3/778: chown d3/l56 2724 1 2021-04-09T18:26:26.259 INFO:tasks.workunit.client.0.smithi120.stdout:7/745: dwrite db/d26/d4c/f9d [0,4194304] 0 2021-04-09T18:26:26.263 INFO:tasks.workunit.client.0.smithi120.stdout:7/746: fdatasync db/d42/d54/d5a/ff0 0 2021-04-09T18:26:26.264 INFO:tasks.workunit.client.0.smithi120.stdout:7/747: stat db/d38/dab/fe6 0 2021-04-09T18:26:26.267 INFO:tasks.workunit.client.0.smithi120.stdout:5/894: write d10/d12/d1b/d3a/d134/ddc/d11d/f49 [689664,94583] 0 2021-04-09T18:26:26.267 INFO:tasks.workunit.client.0.smithi120.stdout:3/779: creat d3/d5/d36/d1e/d6b/fff x:0 0 0 2021-04-09T18:26:26.274 INFO:tasks.workunit.client.0.smithi120.stdout:3/780: creat d3/d5/d36/d1e/d6b/d6a/d83/dc7/f100 x:0 0 0 2021-04-09T18:26:26.284 INFO:tasks.workunit.client.0.smithi120.stdout:3/781: dwrite d3/d5/d36/d1e/d6b/d6a/d83/dc7/f100 [0,4194304] 0 2021-04-09T18:26:26.285 INFO:tasks.workunit.client.0.smithi120.stdout:0/703: truncate d0/d2/f60 3044716 0 2021-04-09T18:26:26.286 INFO:tasks.workunit.client.0.smithi120.stdout:3/782: rmdir d3/d5/d36/d1e/d6b/d49 39 2021-04-09T18:26:26.289 INFO:tasks.workunit.client.0.smithi120.stdout:0/704: creat d0/d5a/d62/d72/fdd x:0 0 0 2021-04-09T18:26:26.296 INFO:tasks.workunit.client.0.smithi120.stdout:3/783: fsync d3/d5/d36/d1e/d6b/d49/d4e/d54/f91 0 2021-04-09T18:26:26.297 INFO:tasks.workunit.client.0.smithi120.stdout:0/705: read d0/fc [6164181,107826] 0 2021-04-09T18:26:26.298 INFO:tasks.workunit.client.0.smithi120.stdout:2/814: dread d13/d7a/d80/f44 [0,4194304] 0 2021-04-09T18:26:26.299 INFO:tasks.workunit.client.0.smithi120.stdout:7/748: dwrite db/d26/d4c/f9d [4194304,4194304] 0 2021-04-09T18:26:26.300 INFO:tasks.workunit.client.0.smithi120.stdout:0/706: fdatasync d0/d2/da/f19 0 2021-04-09T18:26:26.302 INFO:tasks.workunit.client.0.smithi120.stdout:7/749: dread db/d42/f65 [0,4194304] 0 2021-04-09T18:26:26.303 INFO:tasks.workunit.client.0.smithi120.stdout:3/784: creat d3/d5/d36/dac/f101 x:0 0 0 2021-04-09T18:26:26.307 INFO:tasks.workunit.client.0.smithi120.stdout:7/750: write db/d2c/d34/f41 [4554523,33584] 0 2021-04-09T18:26:26.309 INFO:tasks.workunit.client.0.smithi120.stdout:0/707: rename d0/d2/da/f2c to d0/d5a/d62/fde 0 2021-04-09T18:26:26.318 INFO:tasks.workunit.client.0.smithi120.stdout:2/815: getdents d13/d7a/d80/d48/d49/d64/d9d/dbb 0 2021-04-09T18:26:26.319 INFO:tasks.workunit.client.0.smithi120.stdout:5/895: write d10/f15 [938813,106019] 0 2021-04-09T18:26:26.319 INFO:tasks.workunit.client.0.smithi120.stdout:0/708: creat d0/d5a/db2/fdf x:0 0 0 2021-04-09T18:26:26.345 INFO:tasks.workunit.client.0.smithi120.stdout:0/709: dread d0/d2/d4/f59 [0,4194304] 0 2021-04-09T18:26:26.349 INFO:tasks.workunit.client.0.smithi120.stdout:0/710: dwrite d0/d5a/d62/d72/fab [0,4194304] 0 2021-04-09T18:26:26.354 INFO:tasks.workunit.client.0.smithi120.stdout:3/785: dwrite d3/d5/d36/d1e/d6b/d6a/d83/dd4/fb5 [0,4194304] 0 2021-04-09T18:26:26.359 INFO:tasks.workunit.client.0.smithi120.stdout:6/742: sync 2021-04-09T18:26:26.359 INFO:tasks.workunit.client.0.smithi120.stdout:4/679: sync 2021-04-09T18:26:26.360 INFO:tasks.workunit.client.0.smithi120.stdout:2/816: write d13/d15/d35/dbc/f106 [2965053,53711] 0 2021-04-09T18:26:26.361 INFO:tasks.workunit.client.0.smithi120.stdout:2/817: stat d13/d7a 0 2021-04-09T18:26:26.367 INFO:tasks.workunit.client.0.smithi120.stdout:3/786: symlink d3/d5/d36/d1e/d6b/d6a/d83/dd6/l102 0 2021-04-09T18:26:26.370 INFO:tasks.workunit.client.0.smithi120.stdout:3/787: chown d3/d5/d36/d1e/d6b/d6a/d83 982770013 1 2021-04-09T18:26:26.375 INFO:tasks.workunit.client.0.smithi120.stdout:4/680: rename d1f/d2c/d34/d60/d7a/d92/da6/fc0 to d1f/d24/d42/da0/fe6 0 2021-04-09T18:26:26.376 INFO:tasks.workunit.client.0.smithi120.stdout:3/788: creat d3/d5/df5/d87/d9e/f103 x:0 0 0 2021-04-09T18:26:26.377 INFO:tasks.workunit.client.0.smithi120.stdout:2/818: creat d13/d15/f111 x:0 0 0 2021-04-09T18:26:26.378 INFO:tasks.workunit.client.0.smithi120.stdout:6/743: getdents d6/d8/d1a/d36/d54/d31/d8a 0 2021-04-09T18:26:26.380 INFO:tasks.workunit.client.0.smithi120.stdout:2/819: read d13/d7a/d80/d48/de3/f10d [141930,3024] 0 2021-04-09T18:26:26.380 INFO:tasks.workunit.client.0.smithi120.stdout:4/681: unlink d1f/d2c/d34/d60/d7a/d92/d3e/d7c/fe2 0 2021-04-09T18:26:26.381 INFO:tasks.workunit.client.0.smithi120.stdout:2/820: readlink d13/d7a/lc8 0 2021-04-09T18:26:26.385 INFO:tasks.workunit.client.0.smithi120.stdout:4/682: write d1f/d24/d42/da0/fe6 [636427,80882] 0 2021-04-09T18:26:26.385 INFO:tasks.workunit.client.0.smithi120.stdout:3/789: unlink d3/f42 0 2021-04-09T18:26:26.386 INFO:tasks.workunit.client.0.smithi120.stdout:2/821: rmdir d13/d7a/d80/d48/d49/d64/d83 39 2021-04-09T18:26:26.387 INFO:tasks.workunit.client.0.smithi120.stdout:5/896: write d10/d12/d3b/fc4 [255494,101514] 0 2021-04-09T18:26:26.395 INFO:tasks.workunit.client.0.smithi120.stdout:4/683: creat d1f/d2c/d34/d60/d7a/d92/d84/d99/dae/fe7 x:0 0 0 2021-04-09T18:26:26.398 INFO:tasks.workunit.client.0.smithi120.stdout:6/744: dread d6/d8/db/d2b/de2/d5d/d6e/f8b [0,4194304] 0 2021-04-09T18:26:26.458 INFO:tasks.workunit.client.0.smithi120.stdout:3/790: dwrite d3/f6 [0,4194304] 0 2021-04-09T18:26:26.459 INFO:tasks.workunit.client.0.smithi120.stdout:4/684: dwrite d1f/d2c/d34/d60/d7a/d92/d3e/f48 [0,4194304] 0 2021-04-09T18:26:26.464 INFO:tasks.workunit.client.0.smithi120.stdout:3/791: fsync d3/d5/d36/d1e/f67 0 2021-04-09T18:26:26.466 INFO:tasks.workunit.client.0.smithi120.stdout:4/685: dwrite d1f/f23 [8388608,4194304] 0 2021-04-09T18:26:26.471 INFO:tasks.workunit.client.0.smithi120.stdout:3/792: fsync d3/d5/d36/d1e/d6b/d49/d4e/f6f 0 2021-04-09T18:26:26.472 INFO:tasks.workunit.client.0.smithi120.stdout:4/686: dwrite d1f/d2c/d34/d60/d7a/d92/d84/d99/dae/fe7 [0,4194304] 0 2021-04-09T18:26:26.474 INFO:tasks.workunit.client.0.smithi120.stdout:4/687: dread - d1f/d2c/d34/d60/d7a/d4f/fcd zero size 2021-04-09T18:26:26.496 INFO:tasks.workunit.client.0.smithi120.stdout:4/688: dwrite d1f/f40 [0,4194304] 0 2021-04-09T18:26:26.520 INFO:tasks.workunit.client.0.smithi120.stdout:4/689: rename d1f/d2c/d30/dc6/dc5/dda/f57 to d1f/d2c/d34/d60/d7a/d4f/dce/fe8 0 2021-04-09T18:26:26.522 INFO:tasks.workunit.client.0.smithi120.stdout:6/745: dread d6/d8/d1a/d36/d54/d31/d8a/fa4 [0,4194304] 0 2021-04-09T18:26:26.530 INFO:tasks.workunit.client.0.smithi120.stdout:4/690: dread d1f/d2c/d56/f74 [0,4194304] 0 2021-04-09T18:26:26.533 INFO:tasks.workunit.client.0.smithi120.stdout:6/746: getdents d6/d8/db/d2b/d4d/dfc/d97 0 2021-04-09T18:26:26.537 INFO:tasks.workunit.client.0.smithi120.stdout:6/747: readlink d6/d8/db/d2b/d68/l96 0 2021-04-09T18:26:26.537 INFO:tasks.workunit.client.0.smithi120.stdout:6/748: dread - d6/d8/d1a/d36/d54/d41/d49/f58 zero size 2021-04-09T18:26:26.537 INFO:tasks.workunit.client.0.smithi120.stdout:6/749: mknod d6/d8/d52/ddf/c106 1 2021-04-09T18:26:26.545 INFO:tasks.workunit.client.0.smithi120.stdout:6/750: creat d6/d8/d1a/d36/d54/d31/d37/f107 x:0 0 0 2021-04-09T18:26:26.546 INFO:tasks.workunit.client.0.smithi120.stdout:6/751: mknod d6/d8/db/d2b/d4d/c108 1 2021-04-09T18:26:26.547 INFO:tasks.workunit.client.0.smithi120.stdout:4/691: link d1f/d2c/d34/d60/d7a/l41 d1f/d2c/d30/dc6/le9 0 2021-04-09T18:26:26.551 INFO:tasks.workunit.client.0.smithi120.stdout:4/692: dwrite d1f/d2c/d56/fc4 [0,4194304] 0 2021-04-09T18:26:26.552 INFO:tasks.workunit.client.0.smithi120.stdout:4/693: dread - d1f/d2c/d34/d83/fbc zero size 2021-04-09T18:26:26.553 INFO:tasks.workunit.client.0.smithi120.stdout:4/694: readlink d1f/d2c/d30/dc6/l90 0 2021-04-09T18:26:26.558 INFO:tasks.workunit.client.0.smithi120.stdout:4/695: mknod d1f/d2c/d34/d60/d7a/d4f/cea 1 2021-04-09T18:26:26.562 INFO:tasks.workunit.client.0.smithi120.stdout:6/752: rename d6/d8/db/f1b to d6/d8/db/f109 0 2021-04-09T18:26:26.568 INFO:tasks.workunit.client.0.smithi120.stdout:6/753: rename d6/d8/d1a/d36/d54/d41/d49/ld8 to d6/d8/d1a/d36/d54/d31/d37/ddd/l10a 0 2021-04-09T18:26:26.569 INFO:tasks.workunit.client.0.smithi120.stdout:4/696: unlink d1f/d2c/d34/d60/d7a/d92/d84/dd0/ld8 0 2021-04-09T18:26:26.576 INFO:tasks.workunit.client.0.smithi120.stdout:6/754: dwrite d6/d8/db/f67 [0,4194304] 0 2021-04-09T18:26:26.643 INFO:tasks.workunit.client.0.smithi120.stdout:4/697: dread d1f/d24/d42/da0/fab [0,4194304] 0 2021-04-09T18:26:26.649 INFO:tasks.workunit.client.0.smithi120.stdout:8/705: sync 2021-04-09T18:26:26.650 INFO:tasks.workunit.client.0.smithi120.stdout:9/811: sync 2021-04-09T18:26:26.650 INFO:tasks.workunit.client.0.smithi120.stdout:1/751: sync 2021-04-09T18:26:26.654 INFO:tasks.workunit.client.0.smithi120.stdout:6/755: rename d6/d8/db/d2b/d4d/dfc/dcb/lbc to d6/d8/db/d2b/de2/d5d/l10b 0 2021-04-09T18:26:26.658 INFO:tasks.workunit.client.0.smithi120.stdout:6/756: unlink d6/d8/db/d2b/d4d/ffe 0 2021-04-09T18:26:26.660 INFO:tasks.workunit.client.0.smithi120.stdout:1/752: dwrite d5/d5c/d75/daf/dc7/ff6 [0,4194304] 0 2021-04-09T18:26:26.664 INFO:tasks.workunit.client.0.smithi120.stdout:8/706: link d2/d3/d11/d6a/d3b/l35 d2/d37/d8d/d9b/ld4 0 2021-04-09T18:26:26.667 INFO:tasks.workunit.client.0.smithi120.stdout:6/757: creat d6/d8/d1a/d36/d54/dfa/f10c x:0 0 0 2021-04-09T18:26:26.669 INFO:tasks.workunit.client.0.smithi120.stdout:4/698: truncate d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f7f 1283348 0 2021-04-09T18:26:26.672 INFO:tasks.workunit.client.0.smithi120.stdout:1/753: mknod d5/d64/d2d/d5a/d8d/c107 1 2021-04-09T18:26:26.672 INFO:tasks.workunit.client.0.smithi120.stdout:1/754: readlink d5/d1f/l44 0 2021-04-09T18:26:26.677 INFO:tasks.workunit.client.0.smithi120.stdout:8/707: chown d2/d37/lb6 37512 1 2021-04-09T18:26:26.678 INFO:tasks.workunit.client.0.smithi120.stdout:4/699: rmdir d1f/d24/d42 39 2021-04-09T18:26:26.680 INFO:tasks.workunit.client.0.smithi120.stdout:9/812: dwrite d19/d24/d37/d40/d89/d29/f6d [0,4194304] 0 2021-04-09T18:26:26.680 INFO:tasks.workunit.client.0.smithi120.stdout:6/758: write d6/d8/db/d2b/de2/d5d/d6e/f8b [2837115,109367] 0 2021-04-09T18:26:26.682 INFO:tasks.workunit.client.0.smithi120.stdout:1/755: creat d5/d64/f108 x:0 0 0 2021-04-09T18:26:26.684 INFO:tasks.workunit.client.0.smithi120.stdout:6/759: write d6/d8/db/dac/fd6 [1286880,124409] 0 2021-04-09T18:26:26.688 INFO:tasks.workunit.client.0.smithi120.stdout:6/760: chown d6/d8/d1a/d36/d54/d41/d49/f73 147618151 1 2021-04-09T18:26:26.690 INFO:tasks.workunit.client.0.smithi120.stdout:1/756: creat d5/d64/df9/f109 x:0 0 0 2021-04-09T18:26:26.691 INFO:tasks.workunit.client.0.smithi120.stdout:6/761: dread - d6/d8/d1a/d36/d54/dfa/f10c zero size 2021-04-09T18:26:26.698 INFO:tasks.workunit.client.0.smithi120.stdout:4/700: rename d1f/d2c/d34/d83/fbc to d1f/d2c/d34/d60/d7a/d92/feb 0 2021-04-09T18:26:26.699 INFO:tasks.workunit.client.0.smithi120.stdout:1/757: mknod d5/d64/d2d/c10a 1 2021-04-09T18:26:26.700 INFO:tasks.workunit.client.0.smithi120.stdout:9/813: rename d19/d24/d36/d47 to d19/d24/d36/d47/d4b/d115 22 2021-04-09T18:26:26.706 INFO:tasks.workunit.client.0.smithi120.stdout:4/701: symlink d1f/d2c/d34/d60/d7a/d4f/lec 0 2021-04-09T18:26:26.707 INFO:tasks.workunit.client.0.smithi120.stdout:8/708: dwrite d2/d3/d11/d2c/f93 [0,4194304] 0 2021-04-09T18:26:26.710 INFO:tasks.workunit.client.0.smithi120.stdout:6/762: dwrite d6/d8/db/d2b/d4d/dfc/d97/fc0 [0,4194304] 0 2021-04-09T18:26:26.712 INFO:tasks.workunit.client.0.smithi120.stdout:1/758: getdents d5/d64/df9 0 2021-04-09T18:26:26.713 INFO:tasks.workunit.client.0.smithi120.stdout:9/814: write d19/d24/fa4 [658813,123915] 0 2021-04-09T18:26:26.714 INFO:tasks.workunit.client.0.smithi120.stdout:4/702: creat d1f/d2c/d34/d60/d7a/d92/da6/fed x:0 0 0 2021-04-09T18:26:26.715 INFO:tasks.workunit.client.0.smithi120.stdout:1/759: mknod d5/d64/d2d/c10b 1 2021-04-09T18:26:26.715 INFO:tasks.workunit.client.0.smithi120.stdout:8/709: dwrite d2/d3/f23 [4194304,4194304] 0 2021-04-09T18:26:26.718 INFO:tasks.workunit.client.0.smithi120.stdout:8/710: write d2/d3/d11/d2c/f9f [1800186,57324] 0 2021-04-09T18:26:26.721 INFO:tasks.workunit.client.0.smithi120.stdout:8/711: write d2/d3/d11/d6a/d3b/d6b/da9/fb3 [867796,69108] 0 2021-04-09T18:26:26.732 INFO:tasks.workunit.client.0.smithi120.stdout:6/763: creat d6/d8/db/d2b/f10d x:0 0 0 2021-04-09T18:26:26.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:26:26.737 INFO:tasks.workunit.client.0.smithi120.stdout:9/815: rename d19/d24/d2e/f10f to d19/d24/de4/f116 0 2021-04-09T18:26:26.737 INFO:tasks.workunit.client.0.smithi120.stdout:4/703: creat d1f/d2c/d34/fee x:0 0 0 2021-04-09T18:26:26.737 INFO:tasks.workunit.client.0.smithi120.stdout:8/712: symlink d2/d37/ld5 0 2021-04-09T18:26:26.745 INFO:tasks.workunit.client.0.smithi120.stdout:6/764: mkdir d6/d8/db/dac/d10e 0 2021-04-09T18:26:26.745 INFO:tasks.workunit.client.0.smithi120.stdout:4/704: mknod d1f/d24/cef 1 2021-04-09T18:26:26.746 INFO:tasks.workunit.client.0.smithi120.stdout:4/705: readlink l11 0 2021-04-09T18:26:26.747 INFO:tasks.workunit.client.0.smithi120.stdout:9/816: dwrite d19/d24/d36/d9d/fb4 [4194304,4194304] 0 2021-04-09T18:26:26.753 INFO:tasks.workunit.client.0.smithi120.stdout:8/713: mkdir d2/dcf/dd6 0 2021-04-09T18:26:26.754 INFO:tasks.workunit.client.0.smithi120.stdout:9/817: chown d19/d24/fcb 18766747 1 2021-04-09T18:26:26.754 INFO:tasks.workunit.client.0.smithi120.stdout:8/714: chown d2/d37/d3e/fb9 189 1 2021-04-09T18:26:26.754 INFO:tasks.workunit.client.0.smithi120.stdout:6/765: creat d6/d8/d1a/d36/f10f x:0 0 0 2021-04-09T18:26:26.758 INFO:tasks.workunit.client.0.smithi120.stdout:9/818: chown d19/d24/l2f 4 1 2021-04-09T18:26:26.765 INFO:tasks.workunit.client.0.smithi120.stdout:8/715: mkdir d2/d3/d8/da3/dd7 0 2021-04-09T18:26:26.780 INFO:tasks.workunit.client.0.smithi120.stdout:4/706: rename d1f/d2c/d30/dc6/le9 to d1f/d2c/d34/d60/d7a/d92/d3e/d73/lf0 0 2021-04-09T18:26:26.780 INFO:tasks.workunit.client.0.smithi120.stdout:6/766: creat d6/d8/db/d2b/d68/d6a/f110 x:0 0 0 2021-04-09T18:26:26.782 INFO:tasks.workunit.client.0.smithi120.stdout:6/767: chown d6/d8/d1a/d36/d54/d31/d37/ff4 1128 1 2021-04-09T18:26:26.785 INFO:tasks.workunit.client.0.smithi120.stdout:9/819: link d19/d81/lc6 d19/d24/d9e/l117 0 2021-04-09T18:26:26.786 INFO:tasks.workunit.client.0.smithi120.stdout:9/820: write d19/d24/d37/d40/d89/d29/f5a [4012746,58891] 0 2021-04-09T18:26:26.787 INFO:tasks.workunit.client.0.smithi120.stdout:6/768: unlink d6/d8/db/d12/d93/f9f 0 2021-04-09T18:26:26.788 INFO:tasks.workunit.client.0.smithi120.stdout:4/707: rename d1f/d24/l67 to d1f/d2c/d30/dc6/da8/lf1 0 2021-04-09T18:26:26.790 INFO:tasks.workunit.client.0.smithi120.stdout:8/716: getdents d2/d3/d11 0 2021-04-09T18:26:26.796 INFO:tasks.workunit.client.0.smithi120.stdout:6/769: mkdir d6/d8/d1a/d36/d54/d31/d111 0 2021-04-09T18:26:26.798 INFO:tasks.workunit.client.0.smithi120.stdout:4/708: unlink d1f/d2c/d34/d60/d7a/l78 0 2021-04-09T18:26:26.799 INFO:tasks.workunit.client.0.smithi120.stdout:8/717: symlink d2/d3/d11/d6a/ld8 0 2021-04-09T18:26:26.800 INFO:tasks.workunit.client.0.smithi120.stdout:4/709: symlink d1f/d2c/d34/d60/d7a/d92/d84/dd0/lf2 0 2021-04-09T18:26:26.800 INFO:tasks.workunit.client.0.smithi120.stdout:8/718: chown d2/d27/f29 1 1 2021-04-09T18:26:26.802 INFO:tasks.workunit.client.0.smithi120.stdout:8/719: fdatasync d2/d37/d3e/d7c/d7a/f73 0 2021-04-09T18:26:26.806 INFO:tasks.workunit.client.0.smithi120.stdout:8/720: unlink d2/d3/d11/d6a/lc7 0 2021-04-09T18:26:26.810 INFO:tasks.workunit.client.0.smithi120.stdout:6/770: link d6/d8/db/d12/d93/def/lf7 d6/d8/db/d2b/d68/d6a/l112 0 2021-04-09T18:26:26.811 INFO:tasks.workunit.client.0.smithi120.stdout:8/721: read d2/d3/d11/d6a/d3b/f2b [1062606,60659] 0 2021-04-09T18:26:26.812 INFO:tasks.workunit.client.0.smithi120.stdout:8/722: fsync d2/d3/d50/f57 0 2021-04-09T18:26:26.812 INFO:tasks.workunit.client.0.smithi120.stdout:8/723: chown d2/d3/d11/d6a/d3b/f7f 2 1 2021-04-09T18:26:26.829 INFO:tasks.workunit.client.0.smithi120.stdout:4/710: dwrite d1f/d2c/d34/d60/dad/fcb [0,4194304] 0 2021-04-09T18:26:26.832 INFO:tasks.workunit.client.0.smithi120.stdout:8/724: dwrite d2/d3/f60 [0,4194304] 0 2021-04-09T18:26:26.834 INFO:tasks.workunit.client.0.smithi120.stdout:4/711: write d1f/d2c/d34/d60/d7a/d92/d3e/d73/fb1 [807340,64406] 0 2021-04-09T18:26:26.839 INFO:tasks.workunit.client.0.smithi120.stdout:8/725: creat d2/d3/d11/d6a/d3b/fd9 x:0 0 0 2021-04-09T18:26:26.848 INFO:tasks.workunit.client.0.smithi120.stdout:4/712: dwrite d1f/d2c/d34/d60/d7a/d92/f53 [4194304,4194304] 0 2021-04-09T18:26:26.858 INFO:tasks.workunit.client.0.smithi120.stdout:8/726: link d2/d3/d50/f57 d2/d3/d11/fda 0 2021-04-09T18:26:26.865 INFO:tasks.workunit.client.0.smithi120.stdout:4/713: dwrite d1f/d2c/d34/d60/d7a/d92/da6/fed [0,4194304] 0 2021-04-09T18:26:26.871 INFO:tasks.workunit.client.0.smithi120.stdout:6/771: write d6/d8/d1a/d36/d54/d31/d37/d61/f9a [858562,63915] 0 2021-04-09T18:26:26.881 INFO:tasks.workunit.client.0.smithi120.stdout:6/772: mknod d6/d8/d1a/d36/d54/d31/d37/c113 1 2021-04-09T18:26:26.899 INFO:tasks.workunit.client.0.smithi120.stdout:6/773: truncate d6/d8/db/d2b/d4d/db8/fdc 629044 0 2021-04-09T18:26:26.903 INFO:tasks.workunit.client.0.smithi120.stdout:6/774: symlink d6/d8/db/d2b/d4d/dfc/dcb/d101/l114 0 2021-04-09T18:26:26.905 INFO:tasks.workunit.client.0.smithi120.stdout:6/775: write d6/d8/d1a/d36/d54/d41/d49/f73 [41221,61062] 0 2021-04-09T18:26:26.912 INFO:tasks.workunit.client.0.smithi120.stdout:4/714: dread d1f/d24/f26 [0,4194304] 0 2021-04-09T18:26:26.915 INFO:tasks.workunit.client.0.smithi120.stdout:6/776: readlink d6/d8/d1a/d36/d54/d31/d37/d61/l69 0 2021-04-09T18:26:26.916 INFO:tasks.workunit.client.0.smithi120.stdout:4/715: chown d1f/d2c/d34/d60/d7a/d92/d84/d99/fd7 523214 1 2021-04-09T18:26:26.919 INFO:tasks.workunit.client.0.smithi120.stdout:6/777: symlink d6/d8/d1a/d36/d54/d31/d8a/l115 0 2021-04-09T18:26:26.921 INFO:tasks.workunit.client.0.smithi120.stdout:6/778: readlink d6/d8/db/d2b/de2/lb4 0 2021-04-09T18:26:26.921 INFO:tasks.workunit.client.0.smithi120.stdout:4/716: rename d1f/d2c/d30 to d1f/d2c/df3 0 2021-04-09T18:26:26.928 INFO:tasks.workunit.client.0.smithi120.stdout:6/779: read d6/d8/d1a/d36/d54/d41/d49/f7c [140558,83032] 0 2021-04-09T18:26:26.929 INFO:tasks.workunit.client.0.smithi120.stdout:4/717: link d1f/d2c/d56/l62 d1f/d2c/d34/d60/d7a/d92/d84/d99/dae/lf4 0 2021-04-09T18:26:26.929 INFO:tasks.workunit.client.0.smithi120.stdout:4/718: stat d1f/d2c/d34/d60 0 2021-04-09T18:26:26.930 INFO:tasks.workunit.client.0.smithi120.stdout:6/780: read - d6/d8/d1a/d36/d54/d41/d49/f58 zero size 2021-04-09T18:26:26.932 INFO:tasks.workunit.client.0.smithi120.stdout:6/781: readlink d6/d8/db/d2b/de2/d5d/l10b 0 2021-04-09T18:26:26.933 INFO:tasks.workunit.client.0.smithi120.stdout:6/782: write d6/ff8 [1034652,128595] 0 2021-04-09T18:26:26.933 INFO:tasks.workunit.client.0.smithi120.stdout:4/719: mkdir d1f/d2c/d34/d60/d7a/d92/d84/d99/df5 0 2021-04-09T18:26:26.936 INFO:tasks.workunit.client.0.smithi120.stdout:4/720: fsync d1f/d24/d42/fdf 0 2021-04-09T18:26:26.942 INFO:tasks.workunit.client.0.smithi120.stdout:4/721: creat d1f/d2c/d34/ff6 x:0 0 0 2021-04-09T18:26:26.942 INFO:tasks.workunit.client.0.smithi120.stdout:6/783: link d6/d8/db/d2b/l81 d6/d8/d1a/d36/d54/d31/d37/dcc/l116 0 2021-04-09T18:26:26.944 INFO:tasks.workunit.client.0.smithi120.stdout:4/722: mkdir d1f/d2c/d34/d83/df7 0 2021-04-09T18:26:26.944 INFO:tasks.workunit.client.0.smithi120.stdout:4/723: chown d1f/f8d 0 1 2021-04-09T18:26:26.945 INFO:tasks.workunit.client.0.smithi120.stdout:4/724: mknod d1f/d2c/d56/d6a/da5/cf8 1 2021-04-09T18:26:26.946 INFO:tasks.workunit.client.0.smithi120.stdout:6/784: creat d6/d8/db/d2b/d4d/dfc/d97/f117 x:0 0 0 2021-04-09T18:26:26.948 INFO:tasks.workunit.client.0.smithi120.stdout:4/725: symlink d1f/d2c/d34/d60/d7a/d92/d84/lf9 0 2021-04-09T18:26:26.950 INFO:tasks.workunit.client.0.smithi120.stdout:6/785: rename d6/d8/db/d12/d93/dc2 to d6/d8/db/d2b/d68/d118 0 2021-04-09T18:26:26.953 INFO:tasks.workunit.client.0.smithi120.stdout:7/751: sync 2021-04-09T18:26:26.956 INFO:tasks.workunit.client.0.smithi120.stdout:6/786: rename d6/f57 to d6/d8/d1a/d36/d54/d31/d37/dcc/f119 0 2021-04-09T18:26:26.958 INFO:tasks.workunit.client.0.smithi120.stdout:8/727: write d2/d37/fc3 [1030968,127844] 0 2021-04-09T18:26:26.962 INFO:tasks.workunit.client.0.smithi120.stdout:6/787: rename d6/d8/db/d2b/d68/d6a to d6/d8/d52/ddf/df2/d11a 0 2021-04-09T18:26:26.962 INFO:tasks.workunit.client.0.smithi120.stdout:8/728: mknod d2/d3/d50/cdb 1 2021-04-09T18:26:26.967 INFO:tasks.workunit.client.0.smithi120.stdout:7/752: getdents db/d38/d74/d6f 0 2021-04-09T18:26:26.968 INFO:tasks.workunit.client.0.smithi120.stdout:6/788: symlink d6/d8/db/d2b/de2/d5d/l11b 0 2021-04-09T18:26:26.970 INFO:tasks.workunit.client.0.smithi120.stdout:8/729: mkdir d2/d3/d11/d6a/d3b/d6b/da9/ddc 0 2021-04-09T18:26:26.971 INFO:tasks.workunit.client.0.smithi120.stdout:8/730: chown d2/d3/d50/f57 0 1 2021-04-09T18:26:26.972 INFO:tasks.workunit.client.0.smithi120.stdout:7/753: creat db/d38/d3c/d6e/f103 x:0 0 0 2021-04-09T18:26:26.973 INFO:tasks.workunit.client.0.smithi120.stdout:8/731: chown d2/d3/d11/d2c/d44 128 1 2021-04-09T18:26:26.975 INFO:tasks.workunit.client.0.smithi120.stdout:6/789: dwrite d6/d8/d1a/d36/d54/d31/f53 [0,4194304] 0 2021-04-09T18:26:26.979 INFO:tasks.workunit.client.0.smithi120.stdout:8/732: creat d2/d3/d11/d6a/d3b/d6b/da9/ddc/fdd x:0 0 0 2021-04-09T18:26:26.981 INFO:tasks.workunit.client.0.smithi120.stdout:7/754: truncate db/d2c/d30/d59/f68 3940419 0 2021-04-09T18:26:26.985 INFO:tasks.workunit.client.0.smithi120.stdout:6/790: dwrite d6/d8/d52/f100 [0,4194304] 0 2021-04-09T18:26:26.987 INFO:tasks.workunit.client.0.smithi120.stdout:8/733: fdatasync d2/d3/d11/d2c/d44/f74 0 2021-04-09T18:26:26.989 INFO:tasks.workunit.client.0.smithi120.stdout:6/791: creat d6/d8/db/d12/d93/f11c x:0 0 0 2021-04-09T18:26:26.991 INFO:tasks.workunit.client.0.smithi120.stdout:8/734: fsync d2/d3/f8b 0 2021-04-09T18:26:27.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.982 7fc48d05b700 1 Processor -- start 2021-04-09T18:26:27.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.982 7fc48d05b700 1 -- start start 2021-04-09T18:26:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc48d05b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc4880eac40 0x7fc4880dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc48d05b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4880d1b40 0x7fc488088000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc48d05b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4880d61e0 con 0x7fc488088620 2021-04-09T18:26:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc48d05b700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4880eaa10 con 0x7fc4880eac40 2021-04-09T18:26:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc48d05b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4880f38e0 con 0x7fc4880d1b40 2021-04-09T18:26:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc486d9d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc4880eac40 0x7fc4880dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc486d9d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc4880eac40 0x7fc4880dc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56904/0 (socket says 172.21.15.120:56904) 2021-04-09T18:26:27.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc48759e700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc488088620 0x7fc4880d6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:46636/0 (socket says 172.21.15.120:46636) 2021-04-09T18:26:27.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc486d9d700 1 -- 172.21.15.120:0/2799214027 learned_addr learned my addr 172.21.15.120:0/2799214027 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:27.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc47e59c700 1 --2- 172.21.15.120:0/2799214027 >> v2:172.21.15.134:3300/0 conn(0x7fc4880d1b40 0x7fc488088000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc48659c700 1 -- 172.21.15.120:0/2799214027 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91387795 0 0) 0x7fc480000d30 con 0x7fc488088620 2021-04-09T18:26:27.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.983 7fc48659c700 1 -- 172.21.15.120:0/2799214027 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc474002fe0 con 0x7fc488088620 2021-04-09T18:26:27.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.984 7fc48659c700 1 -- 172.21.15.120:0/2799214027 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1644550456 0 0) 0x7fc4800011f0 con 0x7fc488088620 2021-04-09T18:26:27.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.984 7fc47e59c700 1 -- 172.21.15.120:0/2799214027 >> v2:172.21.15.120:3300/0 conn(0x7fc4880eac40 msgr2=0x7fc4880dc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:26:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.984 7fc47e59c700 1 --2- 172.21.15.120:0/2799214027 >> v2:172.21.15.120:3300/0 conn(0x7fc4880eac40 0x7fc4880dc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.984 7fc47e59c700 1 -- 172.21.15.120:0/2799214027 >> v1:172.21.15.134:6789/0 conn(0x7fc488088620 legacy=0x7fc4880d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.984 7fc47e59c700 1 -- 172.21.15.120:0/2799214027 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4880d6f50 con 0x7fc4880d1b40 2021-04-09T18:26:27.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.984 7fc47e59c700 1 --2- 172.21.15.120:0/2799214027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4880d1b40 0x7fc488088000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fc470006650 tx=0x7fc470009a00).ready entity=mon.1 client_cookie=e7007c4005bc6996 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.988 7fc48659c700 1 -- 172.21.15.120:0/2799214027 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc470009df0 con 0x7fc4880d1b40 2021-04-09T18:26:27.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.988 7fc48659c700 1 -- 172.21.15.120:0/2799214027 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4700009b0 con 0x7fc4880d1b40 2021-04-09T18:26:27.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.988 7fc48659c700 1 -- 172.21.15.120:0/2799214027 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc47000c2b0 con 0x7fc4880d1b40 2021-04-09T18:26:27.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.988 7fc48d05b700 1 -- 172.21.15.120:0/2799214027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4880d1b40 msgr2=0x7fc488088000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.988 7fc48d05b700 1 --2- 172.21.15.120:0/2799214027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4880d1b40 0x7fc488088000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fc470006650 tx=0x7fc470009a00).stop 2021-04-09T18:26:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.989 7fc48d05b700 1 -- 172.21.15.120:0/2799214027 shutdown_connections 2021-04-09T18:26:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.989 7fc48d05b700 1 --2- 172.21.15.120:0/2799214027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4880d1b40 0x7fc488088000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.989 7fc48d05b700 1 --2- 172.21.15.120:0/2799214027 >> v2:172.21.15.120:3300/0 conn(0x7fc4880eac40 0x7fc4880dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.989 7fc48d05b700 1 -- 172.21.15.120:0/2799214027 >> 172.21.15.120:0/2799214027 conn(0x7fc4880e93c0 msgr2=0x7fc488100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.990 7fc48d05b700 1 -- 172.21.15.120:0/2799214027 shutdown_connections 2021-04-09T18:26:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:26.990 7fc48d05b700 1 -- 172.21.15.120:0/2799214027 wait complete. 2021-04-09T18:26:27.021 INFO:tasks.workunit.client.0.smithi120.stdout:8/735: creat d2/dcf/dd6/fde x:0 0 0 2021-04-09T18:26:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.014 7fc48d05b700 1 Processor -- start 2021-04-09T18:26:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.014 7fc48d05b700 1 -- start start 2021-04-09T18:26:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc48d05b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4880c39c0 0x7fc488095450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc48d05b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc488095a70 0x7fc4880941d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc48d05b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4880947f0 0x7fc488191c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc48d05b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4880c3200 con 0x7fc4880c39c0 2021-04-09T18:26:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc48d05b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4880c3550 con 0x7fc488095a70 2021-04-09T18:26:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc48d05b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc488192230 con 0x7fc4880947f0 2021-04-09T18:26:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc486d9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4880c39c0 0x7fc488095450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc486d9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4880c39c0 0x7fc488095450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56910/0 (socket says 172.21.15.120:56910) 2021-04-09T18:26:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc486d9d700 1 -- 172.21.15.120:0/2546307721 learned_addr learned my addr 172.21.15.120:0/2546307721 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:26:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc47e59c700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc488095a70 0x7fc4880941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc486d9d700 1 -- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4880947f0 msgr2=0x7fc488191c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc486d9d700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4880947f0 0x7fc488191c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:26:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc486d9d700 1 -- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc488095a70 msgr2=0x7fc4880941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc486d9d700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc488095a70 0x7fc4880941d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc486d9d700 1 -- 172.21.15.120:0/2546307721 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc488192450 con 0x7fc4880c39c0 2021-04-09T18:26:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc486d9d700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4880c39c0 0x7fc488095450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fc47800b530 tx=0x7fc47800b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.015 7fc47ffff700 1 -- 172.21.15.120:0/2546307721 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc47800bcc0 con 0x7fc4880c39c0 2021-04-09T18:26:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.016 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc488192450 con 0x7fc4880c39c0 2021-04-09T18:26:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.016 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc488192450 con 0x7fc4880c39c0 2021-04-09T18:26:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.016 7fc47ffff700 1 -- 172.21.15.120:0/2546307721 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800bcc0 con 0x7fc4880c39c0 2021-04-09T18:26:27.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.016 7fc47ffff700 1 -- 172.21.15.120:0/2546307721 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc478002030 con 0x7fc4880c39c0 2021-04-09T18:26:27.030 INFO:tasks.workunit.client.0.smithi120.stdout:4/726: dwrite d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f7f [0,4194304] 0 2021-04-09T18:26:27.031 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.016 7fc47ffff700 1 -- 172.21.15.120:0/2546307721 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc478009fb0 con 0x7fc4880c39c0 2021-04-09T18:26:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.016 7fc47ffff700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc46c018930 0x7fc46c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:26:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.016 7fc47ffff700 1 -- 172.21.15.120:0/2546307721 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7fc478032d10 con 0x7fc4880c39c0 2021-04-09T18:26:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.017 7fc47e59c700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc46c018930 0x7fc46c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:26:27.033 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.019 7fc47e59c700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc46c018930 0x7fc46c01ae10 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:26:27.033 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.026 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc460002fd0 con 0x7fc4880c39c0 2021-04-09T18:26:27.033 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.029 7fc47ffff700 1 -- 172.21.15.120:0/2546307721 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc478000c90 con 0x7fc4880c39c0 2021-04-09T18:26:27.137 INFO:tasks.workunit.client.0.smithi120.stdout:5/897: sync 2021-04-09T18:26:27.138 INFO:tasks.workunit.client.0.smithi120.stdout:3/793: sync 2021-04-09T18:26:27.138 INFO:tasks.workunit.client.0.smithi120.stdout:2/822: sync 2021-04-09T18:26:27.138 INFO:tasks.workunit.client.0.smithi120.stdout:0/711: sync 2021-04-09T18:26:27.207 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.214 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc460002de0 con 0x7fc4880c39c0 2021-04-09T18:26:27.208 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.214 7fc47ffff700 1 -- 172.21.15.120:0/2546307721 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fc478009fb0 con 0x7fc4880c39c0 2021-04-09T18:26:27.209 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2021-04-09T18:26:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:26:27.211 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:26:27.212 INFO:tasks.workunit.client.0.smithi120.stdout:9/821: sync 2021-04-09T18:26:27.212 INFO:tasks.workunit.client.0.smithi120.stdout:1/760: sync 2021-04-09T18:26:27.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc46c018930 msgr2=0x7fc46c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc46c018930 0x7fc46c01ae10 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4880c39c0 msgr2=0x7fc488095450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:26:27.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4880c39c0 0x7fc488095450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fc47800b530 tx=0x7fc47800b8d0).stop 2021-04-09T18:26:27.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 shutdown_connections 2021-04-09T18:26:27.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc46c018930 0x7fc46c01ae10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4880947f0 0x7fc488191c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:26:27.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc488095a70 0x7fc4880941d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 --2- 172.21.15.120:0/2546307721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4880c39c0 0x7fc488095450 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:26:27.218 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 >> 172.21.15.120:0/2546307721 conn(0x7fc4880ab640 msgr2=0x7fc48809fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:26:27.218 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 shutdown_connections 2021-04-09T18:26:27.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:26:27.217 7fc48d05b700 1 -- 172.21.15.120:0/2546307721 wait complete. 2021-04-09T18:26:27.221 INFO:tasks.mds_thrash.fs.[None]:mds.a reported in up:standby state 2021-04-09T18:26:27.221 INFO:tasks.mds_thrash.fs.[None]:waiting for 76 secs before thrashing 2021-04-09T18:26:27.381 INFO:tasks.workunit.client.0.smithi120.stdout:7/755: link db/d38/d74/l77 db/d38/l104 0 2021-04-09T18:26:27.383 INFO:tasks.workunit.client.0.smithi120.stdout:4/727: mkdir d1f/d2c/d34/d60/d7a/d92/d84/dfa 0 2021-04-09T18:26:27.408 INFO:tasks.workunit.client.0.smithi120.stdout:6/792: dread d6/d8/db/d2b/de2/d5d/d6e/f80 [0,4194304] 0 2021-04-09T18:26:27.410 INFO:tasks.workunit.client.0.smithi120.stdout:6/793: dread - d6/d8/db/d2b/d68/d118/ff6 zero size 2021-04-09T18:26:27.411 INFO:tasks.workunit.client.0.smithi120.stdout:1/761: dread d5/d64/df9/d86/fcd [0,4194304] 0 2021-04-09T18:26:27.412 INFO:tasks.workunit.client.0.smithi120.stdout:6/794: chown d6/d8/db/d12/f4b 27227 1 2021-04-09T18:26:27.419 INFO:tasks.workunit.client.0.smithi120.stdout:2/823: creat d13/d7a/d80/d48/da3/f112 x:0 0 0 2021-04-09T18:26:27.422 INFO:tasks.workunit.client.0.smithi120.stdout:0/712: dwrite d0/f41 [4194304,4194304] 0 2021-04-09T18:26:27.423 INFO:tasks.workunit.client.0.smithi120.stdout:7/756: mknod db/d26/d4c/d53/c105 1 2021-04-09T18:26:27.434 INFO:tasks.workunit.client.0.smithi120.stdout:6/795: rmdir d6/d8/db 39 2021-04-09T18:26:27.435 INFO:tasks.workunit.client.0.smithi120.stdout:5/898: getdents d10/d12/d1b/d1f/d39/dbb/d12b 0 2021-04-09T18:26:27.436 INFO:tasks.workunit.client.0.smithi120.stdout:5/899: chown d10/d12/d1b/d1f/d84/d3d/f8e 41492723 1 2021-04-09T18:26:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:2/824: rename d13/l70 to d13/d84/df4/l113 0 2021-04-09T18:26:27.445 INFO:tasks.workunit.client.0.smithi120.stdout:2/825: dread - d13/d15/d35/dbc/f109 zero size 2021-04-09T18:26:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:8/736: creat d2/d37/fdf x:0 0 0 2021-04-09T18:26:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:3/794: write d3/d5/d36/d1e/d6b/d49/d89/d68/da1/fc2 [355645,13590] 0 2021-04-09T18:26:27.449 INFO:tasks.workunit.client.0.smithi120.stdout:9/822: link d19/d24/d2e/ff0 d19/d24/d36/d9c/f118 0 2021-04-09T18:26:27.451 INFO:tasks.workunit.client.0.smithi120.stdout:0/713: rename d0/l84 to d0/d5a/d62/d69/dc6/le0 0 2021-04-09T18:26:27.453 INFO:tasks.workunit.client.0.smithi120.stdout:1/762: creat d5/d64/df9/d86/f10c x:0 0 0 2021-04-09T18:26:27.455 INFO:tasks.workunit.client.0.smithi120.stdout:4/728: dwrite d1f/d2c/f86 [4194304,4194304] 0 2021-04-09T18:26:27.458 INFO:tasks.workunit.client.0.smithi120.stdout:5/900: dwrite d10/d12/f19 [0,4194304] 0 2021-04-09T18:26:27.463 INFO:tasks.workunit.client.0.smithi120.stdout:0/714: fdatasync d0/d2/dd/db4/f83 0 2021-04-09T18:26:27.464 INFO:tasks.workunit.client.0.smithi120.stdout:0/715: readlink d0/d5a/d62/d8f/ld4 0 2021-04-09T18:26:27.465 INFO:tasks.workunit.client.0.smithi120.stdout:6/796: creat d6/f11d x:0 0 0 2021-04-09T18:26:27.467 INFO:tasks.workunit.client.0.smithi120.stdout:2/826: write d13/d7a/d80/d48/de3/f10d [1367570,77299] 0 2021-04-09T18:26:27.468 INFO:tasks.workunit.client.0.smithi120.stdout:0/716: chown d0/d2/dd/db4/dd2/ldc 43512578 1 2021-04-09T18:26:27.470 INFO:tasks.workunit.client.0.smithi120.stdout:8/737: dwrite d2/d27/f2f [0,4194304] 0 2021-04-09T18:26:27.474 INFO:tasks.workunit.client.0.smithi120.stdout:2/827: dread - d13/d7a/d80/d48/da3/fb6 zero size 2021-04-09T18:26:27.474 INFO:tasks.workunit.client.0.smithi120.stdout:0/717: fdatasync d0/d5a/d62/d69/fba 0 2021-04-09T18:26:27.485 INFO:tasks.workunit.client.0.smithi120.stdout:8/738: write d2/d3/d11/d6a/d3b/d6b/da9/ddc/fdd [775929,32888] 0 2021-04-09T18:26:27.485 INFO:tasks.workunit.client.0.smithi120.stdout:7/757: rename db/d42/fa8 to db/d2c/f106 0 2021-04-09T18:26:27.487 INFO:tasks.workunit.client.0.smithi120.stdout:9/823: truncate f16 6035962 0 2021-04-09T18:26:27.491 INFO:tasks.workunit.client.0.smithi120.stdout:6/797: symlink d6/d8/d1a/d36/d54/d41/d49/l11e 0 2021-04-09T18:26:27.492 INFO:tasks.workunit.client.0.smithi120.stdout:6/798: chown d6/d8/d52/faa 1 1 2021-04-09T18:26:27.492 INFO:tasks.workunit.client.0.smithi120.stdout:2/828: readlink d13/d7a/d80/d48/d49/d76/lfe 0 2021-04-09T18:26:27.504 INFO:tasks.workunit.client.0.smithi120.stdout:9/824: mkdir d19/d81/d119 0 2021-04-09T18:26:27.507 INFO:tasks.workunit.client.0.smithi120.stdout:0/718: write d0/d2/d4/f73 [632589,13012] 0 2021-04-09T18:26:27.508 INFO:tasks.workunit.client.0.smithi120.stdout:8/739: write d2/d3/f97 [861352,35844] 0 2021-04-09T18:26:27.509 INFO:tasks.workunit.client.0.smithi120.stdout:5/901: dwrite d10/d12/d1b/d1f/d39/dab/fe3 [0,4194304] 0 2021-04-09T18:26:27.514 INFO:tasks.workunit.client.0.smithi120.stdout:9/825: fdatasync d19/d24/fcb 0 2021-04-09T18:26:27.514 INFO:tasks.workunit.client.0.smithi120.stdout:8/740: write d2/d3/d11/d6a/d3b/d6b/da9/fb3 [843128,16041] 0 2021-04-09T18:26:27.517 INFO:tasks.workunit.client.0.smithi120.stdout:4/729: truncate d1f/d2c/d56/fc4 1497959 0 2021-04-09T18:26:27.517 INFO:tasks.workunit.client.0.smithi120.stdout:9/826: chown d19/f3d 1833076 1 2021-04-09T18:26:27.518 INFO:tasks.workunit.client.0.smithi120.stdout:0/719: dwrite d0/f30 [0,4194304] 0 2021-04-09T18:26:27.521 INFO:tasks.workunit.client.0.smithi120.stdout:9/827: stat d19/d24/d36/f45 0 2021-04-09T18:26:27.526 INFO:tasks.workunit.client.0.smithi120.stdout:8/741: symlink d2/dcf/dd6/le0 0 2021-04-09T18:26:27.529 INFO:tasks.workunit.client.0.smithi120.stdout:9/828: symlink d19/d24/d36/l11a 0 2021-04-09T18:26:27.530 INFO:tasks.workunit.client.0.smithi120.stdout:7/758: truncate db/d42/d54/d5a/ff0 68626 0 2021-04-09T18:26:27.530 INFO:tasks.workunit.client.0.smithi120.stdout:5/902: rename d10/d12/d1b/d3a/d5b to d10/d12/d1b/d141 0 2021-04-09T18:26:27.532 INFO:tasks.workunit.client.0.smithi120.stdout:7/759: chown db/d38/d3c 12336 1 2021-04-09T18:26:27.533 INFO:tasks.workunit.client.0.smithi120.stdout:4/730: unlink d1f/d2c/d56/l76 0 2021-04-09T18:26:27.534 INFO:tasks.workunit.client.0.smithi120.stdout:2/829: truncate d13/d61/f89 198752 0 2021-04-09T18:26:27.534 INFO:tasks.workunit.client.0.smithi120.stdout:6/799: dwrite d6/d8/db/d2b/de2/fb3 [0,4194304] 0 2021-04-09T18:26:27.536 INFO:tasks.workunit.client.0.smithi120.stdout:6/800: mknod d6/d8/d52/da8/c11f 1 2021-04-09T18:26:27.537 INFO:tasks.workunit.client.0.smithi120.stdout:0/720: creat d0/d2/fe1 x:0 0 0 2021-04-09T18:26:27.538 INFO:tasks.workunit.client.0.smithi120.stdout:4/731: chown d1f/d2c/d34/d60/dad/fcb 967058 1 2021-04-09T18:26:27.549 INFO:tasks.workunit.client.0.smithi120.stdout:2/830: symlink d13/d7a/d80/d48/de3/l114 0 2021-04-09T18:26:27.553 INFO:tasks.workunit.client.0.smithi120.stdout:8/742: creat d2/d3/d11/d2c/fe1 x:0 0 0 2021-04-09T18:26:27.555 INFO:tasks.workunit.client.0.smithi120.stdout:4/732: stat l1d 0 2021-04-09T18:26:27.567 INFO:tasks.workunit.client.0.smithi120.stdout:8/743: link d2/f6e d2/d37/d3e/d42/d9e/fe2 0 2021-04-09T18:26:27.570 INFO:tasks.workunit.client.0.smithi120.stdout:2/831: creat d13/d7a/f115 x:0 0 0 2021-04-09T18:26:27.576 INFO:tasks.workunit.client.0.smithi120.stdout:4/733: creat d1f/d2c/d34/d60/d7a/ffb x:0 0 0 2021-04-09T18:26:27.577 INFO:tasks.workunit.client.0.smithi120.stdout:9/829: write d19/f74 [1468560,41349] 0 2021-04-09T18:26:27.577 INFO:tasks.workunit.client.0.smithi120.stdout:6/801: write d6/d8/d1a/d36/d54/d31/d37/dcc/f119 [1080707,66631] 0 2021-04-09T18:26:27.586 INFO:tasks.workunit.client.0.smithi120.stdout:0/721: dwrite d0/d2/dd/db4/f98 [0,4194304] 0 2021-04-09T18:26:27.586 INFO:tasks.workunit.client.0.smithi120.stdout:9/830: fsync f12 0 2021-04-09T18:26:27.587 INFO:tasks.workunit.client.0.smithi120.stdout:2/832: creat d13/d15/d35/d9f/f116 x:0 0 0 2021-04-09T18:26:27.587 INFO:tasks.workunit.client.0.smithi120.stdout:9/831: readlink d19/d24/de4/lfe 0 2021-04-09T18:26:27.588 INFO:tasks.workunit.client.0.smithi120.stdout:0/722: mknod d0/d2/d82/d9f/ce2 1 2021-04-09T18:26:27.588 INFO:tasks.workunit.client.0.smithi120.stdout:6/802: unlink d6/d8/d1a/d36/d54/d31/d37/dcc/f119 0 2021-04-09T18:26:27.589 INFO:tasks.workunit.client.0.smithi120.stdout:9/832: chown d19/d24/d37/f5f 78 1 2021-04-09T18:26:27.596 INFO:tasks.workunit.client.0.smithi120.stdout:7/760: truncate db/d42/d54/f71 3510193 0 2021-04-09T18:26:27.597 INFO:tasks.workunit.client.0.smithi120.stdout:4/734: creat d1f/d24/ffc x:0 0 0 2021-04-09T18:26:27.602 INFO:tasks.workunit.client.0.smithi120.stdout:3/795: dread d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe/f92 [0,4194304] 0 2021-04-09T18:26:27.605 INFO:tasks.workunit.client.0.smithi120.stdout:2/833: creat d13/d7a/f117 x:0 0 0 2021-04-09T18:26:27.608 INFO:tasks.workunit.client.0.smithi120.stdout:6/803: creat d6/d8/d1a/d36/d54/f120 x:0 0 0 2021-04-09T18:26:27.610 INFO:tasks.workunit.client.0.smithi120.stdout:3/796: fdatasync d3/d5/d36/d1e/d6b/d49/d89/d68/fcb 0 2021-04-09T18:26:27.610 INFO:tasks.workunit.client.0.smithi120.stdout:9/833: creat d19/d24/d37/d40/d89/d29/d76/f11b x:0 0 0 2021-04-09T18:26:27.614 INFO:tasks.workunit.client.0.smithi120.stdout:5/903: dread d10/d12/d1b/d141/f8d [0,4194304] 0 2021-04-09T18:26:27.617 INFO:tasks.workunit.client.0.smithi120.stdout:6/804: creat d6/d8/db/dd5/f121 x:0 0 0 2021-04-09T18:26:27.619 INFO:tasks.workunit.client.0.smithi120.stdout:6/805: fdatasync d6/d8/db/d2b/d68/d118/dc3/fc5 0 2021-04-09T18:26:27.620 INFO:tasks.workunit.client.0.smithi120.stdout:9/834: rename d19/d24/d9e/ffb to d19/d81/f11c 0 2021-04-09T18:26:27.625 INFO:tasks.workunit.client.0.smithi120.stdout:7/761: dwrite db/d42/d54/d5a/ff0 [0,4194304] 0 2021-04-09T18:26:27.627 INFO:tasks.workunit.client.0.smithi120.stdout:9/835: unlink d19/d24/d36/lf2 0 2021-04-09T18:26:27.628 INFO:tasks.workunit.client.0.smithi120.stdout:4/735: link lc d1f/lfd 0 2021-04-09T18:26:27.629 INFO:tasks.workunit.client.0.smithi120.stdout:9/836: chown d19/d2c/f79 6210 1 2021-04-09T18:26:27.629 INFO:tasks.workunit.client.0.smithi120.stdout:4/736: mknod d1f/d2c/d56/dca/cfe 1 2021-04-09T18:26:27.631 INFO:tasks.workunit.client.0.smithi120.stdout:4/737: fdatasync d1f/d2c/d34/d60/d7a/d92/d3e/f48 0 2021-04-09T18:26:27.634 INFO:tasks.workunit.client.0.smithi120.stdout:3/797: dwrite d3/d5/d36/d1e/d6b/d6a/d83/dd4/f66 [0,4194304] 0 2021-04-09T18:26:27.635 INFO:tasks.workunit.client.0.smithi120.stdout:7/762: mkdir db/d38/d74/d6f/d76/da5/d107 0 2021-04-09T18:26:27.638 INFO:tasks.workunit.client.0.smithi120.stdout:9/837: dwrite d19/d24/dd8/d106/f108 [0,4194304] 0 2021-04-09T18:26:27.639 INFO:tasks.workunit.client.0.smithi120.stdout:4/738: unlink l11 0 2021-04-09T18:26:27.640 INFO:tasks.workunit.client.0.smithi120.stdout:7/763: symlink db/d7f/l108 0 2021-04-09T18:26:27.643 INFO:tasks.workunit.client.0.smithi120.stdout:2/834: link d13/d15/d35/f5b d13/f118 0 2021-04-09T18:26:27.643 INFO:tasks.workunit.client.0.smithi120.stdout:3/798: mknod d3/d5/d36/d1e/d6b/d49/d89/dd0/c104 1 2021-04-09T18:26:27.644 INFO:tasks.workunit.client.0.smithi120.stdout:0/723: dread d0/d2/fd5 [0,4194304] 0 2021-04-09T18:26:27.651 INFO:tasks.workunit.client.0.smithi120.stdout:6/806: rename d6/d8/d1a/d36/d54/d31/d37/d61/fbb to d6/d8/db/d2b/de2/d5d/d6e/f122 0 2021-04-09T18:26:27.651 INFO:tasks.workunit.client.0.smithi120.stdout:5/904: dwrite d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/fbc [0,4194304] 0 2021-04-09T18:26:27.653 INFO:tasks.workunit.client.0.smithi120.stdout:3/799: readlink d3/d5/d36/d1e/d6b/d49/l50 0 2021-04-09T18:26:27.661 INFO:tasks.workunit.client.0.smithi120.stdout:0/724: symlink d0/d2/da/le3 0 2021-04-09T18:26:27.663 INFO:tasks.workunit.client.0.smithi120.stdout:9/838: dread d19/d24/d37/d40/d89/f6b [0,4194304] 0 2021-04-09T18:26:27.668 INFO:tasks.workunit.client.0.smithi120.stdout:7/764: rmdir db/d38/d74/d6f/d76/da5/d107 0 2021-04-09T18:26:27.672 INFO:tasks.workunit.client.0.smithi120.stdout:2/835: rename d13/d7a/d80/d48/de3/df8/f100 to d13/d61/d7c/f119 0 2021-04-09T18:26:27.673 INFO:tasks.workunit.client.0.smithi120.stdout:6/807: dwrite d6/f11d [0,4194304] 0 2021-04-09T18:26:27.686 INFO:tasks.workunit.client.0.smithi120.stdout:3/800: rename d3/d5/d36/d3d/f8b to d3/d5/df5/d87/f105 0 2021-04-09T18:26:27.690 INFO:tasks.workunit.client.0.smithi120.stdout:3/801: chown d3/d5/d36/d1e/d6b/d49/f4a 20059230 1 2021-04-09T18:26:27.691 INFO:tasks.workunit.client.0.smithi120.stdout:7/765: truncate db/d42/d54/f71 3988522 0 2021-04-09T18:26:27.692 INFO:tasks.workunit.client.0.smithi120.stdout:7/766: write db/d38/d74/d6f/d76/fe4 [231260,83539] 0 2021-04-09T18:26:27.694 INFO:tasks.workunit.client.0.smithi120.stdout:7/767: mknod db/d42/c109 1 2021-04-09T18:26:27.694 INFO:tasks.workunit.client.0.smithi120.stdout:3/802: dread d3/f6 [0,4194304] 0 2021-04-09T18:26:27.698 INFO:tasks.workunit.client.0.smithi120.stdout:7/768: symlink db/d42/d54/l10a 0 2021-04-09T18:26:27.698 INFO:tasks.workunit.client.0.smithi120.stdout:7/769: stat db/d2c/d34/ffd 0 2021-04-09T18:26:27.699 INFO:tasks.workunit.client.0.smithi120.stdout:3/803: mkdir d3/d5/df5/da6/dcc/d106 0 2021-04-09T18:26:27.700 INFO:tasks.workunit.client.0.smithi120.stdout:7/770: chown db/d38/d3c/d6e 118634 1 2021-04-09T18:26:27.700 INFO:tasks.workunit.client.0.smithi120.stdout:7/771: stat db 0 2021-04-09T18:26:27.701 INFO:tasks.workunit.client.0.smithi120.stdout:3/804: fsync d3/d5/df5/d25/f22 0 2021-04-09T18:26:27.702 INFO:tasks.workunit.client.0.smithi120.stdout:7/772: chown db/d26/d4c/f9d 4585 1 2021-04-09T18:26:27.705 INFO:tasks.workunit.client.0.smithi120.stdout:4/739: dwrite d1f/d2c/d34/d60/d7a/d92/d3e/d73/f8b [0,4194304] 0 2021-04-09T18:26:27.706 INFO:tasks.workunit.client.0.smithi120.stdout:4/740: mknod d1f/d2c/d56/dca/cff 1 2021-04-09T18:26:27.707 INFO:tasks.workunit.client.0.smithi120.stdout:9/839: rename d19/d24/d37/d40/d89/d29 to d19/d11d 0 2021-04-09T18:26:27.708 INFO:tasks.workunit.client.0.smithi120.stdout:0/725: write d0/d2/dd/f92 [120945,13642] 0 2021-04-09T18:26:27.713 INFO:tasks.workunit.client.0.smithi120.stdout:2/836: dwrite d13/d7a/d80/f2f [0,4194304] 0 2021-04-09T18:26:27.716 INFO:tasks.workunit.client.0.smithi120.stdout:6/808: dwrite d6/d8/d3a/f59 [0,4194304] 0 2021-04-09T18:26:27.724 INFO:tasks.workunit.client.0.smithi120.stdout:6/809: write d6/d8/db/d2b/d68/d118/ff6 [663414,11666] 0 2021-04-09T18:26:27.737 INFO:tasks.workunit.client.0.smithi120.stdout:7/773: creat db/d2c/d34/d5d/dd2/f10b x:0 0 0 2021-04-09T18:26:27.744 INFO:tasks.workunit.client.0.smithi120.stdout:2/837: symlink d13/d15/de5/l11a 0 2021-04-09T18:26:27.745 INFO:tasks.workunit.client.0.smithi120.stdout:7/774: mknod db/d26/c10c 1 2021-04-09T18:26:27.745 INFO:tasks.workunit.client.0.smithi120.stdout:0/726: chown d0/d52/d56/f5d 27 1 2021-04-09T18:26:27.746 INFO:tasks.workunit.client.0.smithi120.stdout:0/727: chown d0/d2/fd5 2076685259 1 2021-04-09T18:26:27.752 INFO:tasks.workunit.client.0.smithi120.stdout:9/840: truncate d19/d2c/dc8/fd6 1689668 0 2021-04-09T18:26:27.753 INFO:tasks.workunit.client.0.smithi120.stdout:3/805: getdents d3/d5 0 2021-04-09T18:26:27.755 INFO:tasks.workunit.client.0.smithi120.stdout:7/775: symlink db/d42/d54/l10d 0 2021-04-09T18:26:27.759 INFO:tasks.workunit.client.0.smithi120.stdout:9/841: mkdir d19/d2c/dc8/d11e 0 2021-04-09T18:26:27.760 INFO:tasks.workunit.client.0.smithi120.stdout:3/806: unlink d3/d5/df5/d87/d9e/f103 0 2021-04-09T18:26:27.762 INFO:tasks.workunit.client.0.smithi120.stdout:2/838: write d13/d15/d35/d9f/db9/fd8 [560530,4065] 0 2021-04-09T18:26:27.764 INFO:tasks.workunit.client.0.smithi120.stdout:6/810: truncate d6/d8/d1a/d36/d54/d31/d37/d61/f9a 1005529 0 2021-04-09T18:26:27.767 INFO:tasks.workunit.client.0.smithi120.stdout:3/807: read d3/d5/f31 [3764485,11145] 0 2021-04-09T18:26:27.781 INFO:tasks.workunit.client.0.smithi120.stdout:0/728: dread d0/d2/da/d23/f2f [0,4194304] 0 2021-04-09T18:26:27.783 INFO:tasks.workunit.client.0.smithi120.stdout:6/811: dwrite d6/d8/d1a/d36/d54/d41/d49/f58 [0,4194304] 0 2021-04-09T18:26:27.785 INFO:tasks.workunit.client.0.smithi120.stdout:9/842: dread d19/d24/d37/d40/d89/f80 [0,4194304] 0 2021-04-09T18:26:27.785 INFO:tasks.workunit.client.0.smithi120.stdout:6/812: stat d6/d8/d1a/d36/d54/d31/f86 0 2021-04-09T18:26:27.787 INFO:tasks.workunit.client.0.smithi120.stdout:9/843: fsync d19/d24/d37/d40/d89/d52/da7/ff6 0 2021-04-09T18:26:27.788 INFO:tasks.workunit.client.0.smithi120.stdout:9/844: write d19/d11d/f6d [1229340,113463] 0 2021-04-09T18:26:27.789 INFO:tasks.workunit.client.0.smithi120.stdout:9/845: mknod d19/d24/d36/d47/c11f 1 2021-04-09T18:26:27.813 INFO:tasks.workunit.client.0.smithi120.stdout:2/839: dread d13/d15/d35/d10e/f99 [0,4194304] 0 2021-04-09T18:26:27.830 INFO:tasks.workunit.client.0.smithi120.stdout:2/840: mkdir d13/d7a/d80/d54/d11b 0 2021-04-09T18:26:27.834 INFO:tasks.workunit.client.0.smithi120.stdout:9/846: creat d19/d24/d37/d40/d89/f120 x:0 0 0 2021-04-09T18:26:27.836 INFO:tasks.workunit.client.0.smithi120.stdout:9/847: write d19/d11d/d76/f11b [320830,68932] 0 2021-04-09T18:26:27.843 INFO:tasks.workunit.client.0.smithi120.stdout:0/729: dread d0/d52/f6d [0,4194304] 0 2021-04-09T18:26:27.851 INFO:tasks.workunit.client.0.smithi120.stdout:9/848: truncate d19/d24/d36/d9c/f118 1028377 0 2021-04-09T18:26:27.853 INFO:tasks.workunit.client.0.smithi120.stdout:0/730: truncate d0/d2/d4/f13 8894311 0 2021-04-09T18:26:27.893 INFO:tasks.workunit.client.0.smithi120.stdout:6/813: write d6/d8/d52/ddf/fe0 [1624861,23437] 0 2021-04-09T18:26:27.894 INFO:tasks.workunit.client.0.smithi120.stdout:6/814: mknod d6/d8/d1a/d36/d54/dfa/c123 1 2021-04-09T18:26:27.900 INFO:tasks.workunit.client.0.smithi120.stdout:6/815: dwrite d6/d8/db/d2b/de2/fec [0,4194304] 0 2021-04-09T18:26:27.950 INFO:tasks.workunit.client.0.smithi120.stdout:7/776: dread db/d42/d54/fa2 [0,4194304] 0 2021-04-09T18:26:27.952 INFO:tasks.workunit.client.0.smithi120.stdout:7/777: chown db/d2c/d30/f66 897 1 2021-04-09T18:26:27.953 INFO:tasks.workunit.client.0.smithi120.stdout:7/778: chown db/d38/f50 0 1 2021-04-09T18:26:27.957 INFO:tasks.workunit.client.0.smithi120.stdout:1/763: sync 2021-04-09T18:26:27.959 INFO:tasks.workunit.client.0.smithi120.stdout:3/808: mkdir d3/d5/d36/d1e/d6b/d49/d89/d68/d107 0 2021-04-09T18:26:27.961 INFO:tasks.workunit.client.0.smithi120.stdout:9/849: dwrite f12 [0,4194304] 0 2021-04-09T18:26:27.963 INFO:tasks.workunit.client.0.smithi120.stdout:9/850: readlink d19/d24/d36/l11a 0 2021-04-09T18:26:27.963 INFO:tasks.workunit.client.0.smithi120.stdout:3/809: symlink d3/d5/df5/d87/d9e/l108 0 2021-04-09T18:26:27.964 INFO:tasks.workunit.client.0.smithi120.stdout:1/764: unlink d5/d5c/d75/daf/dc7/lc1 0 2021-04-09T18:26:27.968 INFO:tasks.workunit.client.0.smithi120.stdout:6/816: mkdir d6/d8/db/d2b/d68/d124 0 2021-04-09T18:26:27.969 INFO:tasks.workunit.client.0.smithi120.stdout:2/841: mkdir d13/d7a/d11c 0 2021-04-09T18:26:27.973 INFO:tasks.workunit.client.0.smithi120.stdout:6/817: rmdir d6/d8/db/d2b/d68/d118/dc3 39 2021-04-09T18:26:27.978 INFO:tasks.workunit.client.0.smithi120.stdout:7/779: dwrite db/d38/f50 [4194304,4194304] 0 2021-04-09T18:26:27.979 INFO:tasks.workunit.client.0.smithi120.stdout:1/765: creat d5/d5c/d75/daf/d87/dc3/f10d x:0 0 0 2021-04-09T18:26:27.989 INFO:tasks.workunit.client.0.smithi120.stdout:6/818: mkdir d6/d8/d52/ddf/df2/d11a/d125 0 2021-04-09T18:26:27.994 INFO:tasks.workunit.client.0.smithi120.stdout:7/780: dread db/d42/d54/d5a/f75 [0,4194304] 0 2021-04-09T18:26:27.994 INFO:tasks.workunit.client.0.smithi120.stdout:6/819: rmdir d6/d8 39 2021-04-09T18:26:27.995 INFO:tasks.workunit.client.0.smithi120.stdout:2/842: link d13/d7a/d80/l87 d13/d15/d35/d9f/db9/l11d 0 2021-04-09T18:26:27.996 INFO:tasks.workunit.client.0.smithi120.stdout:7/781: chown db/d42/d54/d5a 451 1 2021-04-09T18:26:28.000 INFO:tasks.workunit.client.0.smithi120.stdout:7/782: symlink db/d38/d3c/d6e/d94/l10e 0 2021-04-09T18:26:28.002 INFO:tasks.workunit.client.0.smithi120.stdout:2/843: rename d13/l55 to d13/d15/d35/l11e 0 2021-04-09T18:26:28.004 INFO:tasks.workunit.client.0.smithi120.stdout:6/820: creat d6/d8/d1a/f126 x:0 0 0 2021-04-09T18:26:28.007 INFO:tasks.workunit.client.0.smithi120.stdout:7/783: rename db/d38/faf to db/d38/d3c/d6e/d94/f10f 0 2021-04-09T18:26:28.019 INFO:tasks.workunit.client.0.smithi120.stdout:6/821: link d6/d8/f4c d6/d8/d1a/d36/d54/d31/d37/dcc/f127 0 2021-04-09T18:26:28.019 INFO:tasks.workunit.client.0.smithi120.stdout:6/822: read d6/d8/db/d2b/de2/f8d [812672,91457] 0 2021-04-09T18:26:28.025 INFO:tasks.workunit.client.0.smithi120.stdout:3/810: dwrite d3/f70 [0,4194304] 0 2021-04-09T18:26:28.030 INFO:tasks.workunit.client.0.smithi120.stdout:3/811: creat d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/df6/f109 x:0 0 0 2021-04-09T18:26:28.041 INFO:tasks.workunit.client.0.smithi120.stdout:1/766: dwrite d5/d64/d2d/f70 [0,4194304] 0 2021-04-09T18:26:28.045 INFO:tasks.workunit.client.0.smithi120.stdout:7/784: write db/d38/f6d [2368910,67667] 0 2021-04-09T18:26:28.047 INFO:tasks.workunit.client.0.smithi120.stdout:2/844: dwrite d13/d7a/d80/d54/fa0 [0,4194304] 0 2021-04-09T18:26:28.058 INFO:tasks.workunit.client.0.smithi120.stdout:7/785: dwrite db/d42/fdb [0,4194304] 0 2021-04-09T18:26:28.059 INFO:tasks.workunit.client.0.smithi120.stdout:2/845: creat d13/d15/d35/f11f x:0 0 0 2021-04-09T18:26:28.059 INFO:tasks.workunit.client.0.smithi120.stdout:7/786: mknod db/d26/df1/c110 1 2021-04-09T18:26:28.060 INFO:tasks.workunit.client.0.smithi120.stdout:2/846: rmdir d13/d7a/d80/d48/d58 39 2021-04-09T18:26:28.060 INFO:tasks.workunit.client.0.smithi120.stdout:2/847: chown d13/d7a/d80/d54/fa0 6837855 1 2021-04-09T18:26:28.070 INFO:tasks.workunit.client.0.smithi120.stdout:2/848: creat d13/d15/d35/d10e/f120 x:0 0 0 2021-04-09T18:26:28.071 INFO:tasks.workunit.client.0.smithi120.stdout:2/849: write d13/d7a/d80/f45 [1056601,31166] 0 2021-04-09T18:26:28.073 INFO:tasks.workunit.client.0.smithi120.stdout:2/850: write d13/d7a/d80/fc2 [489498,100538] 0 2021-04-09T18:26:28.074 INFO:tasks.workunit.client.0.smithi120.stdout:2/851: dread - d13/d7a/d80/fdf zero size 2021-04-09T18:26:28.082 INFO:tasks.workunit.client.0.smithi120.stdout:2/852: stat l12 0 2021-04-09T18:26:28.082 INFO:tasks.workunit.client.0.smithi120.stdout:6/823: truncate d6/d8/db/d2b/de2/fec 2664089 0 2021-04-09T18:26:28.085 INFO:tasks.workunit.client.0.smithi120.stdout:3/812: dwrite d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe/fce [0,4194304] 0 2021-04-09T18:26:28.091 INFO:tasks.workunit.client.0.smithi120.stdout:2/853: dread d13/fbd [0,4194304] 0 2021-04-09T18:26:28.109 INFO:tasks.workunit.client.0.smithi120.stdout:6/824: creat d6/d8/db/d2b/d68/f128 x:0 0 0 2021-04-09T18:26:28.112 INFO:tasks.workunit.client.0.smithi120.stdout:6/825: read d6/d8/db/d2b/d4d/db8/fdc [267403,25063] 0 2021-04-09T18:26:28.113 INFO:tasks.workunit.client.0.smithi120.stdout:6/826: readlink d6/d8/d1a/l20 0 2021-04-09T18:26:28.119 INFO:tasks.workunit.client.0.smithi120.stdout:3/813: dread d3/d5/df5/d25/f99 [0,4194304] 0 2021-04-09T18:26:28.123 INFO:tasks.workunit.client.0.smithi120.stdout:6/827: rename d6/d8/d1a/d36/d54/d41/d49/f58 to d6/d8/db/d2b/d4d/dfc/dcb/d101/f129 0 2021-04-09T18:26:28.123 INFO:tasks.workunit.client.0.smithi120.stdout:9/851: dread d19/d11d/d63/f87 [4194304,4194304] 0 2021-04-09T18:26:28.124 INFO:tasks.workunit.client.0.smithi120.stdout:3/814: creat d3/d5/d36/d1e/d6b/d6a/d83/dd4/dda/dfd/f10a x:0 0 0 2021-04-09T18:26:28.128 INFO:tasks.workunit.client.0.smithi120.stdout:9/852: unlink f17 0 2021-04-09T18:26:28.131 INFO:tasks.workunit.client.0.smithi120.stdout:7/787: write db/d26/d4c/d53/f67 [567641,124137] 0 2021-04-09T18:26:28.132 INFO:tasks.workunit.client.0.smithi120.stdout:7/788: write db/d26/d4c/d53/f57 [8727448,33089] 0 2021-04-09T18:26:28.135 INFO:tasks.workunit.client.0.smithi120.stdout:9/853: rename d19/d24/d36/d9c/f118 to d19/d24/d36/da8/dcd/f121 0 2021-04-09T18:26:28.136 INFO:tasks.workunit.client.0.smithi120.stdout:7/789: mknod db/d42/c111 1 2021-04-09T18:26:28.136 INFO:tasks.workunit.client.0.smithi120.stdout:6/828: truncate d6/d8/db/d2b/d4d/ff9 907525 0 2021-04-09T18:26:28.137 INFO:tasks.workunit.client.0.smithi120.stdout:9/854: write d19/d24/de4/f116 [91317,4573] 0 2021-04-09T18:26:28.141 INFO:tasks.workunit.client.0.smithi120.stdout:9/855: symlink d19/d24/d37/d40/d89/d52/da7/db1/l122 0 2021-04-09T18:26:28.163 INFO:tasks.workunit.client.0.smithi120.stdout:3/815: dwrite d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe/f92 [0,4194304] 0 2021-04-09T18:26:28.165 INFO:tasks.workunit.client.0.smithi120.stdout:3/816: dread d3/f70 [0,4194304] 0 2021-04-09T18:26:28.168 INFO:tasks.workunit.client.0.smithi120.stdout:7/790: dwrite db/f27 [0,4194304] 0 2021-04-09T18:26:28.169 INFO:tasks.workunit.client.0.smithi120.stdout:7/791: fdatasync db/d38/d3c/d6e/fea 0 2021-04-09T18:26:28.173 INFO:tasks.workunit.client.0.smithi120.stdout:3/817: link d3/d5/d36/dac/fb8 d3/d5/df5/d87/dc8/f10b 0 2021-04-09T18:26:28.178 INFO:tasks.workunit.client.0.smithi120.stdout:7/792: rename db/d42/le3 to db/d2c/d34/d5d/dd2/l112 0 2021-04-09T18:26:28.178 INFO:tasks.workunit.client.0.smithi120.stdout:6/829: truncate d6/d8/db/f39 1277322 0 2021-04-09T18:26:28.182 INFO:tasks.workunit.client.0.smithi120.stdout:3/818: read d3/d5/f77 [4075838,92082] 0 2021-04-09T18:26:28.183 INFO:tasks.workunit.client.0.smithi120.stdout:6/830: getdents d6/d8/d1a/dc7/db2 0 2021-04-09T18:26:28.184 INFO:tasks.workunit.client.0.smithi120.stdout:9/856: write d19/d24/d37/d40/faa [884071,77315] 0 2021-04-09T18:26:28.187 INFO:tasks.workunit.client.0.smithi120.stdout:7/793: dwrite db/d38/fdf [0,4194304] 0 2021-04-09T18:26:28.187 INFO:tasks.workunit.client.0.smithi120.stdout:6/831: readlink d6/d8/d1a/d36/d54/dfa/l102 0 2021-04-09T18:26:28.189 INFO:tasks.workunit.client.0.smithi120.stdout:7/794: readlink db/d38/d3c/lc7 0 2021-04-09T18:26:28.193 INFO:tasks.workunit.client.0.smithi120.stdout:6/832: unlink d6/d8/d52/faa 0 2021-04-09T18:26:28.199 INFO:tasks.workunit.client.0.smithi120.stdout:3/819: read d3/d5/df5/d87/dc8/f10b [1258723,81538] 0 2021-04-09T18:26:28.204 INFO:tasks.workunit.client.0.smithi120.stdout:3/820: symlink d3/d5/d36/d1e/d6b/d6a/d83/dd6/l10c 0 2021-04-09T18:26:28.209 INFO:tasks.workunit.client.0.smithi120.stdout:7/795: creat db/d2c/d34/d5d/f113 x:0 0 0 2021-04-09T18:26:28.210 INFO:tasks.workunit.client.0.smithi120.stdout:6/833: symlink d6/d8/d1a/l12a 0 2021-04-09T18:26:28.210 INFO:tasks.workunit.client.0.smithi120.stdout:3/821: fdatasync d3/d5/d36/d1e/d6b/d6a/d83/dd4/dda/dfd/f10a 0 2021-04-09T18:26:28.214 INFO:tasks.workunit.client.0.smithi120.stdout:6/834: rmdir d6/d8/d1a/d36/d54 39 2021-04-09T18:26:28.216 INFO:tasks.workunit.client.0.smithi120.stdout:9/857: fdatasync d19/d24/d37/d40/f113 0 2021-04-09T18:26:28.218 INFO:tasks.workunit.client.0.smithi120.stdout:3/822: creat d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe/f10d x:0 0 0 2021-04-09T18:26:28.219 INFO:tasks.workunit.client.0.smithi120.stdout:7/796: read db/d2c/d30/f52 [1476751,116342] 0 2021-04-09T18:26:28.223 INFO:tasks.workunit.client.0.smithi120.stdout:3/823: mkdir d3/d5/df5/d25/d10e 0 2021-04-09T18:26:28.224 INFO:tasks.workunit.client.0.smithi120.stdout:3/824: chown d3/fbe 0 1 2021-04-09T18:26:28.226 INFO:tasks.workunit.client.0.smithi120.stdout:3/825: read d3/d5/d36/d1e/f67 [467390,123062] 0 2021-04-09T18:26:28.238 INFO:tasks.workunit.client.0.smithi120.stdout:3/826: rename d3/d5/df5/l3a to d3/d5/df5/d25/d10e/l10f 0 2021-04-09T18:26:28.243 INFO:tasks.workunit.client.0.smithi120.stdout:6/835: write d6/d8/db/d12/f18 [401230,86255] 0 2021-04-09T18:26:28.245 INFO:tasks.workunit.client.0.smithi120.stdout:6/836: write d6/d8/db/d2b/d68/d118/ff6 [1131361,77640] 0 2021-04-09T18:26:28.251 INFO:tasks.workunit.client.0.smithi120.stdout:6/837: unlink d6/d8/db/da6/f8e 0 2021-04-09T18:26:28.251 INFO:tasks.workunit.client.0.smithi120.stdout:2/854: dread d13/d15/f2d [4194304,4194304] 0 2021-04-09T18:26:28.252 INFO:tasks.workunit.client.0.smithi120.stdout:2/855: rmdir d13/d84/df4 39 2021-04-09T18:26:28.257 INFO:tasks.workunit.client.0.smithi120.stdout:6/838: rename d6/d8/db/d2b/de2/fec to d6/d8/db/f12b 0 2021-04-09T18:26:28.259 INFO:tasks.workunit.client.0.smithi120.stdout:6/839: write d6/d8/db/d12/f18 [1261088,95829] 0 2021-04-09T18:26:28.261 INFO:tasks.workunit.client.0.smithi120.stdout:9/858: dwrite d19/d24/d37/d40/f56 [0,4194304] 0 2021-04-09T18:26:28.265 INFO:tasks.workunit.client.0.smithi120.stdout:9/859: fdatasync d19/d24/d37/d40/d89/d52/da7/fc3 0 2021-04-09T18:26:28.267 INFO:tasks.workunit.client.0.smithi120.stdout:8/744: sync 2021-04-09T18:26:28.272 INFO:tasks.workunit.client.0.smithi120.stdout:7/797: dwrite db/d2c/d34/f5b [0,4194304] 0 2021-04-09T18:26:28.281 INFO:tasks.workunit.client.0.smithi120.stdout:3/827: write d3/d5/d36/d1e/d6b/d49/d4e/d54/fb3 [836657,26427] 0 2021-04-09T18:26:28.281 INFO:tasks.workunit.client.0.smithi120.stdout:8/745: getdents d2/d37/d8d 0 2021-04-09T18:26:28.281 INFO:tasks.workunit.client.0.smithi120.stdout:8/746: write d2/d3/d8/f1d [1142532,1707] 0 2021-04-09T18:26:28.284 INFO:tasks.workunit.client.0.smithi120.stdout:3/828: dwrite d3/d5/df5/d87/dc8/ffb [0,4194304] 0 2021-04-09T18:26:28.289 INFO:tasks.workunit.client.0.smithi120.stdout:3/829: rmdir d3/d5/df5/d87/d9e 39 2021-04-09T18:26:28.291 INFO:tasks.workunit.client.0.smithi120.stdout:8/747: fdatasync d2/d37/d3e/f5d 0 2021-04-09T18:26:28.294 INFO:tasks.workunit.client.0.smithi120.stdout:2/856: write d13/d7a/d80/d48/d49/fdc [1039720,9887] 0 2021-04-09T18:26:28.303 INFO:tasks.workunit.client.0.smithi120.stdout:9/860: dwrite d19/d2c/f79 [0,4194304] 0 2021-04-09T18:26:28.310 INFO:tasks.workunit.client.0.smithi120.stdout:8/748: creat d2/d37/d3e/d7c/fe3 x:0 0 0 2021-04-09T18:26:28.310 INFO:tasks.workunit.client.0.smithi120.stdout:9/861: mkdir d19/d24/d36/d47/dbe/ddf/d123 0 2021-04-09T18:26:28.311 INFO:tasks.workunit.client.0.smithi120.stdout:2/857: creat d13/d15/d35/d9f/f121 x:0 0 0 2021-04-09T18:26:28.318 INFO:tasks.workunit.client.0.smithi120.stdout:7/798: truncate db/d38/d3c/d6e/fe2 4751320 0 2021-04-09T18:26:28.320 INFO:tasks.workunit.client.0.smithi120.stdout:9/862: dread d19/d24/d9e/fe9 [0,4194304] 0 2021-04-09T18:26:28.322 INFO:tasks.workunit.client.0.smithi120.stdout:9/863: chown d19/d24/d37/d40/d89/f120 2526 1 2021-04-09T18:26:28.324 INFO:tasks.workunit.client.0.smithi120.stdout:8/749: getdents d2/d37/d8d/dc6 0 2021-04-09T18:26:28.324 INFO:tasks.workunit.client.0.smithi120.stdout:6/840: dread d6/d8/db/d2b/d4d/db8/fd2 [0,4194304] 0 2021-04-09T18:26:28.331 INFO:tasks.workunit.client.0.smithi120.stdout:8/750: truncate d2/d3/fce 271169 0 2021-04-09T18:26:28.332 INFO:tasks.workunit.client.0.smithi120.stdout:6/841: truncate d6/d8/db/d2b/d4d/dfc/dcb/fab 1453631 0 2021-04-09T18:26:28.333 INFO:tasks.workunit.client.0.smithi120.stdout:3/830: dwrite d3/d5/d36/d1e/d6b/d49/d89/dd0/d9a/fa7 [0,4194304] 0 2021-04-09T18:26:28.340 INFO:tasks.workunit.client.0.smithi120.stdout:8/751: link d2/lc1 d2/d3/d11/d6a/daa/le4 0 2021-04-09T18:26:28.345 INFO:tasks.workunit.client.0.smithi120.stdout:8/752: creat d2/d3/d8/da3/fe5 x:0 0 0 2021-04-09T18:26:28.346 INFO:tasks.workunit.client.0.smithi120.stdout:3/831: dwrite d3/d5/d36/d1e/d6b/d6a/d83/dd4/fb5 [0,4194304] 0 2021-04-09T18:26:28.359 INFO:tasks.workunit.client.0.smithi120.stdout:3/832: dread d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe/fce [0,4194304] 0 2021-04-09T18:26:28.374 INFO:tasks.workunit.client.0.smithi120.stdout:7/799: write db/d26/d4c/fe7 [2996436,125398] 0 2021-04-09T18:26:28.375 INFO:tasks.workunit.client.0.smithi120.stdout:7/800: chown db/d38/d3c/l4a 21624 1 2021-04-09T18:26:28.376 INFO:tasks.workunit.client.0.smithi120.stdout:7/801: chown db/d38/d3c/f6a 4479 1 2021-04-09T18:26:28.382 INFO:tasks.workunit.client.0.smithi120.stdout:3/833: getdents d3/d5/d36/d1e 0 2021-04-09T18:26:28.384 INFO:tasks.workunit.client.0.smithi120.stdout:3/834: dread - d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/df6/f109 zero size 2021-04-09T18:26:28.385 INFO:tasks.workunit.client.0.smithi120.stdout:3/835: stat d3/d5/d36/d1e/d6b/d6a/d83/dd4/fb5 0 2021-04-09T18:26:28.401 INFO:tasks.workunit.client.0.smithi120.stdout:3/836: unlink d3/d5/df5/d25/fb0 0 2021-04-09T18:26:28.407 INFO:tasks.workunit.client.0.smithi120.stdout:8/753: truncate d2/d3/d11/d6a/d3b/d6b/da9/fa1 7814545 0 2021-04-09T18:26:28.408 INFO:tasks.workunit.client.0.smithi120.stdout:8/754: readlink d2/d37/d3e/d42/d9e/laf 0 2021-04-09T18:26:28.413 INFO:tasks.workunit.client.0.smithi120.stdout:3/837: dwrite d3/d5/d36/d1e/d6b/d49/d89/f96 [0,4194304] 0 2021-04-09T18:26:28.414 INFO:tasks.workunit.client.0.smithi120.stdout:8/755: link d2/d37/d3e/d42/fb4 d2/d37/d3e/d42/d9e/fe6 0 2021-04-09T18:26:28.419 INFO:tasks.workunit.client.0.smithi120.stdout:8/756: rename d2/d37/d8d/d9b to d2/de7 0 2021-04-09T18:26:28.424 INFO:tasks.workunit.client.0.smithi120.stdout:8/757: creat d2/d37/fe8 x:0 0 0 2021-04-09T18:26:28.428 INFO:tasks.workunit.client.0.smithi120.stdout:8/758: mkdir d2/d3/de9 0 2021-04-09T18:26:28.429 INFO:tasks.workunit.client.0.smithi120.stdout:8/759: rmdir d2/d3/d11/d6a/d3b/d6b/da9 39 2021-04-09T18:26:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:8/760: dwrite d2/d3/d11/fda [0,4194304] 0 2021-04-09T18:26:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:8/761: dread d2/f6e [0,4194304] 0 2021-04-09T18:26:28.457 INFO:tasks.workunit.client.0.smithi120.stdout:8/762: rename d2/d3/d11/d6a/d3b/f66 to d2/de7/fea 0 2021-04-09T18:26:28.458 INFO:tasks.workunit.client.0.smithi120.stdout:5/905: sync 2021-04-09T18:26:28.458 INFO:tasks.workunit.client.0.smithi120.stdout:4/741: sync 2021-04-09T18:26:28.458 INFO:tasks.workunit.client.0.smithi120.stdout:0/731: sync 2021-04-09T18:26:28.462 INFO:tasks.workunit.client.0.smithi120.stdout:5/906: symlink d10/d12/d1b/d141/l142 0 2021-04-09T18:26:28.464 INFO:tasks.workunit.client.0.smithi120.stdout:5/907: chown d10/d12/d1b/d3a/d134/db4/d103/f139 160529 1 2021-04-09T18:26:28.464 INFO:tasks.workunit.client.0.smithi120.stdout:4/742: creat d1f/d2c/df3/f100 x:0 0 0 2021-04-09T18:26:28.481 INFO:tasks.workunit.client.0.smithi120.stdout:0/732: write d0/d2/d4/f13 [6329329,20502] 0 2021-04-09T18:26:28.484 INFO:tasks.workunit.client.0.smithi120.stdout:5/908: fdatasync d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b/fa7 0 2021-04-09T18:26:28.484 INFO:tasks.workunit.client.0.smithi120.stdout:0/733: dread - d0/d2/fe1 zero size 2021-04-09T18:26:28.490 INFO:tasks.workunit.client.0.smithi120.stdout:4/743: truncate d1f/d2c/d56/fc4 1003641 0 2021-04-09T18:26:28.492 INFO:tasks.workunit.client.0.smithi120.stdout:5/909: chown d10/d12/d1b/d3a/d134/ddc/d11d/d8c/fd1 12045 1 2021-04-09T18:26:28.495 INFO:tasks.workunit.client.0.smithi120.stdout:4/744: symlink d1f/d2c/d34/d60/d7a/d92/d3e/l101 0 2021-04-09T18:26:28.496 INFO:tasks.workunit.client.0.smithi120.stdout:0/734: truncate d0/d5a/d6c/faf 569745 0 2021-04-09T18:26:28.497 INFO:tasks.workunit.client.0.smithi120.stdout:5/910: fsync d10/d12/d1b/d141/d78/f81 0 2021-04-09T18:26:28.498 INFO:tasks.workunit.client.0.smithi120.stdout:4/745: unlink d1f/d24/l5a 0 2021-04-09T18:26:28.499 INFO:tasks.workunit.client.0.smithi120.stdout:8/763: dread d2/d3/d11/d6a/d3b/f80 [0,4194304] 0 2021-04-09T18:26:28.501 INFO:tasks.workunit.client.0.smithi120.stdout:4/746: chown d1f/d2c/d34/d60/d7a/d92/d3e/l101 3010138 1 2021-04-09T18:26:28.504 INFO:tasks.workunit.client.0.smithi120.stdout:0/735: dwrite d0/d2/da/f7a [0,4194304] 0 2021-04-09T18:26:28.506 INFO:tasks.workunit.client.0.smithi120.stdout:4/747: write d1f/d2c/d34/d60/fba [1029175,101492] 0 2021-04-09T18:26:28.507 INFO:tasks.workunit.client.0.smithi120.stdout:8/764: rename d2/d3/d50/fbc to d2/d3/d3c/feb 0 2021-04-09T18:26:28.514 INFO:tasks.workunit.client.0.smithi120.stdout:5/911: rename d10/d12/d1b/d1f/d84/d3d/le9 to d10/d12/d1b/d1f/d39/dab/d115/l143 0 2021-04-09T18:26:28.523 INFO:tasks.workunit.client.0.smithi120.stdout:5/912: write d10/d12/d1b/d1f/d84/d3d/d50/faf [957373,9137] 0 2021-04-09T18:26:28.524 INFO:tasks.workunit.client.0.smithi120.stdout:0/736: getdents d0/d5a/d62 0 2021-04-09T18:26:28.524 INFO:tasks.workunit.client.0.smithi120.stdout:4/748: creat d1f/d2c/d34/d60/d7a/d4f/f102 x:0 0 0 2021-04-09T18:26:28.524 INFO:tasks.workunit.client.0.smithi120.stdout:0/737: symlink d0/le4 0 2021-04-09T18:26:28.525 INFO:tasks.workunit.client.0.smithi120.stdout:5/913: mkdir d10/d12/d1b/d3a/d144 0 2021-04-09T18:26:28.527 INFO:tasks.workunit.client.0.smithi120.stdout:4/749: rename d1f/d2c/d34/d83 to d1f/d2c/d34/d83/df7/d103 22 2021-04-09T18:26:28.528 INFO:tasks.workunit.client.0.smithi120.stdout:4/750: chown d1f/d2c/df3/l6f 4156 1 2021-04-09T18:26:28.532 INFO:tasks.workunit.client.0.smithi120.stdout:0/738: link d0/d2/l47 d0/d2/dd/db4/dd2/le5 0 2021-04-09T18:26:28.532 INFO:tasks.workunit.client.0.smithi120.stdout:4/751: rmdir d1f/d2c/d34/d60/d7a/d92 39 2021-04-09T18:26:28.533 INFO:tasks.workunit.client.0.smithi120.stdout:0/739: chown d0/d2/dd/db4 870411 1 2021-04-09T18:26:28.537 INFO:tasks.workunit.client.0.smithi120.stdout:5/914: truncate d10/d12/d1b/d1f/f71 151240 0 2021-04-09T18:26:28.537 INFO:tasks.workunit.client.0.smithi120.stdout:5/915: chown d10/d12/d1b/d3a/d134/ddc 1951353998 1 2021-04-09T18:26:28.538 INFO:tasks.workunit.client.0.smithi120.stdout:0/740: readlink d0/d2/d4/d5f/d81/lb0 0 2021-04-09T18:26:28.540 INFO:tasks.workunit.client.0.smithi120.stdout:4/752: rename d1f/d2c/d34/d83 to d1f/d2c/d34/d60/d7a/d92/d84/d104 0 2021-04-09T18:26:28.543 INFO:tasks.workunit.client.0.smithi120.stdout:4/753: read d1f/d2c/d34/d60/d7a/d4f/fc2 [975485,89657] 0 2021-04-09T18:26:28.548 INFO:tasks.workunit.client.0.smithi120.stdout:5/916: write d10/d12/d3b/f114 [162132,39137] 0 2021-04-09T18:26:28.551 INFO:tasks.workunit.client.0.smithi120.stdout:4/754: dwrite d1f/d2c/d34/d60/d7a/d4f/f102 [0,4194304] 0 2021-04-09T18:26:28.554 INFO:tasks.workunit.client.0.smithi120.stdout:4/755: chown d1f/d2c/d56/lac 12 1 2021-04-09T18:26:28.557 INFO:tasks.workunit.client.0.smithi120.stdout:5/917: chown d10/d12/d1b/d1f/d39/lf7 39 1 2021-04-09T18:26:28.558 INFO:tasks.workunit.client.0.smithi120.stdout:4/756: fdatasync d1f/d2c/d56/f74 0 2021-04-09T18:26:28.565 INFO:tasks.workunit.client.0.smithi120.stdout:5/918: mkdir d10/d12/d1b/d3a/d134/ddc/d11d/d145 0 2021-04-09T18:26:28.566 INFO:tasks.workunit.client.0.smithi120.stdout:4/757: rmdir d1f/d2c/d34/d60/d7a/d92/d3e/d77 39 2021-04-09T18:26:28.569 INFO:tasks.workunit.client.0.smithi120.stdout:5/919: chown d10/d12/d1b/d3a/d134/db4/lfb 0 1 2021-04-09T18:26:28.570 INFO:tasks.workunit.client.0.smithi120.stdout:5/920: chown d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/ff1 26438 1 2021-04-09T18:26:28.572 INFO:tasks.workunit.client.0.smithi120.stdout:4/758: creat d1f/d2c/d34/d60/d7a/d92/d84/d99/df5/f105 x:0 0 0 2021-04-09T18:26:28.576 INFO:tasks.workunit.client.0.smithi120.stdout:5/921: link d10/d12/d1b/fda d10/d12/d1b/d3a/d134/db4/d103/f146 0 2021-04-09T18:26:28.580 INFO:tasks.workunit.client.0.smithi120.stdout:4/759: dwrite d1f/d2c/d34/d60/d7a/d92/d84/fc9 [0,4194304] 0 2021-04-09T18:26:28.581 INFO:tasks.workunit.client.0.smithi120.stdout:5/922: creat d10/d12/d1b/d1f/d39/f147 x:0 0 0 2021-04-09T18:26:28.581 INFO:tasks.workunit.client.0.smithi120.stdout:4/760: readlink d1f/l22 0 2021-04-09T18:26:28.582 INFO:tasks.workunit.client.0.smithi120.stdout:0/741: dread d0/d52/d56/f5d [0,4194304] 0 2021-04-09T18:26:28.589 INFO:tasks.workunit.client.0.smithi120.stdout:5/923: creat d10/d12/d1b/d3a/d134/ddc/d11d/f148 x:0 0 0 2021-04-09T18:26:28.590 INFO:tasks.workunit.client.0.smithi120.stdout:4/761: truncate d1f/d24/fde 618794 0 2021-04-09T18:26:28.602 INFO:tasks.workunit.client.0.smithi120.stdout:0/742: write d0/d2/d4/d5f/d61/d8b/fb7 [48761,6771] 0 2021-04-09T18:26:28.606 INFO:tasks.workunit.client.0.smithi120.stdout:0/743: dread d0/d52/f6d [0,4194304] 0 2021-04-09T18:26:28.609 INFO:tasks.workunit.client.0.smithi120.stdout:0/744: getdents d0/d2/d8d/dd1 0 2021-04-09T18:26:28.610 INFO:tasks.workunit.client.0.smithi120.stdout:5/924: dwrite d10/d12/d3b/f76 [0,4194304] 0 2021-04-09T18:26:28.610 INFO:tasks.workunit.client.0.smithi120.stdout:4/762: dwrite d1f/d2c/df3/dc6/dc5/dda/f93 [0,4194304] 0 2021-04-09T18:26:28.613 INFO:tasks.workunit.client.0.smithi120.stdout:5/925: readlink d10/d12/d1b/d1f/d39/dbb/l11a 0 2021-04-09T18:26:28.615 INFO:tasks.workunit.client.0.smithi120.stdout:5/926: chown d10/d12/d1b/d1f/l37 235200231 1 2021-04-09T18:26:28.619 INFO:tasks.workunit.client.0.smithi120.stdout:0/745: dwrite d0/d2/d4/d5f/d61/d8b/fb7 [0,4194304] 0 2021-04-09T18:26:28.621 INFO:tasks.workunit.client.0.smithi120.stdout:4/763: dread d1f/d2c/d34/d60/d7a/d92/d84/fc9 [0,4194304] 0 2021-04-09T18:26:28.623 INFO:tasks.workunit.client.0.smithi120.stdout:0/746: fsync d0/f3c 0 2021-04-09T18:26:28.627 INFO:tasks.workunit.client.0.smithi120.stdout:5/927: mkdir d10/d12/d1b/d1f/d39/d149 0 2021-04-09T18:26:28.628 INFO:tasks.workunit.client.0.smithi120.stdout:5/928: stat d10/d12/d1b/d1f/d84/d3d/d50/f83 0 2021-04-09T18:26:28.647 INFO:tasks.workunit.client.0.smithi120.stdout:5/929: symlink d10/d12/d1b/d1f/d84/d3d/d50/d94/de5/l14a 0 2021-04-09T18:26:28.648 INFO:tasks.workunit.client.0.smithi120.stdout:5/930: chown d10/d12/d1b/d141/d78/f81 5010 1 2021-04-09T18:26:28.648 INFO:tasks.workunit.client.0.smithi120.stdout:5/931: chown d10/d12/d1b/d1f/ff9 2699467 1 2021-04-09T18:26:28.659 INFO:tasks.workunit.client.0.smithi120.stdout:0/747: getdents d0/d5a/d62/d69/dc6 0 2021-04-09T18:26:28.661 INFO:tasks.workunit.client.0.smithi120.stdout:5/932: fsync d10/d12/d1b/d1f/d39/ffe 0 2021-04-09T18:26:28.666 INFO:tasks.workunit.client.0.smithi120.stdout:5/933: fsync d10/d12/d3b/f67 0 2021-04-09T18:26:28.669 INFO:tasks.workunit.client.0.smithi120.stdout:5/934: dread - d10/d12/d1b/d1f/ff9 zero size 2021-04-09T18:26:28.671 INFO:tasks.workunit.client.0.smithi120.stdout:0/748: truncate d0/d2/dd/db4/dc0/fc2 345622 0 2021-04-09T18:26:28.672 INFO:tasks.workunit.client.0.smithi120.stdout:0/749: readlink d0/d5a/l6a 0 2021-04-09T18:26:28.673 INFO:tasks.workunit.client.0.smithi120.stdout:5/935: rmdir d10/d12/d1b/d1f/d84/d3d/d50/d94 39 2021-04-09T18:26:28.864 INFO:tasks.workunit.client.0.smithi120.stdout:1/767: sync 2021-04-09T18:26:28.865 INFO:tasks.workunit.client.0.smithi120.stdout:1/768: readlink d5/d64/d2d/db5/lbb 0 2021-04-09T18:26:28.866 INFO:tasks.workunit.client.0.smithi120.stdout:1/769: dread - d5/d64/d2d/d5a/fe3 zero size 2021-04-09T18:26:28.870 INFO:tasks.workunit.client.0.smithi120.stdout:1/770: rename d5/d5c/fe6 to d5/d5c/d75/daf/db8/f10e 0 2021-04-09T18:26:28.999 INFO:tasks.workunit.client.0.smithi120.stdout:2/858: sync 2021-04-09T18:26:29.000 INFO:tasks.workunit.client.0.smithi120.stdout:2/859: rmdir d13/d7a/d80/d48/d49 39 2021-04-09T18:26:29.002 INFO:tasks.workunit.client.0.smithi120.stdout:2/860: rmdir d13/d15/d35/d9f/db9 39 2021-04-09T18:26:29.007 INFO:tasks.workunit.client.0.smithi120.stdout:2/861: dwrite d13/d7a/d80/d48/da3/fb6 [0,4194304] 0 2021-04-09T18:26:29.008 INFO:tasks.workunit.client.0.smithi120.stdout:2/862: chown d13/d15/d35/d10e 42 1 2021-04-09T18:26:29.008 INFO:tasks.workunit.client.0.smithi120.stdout:2/863: fdatasync d13/d84/fc3 0 2021-04-09T18:26:29.013 INFO:tasks.workunit.client.0.smithi120.stdout:5/936: dwrite d10/f11 [4194304,4194304] 0 2021-04-09T18:26:29.013 INFO:tasks.workunit.client.0.smithi120.stdout:1/771: write d5/d1f/f15 [200209,126489] 0 2021-04-09T18:26:29.035 INFO:tasks.workunit.client.0.smithi120.stdout:2/864: write d13/f1d [522715,43381] 0 2021-04-09T18:26:29.036 INFO:tasks.workunit.client.0.smithi120.stdout:1/772: write d5/d64/d2d/f3a [8783644,112950] 0 2021-04-09T18:26:29.036 INFO:tasks.workunit.client.0.smithi120.stdout:5/937: write d10/d12/f90 [340915,86678] 0 2021-04-09T18:26:29.037 INFO:tasks.workunit.client.0.smithi120.stdout:2/865: fsync d13/d15/d35/dae/f10f 0 2021-04-09T18:26:29.042 INFO:tasks.workunit.client.0.smithi120.stdout:1/773: symlink d5/d5c/d75/daf/d87/dc3/l10f 0 2021-04-09T18:26:29.047 INFO:tasks.workunit.client.0.smithi120.stdout:5/938: getdents d10/d12/d1b/d3a/d134/db4/d103 0 2021-04-09T18:26:29.048 INFO:tasks.workunit.client.0.smithi120.stdout:2/866: link d13/d15/f2d d13/d15/d35/d10e/f122 0 2021-04-09T18:26:29.049 INFO:tasks.workunit.client.0.smithi120.stdout:5/939: stat d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/fbc 0 2021-04-09T18:26:29.051 INFO:tasks.workunit.client.0.smithi120.stdout:5/940: stat d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/lde 0 2021-04-09T18:26:29.051 INFO:tasks.workunit.client.0.smithi120.stdout:1/774: rename d5/d5c/d75/daf/dc7/d61/deb/fbf to d5/d64/d2d/f110 0 2021-04-09T18:26:29.052 INFO:tasks.workunit.client.0.smithi120.stdout:2/867: dread - d13/d15/fc5 zero size 2021-04-09T18:26:29.053 INFO:tasks.workunit.client.0.smithi120.stdout:5/941: readlink d10/d12/d1b/d1f/d84/d3d/d50/l7f 0 2021-04-09T18:26:29.053 INFO:tasks.workunit.client.0.smithi120.stdout:2/868: readlink ld 0 2021-04-09T18:26:29.055 INFO:tasks.workunit.client.0.smithi120.stdout:2/869: mknod d13/d7a/d80/c123 1 2021-04-09T18:26:29.058 INFO:tasks.workunit.client.0.smithi120.stdout:1/775: dread d5/d64/df9/d86/fcd [0,4194304] 0 2021-04-09T18:26:29.059 INFO:tasks.workunit.client.0.smithi120.stdout:8/765: sync 2021-04-09T18:26:29.060 INFO:tasks.workunit.client.0.smithi120.stdout:7/802: sync 2021-04-09T18:26:29.060 INFO:tasks.workunit.client.0.smithi120.stdout:6/842: sync 2021-04-09T18:26:29.060 INFO:tasks.workunit.client.0.smithi120.stdout:3/838: sync 2021-04-09T18:26:29.060 INFO:tasks.workunit.client.0.smithi120.stdout:4/764: sync 2021-04-09T18:26:29.061 INFO:tasks.workunit.client.0.smithi120.stdout:0/750: sync 2021-04-09T18:26:29.061 INFO:tasks.workunit.client.0.smithi120.stdout:9/864: sync 2021-04-09T18:26:29.062 INFO:tasks.workunit.client.0.smithi120.stdout:2/870: dwrite d13/d15/d35/d9f/f116 [0,4194304] 0 2021-04-09T18:26:29.063 INFO:tasks.workunit.client.0.smithi120.stdout:1/776: write d5/d5c/d75/daf/d2b/dd4/ffe [407838,70623] 0 2021-04-09T18:26:29.064 INFO:tasks.workunit.client.0.smithi120.stdout:8/766: stat d2/d3/d11/d6a/d3b/f94 0 2021-04-09T18:26:29.065 INFO:tasks.workunit.client.0.smithi120.stdout:0/751: unlink d0/d2/dd/f40 0 2021-04-09T18:26:29.065 INFO:tasks.workunit.client.0.smithi120.stdout:2/871: chown d13/d15/de5 83246 1 2021-04-09T18:26:29.067 INFO:tasks.workunit.client.0.smithi120.stdout:3/839: fdatasync d3/d5/d36/d1e/d6b/d49/d4e/f60 0 2021-04-09T18:26:29.070 INFO:tasks.workunit.client.0.smithi120.stdout:1/777: fdatasync d5/d64/d2d/fe1 0 2021-04-09T18:26:29.071 INFO:tasks.workunit.client.0.smithi120.stdout:8/767: fdatasync d2/d37/d3e/f5d 0 2021-04-09T18:26:29.071 INFO:tasks.workunit.client.0.smithi120.stdout:9/865: dread d19/d11d/d63/f8b [0,4194304] 0 2021-04-09T18:26:29.078 INFO:tasks.workunit.client.0.smithi120.stdout:3/840: mknod d3/d5/d36/d1e/d6b/c110 1 2021-04-09T18:26:29.078 INFO:tasks.workunit.client.0.smithi120.stdout:4/765: write d1f/d2c/d34/d60/d7a/d4f/fe1 [2883986,73987] 0 2021-04-09T18:26:29.079 INFO:tasks.workunit.client.0.smithi120.stdout:1/778: stat d5/d5c/d75/fc2 0 2021-04-09T18:26:29.080 INFO:tasks.workunit.client.0.smithi120.stdout:5/942: dwrite d10/d12/d1b/d3a/d134/ddc/d11d/d8c/fad [0,4194304] 0 2021-04-09T18:26:29.080 INFO:tasks.workunit.client.0.smithi120.stdout:7/803: link db/d26/f5e db/d38/d3c/f114 0 2021-04-09T18:26:29.084 INFO:tasks.workunit.client.0.smithi120.stdout:6/843: dwrite d6/d8/db/d2b/d68/f128 [0,4194304] 0 2021-04-09T18:26:29.086 INFO:tasks.workunit.client.0.smithi120.stdout:2/872: symlink d13/d7a/d80/d48/d49/d76/l124 0 2021-04-09T18:26:29.089 INFO:tasks.workunit.client.0.smithi120.stdout:7/804: fdatasync db/d38/d3c/f101 0 2021-04-09T18:26:29.094 INFO:tasks.workunit.client.0.smithi120.stdout:0/752: dwrite d0/d2/f26 [0,4194304] 0 2021-04-09T18:26:29.116 INFO:tasks.workunit.client.0.smithi120.stdout:6/844: mknod d6/d8/d52/c12c 1 2021-04-09T18:26:29.119 INFO:tasks.workunit.client.0.smithi120.stdout:2/873: creat d13/d7a/d80/d48/de3/df8/f125 x:0 0 0 2021-04-09T18:26:29.120 INFO:tasks.workunit.client.0.smithi120.stdout:2/874: stat d13/d7a/d80/d48/d49/d64/d9d/dec 0 2021-04-09T18:26:29.120 INFO:tasks.workunit.client.0.smithi120.stdout:7/805: creat db/d26/df1/f115 x:0 0 0 2021-04-09T18:26:29.123 INFO:tasks.workunit.client.0.smithi120.stdout:4/766: creat d1f/d2c/d34/d60/d7a/d92/d84/d104/f106 x:0 0 0 2021-04-09T18:26:29.128 INFO:tasks.workunit.client.0.smithi120.stdout:7/806: dwrite db/d26/df1/f115 [0,4194304] 0 2021-04-09T18:26:29.130 INFO:tasks.workunit.client.0.smithi120.stdout:9/866: getdents d19/d11d/d76 0 2021-04-09T18:26:29.131 INFO:tasks.workunit.client.0.smithi120.stdout:9/867: stat d19/d24/dd8 0 2021-04-09T18:26:29.144 INFO:tasks.workunit.client.0.smithi120.stdout:5/943: write d10/d12/d1b/d1f/d39/dbb/fef [179088,98458] 0 2021-04-09T18:26:29.151 INFO:tasks.workunit.client.0.smithi120.stdout:3/841: dwrite d3/d5/d36/d1e/d6b/d49/f7c [0,4194304] 0 2021-04-09T18:26:29.151 INFO:tasks.workunit.client.0.smithi120.stdout:9/868: readlink d19/d11d/l5c 0 2021-04-09T18:26:29.152 INFO:tasks.workunit.client.0.smithi120.stdout:8/768: truncate d2/d3/d3c/fc2 889697 0 2021-04-09T18:26:29.153 INFO:tasks.workunit.client.0.smithi120.stdout:0/753: creat d0/d52/fe6 x:0 0 0 2021-04-09T18:26:29.156 INFO:tasks.workunit.client.0.smithi120.stdout:6/845: creat d6/d8/d1a/d36/d54/d31/d111/f12d x:0 0 0 2021-04-09T18:26:29.160 INFO:tasks.workunit.client.0.smithi120.stdout:4/767: dwrite d1f/d24/f26 [0,4194304] 0 2021-04-09T18:26:29.161 INFO:tasks.workunit.client.0.smithi120.stdout:7/807: write db/d38/d3c/d6e/d94/f10f [266844,51602] 0 2021-04-09T18:26:29.163 INFO:tasks.workunit.client.0.smithi120.stdout:4/768: readlink d1f/d2c/d56/lac 0 2021-04-09T18:26:29.166 INFO:tasks.workunit.client.0.smithi120.stdout:6/846: rmdir d6/d8/d1a/d36/d54/d31/d37/dcc 39 2021-04-09T18:26:29.167 INFO:tasks.workunit.client.0.smithi120.stdout:0/754: dwrite d0/d5a/d62/d69/dac/fcd [0,4194304] 0 2021-04-09T18:26:29.169 INFO:tasks.workunit.client.0.smithi120.stdout:1/779: sync 2021-04-09T18:26:29.171 INFO:tasks.workunit.client.0.smithi120.stdout:2/875: dwrite d13/f118 [0,4194304] 0 2021-04-09T18:26:29.174 INFO:tasks.workunit.client.0.smithi120.stdout:8/769: write d2/d37/d3e/d42/d9e/fe2 [1400907,7317] 0 2021-04-09T18:26:29.180 INFO:tasks.workunit.client.0.smithi120.stdout:4/769: read d1f/f8d [209970,25907] 0 2021-04-09T18:26:29.180 INFO:tasks.workunit.client.0.smithi120.stdout:1/780: mknod d5/d5c/d75/daf/d6c/c111 1 2021-04-09T18:26:29.182 INFO:tasks.workunit.client.0.smithi120.stdout:8/770: dread - d2/d37/d3e/d7c/fe3 zero size 2021-04-09T18:26:29.184 INFO:tasks.workunit.client.0.smithi120.stdout:7/808: link db/d38/fdf db/d42/f116 0 2021-04-09T18:26:29.185 INFO:tasks.workunit.client.0.smithi120.stdout:5/944: link d10/d12/d3b/l108 d10/d12/d1b/d1f/d84/d3d/d50/d94/l14b 0 2021-04-09T18:26:29.186 INFO:tasks.workunit.client.0.smithi120.stdout:6/847: mkdir d6/d8/db/d2b/de2/d12e 0 2021-04-09T18:26:29.190 INFO:tasks.workunit.client.0.smithi120.stdout:0/755: mkdir d0/d5a/d62/d69/de7 0 2021-04-09T18:26:29.191 INFO:tasks.workunit.client.0.smithi120.stdout:2/876: dread - d13/d7a/d80/d48/d58/f86 zero size 2021-04-09T18:26:29.192 INFO:tasks.workunit.client.0.smithi120.stdout:8/771: write d2/d37/d3e/d7c/fe3 [741618,56683] 0 2021-04-09T18:26:29.193 INFO:tasks.workunit.client.0.smithi120.stdout:3/842: truncate d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe/fce 2394865 0 2021-04-09T18:26:29.194 INFO:tasks.workunit.client.0.smithi120.stdout:0/756: mknod d0/d2/dd/db4/dc0/ce8 1 2021-04-09T18:26:29.196 INFO:tasks.workunit.client.0.smithi120.stdout:3/843: stat d3/d5/d36/d1e/d6b/d49/d5e/d80 0 2021-04-09T18:26:29.197 INFO:tasks.workunit.client.0.smithi120.stdout:4/770: mkdir d1f/d107 0 2021-04-09T18:26:29.197 INFO:tasks.workunit.client.0.smithi120.stdout:1/781: mkdir d5/d5c/d75/daf/d87/d112 0 2021-04-09T18:26:29.209 INFO:tasks.workunit.client.0.smithi120.stdout:8/772: stat d2/d3/d11/ff 0 2021-04-09T18:26:29.209 INFO:tasks.workunit.client.0.smithi120.stdout:7/809: rmdir db/d38/d74/d6f/d76/dfa 0 2021-04-09T18:26:29.214 INFO:tasks.workunit.client.0.smithi120.stdout:7/810: chown db/d38/d3c/d6e/fe2 16581 1 2021-04-09T18:26:29.219 INFO:tasks.workunit.client.0.smithi120.stdout:8/773: creat d2/d37/d8d/dc6/fec x:0 0 0 2021-04-09T18:26:29.220 INFO:tasks.workunit.client.0.smithi120.stdout:9/869: truncate d19/d24/d36/fc7 973283 0 2021-04-09T18:26:29.220 INFO:tasks.workunit.client.0.smithi120.stdout:9/870: chown d19/d2c/df4 746 1 2021-04-09T18:26:29.223 INFO:tasks.workunit.client.0.smithi120.stdout:5/945: truncate d10/d12/d1b/d3a/d134/db4/fdb 4677948 0 2021-04-09T18:26:29.224 INFO:tasks.workunit.client.0.smithi120.stdout:4/771: getdents d1f/d2c/df3/dc6/da8 0 2021-04-09T18:26:29.231 INFO:tasks.workunit.client.0.smithi120.stdout:7/811: dread db/d2c/d34/f70 [0,4194304] 0 2021-04-09T18:26:29.232 INFO:tasks.workunit.client.0.smithi120.stdout:5/946: dwrite d10/d12/f90 [0,4194304] 0 2021-04-09T18:26:29.238 INFO:tasks.workunit.client.0.smithi120.stdout:2/877: rename d13/d84/d10c/lf0 to d13/d15/d35/d9f/l126 0 2021-04-09T18:26:29.238 INFO:tasks.workunit.client.0.smithi120.stdout:6/848: link d6/d8/d1a/d36/d54/d31/d8a/l115 d6/d8/db/d2b/d68/d118/l12f 0 2021-04-09T18:26:29.242 INFO:tasks.workunit.client.0.smithi120.stdout:7/812: dwrite db/d26/df1/ff7 [0,4194304] 0 2021-04-09T18:26:29.246 INFO:tasks.workunit.client.0.smithi120.stdout:8/774: creat d2/d3/d11/d2c/d44/fed x:0 0 0 2021-04-09T18:26:29.246 INFO:tasks.workunit.client.0.smithi120.stdout:2/878: rmdir d13/d15/d35/dbc 39 2021-04-09T18:26:29.248 INFO:tasks.workunit.client.0.smithi120.stdout:3/844: dwrite d3/d5/d36/d1e/d6b/d49/d89/dd0/f76 [4194304,4194304] 0 2021-04-09T18:26:29.249 INFO:tasks.workunit.client.0.smithi120.stdout:9/871: creat d19/d24/d36/d47/d4b/f124 x:0 0 0 2021-04-09T18:26:29.254 INFO:tasks.workunit.client.0.smithi120.stdout:9/872: write d19/d24/d37/d40/d89/f53 [8178800,91138] 0 2021-04-09T18:26:29.256 INFO:tasks.workunit.client.0.smithi120.stdout:1/782: dwrite d5/d5c/d75/daf/d2b/ff2 [0,4194304] 0 2021-04-09T18:26:29.257 INFO:tasks.workunit.client.0.smithi120.stdout:1/783: chown d5/d64/d2d/f3a 283257 1 2021-04-09T18:26:29.258 INFO:tasks.workunit.client.0.smithi120.stdout:0/757: rename d0/d52/f6e to d0/d2/d7b/fe9 0 2021-04-09T18:26:29.258 INFO:tasks.workunit.client.0.smithi120.stdout:7/813: symlink db/dbf/l117 0 2021-04-09T18:26:29.259 INFO:tasks.workunit.client.0.smithi120.stdout:7/814: mknod db/d26/df1/c118 1 2021-04-09T18:26:29.275 INFO:tasks.workunit.client.0.smithi120.stdout:6/849: mkdir d6/d8/d1a/d36/d54/d31/df1/d130 0 2021-04-09T18:26:29.277 INFO:tasks.workunit.client.0.smithi120.stdout:4/772: dwrite d1f/d2c/d34/d60/d7a/d4f/f79 [0,4194304] 0 2021-04-09T18:26:29.278 INFO:tasks.workunit.client.0.smithi120.stdout:1/784: creat d5/d5c/d75/daf/db8/f113 x:0 0 0 2021-04-09T18:26:29.285 INFO:tasks.workunit.client.0.smithi120.stdout:3/845: creat d3/d5/d36/d1e/d6b/d49/d89/dd0/f111 x:0 0 0 2021-04-09T18:26:29.287 INFO:tasks.workunit.client.0.smithi120.stdout:2/879: rename d13/d7a/d80/dc9 to d13/d7a/d127 0 2021-04-09T18:26:29.287 INFO:tasks.workunit.client.0.smithi120.stdout:5/947: dread d10/d12/d3b/f67 [0,4194304] 0 2021-04-09T18:26:29.289 INFO:tasks.workunit.client.0.smithi120.stdout:0/758: creat d0/d2/d4/fea x:0 0 0 2021-04-09T18:26:29.289 INFO:tasks.workunit.client.0.smithi120.stdout:9/873: dread d19/d24/d36/fc7 [0,4194304] 0 2021-04-09T18:26:29.295 INFO:tasks.workunit.client.0.smithi120.stdout:8/775: rename d2/d3/d11/d6a/f70 to d2/d3/de9/fee 0 2021-04-09T18:26:29.296 INFO:tasks.workunit.client.0.smithi120.stdout:0/759: creat d0/d2/d4/d5f/d61/feb x:0 0 0 2021-04-09T18:26:29.297 INFO:tasks.workunit.client.0.smithi120.stdout:3/846: unlink d3/d5/df5/d25/lc0 0 2021-04-09T18:26:29.297 INFO:tasks.workunit.client.0.smithi120.stdout:0/760: chown d0/d2/f26 0 1 2021-04-09T18:26:29.298 INFO:tasks.workunit.client.0.smithi120.stdout:2/880: symlink d13/d15/d35/l128 0 2021-04-09T18:26:29.299 INFO:tasks.workunit.client.0.smithi120.stdout:3/847: stat d3/d5/d36/d1e/d6b/d6a/d83 0 2021-04-09T18:26:29.299 INFO:tasks.workunit.client.0.smithi120.stdout:2/881: chown d13/d7a/d80/fc2 11677 1 2021-04-09T18:26:29.305 INFO:tasks.workunit.client.0.smithi120.stdout:7/815: dwrite db/d26/f5e [0,4194304] 0 2021-04-09T18:26:29.307 INFO:tasks.workunit.client.0.smithi120.stdout:0/761: creat d0/d5a/d62/d69/dc6/fec x:0 0 0 2021-04-09T18:26:29.313 INFO:tasks.workunit.client.0.smithi120.stdout:3/848: creat d3/d5/f112 x:0 0 0 2021-04-09T18:26:29.315 INFO:tasks.workunit.client.0.smithi120.stdout:2/882: fdatasync d13/d7a/d80/d48/d49/d64/d83/fa9 0 2021-04-09T18:26:29.320 INFO:tasks.workunit.client.0.smithi120.stdout:4/773: write d1f/d2c/d34/d60/d7a/d92/d84/fd3 [331123,86575] 0 2021-04-09T18:26:29.323 INFO:tasks.workunit.client.0.smithi120.stdout:4/774: fsync d1f/d2c/d34/d60/d7a/d4f/f91 0 2021-04-09T18:26:29.328 INFO:tasks.workunit.client.0.smithi120.stdout:0/762: chown d0/d2/l47 33 1 2021-04-09T18:26:29.329 INFO:tasks.workunit.client.0.smithi120.stdout:5/948: dwrite d10/d12/d1b/d1f/d84/d3d/d50/f70 [0,4194304] 0 2021-04-09T18:26:29.333 INFO:tasks.workunit.client.0.smithi120.stdout:1/785: rename d5/l23 to d5/d64/d2d/l114 0 2021-04-09T18:26:29.333 INFO:tasks.workunit.client.0.smithi120.stdout:6/850: dread d6/d8/db/d12/f18 [0,4194304] 0 2021-04-09T18:26:29.334 INFO:tasks.workunit.client.0.smithi120.stdout:2/883: write d13/d15/d35/d9f/db9/fd8 [101069,57792] 0 2021-04-09T18:26:29.335 INFO:tasks.workunit.client.0.smithi120.stdout:0/763: chown d0/d5a/d6c/faf 497931020 1 2021-04-09T18:26:29.338 INFO:tasks.workunit.client.0.smithi120.stdout:8/776: link d2/dcf/dd6/le0 d2/d3/d11/dbd/lef 0 2021-04-09T18:26:29.340 INFO:tasks.workunit.client.0.smithi120.stdout:1/786: chown d5/d5c/d75/daf/d2b/ff4 19192 1 2021-04-09T18:26:29.347 INFO:tasks.workunit.client.0.smithi120.stdout:4/775: rename d1f/d2c/d34/d60/d7a/d92/d84/d104/f106 to d1f/d107/f108 0 2021-04-09T18:26:29.348 INFO:tasks.workunit.client.0.smithi120.stdout:6/851: write d6/d8/db/d2b/de2/d5d/d6e/f80 [3607014,4295] 0 2021-04-09T18:26:29.349 INFO:tasks.workunit.client.0.smithi120.stdout:0/764: symlink d0/d52/d56/led 0 2021-04-09T18:26:29.351 INFO:tasks.workunit.client.0.smithi120.stdout:8/777: mknod d2/d3/cf0 1 2021-04-09T18:26:29.351 INFO:tasks.workunit.client.0.smithi120.stdout:4/776: write d1f/d2c/d34/d60/d7a/d4f/f102 [82026,114548] 0 2021-04-09T18:26:29.351 INFO:tasks.workunit.client.0.smithi120.stdout:8/778: write d2/f6e [2359065,44127] 0 2021-04-09T18:26:29.358 INFO:tasks.workunit.client.0.smithi120.stdout:5/949: creat d10/d12/f14c x:0 0 0 2021-04-09T18:26:29.358 INFO:tasks.workunit.client.0.smithi120.stdout:0/765: rmdir d0/d52 39 2021-04-09T18:26:29.364 INFO:tasks.workunit.client.0.smithi120.stdout:4/777: dwrite d1f/d2c/d34/d60/d7a/d92/d84/d99/dae/fe7 [0,4194304] 0 2021-04-09T18:26:29.366 INFO:tasks.workunit.client.0.smithi120.stdout:0/766: unlink d0/d2/d4/d5f/d81/fd6 0 2021-04-09T18:26:29.368 INFO:tasks.workunit.client.0.smithi120.stdout:7/816: write db/d42/d54/fc4 [1282305,75835] 0 2021-04-09T18:26:29.368 INFO:tasks.workunit.client.0.smithi120.stdout:0/767: fdatasync d0/d2/d4/d5f/d61/d8b/fb7 0 2021-04-09T18:26:29.371 INFO:tasks.workunit.client.0.smithi120.stdout:8/779: creat d2/d37/d3e/d7c/ff1 x:0 0 0 2021-04-09T18:26:29.375 INFO:tasks.workunit.client.0.smithi120.stdout:5/950: dread d10/d12/d1b/d1f/d39/f80 [0,4194304] 0 2021-04-09T18:26:29.378 INFO:tasks.workunit.client.0.smithi120.stdout:2/884: write d13/d7a/d80/f44 [743712,79093] 0 2021-04-09T18:26:29.378 INFO:tasks.workunit.client.0.smithi120.stdout:1/787: truncate d5/d64/d2d/d5a/fe3 193990 0 2021-04-09T18:26:29.380 INFO:tasks.workunit.client.0.smithi120.stdout:2/885: chown d13/d7a/d80/f44 217426 1 2021-04-09T18:26:29.380 INFO:tasks.workunit.client.0.smithi120.stdout:1/788: mknod d5/d5c/d75/daf/d87/dc3/c115 1 2021-04-09T18:26:29.382 INFO:tasks.workunit.client.0.smithi120.stdout:3/849: creat d3/d5/d36/d1e/d6b/d49/d89/d86/f113 x:0 0 0 2021-04-09T18:26:29.382 INFO:tasks.workunit.client.0.smithi120.stdout:6/852: getdents d6/d8/d3a 0 2021-04-09T18:26:29.384 INFO:tasks.workunit.client.0.smithi120.stdout:9/874: truncate d19/d24/d37/d40/d89/d52/ff7 3420339 0 2021-04-09T18:26:29.386 INFO:tasks.workunit.client.0.smithi120.stdout:8/780: unlink d2/d37/d3e/d42/fb4 0 2021-04-09T18:26:29.386 INFO:tasks.workunit.client.0.smithi120.stdout:9/875: dread - d19/d24/fcb zero size 2021-04-09T18:26:29.387 INFO:tasks.workunit.client.0.smithi120.stdout:8/781: readlink d2/d3/d11/d6a/lc9 0 2021-04-09T18:26:29.389 INFO:tasks.workunit.client.0.smithi120.stdout:4/778: symlink d1f/d2c/d56/de0/l109 0 2021-04-09T18:26:29.390 INFO:tasks.workunit.client.0.smithi120.stdout:5/951: rename d10/d12/fbf to d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/f14d 0 2021-04-09T18:26:29.394 INFO:tasks.workunit.client.0.smithi120.stdout:0/768: creat d0/d52/d56/fee x:0 0 0 2021-04-09T18:26:29.394 INFO:tasks.workunit.client.0.smithi120.stdout:3/850: mkdir d3/d5/d36/d1e/d6b/d49/d5e/d80/d114 0 2021-04-09T18:26:29.397 INFO:tasks.workunit.client.0.smithi120.stdout:8/782: dwrite d2/d37/fdf [0,4194304] 0 2021-04-09T18:26:29.404 INFO:tasks.workunit.client.0.smithi120.stdout:5/952: read d10/d12/f1a [1093773,42035] 0 2021-04-09T18:26:29.404 INFO:tasks.workunit.client.0.smithi120.stdout:7/817: write db/d38/dab/fe6 [300476,89013] 0 2021-04-09T18:26:29.407 INFO:tasks.workunit.client.0.smithi120.stdout:1/789: getdents d5/d64/df9 0 2021-04-09T18:26:29.407 INFO:tasks.workunit.client.0.smithi120.stdout:6/853: creat d6/d8/db/d12/d22/f131 x:0 0 0 2021-04-09T18:26:29.410 INFO:tasks.workunit.client.0.smithi120.stdout:3/851: symlink d3/d5/d36/d1e/d6b/d49/d5e/d80/d114/l115 0 2021-04-09T18:26:29.420 INFO:tasks.workunit.client.0.smithi120.stdout:6/854: fdatasync d6/d8/db/d12/d93/fce 0 2021-04-09T18:26:29.422 INFO:tasks.workunit.client.0.smithi120.stdout:2/886: dwrite d13/d15/f24 [0,4194304] 0 2021-04-09T18:26:29.423 INFO:tasks.workunit.client.0.smithi120.stdout:2/887: chown d13/d7a/d80/d48/d49 2194724 1 2021-04-09T18:26:29.424 INFO:tasks.workunit.client.0.smithi120.stdout:2/888: chown d13/d84/d10c/fd5 0 1 2021-04-09T18:26:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:9/876: truncate d19/d24/d37/d40/d89/f120 28572 0 2021-04-09T18:26:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:9/877: chown d19/d24/d37/d40/d89/d52/lc1 1851807 1 2021-04-09T18:26:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:4/779: dwrite d1f/d2c/d34/d60/d7a/d92/d84/d99/f9e [0,4194304] 0 2021-04-09T18:26:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:4/780: write d1f/d24/f26 [5409643,85029] 0 2021-04-09T18:26:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:3/852: symlink d3/d5/d36/d1e/d6b/d49/l116 0 2021-04-09T18:26:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:4/781: chown d1f/d24/f26 7763 1 2021-04-09T18:26:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:1/790: creat d5/d64/df9/d86/f116 x:0 0 0 2021-04-09T18:26:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:1/791: stat d5/d64/d2d/d5a 0 2021-04-09T18:26:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:5/953: getdents d10/d12/d1b/d3a/d134/db4 0 2021-04-09T18:26:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:8/783: truncate d2/d3/f5f 3493212 0 2021-04-09T18:26:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:5/954: chown d10/d12/d1b/d3a/d134/ddc/d11d/d8c/fd8 127987 1 2021-04-09T18:26:29.448 INFO:tasks.workunit.client.0.smithi120.stdout:7/818: link db/d2c/d30/f72 db/d38/d3c/d6e/d94/dd7/f119 0 2021-04-09T18:26:29.449 INFO:tasks.workunit.client.0.smithi120.stdout:2/889: creat d13/d84/f129 x:0 0 0 2021-04-09T18:26:29.450 INFO:tasks.workunit.client.0.smithi120.stdout:8/784: creat d2/de7/ff2 x:0 0 0 2021-04-09T18:26:29.451 INFO:tasks.workunit.client.0.smithi120.stdout:2/890: chown d13/f72 59270837 1 2021-04-09T18:26:29.459 INFO:tasks.workunit.client.0.smithi120.stdout:9/878: rename d19/d2c/f79 to d19/d24/d37/f125 0 2021-04-09T18:26:29.466 INFO:tasks.workunit.client.0.smithi120.stdout:2/891: creat d13/d7a/d80/d48/de3/f12a x:0 0 0 2021-04-09T18:26:29.467 INFO:tasks.workunit.client.0.smithi120.stdout:6/855: link d6/d8/db/f39 d6/d8/d1a/d36/d54/d31/d37/f132 0 2021-04-09T18:26:29.470 INFO:tasks.workunit.client.0.smithi120.stdout:8/785: symlink d2/d3/d8/dc5/lf3 0 2021-04-09T18:26:29.471 INFO:tasks.workunit.client.0.smithi120.stdout:3/853: getdents d3/d5/df5/da6 0 2021-04-09T18:26:29.474 INFO:tasks.workunit.client.0.smithi120.stdout:3/854: chown d3/d5/d36/d1e/d6b/d49/fa8 13770 1 2021-04-09T18:26:29.475 INFO:tasks.workunit.client.0.smithi120.stdout:6/856: dwrite d6/d8/db/d12/d93/f11c [0,4194304] 0 2021-04-09T18:26:29.477 INFO:tasks.workunit.client.0.smithi120.stdout:5/955: write d10/d12/d1b/d1f/d39/dbb/f119 [12018,54454] 0 2021-04-09T18:26:29.479 INFO:tasks.workunit.client.0.smithi120.stdout:9/879: creat d19/d24/d2e/f126 x:0 0 0 2021-04-09T18:26:29.482 INFO:tasks.workunit.client.0.smithi120.stdout:5/956: stat d10/d12/d1b/d1f/d39/dbb/dff/d138 0 2021-04-09T18:26:29.482 INFO:tasks.workunit.client.0.smithi120.stdout:1/792: dwrite d5/d5c/d75/fc2 [0,4194304] 0 2021-04-09T18:26:29.497 INFO:tasks.workunit.client.0.smithi120.stdout:3/855: rmdir d3/d5/d36/d1e/d6b/d49/d4e 39 2021-04-09T18:26:29.501 INFO:tasks.workunit.client.0.smithi120.stdout:2/892: write d13/d7a/d80/d48/d58/f86 [751553,21019] 0 2021-04-09T18:26:29.503 INFO:tasks.workunit.client.0.smithi120.stdout:7/819: dwrite db/d38/f69 [0,4194304] 0 2021-04-09T18:26:29.514 INFO:tasks.workunit.client.0.smithi120.stdout:7/820: rmdir db/d2c/d30 39 2021-04-09T18:26:29.518 INFO:tasks.workunit.client.0.smithi120.stdout:0/769: dread d0/d43/f66 [0,4194304] 0 2021-04-09T18:26:29.526 INFO:tasks.workunit.client.0.smithi120.stdout:1/793: write d5/d1f/f96 [3964387,49156] 0 2021-04-09T18:26:29.531 INFO:tasks.workunit.client.0.smithi120.stdout:1/794: chown d5/d5c/d75/daf/d6c/l71 1328673910 1 2021-04-09T18:26:29.533 INFO:tasks.workunit.client.0.smithi120.stdout:1/795: chown d5/d5c/d75/daf/d2b/f62 1026 1 2021-04-09T18:26:29.536 INFO:tasks.workunit.client.0.smithi120.stdout:8/786: dwrite d2/d3/d11/d6a/d3b/fa4 [0,4194304] 0 2021-04-09T18:26:29.536 INFO:tasks.workunit.client.0.smithi120.stdout:6/857: dwrite d6/d8/d1a/d36/d54/d41/d49/f88 [0,4194304] 0 2021-04-09T18:26:29.540 INFO:tasks.workunit.client.0.smithi120.stdout:9/880: write d19/f38 [5174029,23055] 0 2021-04-09T18:26:29.541 INFO:tasks.workunit.client.0.smithi120.stdout:3/856: read d3/d5/df5/d87/f105 [283654,23629] 0 2021-04-09T18:26:29.541 INFO:tasks.workunit.client.0.smithi120.stdout:7/821: creat db/d26/d4c/f11a x:0 0 0 2021-04-09T18:26:29.542 INFO:tasks.workunit.client.0.smithi120.stdout:7/822: mknod db/d42/d100/c11b 1 2021-04-09T18:26:29.544 INFO:tasks.workunit.client.0.smithi120.stdout:9/881: chown d19/d24/de4/lfe 173337181 1 2021-04-09T18:26:29.551 INFO:tasks.workunit.client.0.smithi120.stdout:5/957: dwrite d10/f140 [0,4194304] 0 2021-04-09T18:26:29.553 INFO:tasks.workunit.client.0.smithi120.stdout:2/893: dwrite f4 [0,4194304] 0 2021-04-09T18:26:29.555 INFO:tasks.workunit.client.0.smithi120.stdout:2/894: chown d13/d61/d7c/f119 117 1 2021-04-09T18:26:29.566 INFO:tasks.workunit.client.0.smithi120.stdout:7/823: rmdir db/d42/d100 0 2021-04-09T18:26:29.566 INFO:tasks.workunit.client.0.smithi120.stdout:2/895: symlink d13/d7a/d80/d48/da3/l12b 0 2021-04-09T18:26:29.570 INFO:tasks.workunit.client.0.smithi120.stdout:0/770: write d0/d2/da/fa9 [544301,107269] 0 2021-04-09T18:26:29.578 INFO:tasks.workunit.client.0.smithi120.stdout:5/958: creat d10/d12/d1b/d3a/d134/ddc/d11d/d8c/f14e x:0 0 0 2021-04-09T18:26:29.590 INFO:tasks.workunit.client.0.smithi120.stdout:0/771: creat d0/d5a/d62/d8f/fef x:0 0 0 2021-04-09T18:26:29.591 INFO:tasks.workunit.client.0.smithi120.stdout:0/772: chown d0/f3c 25686270 1 2021-04-09T18:26:29.591 INFO:tasks.workunit.client.0.smithi120.stdout:0/773: chown d0/d2 488 1 2021-04-09T18:26:29.594 INFO:tasks.workunit.client.0.smithi120.stdout:3/857: write d3/d5/df5/d25/f1f [315426,95311] 0 2021-04-09T18:26:29.594 INFO:tasks.workunit.client.0.smithi120.stdout:9/882: write d19/d24/d37/d40/d89/f120 [269291,36918] 0 2021-04-09T18:26:29.600 INFO:tasks.workunit.client.0.smithi120.stdout:6/858: truncate d6/d8/d1a/d36/d54/d31/f76 1131742 0 2021-04-09T18:26:29.600 INFO:tasks.workunit.client.0.smithi120.stdout:9/883: mknod d19/d24/dd8/c127 1 2021-04-09T18:26:29.603 INFO:tasks.workunit.client.0.smithi120.stdout:9/884: read - d19/d24/d2e/f126 zero size 2021-04-09T18:26:29.604 INFO:tasks.workunit.client.0.smithi120.stdout:3/858: stat d3/d5/d36/lcf 0 2021-04-09T18:26:29.607 INFO:tasks.workunit.client.0.smithi120.stdout:2/896: dwrite d13/d7a/d80/d54/f60 [0,4194304] 0 2021-04-09T18:26:29.608 INFO:tasks.workunit.client.0.smithi120.stdout:5/959: fsync d10/d12/d1b/d3a/d134/db4/fdb 0 2021-04-09T18:26:29.609 INFO:tasks.workunit.client.0.smithi120.stdout:9/885: rmdir d19/d24/d36 39 2021-04-09T18:26:29.612 INFO:tasks.workunit.client.0.smithi120.stdout:7/824: dwrite db/d42/d54/f71 [0,4194304] 0 2021-04-09T18:26:29.615 INFO:tasks.workunit.client.0.smithi120.stdout:2/897: creat d13/d7a/d80/d48/d49/d76/f12c x:0 0 0 2021-04-09T18:26:29.616 INFO:tasks.workunit.client.0.smithi120.stdout:5/960: chown d10/d12/d1b/d3a/d134/ddc/d11d/d8c/l47 3570202 1 2021-04-09T18:26:29.618 INFO:tasks.workunit.client.0.smithi120.stdout:9/886: fsync d19/d81/f109 0 2021-04-09T18:26:29.619 INFO:tasks.workunit.client.0.smithi120.stdout:9/887: stat d19/d81/d119 0 2021-04-09T18:26:29.626 INFO:tasks.workunit.client.0.smithi120.stdout:6/859: rename d6/d8/db/d2b/de2/d5d/d6e/f122 to d6/d8/d3a/f133 0 2021-04-09T18:26:29.631 INFO:tasks.workunit.client.0.smithi120.stdout:9/888: rmdir d19/d24 39 2021-04-09T18:26:29.637 INFO:tasks.workunit.client.0.smithi120.stdout:7/825: mkdir db/d2c/d34/d5d/d11c 0 2021-04-09T18:26:29.642 INFO:tasks.workunit.client.0.smithi120.stdout:2/898: mkdir d13/d15/d12d 0 2021-04-09T18:26:29.643 INFO:tasks.workunit.client.0.smithi120.stdout:7/826: dwrite db/f27 [4194304,4194304] 0 2021-04-09T18:26:29.654 INFO:tasks.workunit.client.0.smithi120.stdout:7/827: rmdir db/d38/d74/d6f/d76/da5 39 2021-04-09T18:26:29.654 INFO:tasks.workunit.client.0.smithi120.stdout:2/899: symlink d13/d7a/d80/d48/d49/d64/d9d/dbb/dd6/l12e 0 2021-04-09T18:26:29.655 INFO:tasks.workunit.client.0.smithi120.stdout:3/859: rename d3/f70 to d3/d5/df5/d25/f117 0 2021-04-09T18:26:29.657 INFO:tasks.workunit.client.0.smithi120.stdout:2/900: read f6 [846145,121266] 0 2021-04-09T18:26:29.658 INFO:tasks.workunit.client.0.smithi120.stdout:2/901: read d13/f118 [721833,84034] 0 2021-04-09T18:26:29.660 INFO:tasks.workunit.client.0.smithi120.stdout:0/774: truncate d0/d2/dd/db4/dc0/fc2 778051 0 2021-04-09T18:26:29.663 INFO:tasks.workunit.client.0.smithi120.stdout:0/775: readlink d0/d2/d4/d5f/d61/d8b/l44 0 2021-04-09T18:26:29.669 INFO:tasks.workunit.client.0.smithi120.stdout:6/860: rename d6/d8/d1a/d36/d54/d31/f53 to d6/d8/d1a/d36/d54/d41/d49/f134 0 2021-04-09T18:26:29.671 INFO:tasks.workunit.client.0.smithi120.stdout:3/860: creat d3/d5/d36/d1e/d6b/d49/d89/d68/f118 x:0 0 0 2021-04-09T18:26:29.675 INFO:tasks.workunit.client.0.smithi120.stdout:7/828: truncate db/d2c/d34/d5d/dd2/f10b 171853 0 2021-04-09T18:26:29.681 INFO:tasks.workunit.client.0.smithi120.stdout:3/861: creat d3/d5/d36/d1e/d38/db9/f119 x:0 0 0 2021-04-09T18:26:29.685 INFO:tasks.workunit.client.0.smithi120.stdout:2/902: truncate d13/d7a/d80/d48/da3/f112 979720 0 2021-04-09T18:26:29.686 INFO:tasks.workunit.client.0.smithi120.stdout:0/776: link d0/d5a/d62/fde d0/d2/da/d23/ff0 0 2021-04-09T18:26:29.688 INFO:tasks.workunit.client.0.smithi120.stdout:5/961: dwrite d10/d12/d1b/d1f/d39/f80 [0,4194304] 0 2021-04-09T18:26:29.690 INFO:tasks.workunit.client.0.smithi120.stdout:6/861: getdents d6/d8/db/d2b/d68/d118/dc3/de4 0 2021-04-09T18:26:29.690 INFO:tasks.workunit.client.0.smithi120.stdout:9/889: truncate d19/d24/d36/d9d/fa6 331473 0 2021-04-09T18:26:29.694 INFO:tasks.workunit.client.0.smithi120.stdout:7/829: dread db/d42/d54/d5a/f6b [4194304,4194304] 0 2021-04-09T18:26:29.694 INFO:tasks.workunit.client.0.smithi120.stdout:3/862: creat d3/d5/d36/d1e/d6b/d6a/d83/dd4/f11a x:0 0 0 2021-04-09T18:26:29.696 INFO:tasks.workunit.client.0.smithi120.stdout:7/830: write db/d26/df1/f115 [3569957,6851] 0 2021-04-09T18:26:29.705 INFO:tasks.workunit.client.0.smithi120.stdout:2/903: dread d13/d15/d35/d10e/f122 [0,4194304] 0 2021-04-09T18:26:29.708 INFO:tasks.workunit.client.0.smithi120.stdout:2/904: chown d13/d15/f24 616333 1 2021-04-09T18:26:29.709 INFO:tasks.workunit.client.0.smithi120.stdout:7/831: creat db/d38/d3c/d6e/d94/f11d x:0 0 0 2021-04-09T18:26:29.710 INFO:tasks.workunit.client.0.smithi120.stdout:2/905: fdatasync d13/d7a/d80/d48/d49/d76/ff3 0 2021-04-09T18:26:29.712 INFO:tasks.workunit.client.0.smithi120.stdout:8/787: dread d2/d3/d3c/d4f/f81 [0,4194304] 0 2021-04-09T18:26:29.714 INFO:tasks.workunit.client.0.smithi120.stdout:8/788: mknod d2/de7/cf4 1 2021-04-09T18:26:29.714 INFO:tasks.workunit.client.0.smithi120.stdout:9/890: creat d19/d24/d37/d40/d89/d52/f128 x:0 0 0 2021-04-09T18:26:29.716 INFO:tasks.workunit.client.0.smithi120.stdout:7/832: dwrite db/d7f/ffe [0,4194304] 0 2021-04-09T18:26:29.718 INFO:tasks.workunit.client.0.smithi120.stdout:2/906: mkdir d13/d7a/d80/d48/d49/d64/d83/d12f 0 2021-04-09T18:26:29.723 INFO:tasks.workunit.client.0.smithi120.stdout:8/789: mkdir d2/d3/d8/df5 0 2021-04-09T18:26:29.727 INFO:tasks.workunit.client.0.smithi120.stdout:9/891: unlink d19/d11d/d76/f83 0 2021-04-09T18:26:29.730 INFO:tasks.workunit.client.0.smithi120.stdout:8/790: rmdir d2/d3/d3c/d4f 39 2021-04-09T18:26:29.731 INFO:tasks.workunit.client.0.smithi120.stdout:5/962: truncate d10/d12/d1b/d1f/d39/dbb/fef 1149360 0 2021-04-09T18:26:29.731 INFO:tasks.workunit.client.0.smithi120.stdout:9/892: readlink d19/d24/d36/d47/d6f/l8d 0 2021-04-09T18:26:29.732 INFO:tasks.workunit.client.0.smithi120.stdout:7/833: dwrite db/d38/d3c/f101 [0,4194304] 0 2021-04-09T18:26:29.732 INFO:tasks.workunit.client.0.smithi120.stdout:0/777: dwrite d0/d2/d4/f59 [0,4194304] 0 2021-04-09T18:26:29.735 INFO:tasks.workunit.client.0.smithi120.stdout:6/862: truncate d6/d8/db/d2b/d4d/f8c 730824 0 2021-04-09T18:26:29.735 INFO:tasks.workunit.client.0.smithi120.stdout:2/907: rename d13/d7a/d80/d48/da3/f112 to d13/f130 0 2021-04-09T18:26:29.740 INFO:tasks.workunit.client.0.smithi120.stdout:7/834: fdatasync db/d38/ff2 0 2021-04-09T18:26:29.750 INFO:tasks.workunit.client.0.smithi120.stdout:6/863: creat d6/d8/d1a/d36/d54/d31/df1/d130/f135 x:0 0 0 2021-04-09T18:26:29.759 INFO:tasks.workunit.client.0.smithi120.stdout:9/893: dwrite d19/d24/d37/f125 [0,4194304] 0 2021-04-09T18:26:29.763 INFO:tasks.workunit.client.0.smithi120.stdout:3/863: truncate d3/d5/d36/d1e/d6b/f79 3819702 0 2021-04-09T18:26:29.764 INFO:tasks.workunit.client.0.smithi120.stdout:3/864: chown d3/d5/d36/d1e/f40 65153 1 2021-04-09T18:26:29.765 INFO:tasks.workunit.client.0.smithi120.stdout:8/791: write d2/d3/d11/d6a/d3b/f47 [1182522,94158] 0 2021-04-09T18:26:29.771 INFO:tasks.workunit.client.0.smithi120.stdout:6/864: truncate d6/d8/db/d2b/d68/fea 861441 0 2021-04-09T18:26:29.776 INFO:tasks.workunit.client.0.smithi120.stdout:8/792: creat d2/d37/ff6 x:0 0 0 2021-04-09T18:26:29.777 INFO:tasks.workunit.client.0.smithi120.stdout:3/865: link d3/d5/d36/d1e/d6b/d6a/d83/dd4/fb5 d3/d5/df5/d87/d9e/f11b 0 2021-04-09T18:26:29.778 INFO:tasks.workunit.client.0.smithi120.stdout:6/865: chown d6/ff8 10902338 1 2021-04-09T18:26:29.780 INFO:tasks.workunit.client.0.smithi120.stdout:2/908: dread d13/d84/fc3 [0,4194304] 0 2021-04-09T18:26:29.785 INFO:tasks.workunit.client.0.smithi120.stdout:3/866: chown d3/d5/d36/d1e/d6b/d49/d5e/d80 44 1 2021-04-09T18:26:29.789 INFO:tasks.workunit.client.0.smithi120.stdout:0/778: write d0/d5a/d6c/fa7 [603535,68604] 0 2021-04-09T18:26:29.791 INFO:tasks.workunit.client.0.smithi120.stdout:3/867: rename d3/d5/df5/da6/dcc/d106 to d3/d5/df5/da6/dcc/d11c 0 2021-04-09T18:26:29.793 INFO:tasks.workunit.client.0.smithi120.stdout:2/909: symlink d13/d15/l131 0 2021-04-09T18:26:29.794 INFO:tasks.workunit.client.0.smithi120.stdout:0/779: stat d0/d2/d7b/fe9 0 2021-04-09T18:26:29.795 INFO:tasks.workunit.client.0.smithi120.stdout:3/868: mknod d3/d5/df5/d25/c11d 1 2021-04-09T18:26:29.796 INFO:tasks.workunit.client.0.smithi120.stdout:0/780: chown d0/d2/da/f19 258 1 2021-04-09T18:26:29.797 INFO:tasks.workunit.client.0.smithi120.stdout:8/793: mkdir d2/d3/d3c/d4f/df7 0 2021-04-09T18:26:29.799 INFO:tasks.workunit.client.0.smithi120.stdout:2/910: mkdir d13/d15/d35/d9f/df1/d132 0 2021-04-09T18:26:29.801 INFO:tasks.workunit.client.0.smithi120.stdout:3/869: symlink d3/d5/df5/da6/de2/l11e 0 2021-04-09T18:26:29.805 INFO:tasks.workunit.client.0.smithi120.stdout:0/781: fdatasync d0/d5a/d62/fde 0 2021-04-09T18:26:29.806 INFO:tasks.workunit.client.0.smithi120.stdout:2/911: mkdir d13/d15/d35/d9f/d133 0 2021-04-09T18:26:29.809 INFO:tasks.workunit.client.0.smithi120.stdout:8/794: rename d2/d3/d8/f1d to d2/d3/d50/ff8 0 2021-04-09T18:26:29.809 INFO:tasks.workunit.client.0.smithi120.stdout:7/835: write db/d38/d3c/d6e/d94/dd7/fff [767464,29527] 0 2021-04-09T18:26:29.817 INFO:tasks.workunit.client.0.smithi120.stdout:0/782: unlink d0/d2/d4/d5f/d61/d8b/fb7 0 2021-04-09T18:26:29.819 INFO:tasks.workunit.client.0.smithi120.stdout:5/963: dread d10/d12/d1b/d141/fb1 [0,4194304] 0 2021-04-09T18:26:29.820 INFO:tasks.workunit.client.0.smithi120.stdout:3/870: dwrite d3/d5/d36/d1e/d6b/d49/d4e/d54/fb3 [0,4194304] 0 2021-04-09T18:26:29.820 INFO:tasks.workunit.client.0.smithi120.stdout:7/836: stat db/d42/d54/l10d 0 2021-04-09T18:26:29.821 INFO:tasks.workunit.client.0.smithi120.stdout:7/837: readlink db/d2c/l49 0 2021-04-09T18:26:29.824 INFO:tasks.workunit.client.0.smithi120.stdout:8/795: getdents d2/d3/de9 0 2021-04-09T18:26:29.828 INFO:tasks.workunit.client.0.smithi120.stdout:7/838: chown db/d42/d54/d5a/ld1 311 1 2021-04-09T18:26:29.833 INFO:tasks.workunit.client.0.smithi120.stdout:3/871: dwrite d3/d5/d36/d1e/d38/f44 [0,4194304] 0 2021-04-09T18:26:29.834 INFO:tasks.workunit.client.0.smithi120.stdout:9/894: dwrite d19/d2c/ff1 [0,4194304] 0 2021-04-09T18:26:29.839 INFO:tasks.workunit.client.0.smithi120.stdout:4/782: dread d1f/d2c/f96 [0,4194304] 0 2021-04-09T18:26:29.840 INFO:tasks.workunit.client.0.smithi120.stdout:5/964: write d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b/fa7 [736944,95722] 0 2021-04-09T18:26:29.846 INFO:tasks.workunit.client.0.smithi120.stdout:6/866: truncate d6/d8/d1a/d36/f5c 4537452 0 2021-04-09T18:26:29.850 INFO:tasks.workunit.client.0.smithi120.stdout:8/796: write d2/d3/f4c [1366952,19537] 0 2021-04-09T18:26:29.859 INFO:tasks.workunit.client.0.smithi120.stdout:7/839: creat db/d2c/d30/f11e x:0 0 0 2021-04-09T18:26:29.860 INFO:tasks.workunit.client.0.smithi120.stdout:2/912: dwrite d13/d7a/d80/d48/da3/fdb [0,4194304] 0 2021-04-09T18:26:29.865 INFO:tasks.workunit.client.0.smithi120.stdout:0/783: dwrite d0/d2/d4/d5f/f76 [0,4194304] 0 2021-04-09T18:26:29.869 INFO:tasks.workunit.client.0.smithi120.stdout:9/895: dwrite d19/d24/d36/d47/d4b/fe6 [0,4194304] 0 2021-04-09T18:26:29.879 INFO:tasks.workunit.client.0.smithi120.stdout:0/784: write d0/d5a/d62/d72/fab [173253,91530] 0 2021-04-09T18:26:29.880 INFO:tasks.workunit.client.0.smithi120.stdout:9/896: rename d19/d24/d37/d40/d89/d52/da7/ff6 to d19/d24/d36/f129 0 2021-04-09T18:26:29.880 INFO:tasks.workunit.client.0.smithi120.stdout:0/785: mknod d0/d2/dd/db4/dc0/cf1 1 2021-04-09T18:26:29.883 INFO:tasks.workunit.client.0.smithi120.stdout:2/913: write d13/d7a/d80/d48/d49/d76/fe9 [639112,126651] 0 2021-04-09T18:26:29.884 INFO:tasks.workunit.client.0.smithi120.stdout:5/965: write d10/d12/d1b/d141/d78/f81 [344159,40973] 0 2021-04-09T18:26:29.884 INFO:tasks.workunit.client.0.smithi120.stdout:8/797: mknod d2/d37/d3e/d42/d9e/cf9 1 2021-04-09T18:26:29.885 INFO:tasks.workunit.client.0.smithi120.stdout:4/783: link d1f/d2c/d34/d60/d7a/l45 d1f/d24/d42/l10a 0 2021-04-09T18:26:29.893 INFO:tasks.workunit.client.0.smithi120.stdout:6/867: link d6/d8/d1a/d36/d54/d41/d49/f7c d6/d8/db/d92/f136 0 2021-04-09T18:26:29.893 INFO:tasks.workunit.client.0.smithi120.stdout:9/897: creat d19/d2c/dc8/d11e/f12a x:0 0 0 2021-04-09T18:26:29.894 INFO:tasks.workunit.client.0.smithi120.stdout:6/868: stat d6/d8/d1a/d36/d54/f120 0 2021-04-09T18:26:29.895 INFO:tasks.workunit.client.0.smithi120.stdout:9/898: mknod d19/d24/d36/c12b 1 2021-04-09T18:26:29.897 INFO:tasks.workunit.client.0.smithi120.stdout:6/869: fdatasync d6/d8/db/d2b/d68/f128 0 2021-04-09T18:26:29.897 INFO:tasks.workunit.client.0.smithi120.stdout:9/899: read d19/d24/d37/f125 [824773,58316] 0 2021-04-09T18:26:29.898 INFO:tasks.workunit.client.0.smithi120.stdout:6/870: mknod d6/d8/db/d12/d93/c137 1 2021-04-09T18:26:29.900 INFO:tasks.workunit.client.0.smithi120.stdout:8/798: write d2/d3/fce [1107343,101475] 0 2021-04-09T18:26:29.901 INFO:tasks.workunit.client.0.smithi120.stdout:2/914: getdents d13/d61 0 2021-04-09T18:26:29.904 INFO:tasks.workunit.client.0.smithi120.stdout:5/966: rename d10/d12/d1b/d3a/d134/ddc/d11d/dcb/d10b to d10/d12/d1b/d1f/d39/dab/d14f 0 2021-04-09T18:26:29.907 INFO:tasks.workunit.client.0.smithi120.stdout:5/967: fsync d10/d12/d1b/d3a/d134/ddc/d11d/f148 0 2021-04-09T18:26:29.911 INFO:tasks.workunit.client.0.smithi120.stdout:8/799: dread d2/d3/d11/d6a/d3b/f67 [0,4194304] 0 2021-04-09T18:26:29.911 INFO:tasks.workunit.client.0.smithi120.stdout:9/900: mkdir d19/d2c/d12c 0 2021-04-09T18:26:29.911 INFO:tasks.workunit.client.0.smithi120.stdout:9/901: fdatasync d19/d24/d36/f6e 0 2021-04-09T18:26:29.913 INFO:tasks.workunit.client.0.smithi120.stdout:6/871: readlink d6/d8/d3a/la3 0 2021-04-09T18:26:29.914 INFO:tasks.workunit.client.0.smithi120.stdout:9/902: chown d19/d11d/d63/f8b 0 1 2021-04-09T18:26:29.916 INFO:tasks.workunit.client.0.smithi120.stdout:3/872: dread d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe/fce [0,4194304] 0 2021-04-09T18:26:29.917 INFO:tasks.workunit.client.0.smithi120.stdout:5/968: mkdir d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/dd4/d130/d150 0 2021-04-09T18:26:29.918 INFO:tasks.workunit.client.0.smithi120.stdout:2/915: creat d13/d7a/d80/d48/d58/f134 x:0 0 0 2021-04-09T18:26:29.922 INFO:tasks.workunit.client.0.smithi120.stdout:6/872: write d6/d8/d1a/d36/d54/d31/d8a/fa4 [754707,94412] 0 2021-04-09T18:26:29.924 INFO:tasks.workunit.client.0.smithi120.stdout:8/800: creat d2/d3/ffa x:0 0 0 2021-04-09T18:26:29.929 INFO:tasks.workunit.client.0.smithi120.stdout:9/903: write d19/d24/d36/d9d/fa6 [607682,76401] 0 2021-04-09T18:26:29.929 INFO:tasks.workunit.client.0.smithi120.stdout:3/873: dwrite d3/d5/d36/d1e/d6b/d49/d89/d68/f118 [0,4194304] 0 2021-04-09T18:26:29.932 INFO:tasks.workunit.client.0.smithi120.stdout:2/916: creat d13/d7a/d80/d48/d49/d64/f135 x:0 0 0 2021-04-09T18:26:29.935 INFO:tasks.workunit.client.0.smithi120.stdout:5/969: dread d10/d12/d1b/d3a/fec [0,4194304] 0 2021-04-09T18:26:29.935 INFO:tasks.workunit.client.0.smithi120.stdout:6/873: creat d6/d8/db/dac/d10e/f138 x:0 0 0 2021-04-09T18:26:29.937 INFO:tasks.workunit.client.0.smithi120.stdout:2/917: write d13/d15/d35/dae/fa5 [3293658,73464] 0 2021-04-09T18:26:29.938 INFO:tasks.workunit.client.0.smithi120.stdout:6/874: chown d6/d8/d1a/dc7 0 1 2021-04-09T18:26:29.943 INFO:tasks.workunit.client.0.smithi120.stdout:0/786: dread d0/d5a/d62/fde [0,4194304] 0 2021-04-09T18:26:29.944 INFO:tasks.workunit.client.0.smithi120.stdout:3/874: chown d3/d5/df5/da6/dcc/lf2 4639132 1 2021-04-09T18:26:29.944 INFO:tasks.workunit.client.0.smithi120.stdout:4/784: dread d1f/d24/f33 [0,4194304] 0 2021-04-09T18:26:29.947 INFO:tasks.workunit.client.0.smithi120.stdout:8/801: dwrite d2/d3/d11/d2c/f93 [0,4194304] 0 2021-04-09T18:26:29.949 INFO:tasks.workunit.client.0.smithi120.stdout:9/904: dwrite d19/d24/d36/d47/d4b/f124 [0,4194304] 0 2021-04-09T18:26:29.950 INFO:tasks.workunit.client.0.smithi120.stdout:6/875: mkdir d6/d8/db/dac/d139 0 2021-04-09T18:26:29.950 INFO:tasks.workunit.client.0.smithi120.stdout:5/970: creat d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/f151 x:0 0 0 2021-04-09T18:26:29.952 INFO:tasks.workunit.client.0.smithi120.stdout:4/785: fsync d1f/d2c/d34/d60/d7a/d92/d84/d99/dae/fe7 0 2021-04-09T18:26:29.955 INFO:tasks.workunit.client.0.smithi120.stdout:0/787: rmdir d0/d2/d4 39 2021-04-09T18:26:29.961 INFO:tasks.workunit.client.0.smithi120.stdout:8/802: dwrite d2/d27/f29 [0,4194304] 0 2021-04-09T18:26:29.961 INFO:tasks.workunit.client.0.smithi120.stdout:9/905: write d19/d24/d36/f6e [1277115,119373] 0 2021-04-09T18:26:29.962 INFO:tasks.workunit.client.0.smithi120.stdout:8/803: write d2/d3/d11/d6a/f85 [5229665,99799] 0 2021-04-09T18:26:29.964 INFO:tasks.workunit.client.0.smithi120.stdout:0/788: fdatasync d0/d5a/d62/d69/dac/fcd 0 2021-04-09T18:26:29.978 INFO:tasks.workunit.client.0.smithi120.stdout:6/876: mkdir d6/d8/db/d13a 0 2021-04-09T18:26:29.979 INFO:tasks.workunit.client.0.smithi120.stdout:5/971: write d10/d12/d1b/d1f/d84/d3d/d50/fdf [81669,83955] 0 2021-04-09T18:26:29.979 INFO:tasks.workunit.client.0.smithi120.stdout:4/786: write d1f/d2c/d34/f51 [4663983,128255] 0 2021-04-09T18:26:29.982 INFO:tasks.workunit.client.0.smithi120.stdout:4/787: dread - d1f/d2c/df3/f100 zero size 2021-04-09T18:26:29.987 INFO:tasks.workunit.client.0.smithi120.stdout:2/918: truncate d13/f47 4632152 0 2021-04-09T18:26:29.988 INFO:tasks.workunit.client.0.smithi120.stdout:8/804: mkdir d2/d3/d11/d6a/daa/dfb 0 2021-04-09T18:26:29.991 INFO:tasks.workunit.client.0.smithi120.stdout:2/919: read d13/d61/f89 [35899,72831] 0 2021-04-09T18:26:29.995 INFO:tasks.workunit.client.0.smithi120.stdout:6/877: symlink d6/d8/db/d2b/de2/d5d/d6e/l13b 0 2021-04-09T18:26:29.996 INFO:tasks.workunit.client.0.smithi120.stdout:4/788: getdents d1f/d2c/d34/d60/d7a/d4f/de3 0 2021-04-09T18:26:29.996 INFO:tasks.workunit.client.0.smithi120.stdout:9/906: chown d19/d81/lc6 3296 1 2021-04-09T18:26:30.002 INFO:tasks.workunit.client.0.smithi120.stdout:2/920: write d13/d15/d35/dae/fa5 [2705262,39915] 0 2021-04-09T18:26:30.003 INFO:tasks.workunit.client.0.smithi120.stdout:6/878: symlink d6/d8/d52/ddf/df2/l13c 0 2021-04-09T18:26:30.003 INFO:tasks.workunit.client.0.smithi120.stdout:9/907: fdatasync d19/d24/fcb 0 2021-04-09T18:26:30.006 INFO:tasks.workunit.client.0.smithi120.stdout:0/789: dwrite d0/d2/d4/fcb [4194304,4194304] 0 2021-04-09T18:26:30.009 INFO:tasks.workunit.client.0.smithi120.stdout:5/972: truncate d10/d12/d1b/fc2 2967807 0 2021-04-09T18:26:30.019 INFO:tasks.workunit.client.0.smithi120.stdout:2/921: dwrite d13/d7a/d80/d48/d49/d64/d83/fa9 [0,4194304] 0 2021-04-09T18:26:30.019 INFO:tasks.workunit.client.0.smithi120.stdout:9/908: symlink d19/d24/d36/l12d 0 2021-04-09T18:26:30.019 INFO:tasks.workunit.client.0.smithi120.stdout:8/805: link d2/d3/d11/d6a/d3b/f2b d2/d3/d11/d6a/d3b/d6b/ffc 0 2021-04-09T18:26:30.024 INFO:tasks.workunit.client.0.smithi120.stdout:2/922: readlink d13/d7a/d80/l3b 0 2021-04-09T18:26:30.033 INFO:tasks.workunit.client.0.smithi120.stdout:2/923: dread - d13/d7a/d80/d48/d49/d64/fba zero size 2021-04-09T18:26:30.042 INFO:tasks.workunit.client.0.smithi120.stdout:0/790: truncate d0/d43/fb1 1453605 0 2021-04-09T18:26:30.043 INFO:tasks.workunit.client.0.smithi120.stdout:0/791: readlink d0/d2/da/le3 0 2021-04-09T18:26:30.043 INFO:tasks.workunit.client.0.smithi120.stdout:8/806: rename d2/d3/d3c/l86 to d2/d3/d3c/d4f/lfd 0 2021-04-09T18:26:30.045 INFO:tasks.workunit.client.0.smithi120.stdout:9/909: getdents d19/d24/d37/d40/d89/d52/da7 0 2021-04-09T18:26:30.046 INFO:tasks.workunit.client.0.smithi120.stdout:8/807: write d2/d37/d3e/d7c/fc4 [299189,109620] 0 2021-04-09T18:26:30.046 INFO:tasks.workunit.client.0.smithi120.stdout:5/973: link d10/d12/d1b/d1f/d84/d3d/d50/d94/f11e d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/f152 0 2021-04-09T18:26:30.050 INFO:tasks.workunit.client.0.smithi120.stdout:9/910: mkdir d19/d24/de4/d99/d12e 0 2021-04-09T18:26:30.050 INFO:tasks.workunit.client.0.smithi120.stdout:4/789: dread d1f/d2c/d34/d60/dad/fcb [0,4194304] 0 2021-04-09T18:26:30.051 INFO:tasks.workunit.client.0.smithi120.stdout:2/924: dwrite d13/d15/d35/dbc/f109 [0,4194304] 0 2021-04-09T18:26:30.052 INFO:tasks.workunit.client.0.smithi120.stdout:8/808: mkdir d2/d3/d11/d6a/dfe 0 2021-04-09T18:26:30.053 INFO:tasks.workunit.client.0.smithi120.stdout:5/974: creat d10/d12/d1b/d1f/d84/d3d/f153 x:0 0 0 2021-04-09T18:26:30.055 INFO:tasks.workunit.client.0.smithi120.stdout:8/809: chown d2/d3/d50/ff8 10873 1 2021-04-09T18:26:30.059 INFO:tasks.workunit.client.0.smithi120.stdout:9/911: unlink d19/d2c/dc8/fd6 0 2021-04-09T18:26:30.060 INFO:tasks.workunit.client.0.smithi120.stdout:5/975: symlink d10/d12/d1b/d1f/d39/dab/d115/l154 0 2021-04-09T18:26:30.062 INFO:tasks.workunit.client.0.smithi120.stdout:2/925: dwrite d13/d7a/d80/d48/da3/fdb [0,4194304] 0 2021-04-09T18:26:30.063 INFO:tasks.workunit.client.0.smithi120.stdout:8/810: read d2/d3/d11/f34 [4927936,80303] 0 2021-04-09T18:26:30.077 INFO:tasks.workunit.client.0.smithi120.stdout:2/926: chown d13/d15/d35/d10e/fe0 37 1 2021-04-09T18:26:30.078 INFO:tasks.workunit.client.0.smithi120.stdout:6/879: dwrite d6/d8/db/f109 [0,4194304] 0 2021-04-09T18:26:30.078 INFO:tasks.workunit.client.0.smithi120.stdout:5/976: creat d10/d12/d1b/d1f/d39/dab/d14f/f155 x:0 0 0 2021-04-09T18:26:30.080 INFO:tasks.workunit.client.0.smithi120.stdout:2/927: mkdir d13/d7a/d80/d48/d49/d64/d83/d12f/d136 0 2021-04-09T18:26:30.086 INFO:tasks.workunit.client.0.smithi120.stdout:6/880: rename d6/d8/d1a/d36/d54/dfa/l102 to d6/l13d 0 2021-04-09T18:26:30.088 INFO:tasks.workunit.client.0.smithi120.stdout:8/811: truncate d2/d3/de9/fee 2749432 0 2021-04-09T18:26:30.089 INFO:tasks.workunit.client.0.smithi120.stdout:8/812: chown d2/d3/d11/d2c/d44/f74 2 1 2021-04-09T18:26:30.100 INFO:tasks.workunit.client.0.smithi120.stdout:5/977: rmdir d10/d12/d1b/d1f/d39/d106 0 2021-04-09T18:26:30.102 INFO:tasks.workunit.client.0.smithi120.stdout:2/928: creat d13/d15/d35/d9f/df1/d132/f137 x:0 0 0 2021-04-09T18:26:30.103 INFO:tasks.workunit.client.0.smithi120.stdout:4/790: dread d1f/d24/f26 [4194304,4194304] 0 2021-04-09T18:26:30.105 INFO:tasks.workunit.client.0.smithi120.stdout:5/978: symlink d10/d12/d1b/d1f/d39/dbb/dff/l156 0 2021-04-09T18:26:30.106 INFO:tasks.workunit.client.0.smithi120.stdout:4/791: mknod d1f/d2c/d34/d60/d7a/d92/d84/dfa/c10b 1 2021-04-09T18:26:30.108 INFO:tasks.workunit.client.0.smithi120.stdout:4/792: chown d1f/d2c/d34/d60/d7a/d4f/f79 10 1 2021-04-09T18:26:30.110 INFO:tasks.workunit.client.0.smithi120.stdout:8/813: creat d2/d3/d8/fff x:0 0 0 2021-04-09T18:26:30.116 INFO:tasks.workunit.client.0.smithi120.stdout:4/793: symlink d1f/d2c/d34/d60/d7a/d92/d84/dfa/l10c 0 2021-04-09T18:26:30.118 INFO:tasks.workunit.client.0.smithi120.stdout:4/794: mknod d1f/d2c/d56/de0/c10d 1 2021-04-09T18:26:30.118 INFO:tasks.workunit.client.0.smithi120.stdout:2/929: symlink d13/d7a/d80/d48/d49/d64/d83/l138 0 2021-04-09T18:26:30.119 INFO:tasks.workunit.client.0.smithi120.stdout:4/795: write d1f/d2c/d34/d60/d7a/ffb [426284,59001] 0 2021-04-09T18:26:30.120 INFO:tasks.workunit.client.0.smithi120.stdout:2/930: chown d13/d7a/d80/d48/d49/d64/d83/fa9 104998 1 2021-04-09T18:26:30.123 INFO:tasks.workunit.client.0.smithi120.stdout:2/931: symlink d13/d7a/d127/l139 0 2021-04-09T18:26:30.125 INFO:tasks.workunit.client.0.smithi120.stdout:4/796: dwrite d1f/f23 [0,4194304] 0 2021-04-09T18:26:30.130 INFO:tasks.workunit.client.0.smithi120.stdout:4/797: mknod d1f/d2c/df3/c10e 1 2021-04-09T18:26:30.132 INFO:tasks.workunit.client.0.smithi120.stdout:9/912: dread d19/d11d/f5a [0,4194304] 0 2021-04-09T18:26:30.141 INFO:tasks.workunit.client.0.smithi120.stdout:4/798: symlink d1f/d2c/d34/d60/d7a/d92/d84/l10f 0 2021-04-09T18:26:30.145 INFO:tasks.workunit.client.0.smithi120.stdout:4/799: rmdir d1f/d2c/d34/d60/d7a/d92/d84/d104/df7 0 2021-04-09T18:26:30.146 INFO:tasks.workunit.client.0.smithi120.stdout:4/800: chown d1f/d107/f108 1 1 2021-04-09T18:26:30.147 INFO:tasks.workunit.client.0.smithi120.stdout:4/801: dread - d1f/d2c/d34/d60/d7a/d92/d84/d99/df5/f105 zero size 2021-04-09T18:26:30.151 INFO:tasks.workunit.client.0.smithi120.stdout:4/802: mknod d1f/d2c/d34/d60/d7a/d92/d84/d104/d8f/c110 1 2021-04-09T18:26:30.152 INFO:tasks.workunit.client.0.smithi120.stdout:8/814: dread d2/d3/fc0 [0,4194304] 0 2021-04-09T18:26:30.159 INFO:tasks.workunit.client.0.smithi120.stdout:4/803: mkdir d1f/d2c/d34/d60/d7a/d92/d84/dd0/d111 0 2021-04-09T18:26:30.160 INFO:tasks.workunit.client.0.smithi120.stdout:4/804: chown d1f/d2c/d34/d60/d7a 2131 1 2021-04-09T18:26:30.161 INFO:tasks.workunit.client.0.smithi120.stdout:6/881: dwrite d6/d8/d1a/d36/f5c [0,4194304] 0 2021-04-09T18:26:30.162 INFO:tasks.workunit.client.0.smithi120.stdout:4/805: read - d1f/d24/d42/fdf zero size 2021-04-09T18:26:30.162 INFO:tasks.workunit.client.0.smithi120.stdout:6/882: chown d6/d8/db/d12/d93 9739 1 2021-04-09T18:26:30.163 INFO:tasks.workunit.client.0.smithi120.stdout:5/979: write d10/f48 [591441,117433] 0 2021-04-09T18:26:30.164 INFO:tasks.workunit.client.0.smithi120.stdout:4/806: fsync d1f/d2c/d34/d60/d7a/d92/d84/fd3 0 2021-04-09T18:26:30.168 INFO:tasks.workunit.client.0.smithi120.stdout:6/883: mkdir d6/d8/db/d2b/d68/d118/d13e 0 2021-04-09T18:26:30.171 INFO:tasks.workunit.client.0.smithi120.stdout:4/807: symlink d1f/d2c/d34/d60/d7a/d92/d84/d99/l112 0 2021-04-09T18:26:30.172 INFO:tasks.workunit.client.0.smithi120.stdout:4/808: fdatasync d1f/fb0 0 2021-04-09T18:26:30.175 INFO:tasks.workunit.client.0.smithi120.stdout:6/884: rmdir d6/d8/db/dd5 39 2021-04-09T18:26:30.176 INFO:tasks.workunit.client.0.smithi120.stdout:4/809: symlink d1f/d2c/d34/d60/dad/l113 0 2021-04-09T18:26:30.178 INFO:tasks.workunit.client.0.smithi120.stdout:6/885: symlink d6/d8/db/l13f 0 2021-04-09T18:26:30.180 INFO:tasks.workunit.client.0.smithi120.stdout:6/886: write d6/d8/d52/f100 [466906,22861] 0 2021-04-09T18:26:30.185 INFO:tasks.workunit.client.0.smithi120.stdout:6/887: chown d6/d8/d1a/d36/d54/d31/d37/l5e 295 1 2021-04-09T18:26:30.187 INFO:tasks.workunit.client.0.smithi120.stdout:1/796: sync 2021-04-09T18:26:30.188 INFO:tasks.workunit.client.0.smithi120.stdout:9/913: write d19/d24/dd8/fd9 [1053870,69129] 0 2021-04-09T18:26:30.189 INFO:tasks.workunit.client.0.smithi120.stdout:1/797: fsync d5/d64/d2d/db5/dd1/f102 0 2021-04-09T18:26:30.196 INFO:tasks.workunit.client.0.smithi120.stdout:6/888: link d6/d8/d52/ddf/df2/d11a/f110 d6/d8/d1a/d36/d54/d31/d8a/f140 0 2021-04-09T18:26:30.199 INFO:tasks.workunit.client.0.smithi120.stdout:8/815: dwrite d2/d3/d3c/fc2 [0,4194304] 0 2021-04-09T18:26:30.207 INFO:tasks.workunit.client.0.smithi120.stdout:1/798: link d5/d1f/l10 d5/d64/df9/l117 0 2021-04-09T18:26:30.208 INFO:tasks.workunit.client.0.smithi120.stdout:8/816: creat d2/dcf/f100 x:0 0 0 2021-04-09T18:26:30.210 INFO:tasks.workunit.client.0.smithi120.stdout:8/817: readlink d2/d3/d8/dc5/lf3 0 2021-04-09T18:26:30.211 INFO:tasks.workunit.client.0.smithi120.stdout:8/818: chown d2/d37/fe8 6818510 1 2021-04-09T18:26:30.212 INFO:tasks.workunit.client.0.smithi120.stdout:9/914: rename d19/d11d/d76/fe0 to d19/d24/d37/d40/d89/d52/f12f 0 2021-04-09T18:26:30.212 INFO:tasks.workunit.client.0.smithi120.stdout:8/819: chown d2/d3/d11/d2c/fe1 9 1 2021-04-09T18:26:30.214 INFO:tasks.workunit.client.0.smithi120.stdout:8/820: mkdir d2/d3/d8/da3/d101 0 2021-04-09T18:26:30.216 INFO:tasks.workunit.client.0.smithi120.stdout:5/980: dread d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da3/fc1 [0,4194304] 0 2021-04-09T18:26:30.216 INFO:tasks.workunit.client.0.smithi120.stdout:6/889: truncate d6/d8/d1a/d36/d54/d31/fe7 724957 0 2021-04-09T18:26:30.217 INFO:tasks.workunit.client.0.smithi120.stdout:4/810: dread d1f/d2c/df3/dc6/dc5/dda/f93 [0,4194304] 0 2021-04-09T18:26:30.218 INFO:tasks.workunit.client.0.smithi120.stdout:9/915: rmdir d19/d24/d2e/d111 0 2021-04-09T18:26:30.224 INFO:tasks.workunit.client.0.smithi120.stdout:6/890: rmdir d6/d8/db/d2b/d4d/dfc/dcb/d101 39 2021-04-09T18:26:30.224 INFO:tasks.workunit.client.0.smithi120.stdout:5/981: mknod d10/d12/d1b/d1f/d84/d3d/d50/d94/c157 1 2021-04-09T18:26:30.225 INFO:tasks.workunit.client.0.smithi120.stdout:8/821: dwrite d2/d37/d3e/d7c/f90 [0,4194304] 0 2021-04-09T18:26:30.226 INFO:tasks.workunit.client.0.smithi120.stdout:8/822: write d2/d37/d3e/d7c/d99/fa5 [514932,82211] 0 2021-04-09T18:26:30.226 INFO:tasks.workunit.client.0.smithi120.stdout:6/891: write d6/d8/d52/f100 [1176779,47289] 0 2021-04-09T18:26:30.228 INFO:tasks.workunit.client.0.smithi120.stdout:9/916: unlink d19/d11d/d76/f11b 0 2021-04-09T18:26:30.238 INFO:tasks.workunit.client.0.smithi120.stdout:8/823: rename d2/d37/f91 to d2/dcf/dd6/f102 0 2021-04-09T18:26:30.240 INFO:tasks.workunit.client.0.smithi120.stdout:9/917: symlink d19/d24/de4/l130 0 2021-04-09T18:26:30.242 INFO:tasks.workunit.client.0.smithi120.stdout:8/824: write d2/d3/d50/ff8 [5110140,81437] 0 2021-04-09T18:26:30.246 INFO:tasks.workunit.client.0.smithi120.stdout:9/918: unlink d19/d11d/d63/f87 0 2021-04-09T18:26:30.252 INFO:tasks.workunit.client.0.smithi120.stdout:5/982: link d10/d12/la2 d10/d12/d3b/l158 0 2021-04-09T18:26:30.255 INFO:tasks.workunit.client.0.smithi120.stdout:1/799: write d5/d64/d2d/db5/fd7 [3570205,118953] 0 2021-04-09T18:26:30.257 INFO:tasks.workunit.client.0.smithi120.stdout:1/800: chown d5/d5c/d75/daf/fc0 1 1 2021-04-09T18:26:30.270 INFO:tasks.workunit.client.0.smithi120.stdout:5/983: rmdir d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/dd4 39 2021-04-09T18:26:30.271 INFO:tasks.workunit.client.0.smithi120.stdout:6/892: write d6/d8/d1a/d36/d54/d31/d37/dcc/f127 [2173916,39123] 0 2021-04-09T18:26:30.274 INFO:tasks.workunit.client.0.smithi120.stdout:6/893: chown d6/d8/db/d2b/f10d 35085 1 2021-04-09T18:26:30.276 INFO:tasks.workunit.client.0.smithi120.stdout:5/984: mknod d10/d12/d1b/d1f/d39/dbb/d12b/c159 1 2021-04-09T18:26:30.278 INFO:tasks.workunit.client.0.smithi120.stdout:4/811: truncate d1f/d2c/d34/d60/d7a/d92/d84/fc9 4223626 0 2021-04-09T18:26:30.279 INFO:tasks.workunit.client.0.smithi120.stdout:4/812: unlink d1f/d24/d42/da0/lb8 0 2021-04-09T18:26:30.280 INFO:tasks.workunit.client.0.smithi120.stdout:8/825: dread d2/d37/d3e/d42/d9e/fe2 [0,4194304] 0 2021-04-09T18:26:30.282 INFO:tasks.workunit.client.0.smithi120.stdout:6/894: creat d6/d8/d1a/d36/d54/d31/d37/f141 x:0 0 0 2021-04-09T18:26:30.284 INFO:tasks.workunit.client.0.smithi120.stdout:4/813: rename d1f/d2c/d34/d60/d7a/d92/d84/d104/d8f to d1f/d2c/d56/d6a/da5/d114 0 2021-04-09T18:26:30.285 INFO:tasks.workunit.client.0.smithi120.stdout:5/985: write d10/d12/d1b/d3a/d134/ddc/d11d/dcb/fdd [617570,21076] 0 2021-04-09T18:26:30.289 INFO:tasks.workunit.client.0.smithi120.stdout:9/919: dwrite d19/d24/d36/da8/f110 [0,4194304] 0 2021-04-09T18:26:30.291 INFO:tasks.workunit.client.0.smithi120.stdout:5/986: mkdir d10/d12/d1b/d1f/d39/d15a 0 2021-04-09T18:26:30.293 INFO:tasks.workunit.client.0.smithi120.stdout:4/814: getdents d1f/d2c/d34/d60/d7a/d92/d84/d99/df5 0 2021-04-09T18:26:30.294 INFO:tasks.workunit.client.0.smithi120.stdout:9/920: dread d19/d2c/ff1 [0,4194304] 0 2021-04-09T18:26:30.299 INFO:tasks.workunit.client.0.smithi120.stdout:5/987: creat d10/d12/d1b/d141/f15b x:0 0 0 2021-04-09T18:26:30.300 INFO:tasks.workunit.client.0.smithi120.stdout:9/921: fdatasync d19/d24/d37/d40/fa2 0 2021-04-09T18:26:30.303 INFO:tasks.workunit.client.0.smithi120.stdout:8/826: dwrite d2/f39 [4194304,4194304] 0 2021-04-09T18:26:30.307 INFO:tasks.workunit.client.0.smithi120.stdout:6/895: dwrite d6/d8/db/d12/d93/fa9 [0,4194304] 0 2021-04-09T18:26:30.313 INFO:tasks.workunit.client.0.smithi120.stdout:9/922: chown d19/d24/d36/d47/d4b/fe6 7 1 2021-04-09T18:26:30.314 INFO:tasks.workunit.client.0.smithi120.stdout:8/827: rmdir d2/d37/d3e/d7c/d99 39 2021-04-09T18:26:30.316 INFO:tasks.workunit.client.0.smithi120.stdout:9/923: unlink d19/d24/d36/d9c/fe7 0 2021-04-09T18:26:30.316 INFO:tasks.workunit.client.0.smithi120.stdout:8/828: dread - d2/dcf/f100 zero size 2021-04-09T18:26:30.317 INFO:tasks.workunit.client.0.smithi120.stdout:6/896: dwrite d6/d8/d1a/d36/f10f [0,4194304] 0 2021-04-09T18:26:30.317 INFO:tasks.workunit.client.0.smithi120.stdout:5/988: creat d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/dcc/dd4/d130/d150/f15c x:0 0 0 2021-04-09T18:26:30.319 INFO:tasks.workunit.client.0.smithi120.stdout:4/815: dread d1f/d2c/df3/f4d [0,4194304] 0 2021-04-09T18:26:30.319 INFO:tasks.workunit.client.0.smithi120.stdout:8/829: readlink d2/lc1 0 2021-04-09T18:26:30.323 INFO:tasks.workunit.client.0.smithi120.stdout:8/830: readlink d2/d3/d3c/lcd 0 2021-04-09T18:26:30.323 INFO:tasks.workunit.client.0.smithi120.stdout:4/816: readlink d1f/d2c/d34/d60/d7a/d92/d3e/l101 0 2021-04-09T18:26:30.324 INFO:tasks.workunit.client.0.smithi120.stdout:6/897: symlink d6/d8/d1a/d36/d54/d41/l142 0 2021-04-09T18:26:30.326 INFO:tasks.workunit.client.0.smithi120.stdout:9/924: fsync d19/f3d 0 2021-04-09T18:26:30.326 INFO:tasks.workunit.client.0.smithi120.stdout:4/817: fsync d1f/d2c/f96 0 2021-04-09T18:26:30.332 INFO:tasks.workunit.client.0.smithi120.stdout:9/925: creat d19/d24/d36/d47/dbe/ddf/f131 x:0 0 0 2021-04-09T18:26:30.340 INFO:tasks.workunit.client.0.smithi120.stdout:9/926: rmdir d19/d24/dd8 39 2021-04-09T18:26:30.346 INFO:tasks.workunit.client.0.smithi120.stdout:9/927: write d19/d24/d37/d40/f113 [4709074,6559] 0 2021-04-09T18:26:30.347 INFO:tasks.workunit.client.0.smithi120.stdout:6/898: getdents d6/d8/d1a/d36/d54/d31/df1 0 2021-04-09T18:26:30.350 INFO:tasks.workunit.client.0.smithi120.stdout:9/928: creat d19/d11d/d63/f132 x:0 0 0 2021-04-09T18:26:30.354 INFO:tasks.workunit.client.0.smithi120.stdout:8/831: dread d2/d3/d11/d6a/d3b/d6b/da9/fa1 [4194304,4194304] 0 2021-04-09T18:26:30.354 INFO:tasks.workunit.client.0.smithi120.stdout:6/899: creat d6/d8/d3a/f143 x:0 0 0 2021-04-09T18:26:30.355 INFO:tasks.workunit.client.0.smithi120.stdout:8/832: readlink d2/d3/d3c/lcd 0 2021-04-09T18:26:30.376 INFO:tasks.workunit.client.0.smithi120.stdout:6/900: write d6/d8/d1a/d36/d54/d31/df1/d130/f135 [337183,42493] 0 2021-04-09T18:26:30.378 INFO:tasks.workunit.client.0.smithi120.stdout:9/929: rename d19/d24/d36/d9d to d19/d81/d133 0 2021-04-09T18:26:30.379 INFO:tasks.workunit.client.0.smithi120.stdout:0/792: dread d0/d2/dd/db4/f83 [0,4194304] 0 2021-04-09T18:26:30.379 INFO:tasks.workunit.client.0.smithi120.stdout:9/930: fdatasync d19/d24/d37/d40/d89/d52/fef 0 2021-04-09T18:26:30.379 INFO:tasks.workunit.client.0.smithi120.stdout:0/793: dwrite d0/d5a/d6c/fa7 [0,4194304] 0 2021-04-09T18:26:30.392 INFO:tasks.workunit.client.0.smithi120.stdout:5/989: truncate d10/d12/d3b/fc4 1818971 0 2021-04-09T18:26:30.393 INFO:tasks.workunit.client.0.smithi120.stdout:6/901: truncate d6/d8/d1a/d36/f10f 2626364 0 2021-04-09T18:26:30.395 INFO:tasks.workunit.client.0.smithi120.stdout:5/990: unlink d10/d12/d1b/d1f/lc5 0 2021-04-09T18:26:30.396 INFO:tasks.workunit.client.0.smithi120.stdout:1/801: dread d5/d5c/d75/daf/d2b/d8e/fc9 [0,4194304] 0 2021-04-09T18:26:30.397 INFO:tasks.workunit.client.0.smithi120.stdout:6/902: chown d6/d8/db/d2b/de2/l99 187213 1 2021-04-09T18:26:30.400 INFO:tasks.workunit.client.0.smithi120.stdout:5/991: creat d10/d12/d1b/d1f/d39/dab/d115/f15d x:0 0 0 2021-04-09T18:26:30.401 INFO:tasks.workunit.client.0.smithi120.stdout:1/802: symlink d5/d64/l118 0 2021-04-09T18:26:30.402 INFO:tasks.workunit.client.0.smithi120.stdout:6/903: rename d6/d8/d3a/f133 to d6/d8/d1a/dc7/f144 0 2021-04-09T18:26:30.417 INFO:tasks.workunit.client.0.smithi120.stdout:1/803: getdents d5/d5c/d75/daf/d6c 0 2021-04-09T18:26:30.418 INFO:tasks.workunit.client.0.smithi120.stdout:5/992: rename d10/d12/d3b/f86 to d10/d12/d1b/d3a/f15e 0 2021-04-09T18:26:30.419 INFO:tasks.workunit.client.0.smithi120.stdout:9/931: write d19/d24/d37/f94 [2520202,33397] 0 2021-04-09T18:26:30.421 INFO:tasks.workunit.client.0.smithi120.stdout:8/833: dread d2/d3/d11/d2c/d44/f74 [0,4194304] 0 2021-04-09T18:26:30.422 INFO:tasks.workunit.client.0.smithi120.stdout:9/932: creat d19/f134 x:0 0 0 2021-04-09T18:26:30.426 INFO:tasks.workunit.client.0.smithi120.stdout:6/904: dwrite d6/d8/d52/ddf/df2/d11a/fd9 [0,4194304] 0 2021-04-09T18:26:30.428 INFO:tasks.workunit.client.0.smithi120.stdout:0/794: dwrite d0/d2/d7b/fe9 [0,4194304] 0 2021-04-09T18:26:30.428 INFO:tasks.workunit.client.0.smithi120.stdout:1/804: write d5/d64/df9/d86/f9c [2397604,108108] 0 2021-04-09T18:26:30.444 INFO:tasks.workunit.client.0.smithi120.stdout:6/905: rename d6/d8/db/d2b/d4d/dfc/dcb/fa2 to d6/d8/db/dac/d10e/f145 0 2021-04-09T18:26:30.444 INFO:tasks.workunit.client.0.smithi120.stdout:1/805: dwrite d5/d64/f108 [0,4194304] 0 2021-04-09T18:26:30.445 INFO:tasks.workunit.client.0.smithi120.stdout:0/795: symlink d0/d2/da/d23/lf2 0 2021-04-09T18:26:30.447 INFO:tasks.workunit.client.0.smithi120.stdout:5/993: dread d10/d12/d1b/d1f/d84/d3d/f8e [0,4194304] 0 2021-04-09T18:26:30.450 INFO:tasks.workunit.client.0.smithi120.stdout:1/806: dwrite d5/d1f/f15 [0,4194304] 0 2021-04-09T18:26:30.455 INFO:tasks.workunit.client.0.smithi120.stdout:6/906: creat d6/d8/d3a/f146 x:0 0 0 2021-04-09T18:26:30.462 INFO:tasks.workunit.client.0.smithi120.stdout:5/994: dread - d10/d12/f14c zero size 2021-04-09T18:26:30.467 INFO:tasks.workunit.client.0.smithi120.stdout:6/907: dread d6/d8/db/d2b/d4d/dfc/dcb/fab [0,4194304] 0 2021-04-09T18:26:30.479 INFO:tasks.workunit.client.0.smithi120.stdout:9/933: truncate d19/d24/d36/d47/d4b/fce 863299 0 2021-04-09T18:26:30.482 INFO:tasks.workunit.client.0.smithi120.stdout:1/807: truncate d5/d5c/d75/daf/d2b/f62 2357755 0 2021-04-09T18:26:30.486 INFO:tasks.workunit.client.0.smithi120.stdout:8/834: dread d2/d3/f60 [0,4194304] 0 2021-04-09T18:26:30.493 INFO:tasks.workunit.client.0.smithi120.stdout:0/796: write d0/d2/d4/fbf [194577,57744] 0 2021-04-09T18:26:30.494 INFO:tasks.workunit.client.0.smithi120.stdout:9/934: rename d19/d24/d36/d47/dbe/ddf to d19/d24/d37/d40/d135 0 2021-04-09T18:26:30.495 INFO:tasks.workunit.client.0.smithi120.stdout:8/835: rmdir d2/d3/d8/dc5 39 2021-04-09T18:26:30.496 INFO:tasks.workunit.client.0.smithi120.stdout:0/797: mkdir d0/d5a/d6c/df3 0 2021-04-09T18:26:30.497 INFO:tasks.workunit.client.0.smithi120.stdout:0/798: creat d0/d2/dd/db4/dc0/ff4 x:0 0 0 2021-04-09T18:26:30.497 INFO:tasks.workunit.client.0.smithi120.stdout:6/908: dwrite d6/d8/d1a/d36/d54/d31/d37/d61/f9e [0,4194304] 0 2021-04-09T18:26:30.499 INFO:tasks.workunit.client.0.smithi120.stdout:1/808: truncate d5/d5c/d75/daf/d2b/ff4 1345253 0 2021-04-09T18:26:30.499 INFO:tasks.workunit.client.0.smithi120.stdout:8/836: creat d2/d37/d3e/d42/d9e/f103 x:0 0 0 2021-04-09T18:26:30.501 INFO:tasks.workunit.client.0.smithi120.stdout:8/837: mknod d2/d3/d11/d6a/dfe/c104 1 2021-04-09T18:26:30.502 INFO:tasks.workunit.client.0.smithi120.stdout:6/909: symlink d6/d8/d1a/d36/d54/d41/d49/l147 0 2021-04-09T18:26:30.503 INFO:tasks.workunit.client.0.smithi120.stdout:1/809: read d5/d5c/d75/daf/d2b/d8e/fc9 [838586,98842] 0 2021-04-09T18:26:30.505 INFO:tasks.workunit.client.0.smithi120.stdout:0/799: dwrite d0/d5a/d62/d72/fab [0,4194304] 0 2021-04-09T18:26:30.509 INFO:tasks.workunit.client.0.smithi120.stdout:6/910: chown d6/d8/d1a/d36/d54/d31/l3f 773 1 2021-04-09T18:26:30.515 INFO:tasks.workunit.client.0.smithi120.stdout:8/838: link d2/d3/d11/d6a/d3b/l35 d2/d37/d3e/d42/d9e/l105 0 2021-04-09T18:26:30.516 INFO:tasks.workunit.client.0.smithi120.stdout:8/839: dread - d2/d3/d8/da3/fe5 zero size 2021-04-09T18:26:30.516 INFO:tasks.workunit.client.0.smithi120.stdout:0/800: rename d0/d43/f66 to d0/d5a/d62/d69/ff5 0 2021-04-09T18:26:30.517 INFO:tasks.workunit.client.0.smithi120.stdout:0/801: write d0/f30 [3600246,2803] 0 2021-04-09T18:26:30.519 INFO:tasks.workunit.client.0.smithi120.stdout:0/802: rmdir d0/d5a/d62/d72 39 2021-04-09T18:26:30.520 INFO:tasks.workunit.client.0.smithi120.stdout:0/803: write d0/fc [6919240,115508] 0 2021-04-09T18:26:30.523 INFO:tasks.workunit.client.0.smithi120.stdout:8/840: creat d2/d37/d3e/d7c/d7a/f106 x:0 0 0 2021-04-09T18:26:30.525 INFO:tasks.workunit.client.0.smithi120.stdout:8/841: fsync d2/d3/d11/d6a/d3b/fd9 0 2021-04-09T18:26:30.526 INFO:tasks.workunit.client.0.smithi120.stdout:0/804: dread d0/d5a/d6c/fa7 [0,4194304] 0 2021-04-09T18:26:30.528 INFO:tasks.workunit.client.0.smithi120.stdout:9/935: write d19/d24/d36/fc7 [66868,25427] 0 2021-04-09T18:26:30.538 INFO:tasks.workunit.client.0.smithi120.stdout:6/911: read d6/d8/db/d2b/f6f [404020,102985] 0 2021-04-09T18:26:30.539 INFO:tasks.workunit.client.0.smithi120.stdout:5/995: truncate d10/d12/d1b/d1f/d84/d3d/d50/d94/d9b/fa7 1084827 0 2021-04-09T18:26:30.539 INFO:tasks.workunit.client.0.smithi120.stdout:8/842: mkdir d2/d3/d11/d6a/d3b/d6b/da9/ddc/d107 0 2021-04-09T18:26:30.540 INFO:tasks.workunit.client.0.smithi120.stdout:8/843: read - d2/d3/ffa zero size 2021-04-09T18:26:30.540 INFO:tasks.workunit.client.0.smithi120.stdout:9/936: creat d19/d2c/d12c/f136 x:0 0 0 2021-04-09T18:26:30.541 INFO:tasks.workunit.client.0.smithi120.stdout:6/912: rename d6/f11d to d6/d8/db/dd5/f148 0 2021-04-09T18:26:30.543 INFO:tasks.workunit.client.0.smithi120.stdout:1/810: dread d5/d5c/d75/daf/dc7/f55 [0,4194304] 0 2021-04-09T18:26:30.546 INFO:tasks.workunit.client.0.smithi120.stdout:5/996: dread d10/d12/d1b/d1f/d39/f87 [0,4194304] 0 2021-04-09T18:26:30.548 INFO:tasks.workunit.client.0.smithi120.stdout:9/937: chown d19/d24/d36/d47/d6f/lbf 214665 1 2021-04-09T18:26:30.553 INFO:tasks.workunit.client.0.smithi120.stdout:6/913: unlink d6/d8/d1a/d36/d54/d31/f76 0 2021-04-09T18:26:30.554 INFO:tasks.workunit.client.0.smithi120.stdout:6/914: readlink d6/d8/l21 0 2021-04-09T18:26:30.560 INFO:tasks.workunit.client.0.smithi120.stdout:6/915: fsync d6/d8/d1a/d36/d54/d41/d49/f88 0 2021-04-09T18:26:30.562 INFO:tasks.workunit.client.0.smithi120.stdout:5/997: dwrite d10/d12/d1b/d3a/d134/db4/d103/f139 [0,4194304] 0 2021-04-09T18:26:30.563 INFO:tasks.workunit.client.0.smithi120.stdout:0/805: truncate d0/d5a/d62/d69/f77 5219434 0 2021-04-09T18:26:30.570 INFO:tasks.workunit.client.0.smithi120.stdout:6/916: mknod d6/d8/db/d2b/de2/d5d/c149 1 2021-04-09T18:26:30.573 INFO:tasks.workunit.client.0.smithi120.stdout:5/998: readlink d10/d12/d1b/l82 0 2021-04-09T18:26:30.574 INFO:tasks.workunit.client.0.smithi120.stdout:0/806: creat d0/d5a/d62/d69/dac/ff6 x:0 0 0 2021-04-09T18:26:30.577 INFO:tasks.workunit.client.0.smithi120.stdout:0/807: dread d0/d5a/d6c/faf [0,4194304] 0 2021-04-09T18:26:30.578 INFO:tasks.workunit.client.0.smithi120.stdout:8/844: write d2/d3/d11/d6a/d3b/f72 [3113177,107377] 0 2021-04-09T18:26:30.578 INFO:tasks.workunit.client.0.smithi120.stdout:9/938: truncate d19/d24/d37/d40/d89/d52/da7/fc3 16945 0 2021-04-09T18:26:30.579 INFO:tasks.workunit.client.0.smithi120.stdout:1/811: rename d5/d5c/d75/daf/d2b/f62 to d5/d5c/d75/daf/dc7/f119 0 2021-04-09T18:26:30.580 INFO:tasks.workunit.client.0.smithi120.stdout:0/808: fsync d0/d2/d82/d9f/fa3 0 2021-04-09T18:26:30.582 INFO:tasks.workunit.client.0.smithi120.stdout:0/809: readlink d0/d2/da/d23/lbe 0 2021-04-09T18:26:30.583 INFO:tasks.workunit.client.0.smithi120.stdout:6/917: creat d6/d8/db/d2b/d4d/dfc/dcb/d101/f14a x:0 0 0 2021-04-09T18:26:30.584 INFO:tasks.workunit.client.0.smithi120.stdout:9/939: readlink d19/d24/l96 0 2021-04-09T18:26:30.585 INFO:tasks.workunit.client.0.smithi120.stdout:8/845: dwrite d2/d3/d11/d6a/d3b/fd9 [0,4194304] 0 2021-04-09T18:26:30.588 INFO:tasks.workunit.client.0.smithi120.stdout:5/999: rename d10/d12/d1b/d1f/l37 to d10/d12/d1b/d3a/d134/ddc/d11d/d8c/da6/l15f 0 2021-04-09T18:26:30.589 INFO:tasks.workunit.client.0.smithi120.stdout:6/918: chown d6/d8/d1a/d36/d54/d41/d49/f134 382 1 2021-04-09T18:26:30.589 INFO:tasks.workunit.client.0.smithi120.stdout:8/846: mknod d2/d3/d11/c108 1 2021-04-09T18:26:30.595 INFO:tasks.workunit.client.0.smithi120.stdout:8/847: creat d2/d3/d11/d6a/dfe/f109 x:0 0 0 2021-04-09T18:26:30.597 INFO:tasks.workunit.client.0.smithi120.stdout:6/919: dwrite d6/d8/d1a/d36/d54/d31/d37/f141 [0,4194304] 0 2021-04-09T18:26:30.602 INFO:tasks.workunit.client.0.smithi120.stdout:1/812: rename d5/d1f/l9d to d5/d5c/d75/daf/dc7/d61/deb/d7c/l11a 0 2021-04-09T18:26:30.605 INFO:tasks.workunit.client.0.smithi120.stdout:6/920: mkdir d6/d8/db/d2b/d68/d118/dc3/de4/d14b 0 2021-04-09T18:26:30.606 INFO:tasks.workunit.client.0.smithi120.stdout:8/848: dwrite d2/d3/d11/d2c/f87 [0,4194304] 0 2021-04-09T18:26:30.617 INFO:tasks.workunit.client.0.smithi120.stdout:1/813: link d5/d5c/d75/daf/dc7/f55 d5/d64/d2d/db5/dd1/f11b 0 2021-04-09T18:26:30.618 INFO:tasks.workunit.client.0.smithi120.stdout:1/814: unlink d5/d5c/d75/fc2 0 2021-04-09T18:26:30.618 INFO:tasks.workunit.client.0.smithi120.stdout:9/940: dwrite d19/d24/d37/f5f [0,4194304] 0 2021-04-09T18:26:30.621 INFO:tasks.workunit.client.0.smithi120.stdout:8/849: creat d2/f10a x:0 0 0 2021-04-09T18:26:30.624 INFO:tasks.workunit.client.0.smithi120.stdout:1/815: symlink d5/d5c/d75/daf/db8/l11c 0 2021-04-09T18:26:30.630 INFO:tasks.workunit.client.0.smithi120.stdout:9/941: mkdir d19/d2c/dc8/d11e/d137 0 2021-04-09T18:26:30.630 INFO:tasks.workunit.client.0.smithi120.stdout:6/921: write d6/d8/d1a/dc7/f105 [2615721,3350] 0 2021-04-09T18:26:30.638 INFO:tasks.workunit.client.0.smithi120.stdout:6/922: write d6/d8/d3a/f59 [2877943,86871] 0 2021-04-09T18:26:30.639 INFO:tasks.workunit.client.0.smithi120.stdout:1/816: mknod d5/d1f/c11d 1 2021-04-09T18:26:30.641 INFO:tasks.workunit.client.0.smithi120.stdout:9/942: dread d19/d24/d37/f5f [0,4194304] 0 2021-04-09T18:26:30.643 INFO:tasks.workunit.client.0.smithi120.stdout:4/818: dread d1f/d2c/d34/d60/d7a/d92/d3e/d73/f8b [0,4194304] 0 2021-04-09T18:26:30.644 INFO:tasks.workunit.client.0.smithi120.stdout:9/943: write d19/f134 [656990,119804] 0 2021-04-09T18:26:30.650 INFO:tasks.workunit.client.0.smithi120.stdout:6/923: rename d6/d8/db/d2b/d68/fea to d6/d8/d1a/dc7/db2/f14c 0 2021-04-09T18:26:30.650 INFO:tasks.workunit.client.0.smithi120.stdout:6/924: chown d6/d8/db/d2b/d4d/db8 93 1 2021-04-09T18:26:30.653 INFO:tasks.workunit.client.0.smithi120.stdout:8/850: symlink d2/d37/d3e/d7c/d7a/dd1/l10b 0 2021-04-09T18:26:30.654 INFO:tasks.workunit.client.0.smithi120.stdout:8/851: chown d2/d37/fba 7938289 1 2021-04-09T18:26:30.656 INFO:tasks.workunit.client.0.smithi120.stdout:1/817: creat d5/d5c/d75/daf/d2b/d8e/f11e x:0 0 0 2021-04-09T18:26:30.660 INFO:tasks.workunit.client.0.smithi120.stdout:1/818: mknod d5/d5c/d75/daf/c11f 1 2021-04-09T18:26:30.661 INFO:tasks.workunit.client.0.smithi120.stdout:6/925: write d6/d8/db/d2b/d4d/fee [539633,95213] 0 2021-04-09T18:26:30.662 INFO:tasks.workunit.client.0.smithi120.stdout:8/852: unlink d2/d37/d3e/d42/d9e/fe6 0 2021-04-09T18:26:30.664 INFO:tasks.workunit.client.0.smithi120.stdout:4/819: link d1f/d2c/df3/l6c d1f/d24/l115 0 2021-04-09T18:26:30.667 INFO:tasks.workunit.client.0.smithi120.stdout:4/820: dread - d1f/d24/d42/fdf zero size 2021-04-09T18:26:30.672 INFO:tasks.workunit.client.0.smithi120.stdout:8/853: read d2/d3/d50/ff8 [1929853,121479] 0 2021-04-09T18:26:30.673 INFO:tasks.workunit.client.0.smithi120.stdout:9/944: dwrite d19/d81/d133/fe5 [0,4194304] 0 2021-04-09T18:26:30.674 INFO:tasks.workunit.client.0.smithi120.stdout:8/854: mknod d2/d37/d3e/c10c 1 2021-04-09T18:26:30.679 INFO:tasks.workunit.client.0.smithi120.stdout:6/926: rename d6/d8/db/d2b/de2/d5d/fe8 to d6/d8/db/d2b/de2/f14d 0 2021-04-09T18:26:30.680 INFO:tasks.workunit.client.0.smithi120.stdout:8/855: write d2/d3/d11/d6a/d3b/f72 [4148571,107833] 0 2021-04-09T18:26:30.681 INFO:tasks.workunit.client.0.smithi120.stdout:9/945: mknod d19/d24/c138 1 2021-04-09T18:26:30.682 INFO:tasks.workunit.client.0.smithi120.stdout:6/927: fsync d6/ff8 0 2021-04-09T18:26:30.693 INFO:tasks.workunit.client.0.smithi120.stdout:6/928: dwrite d6/d8/d1a/d36/d54/d31/d37/f107 [0,4194304] 0 2021-04-09T18:26:30.695 INFO:tasks.workunit.client.0.smithi120.stdout:9/946: dread d19/d24/d37/d40/d89/fe8 [0,4194304] 0 2021-04-09T18:26:30.696 INFO:tasks.workunit.client.0.smithi120.stdout:6/929: creat d6/d8/d52/ddf/df2/f14e x:0 0 0 2021-04-09T18:26:30.701 INFO:tasks.workunit.client.0.smithi120.stdout:6/930: link d6/d8/db/f39 d6/d8/d1a/d36/d54/f14f 0 2021-04-09T18:26:30.702 INFO:tasks.workunit.client.0.smithi120.stdout:6/931: mknod d6/d8/c150 1 2021-04-09T18:26:30.708 INFO:tasks.workunit.client.0.smithi120.stdout:0/810: dread d0/d5a/d62/d69/fba [0,4194304] 0 2021-04-09T18:26:30.708 INFO:tasks.workunit.client.0.smithi120.stdout:0/811: read - d0/d2/d4/fea zero size 2021-04-09T18:26:30.709 INFO:tasks.workunit.client.0.smithi120.stdout:6/932: truncate d6/d8/db/d2b/d68/d118/dc3/fc5 26658 0 2021-04-09T18:26:30.721 INFO:tasks.workunit.client.0.smithi120.stdout:0/812: truncate d0/d2/da/d23/f2f 1563292 0 2021-04-09T18:26:30.722 INFO:tasks.workunit.client.0.smithi120.stdout:0/813: write d0/d52/d56/fee [918400,57621] 0 2021-04-09T18:26:30.722 INFO:tasks.workunit.client.0.smithi120.stdout:0/814: mkdir d0/d5a/d6c/df3/df7 0 2021-04-09T18:26:30.723 INFO:tasks.workunit.client.0.smithi120.stdout:0/815: mkdir d0/d52/d56/df8 0 2021-04-09T18:26:30.725 INFO:tasks.workunit.client.0.smithi120.stdout:0/816: stat d0/d5a/d62/d69/ff5 0 2021-04-09T18:26:30.726 INFO:tasks.workunit.client.0.smithi120.stdout:0/817: fsync d0/d52/f6d 0 2021-04-09T18:26:30.727 INFO:tasks.workunit.client.0.smithi120.stdout:0/818: readlink d0/d5a/l9b 0 2021-04-09T18:26:30.728 INFO:tasks.workunit.client.0.smithi120.stdout:0/819: rmdir d0/d2/dd/db4/dc0 39 2021-04-09T18:26:30.733 INFO:tasks.workunit.client.0.smithi120.stdout:0/820: creat d0/d2/da/ff9 x:0 0 0 2021-04-09T18:26:30.738 INFO:tasks.workunit.client.0.smithi120.stdout:0/821: truncate d0/d5a/d62/d69/dac/fad 479793 0 2021-04-09T18:26:30.837 INFO:tasks.workunit.client.0.smithi120.stdout:3/875: sync 2021-04-09T18:26:30.838 INFO:tasks.workunit.client.0.smithi120.stdout:7/840: sync 2021-04-09T18:26:30.839 INFO:tasks.workunit.client.0.smithi120.stdout:7/841: readlink db/d38/d74/d6f/l102 0 2021-04-09T18:26:30.839 INFO:tasks.workunit.client.0.smithi120.stdout:7/842: fsync db/d26/fa9 0 2021-04-09T18:26:30.840 INFO:tasks.workunit.client.0.smithi120.stdout:3/876: write d3/d5/d36/d1e/d6b/d6a/d83/dd4/dda/dfd/f10a [35350,96049] 0 2021-04-09T18:26:30.842 INFO:tasks.workunit.client.0.smithi120.stdout:7/843: mkdir db/d2c/d34/d5d/dd2/d11f 0 2021-04-09T18:26:30.843 INFO:tasks.workunit.client.0.smithi120.stdout:3/877: write d3/d5/df5/d25/f22 [756164,13302] 0 2021-04-09T18:26:30.847 INFO:tasks.workunit.client.0.smithi120.stdout:7/844: getdents db/d38/d74/d6f 0 2021-04-09T18:26:30.857 INFO:tasks.workunit.client.0.smithi120.stdout:3/878: dread d3/d5/d36/d1e/d6b/d49/d4e/f6f [0,4194304] 0 2021-04-09T18:26:30.862 INFO:tasks.workunit.client.0.smithi120.stdout:3/879: dwrite d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/dc3/ff4 [0,4194304] 0 2021-04-09T18:26:30.882 INFO:tasks.workunit.client.0.smithi120.stdout:3/880: dread d3/d5/d36/d1e/d6b/d49/d89/dd0/d9a/fa7 [0,4194304] 0 2021-04-09T18:26:30.883 INFO:tasks.workunit.client.0.smithi120.stdout:3/881: dread - d3/d5/d36/d1e/d6b/fff zero size 2021-04-09T18:26:30.888 INFO:tasks.workunit.client.0.smithi120.stdout:1/819: write d5/d5c/d75/daf/dc7/d61/deb/f68 [1896388,96599] 0 2021-04-09T18:26:30.892 INFO:tasks.workunit.client.0.smithi120.stdout:1/820: write d5/d64/df9/d86/da3/fc6 [517505,53806] 0 2021-04-09T18:26:30.902 INFO:tasks.workunit.client.0.smithi120.stdout:3/882: dwrite d3/d5/f31 [0,4194304] 0 2021-04-09T18:26:30.903 INFO:tasks.workunit.client.0.smithi120.stdout:8/856: dwrite d2/d3/d11/d6a/f8c [0,4194304] 0 2021-04-09T18:26:30.903 INFO:tasks.workunit.client.0.smithi120.stdout:4/821: truncate d1f/d2c/d34/d60/d7a/d92/d84/d99/fdc 814971 0 2021-04-09T18:26:30.904 INFO:tasks.workunit.client.0.smithi120.stdout:1/821: unlink d5/d5c/d75/daf/d2b/l52 0 2021-04-09T18:26:30.904 INFO:tasks.workunit.client.0.smithi120.stdout:4/822: dread - d1f/d2c/d34/d60/d7a/d92/d84/d99/df5/f105 zero size 2021-04-09T18:26:30.907 INFO:tasks.workunit.client.0.smithi120.stdout:2/932: sync 2021-04-09T18:26:30.908 INFO:tasks.workunit.client.0.smithi120.stdout:6/933: truncate d6/d8/d1a/d36/d54/d41/d49/f134 188405 0 2021-04-09T18:26:30.910 INFO:tasks.workunit.client.0.smithi120.stdout:4/823: creat d1f/d2c/d34/d60/d7a/d92/da6/f116 x:0 0 0 2021-04-09T18:26:30.917 INFO:tasks.workunit.client.0.smithi120.stdout:8/857: creat d2/d3/d11/d2c/d44/f10d x:0 0 0 2021-04-09T18:26:30.917 INFO:tasks.workunit.client.0.smithi120.stdout:6/934: dread - d6/d8/db/d12/d22/f131 zero size 2021-04-09T18:26:30.918 INFO:tasks.workunit.client.0.smithi120.stdout:1/822: dwrite d5/d5c/d75/daf/dc7/ff6 [0,4194304] 0 2021-04-09T18:26:30.920 INFO:tasks.workunit.client.0.smithi120.stdout:3/883: write d3/d5/d36/d1e/d6b/d6a/d83/f9b [971910,33183] 0 2021-04-09T18:26:30.932 INFO:tasks.workunit.client.0.smithi120.stdout:0/822: dwrite d0/d2/fb5 [0,4194304] 0 2021-04-09T18:26:30.932 INFO:tasks.workunit.client.0.smithi120.stdout:3/884: chown d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe 258476898 1 2021-04-09T18:26:30.933 INFO:tasks.workunit.client.0.smithi120.stdout:7/845: dwrite db/d42/d54/faa [0,4194304] 0 2021-04-09T18:26:30.936 INFO:tasks.workunit.client.0.smithi120.stdout:4/824: write d1f/d2c/d34/d60/d7a/d92/feb [588001,70236] 0 2021-04-09T18:26:30.937 INFO:tasks.workunit.client.0.smithi120.stdout:0/823: creat d0/d2/d8d/dd1/ffa x:0 0 0 2021-04-09T18:26:30.944 INFO:tasks.workunit.client.0.smithi120.stdout:3/885: mkdir d3/d5/d36/d1e/d38/d11f 0 2021-04-09T18:26:30.948 INFO:tasks.workunit.client.0.smithi120.stdout:4/825: unlink d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f8a 0 2021-04-09T18:26:30.952 INFO:tasks.workunit.client.0.smithi120.stdout:0/824: fdatasync d0/d43/fb1 0 2021-04-09T18:26:30.958 INFO:tasks.workunit.client.0.smithi120.stdout:1/823: write d5/d64/d2d/d5a/d8d/fb4 [312409,10252] 0 2021-04-09T18:26:30.959 INFO:tasks.workunit.client.0.smithi120.stdout:2/933: dwrite f6 [0,4194304] 0 2021-04-09T18:26:30.967 INFO:tasks.workunit.client.0.smithi120.stdout:8/858: link d2/d3/d3c/feb d2/d3/d50/f10e 0 2021-04-09T18:26:30.968 INFO:tasks.workunit.client.0.smithi120.stdout:1/824: mknod d5/d64/df9/d86/c120 1 2021-04-09T18:26:30.971 INFO:tasks.workunit.client.0.smithi120.stdout:6/935: truncate d6/d8/d52/ddf/df2/f14e 899801 0 2021-04-09T18:26:30.975 INFO:tasks.workunit.client.0.smithi120.stdout:7/846: dwrite db/d2c/d34/ffd [0,4194304] 0 2021-04-09T18:26:30.982 INFO:tasks.workunit.client.0.smithi120.stdout:6/936: symlink d6/d8/d1a/d36/d54/d31/d111/l151 0 2021-04-09T18:26:30.983 INFO:tasks.workunit.client.0.smithi120.stdout:2/934: truncate d13/d7a/f115 292219 0 2021-04-09T18:26:30.991 INFO:tasks.workunit.client.0.smithi120.stdout:7/847: creat db/d2c/d34/d5d/dd2/d11f/f120 x:0 0 0 2021-04-09T18:26:30.991 INFO:tasks.workunit.client.0.smithi120.stdout:0/825: write d0/d5a/d6c/faa [211192,21240] 0 2021-04-09T18:26:30.992 INFO:tasks.workunit.client.0.smithi120.stdout:8/859: write d2/d3/d11/d6a/d3b/f77 [555306,24142] 0 2021-04-09T18:26:30.992 INFO:tasks.workunit.client.0.smithi120.stdout:1/825: dwrite d5/d64/df9/d86/f116 [0,4194304] 0 2021-04-09T18:26:30.993 INFO:tasks.workunit.client.0.smithi120.stdout:2/935: fsync d13/d7a/d80/d48/d49/d64/fb4 0 2021-04-09T18:26:30.996 INFO:tasks.workunit.client.0.smithi120.stdout:7/848: mknod db/d38/d74/c121 1 2021-04-09T18:26:30.997 INFO:tasks.workunit.client.0.smithi120.stdout:8/860: unlink d2/d3/f5f 0 2021-04-09T18:26:30.997 INFO:tasks.workunit.client.0.smithi120.stdout:0/826: rmdir d0/d52 39 2021-04-09T18:26:30.999 INFO:tasks.workunit.client.0.smithi120.stdout:0/827: stat d0/d5a/fd0 0 2021-04-09T18:26:31.000 INFO:tasks.workunit.client.0.smithi120.stdout:8/861: mkdir d2/d37/d10f 0 2021-04-09T18:26:31.008 INFO:tasks.workunit.client.0.smithi120.stdout:2/936: dwrite d13/d15/d35/d9f/df1/d132/f137 [0,4194304] 0 2021-04-09T18:26:31.021 INFO:tasks.workunit.client.0.smithi120.stdout:2/937: mknod d13/d7a/d80/d48/c13a 1 2021-04-09T18:26:31.022 INFO:tasks.workunit.client.0.smithi120.stdout:7/849: link db/d42/d54/l10a db/d2c/d34/l122 0 2021-04-09T18:26:31.023 INFO:tasks.workunit.client.0.smithi120.stdout:3/886: dread d3/d5/d36/d1e/d6b/d6a/d83/dc7/f100 [0,4194304] 0 2021-04-09T18:26:31.023 INFO:tasks.workunit.client.0.smithi120.stdout:1/826: link d5/d5c/d75/daf/db8/ff3 d5/d64/d2d/d5a/d8d/f121 0 2021-04-09T18:26:31.026 INFO:tasks.workunit.client.0.smithi120.stdout:2/938: stat d13/d84/d10c/fd5 0 2021-04-09T18:26:31.030 INFO:tasks.workunit.client.0.smithi120.stdout:1/827: creat d5/d5c/d75/d104/f122 x:0 0 0 2021-04-09T18:26:31.031 INFO:tasks.workunit.client.0.smithi120.stdout:3/887: creat d3/d5/d36/d1e/d6b/d49/d89/d68/da1/f120 x:0 0 0 2021-04-09T18:26:31.032 INFO:tasks.workunit.client.0.smithi120.stdout:1/828: dread - d5/d5c/d75/daf/db8/f113 zero size 2021-04-09T18:26:31.033 INFO:tasks.workunit.client.0.smithi120.stdout:7/850: stat db/d38/d74/d6f/d76/da5 0 2021-04-09T18:26:31.034 INFO:tasks.workunit.client.0.smithi120.stdout:0/828: truncate d0/d5a/d62/d69/dac/ff6 458080 0 2021-04-09T18:26:31.035 INFO:tasks.workunit.client.0.smithi120.stdout:0/829: write d0/d5a/fd0 [800375,83791] 0 2021-04-09T18:26:31.036 INFO:tasks.workunit.client.0.smithi120.stdout:1/829: creat d5/d5c/d75/daf/d2b/d8e/dfa/f123 x:0 0 0 2021-04-09T18:26:31.038 INFO:tasks.workunit.client.0.smithi120.stdout:7/851: chown db/d38/d74/d6f/d76/lba 12814 1 2021-04-09T18:26:31.040 INFO:tasks.workunit.client.0.smithi120.stdout:0/830: mkdir d0/d5a/d62/d8f/dfb 0 2021-04-09T18:26:31.044 INFO:tasks.workunit.client.0.smithi120.stdout:9/947: dread d19/d24/d37/d40/d89/f1f [0,4194304] 0 2021-04-09T18:26:31.045 INFO:tasks.workunit.client.0.smithi120.stdout:7/852: mkdir db/d38/d3c/d6e/d94/d123 0 2021-04-09T18:26:31.046 INFO:tasks.workunit.client.0.smithi120.stdout:4/826: dread d1f/d2c/d34/d60/d7a/d92/f8e [0,4194304] 0 2021-04-09T18:26:31.047 INFO:tasks.workunit.client.0.smithi120.stdout:1/830: rename d5/d5c/d75/daf/dc7/d61/deb/d7c/l11a to d5/d5c/d75/d104/l124 0 2021-04-09T18:26:31.048 INFO:tasks.workunit.client.0.smithi120.stdout:7/853: mknod db/d26/c124 1 2021-04-09T18:26:31.049 INFO:tasks.workunit.client.0.smithi120.stdout:6/937: write d6/d8/d1a/d36/d54/d31/d37/f132 [1536975,79151] 0 2021-04-09T18:26:31.051 INFO:tasks.workunit.client.0.smithi120.stdout:9/948: rename d19/d2c/dc8/d11e to d19/d24/d36/da8/dcd/d139 0 2021-04-09T18:26:31.054 INFO:tasks.workunit.client.0.smithi120.stdout:4/827: link d1f/d2c/d34/ff6 d1f/d2c/d34/d60/d7a/d92/d84/f117 0 2021-04-09T18:26:31.056 INFO:tasks.workunit.client.0.smithi120.stdout:4/828: chown d1f/d24/d42 1397 1 2021-04-09T18:26:31.056 INFO:tasks.workunit.client.0.smithi120.stdout:9/949: read d19/d24/d36/f45 [4134222,73996] 0 2021-04-09T18:26:31.060 INFO:tasks.workunit.client.0.smithi120.stdout:1/831: dread d5/d5c/d75/daf/dc7/f55 [0,4194304] 0 2021-04-09T18:26:31.061 INFO:tasks.workunit.client.0.smithi120.stdout:9/950: mknod d19/d24/d37/d40/d135/c13a 1 2021-04-09T18:26:31.063 INFO:tasks.workunit.client.0.smithi120.stdout:1/832: rmdir d5/d5c 39 2021-04-09T18:26:31.063 INFO:tasks.workunit.client.0.smithi120.stdout:9/951: chown d19/d2c/d12c 412 1 2021-04-09T18:26:31.064 INFO:tasks.workunit.client.0.smithi120.stdout:6/938: dwrite d6/d8/d1a/d36/d54/d31/d37/f107 [0,4194304] 0 2021-04-09T18:26:31.068 INFO:tasks.workunit.client.0.smithi120.stdout:4/829: creat d1f/d2c/d34/d60/d7a/d92/d3e/d73/f118 x:0 0 0 2021-04-09T18:26:31.071 INFO:tasks.workunit.client.0.smithi120.stdout:1/833: fdatasync d5/d64/d2d/d5a/fe3 0 2021-04-09T18:26:31.086 INFO:tasks.workunit.client.0.smithi120.stdout:4/830: symlink d1f/d2c/d34/d60/d7a/d92/da6/l119 0 2021-04-09T18:26:31.087 INFO:tasks.workunit.client.0.smithi120.stdout:7/854: read db/d38/d3c/d6e/d94/f10f [530637,12870] 0 2021-04-09T18:26:31.088 INFO:tasks.workunit.client.0.smithi120.stdout:1/834: mknod d5/d5c/d75/daf/d2b/c125 1 2021-04-09T18:26:31.089 INFO:tasks.workunit.client.0.smithi120.stdout:0/831: dread d0/d2/dd/db4/f98 [0,4194304] 0 2021-04-09T18:26:31.089 INFO:tasks.workunit.client.0.smithi120.stdout:4/831: read - d1f/d2c/d34/d60/d7a/d92/d84/d99/df5/f105 zero size 2021-04-09T18:26:31.098 INFO:tasks.workunit.client.0.smithi120.stdout:2/939: dread d13/d7a/d80/d48/d49/d76/ff3 [0,4194304] 0 2021-04-09T18:26:31.101 INFO:tasks.workunit.client.0.smithi120.stdout:2/940: dwrite f9 [0,4194304] 0 2021-04-09T18:26:31.103 INFO:tasks.workunit.client.0.smithi120.stdout:1/835: unlink d5/d5c/d75/daf/d2b/ff2 0 2021-04-09T18:26:31.109 INFO:tasks.workunit.client.0.smithi120.stdout:6/939: truncate d6/d8/db/d2b/d4d/db8/fdc 225275 0 2021-04-09T18:26:31.112 INFO:tasks.workunit.client.0.smithi120.stdout:2/941: fsync d13/d15/f42 0 2021-04-09T18:26:31.118 INFO:tasks.workunit.client.0.smithi120.stdout:9/952: dread d19/d24/d36/d47/d4b/fce [0,4194304] 0 2021-04-09T18:26:31.118 INFO:tasks.workunit.client.0.smithi120.stdout:9/953: chown d19/d24/d37/d40/d89/d52/f61 51187968 1 2021-04-09T18:26:31.120 INFO:tasks.workunit.client.0.smithi120.stdout:9/954: write d19/d24/de4/f116 [688044,29606] 0 2021-04-09T18:26:31.124 INFO:tasks.workunit.client.0.smithi120.stdout:9/955: dwrite d19/d2c/f3f [0,4194304] 0 2021-04-09T18:26:31.128 INFO:tasks.workunit.client.0.smithi120.stdout:7/855: write db/d2c/d30/fb3 [990926,116299] 0 2021-04-09T18:26:31.129 INFO:tasks.workunit.client.0.smithi120.stdout:6/940: rmdir d6/d8/d1a/d36/d54/d31/d37 39 2021-04-09T18:26:31.136 INFO:tasks.workunit.client.0.smithi120.stdout:1/836: creat d5/d5c/d75/f126 x:0 0 0 2021-04-09T18:26:31.137 INFO:tasks.workunit.client.0.smithi120.stdout:9/956: creat d19/d24/d37/d40/d89/d52/da7/db1/f13b x:0 0 0 2021-04-09T18:26:31.143 INFO:tasks.workunit.client.0.smithi120.stdout:0/832: dwrite d0/d5a/d62/d69/ff5 [0,4194304] 0 2021-04-09T18:26:31.143 INFO:tasks.workunit.client.0.smithi120.stdout:6/941: rename d6/d8/db/d92 to d6/d8/db/d2b/de2/d12e/d152 0 2021-04-09T18:26:31.144 INFO:tasks.workunit.client.0.smithi120.stdout:2/942: creat d13/d15/d35/d9f/f13b x:0 0 0 2021-04-09T18:26:31.145 INFO:tasks.workunit.client.0.smithi120.stdout:1/837: write d5/d64/d2d/db5/dd1/f102 [251049,13939] 0 2021-04-09T18:26:31.147 INFO:tasks.workunit.client.0.smithi120.stdout:1/838: mknod d5/d5c/d75/daf/d2b/dd4/c127 1 2021-04-09T18:26:31.148 INFO:tasks.workunit.client.0.smithi120.stdout:0/833: read - d0/d2/fe1 zero size 2021-04-09T18:26:31.149 INFO:tasks.workunit.client.0.smithi120.stdout:0/834: fdatasync d0/d43/fd9 0 2021-04-09T18:26:31.150 INFO:tasks.workunit.client.0.smithi120.stdout:2/943: creat d13/d7a/d80/d48/f13c x:0 0 0 2021-04-09T18:26:31.151 INFO:tasks.workunit.client.0.smithi120.stdout:1/839: dread - d5/d5c/d75/daf/d2b/dd4/ff7 zero size 2021-04-09T18:26:31.152 INFO:tasks.workunit.client.0.smithi120.stdout:7/856: dread db/d42/f65 [0,4194304] 0 2021-04-09T18:26:31.153 INFO:tasks.workunit.client.0.smithi120.stdout:2/944: chown d13/d15/d35/dae/fa5 507627105 1 2021-04-09T18:26:31.155 INFO:tasks.workunit.client.0.smithi120.stdout:0/835: mkdir d0/d5a/dfc 0 2021-04-09T18:26:31.157 INFO:tasks.workunit.client.0.smithi120.stdout:9/957: dread d19/d24/d9e/fe9 [0,4194304] 0 2021-04-09T18:26:31.159 INFO:tasks.workunit.client.0.smithi120.stdout:4/832: dwrite d1f/d24/f33 [0,4194304] 0 2021-04-09T18:26:31.166 INFO:tasks.workunit.client.0.smithi120.stdout:1/840: rename d5/d5c/d75/daf/d2b/d8e/f11e to d5/d5c/d75/daf/f128 0 2021-04-09T18:26:31.166 INFO:tasks.workunit.client.0.smithi120.stdout:0/836: dwrite d0/d2/d4/f59 [0,4194304] 0 2021-04-09T18:26:31.167 INFO:tasks.workunit.client.0.smithi120.stdout:9/958: unlink d19/d24/d36/f6e 0 2021-04-09T18:26:31.168 INFO:tasks.workunit.client.0.smithi120.stdout:4/833: symlink d1f/d24/d42/l11a 0 2021-04-09T18:26:31.169 INFO:tasks.workunit.client.0.smithi120.stdout:7/857: link db/d2c/f44 db/d26/d4c/f125 0 2021-04-09T18:26:31.174 INFO:tasks.workunit.client.0.smithi120.stdout:0/837: mknod d0/d2/da/cfd 1 2021-04-09T18:26:31.175 INFO:tasks.workunit.client.0.smithi120.stdout:4/834: mknod d1f/d2c/d34/d60/d7a/d92/d84/d99/df5/c11b 1 2021-04-09T18:26:31.178 INFO:tasks.workunit.client.0.smithi120.stdout:0/838: dread d0/d2/fb5 [0,4194304] 0 2021-04-09T18:26:31.181 INFO:tasks.workunit.client.0.smithi120.stdout:7/858: rename db/d26/d4c/f9f to db/d38/d3c/d6e/d94/f126 0 2021-04-09T18:26:31.190 INFO:tasks.workunit.client.0.smithi120.stdout:1/841: write d5/d5c/fed [2490216,13778] 0 2021-04-09T18:26:31.190 INFO:tasks.workunit.client.0.smithi120.stdout:9/959: write d19/d24/d37/d40/d89/f27 [4889432,98335] 0 2021-04-09T18:26:31.191 INFO:tasks.workunit.client.0.smithi120.stdout:2/945: truncate d13/f47 1205393 0 2021-04-09T18:26:31.191 INFO:tasks.workunit.client.0.smithi120.stdout:6/942: dwrite d6/d8/db/d2b/d68/d118/dc3/fc5 [0,4194304] 0 2021-04-09T18:26:31.200 INFO:tasks.workunit.client.0.smithi120.stdout:1/842: rename d5 to d5/d129 22 2021-04-09T18:26:31.204 INFO:tasks.workunit.client.0.smithi120.stdout:7/859: creat db/d42/d54/f127 x:0 0 0 2021-04-09T18:26:31.207 INFO:tasks.workunit.client.0.smithi120.stdout:2/946: creat d13/d7a/d80/d48/d49/d76/dfd/f13d x:0 0 0 2021-04-09T18:26:31.210 INFO:tasks.workunit.client.0.smithi120.stdout:9/960: dwrite d19/d24/dd8/d106/f108 [0,4194304] 0 2021-04-09T18:26:31.216 INFO:tasks.workunit.client.0.smithi120.stdout:7/860: symlink db/d2c/d30/l128 0 2021-04-09T18:26:31.221 INFO:tasks.workunit.client.0.smithi120.stdout:4/835: truncate d1f/d24/f33 2544938 0 2021-04-09T18:26:31.221 INFO:tasks.workunit.client.0.smithi120.stdout:7/861: read - db/d38/d3c/d6e/d94/f11d zero size 2021-04-09T18:26:31.222 INFO:tasks.workunit.client.0.smithi120.stdout:2/947: creat d13/d7a/d80/f13e x:0 0 0 2021-04-09T18:26:31.230 INFO:tasks.workunit.client.0.smithi120.stdout:4/836: rename d1f/d2c/d56/f72 to d1f/d2c/d56/f11c 0 2021-04-09T18:26:31.231 INFO:tasks.workunit.client.0.smithi120.stdout:6/943: dwrite d6/d8/db/d2b/de2/f8d [0,4194304] 0 2021-04-09T18:26:31.232 INFO:tasks.workunit.client.0.smithi120.stdout:6/944: chown d6/d8/d1a/f126 1114734 1 2021-04-09T18:26:31.233 INFO:tasks.workunit.client.0.smithi120.stdout:0/839: dread d0/d2/d4/d5f/f76 [0,4194304] 0 2021-04-09T18:26:31.235 INFO:tasks.workunit.client.0.smithi120.stdout:0/840: mknod d0/d5a/d62/cfe 1 2021-04-09T18:26:31.244 INFO:tasks.workunit.client.0.smithi120.stdout:1/843: write d5/d64/d2d/d5a/d8d/fa8 [1774911,60136] 0 2021-04-09T18:26:31.247 INFO:tasks.workunit.client.0.smithi120.stdout:1/844: write d5/d64/d2d/db5/dd1/f102 [1155877,81645] 0 2021-04-09T18:26:31.265 INFO:tasks.workunit.client.0.smithi120.stdout:9/961: write d19/d24/d37/d40/d89/d52/f59 [427671,10675] 0 2021-04-09T18:26:31.266 INFO:tasks.workunit.client.0.smithi120.stdout:2/948: write d13/d7a/d80/d54/fa8 [2895583,126448] 0 2021-04-09T18:26:31.268 INFO:tasks.workunit.client.0.smithi120.stdout:2/949: write d13/d15/d35/dbc/fe2 [1511053,121221] 0 2021-04-09T18:26:31.269 INFO:tasks.workunit.client.0.smithi120.stdout:2/950: readlink d13/d7a/d127/lf5 0 2021-04-09T18:26:31.273 INFO:tasks.workunit.client.0.smithi120.stdout:2/951: fsync d13/d7a/d80/d48/d49/d64/fba 0 2021-04-09T18:26:31.274 INFO:tasks.workunit.client.0.smithi120.stdout:9/962: getdents d19/d24/d36/da8 0 2021-04-09T18:26:31.276 INFO:tasks.workunit.client.0.smithi120.stdout:9/963: chown d19/d2c/dc8 4120735 1 2021-04-09T18:26:31.277 INFO:tasks.workunit.client.0.smithi120.stdout:6/945: dwrite d6/d8/db/d2b/f6f [0,4194304] 0 2021-04-09T18:26:31.281 INFO:tasks.workunit.client.0.smithi120.stdout:1/845: write d5/d64/d2d/d5a/fe3 [882389,17111] 0 2021-04-09T18:26:31.283 INFO:tasks.workunit.client.0.smithi120.stdout:4/837: truncate d1f/d2c/d34/d60/d7a/d92/d84/d99/f9e 2679954 0 2021-04-09T18:26:31.288 INFO:tasks.workunit.client.0.smithi120.stdout:9/964: rename d19/d24/d37/d40/d89/d52/da7/db1/l122 to d19/d24/d36/d47/d6f/l13c 0 2021-04-09T18:26:31.288 INFO:tasks.workunit.client.0.smithi120.stdout:1/846: rename d5/d5c to d5/d5c/d75/daf/d6c/d12a 22 2021-04-09T18:26:31.292 INFO:tasks.workunit.client.0.smithi120.stdout:6/946: rename d6/d8/db/d12/d22/f27 to d6/d8/d1a/d36/d54/d31/d37/ddd/f153 0 2021-04-09T18:26:31.293 INFO:tasks.workunit.client.0.smithi120.stdout:4/838: creat d1f/d2c/d34/f11d x:0 0 0 2021-04-09T18:26:31.294 INFO:tasks.workunit.client.0.smithi120.stdout:1/847: readlink d5/d5c/d75/daf/d2b/d8e/l94 0 2021-04-09T18:26:31.294 INFO:tasks.workunit.client.0.smithi120.stdout:4/839: fdatasync d1f/d2c/d34/d60/d7a/d4f/fcd 0 2021-04-09T18:26:31.296 INFO:tasks.workunit.client.0.smithi120.stdout:9/965: rename d19/d24/dd8/d106/f108 to d19/d11d/d101/f13d 0 2021-04-09T18:26:31.298 INFO:tasks.workunit.client.0.smithi120.stdout:4/840: mknod d1f/d2c/df3/c11e 1 2021-04-09T18:26:31.298 INFO:tasks.workunit.client.0.smithi120.stdout:6/947: dread d6/d8/d52/ddf/df2/d11a/fd9 [0,4194304] 0 2021-04-09T18:26:31.299 INFO:tasks.workunit.client.0.smithi120.stdout:4/841: readlink d1f/d2c/df3/l7e 0 2021-04-09T18:26:31.304 INFO:tasks.workunit.client.0.smithi120.stdout:9/966: fsync d19/d24/d2e/f9b 0 2021-04-09T18:26:31.306 INFO:tasks.workunit.client.0.smithi120.stdout:1/848: unlink d5/d64/d2d/d5a/d8d/f121 0 2021-04-09T18:26:31.313 INFO:tasks.workunit.client.0.smithi120.stdout:1/849: dwrite d5/d64/d2d/db5/dd1/f102 [0,4194304] 0 2021-04-09T18:26:31.318 INFO:tasks.workunit.client.0.smithi120.stdout:4/842: mkdir d1f/d2c/d34/d60/d7a/d92/d3e/d73/d11f 0 2021-04-09T18:26:31.325 INFO:tasks.workunit.client.0.smithi120.stdout:9/967: rmdir d19/d24/d36/d47/d6f/d114 0 2021-04-09T18:26:31.369 INFO:tasks.workunit.client.0.smithi120.stdout:9/968: dread d19/d24/d36/d47/d6f/f7f [0,4194304] 0 2021-04-09T18:26:31.392 INFO:tasks.workunit.client.0.smithi120.stdout:7/862: dread db/d26/df1/ff7 [0,4194304] 0 2021-04-09T18:26:31.393 INFO:tasks.workunit.client.0.smithi120.stdout:9/969: dread d19/f3d [4194304,4194304] 0 2021-04-09T18:26:31.396 INFO:tasks.workunit.client.0.smithi120.stdout:0/841: dread d0/d2/da/f19 [0,4194304] 0 2021-04-09T18:26:31.400 INFO:tasks.workunit.client.0.smithi120.stdout:7/863: fsync db/d38/d74/d6f/f89 0 2021-04-09T18:26:31.401 INFO:tasks.workunit.client.0.smithi120.stdout:4/843: truncate d1f/f8d 54920 0 2021-04-09T18:26:31.403 INFO:tasks.workunit.client.0.smithi120.stdout:4/844: write d1f/d2c/d34/d60/d7a/d4f/f79 [5161811,102273] 0 2021-04-09T18:26:31.408 INFO:tasks.workunit.client.0.smithi120.stdout:6/948: dread d6/d8/db/f12b [0,4194304] 0 2021-04-09T18:26:31.409 INFO:tasks.workunit.client.0.smithi120.stdout:7/864: dread db/d2c/d30/d59/f9e [0,4194304] 0 2021-04-09T18:26:31.415 INFO:tasks.workunit.client.0.smithi120.stdout:0/842: truncate d0/d2/f9c 765870 0 2021-04-09T18:26:31.416 INFO:tasks.workunit.client.0.smithi120.stdout:9/970: truncate d19/d24/d2e/ff0 1496318 0 2021-04-09T18:26:31.418 INFO:tasks.workunit.client.0.smithi120.stdout:4/845: truncate d1f/d2c/df3/f4d 1876752 0 2021-04-09T18:26:31.419 INFO:tasks.workunit.client.0.smithi120.stdout:4/846: mknod d1f/d2c/d56/d6a/da5/c120 1 2021-04-09T18:26:31.420 INFO:tasks.workunit.client.0.smithi120.stdout:4/847: chown d1f/d2c/d34/d60/d7a/d92/d84/dfa 0 1 2021-04-09T18:26:31.421 INFO:tasks.workunit.client.0.smithi120.stdout:9/971: chown d19/d24/d36/da8/dcd/lff 16655011 1 2021-04-09T18:26:31.421 INFO:tasks.workunit.client.0.smithi120.stdout:7/865: creat db/d38/d74/f129 x:0 0 0 2021-04-09T18:26:31.423 INFO:tasks.workunit.client.0.smithi120.stdout:1/850: dwrite d5/d5c/d75/daf/d2b/ff4 [0,4194304] 0 2021-04-09T18:26:31.424 INFO:tasks.workunit.client.0.smithi120.stdout:9/972: mknod d19/d2c/c13e 1 2021-04-09T18:26:31.438 INFO:tasks.workunit.client.0.smithi120.stdout:7/866: dwrite db/d38/d74/d6f/fd6 [0,4194304] 0 2021-04-09T18:26:31.440 INFO:tasks.workunit.client.0.smithi120.stdout:9/973: creat d19/d24/d36/da8/dcd/d139/d137/f13f x:0 0 0 2021-04-09T18:26:31.442 INFO:tasks.workunit.client.0.smithi120.stdout:4/848: dwrite d1f/d24/f9c [0,4194304] 0 2021-04-09T18:26:31.446 INFO:tasks.workunit.client.0.smithi120.stdout:4/849: chown d1f/d2c/d34/d60/d7a/d92/d84/dfa 17701 1 2021-04-09T18:26:31.448 INFO:tasks.workunit.client.0.smithi120.stdout:9/974: rmdir d19/d24/d36/da8/dcd 39 2021-04-09T18:26:31.448 INFO:tasks.workunit.client.0.smithi120.stdout:1/851: creat d5/d5c/d75/daf/dc7/d61/deb/f12b x:0 0 0 2021-04-09T18:26:31.449 INFO:tasks.workunit.client.0.smithi120.stdout:2/952: dread d13/d7a/d80/d48/d58/f65 [4194304,4194304] 0 2021-04-09T18:26:31.451 INFO:tasks.workunit.client.0.smithi120.stdout:4/850: write d1f/d24/f26 [3225925,4226] 0 2021-04-09T18:26:31.453 INFO:tasks.workunit.client.0.smithi120.stdout:4/851: stat d1f/d2c/d56/dca 0 2021-04-09T18:26:31.460 INFO:tasks.workunit.client.0.smithi120.stdout:9/975: dwrite d19/d24/d37/d40/d89/f53 [8388608,4194304] 0 2021-04-09T18:26:31.461 INFO:tasks.workunit.client.0.smithi120.stdout:2/953: dread - d13/d15/d35/fee zero size 2021-04-09T18:26:31.462 INFO:tasks.workunit.client.0.smithi120.stdout:4/852: dwrite d1f/d24/f26 [4194304,4194304] 0 2021-04-09T18:26:31.465 INFO:tasks.workunit.client.0.smithi120.stdout:1/852: rename d5/d64/df9/d86/f116 to d5/d5c/d75/daf/dc7/d61/f12c 0 2021-04-09T18:26:31.466 INFO:tasks.workunit.client.0.smithi120.stdout:7/867: creat db/d2c/d34/f12a x:0 0 0 2021-04-09T18:26:31.470 INFO:tasks.workunit.client.0.smithi120.stdout:9/976: creat d19/d24/d37/d40/d135/f140 x:0 0 0 2021-04-09T18:26:31.473 INFO:tasks.workunit.client.0.smithi120.stdout:4/853: readlink l1c 0 2021-04-09T18:26:31.481 INFO:tasks.workunit.client.0.smithi120.stdout:7/868: dwrite db/d38/d74/d6f/fd6 [4194304,4194304] 0 2021-04-09T18:26:31.497 INFO:tasks.workunit.client.0.smithi120.stdout:4/854: mkdir d1f/d2c/d34/d60/d7a/d92/d84/d99/df5/d121 0 2021-04-09T18:26:31.502 INFO:tasks.workunit.client.0.smithi120.stdout:2/954: write d13/d84/fff [431763,59112] 0 2021-04-09T18:26:31.503 INFO:tasks.workunit.client.0.smithi120.stdout:4/855: fdatasync d1f/d2c/d34/d60/d7a/d92/d3e/f48 0 2021-04-09T18:26:31.508 INFO:tasks.workunit.client.0.smithi120.stdout:1/853: dwrite d5/d5c/d75/daf/fc0 [0,4194304] 0 2021-04-09T18:26:31.509 INFO:tasks.workunit.client.0.smithi120.stdout:1/854: chown d5/d64/f108 1 1 2021-04-09T18:26:31.512 INFO:tasks.workunit.client.0.smithi120.stdout:7/869: dwrite db/d2c/d34/f79 [0,4194304] 0 2021-04-09T18:26:31.514 INFO:tasks.workunit.client.0.smithi120.stdout:7/870: write db/d42/d54/fc4 [1269888,105717] 0 2021-04-09T18:26:31.520 INFO:tasks.workunit.client.0.smithi120.stdout:1/855: mknod d5/d64/c12d 1 2021-04-09T18:26:31.520 INFO:tasks.workunit.client.0.smithi120.stdout:1/856: chown d5/d64/d2d/db5 56 1 2021-04-09T18:26:31.521 INFO:tasks.workunit.client.0.smithi120.stdout:1/857: chown d5/d64/d2d/d5a/d8d/fcc 11006 1 2021-04-09T18:26:31.522 INFO:tasks.workunit.client.0.smithi120.stdout:2/955: write fb [2406269,77176] 0 2021-04-09T18:26:31.524 INFO:tasks.workunit.client.0.smithi120.stdout:1/858: write d5/d64/d2d/db5/fd7 [4712662,105684] 0 2021-04-09T18:26:31.525 INFO:tasks.workunit.client.0.smithi120.stdout:4/856: creat d1f/d2c/d34/d60/d7a/d92/d84/dd0/d111/f122 x:0 0 0 2021-04-09T18:26:31.527 INFO:tasks.workunit.client.0.smithi120.stdout:4/857: stat d1f/d2c/d34/d60/d7a/d92/d84/lf9 0 2021-04-09T18:26:31.530 INFO:tasks.workunit.client.0.smithi120.stdout:4/858: chown d1f/d2c/d34/d60/d7a/d92/d3e/d73/f8b 354692340 1 2021-04-09T18:26:31.534 INFO:tasks.workunit.client.0.smithi120.stdout:4/859: readlink d1f/d2c/d34/d60/d7a/d92/d3e/l101 0 2021-04-09T18:26:31.540 INFO:tasks.workunit.client.0.smithi120.stdout:2/956: unlink d13/d7a/d80/fdf 0 2021-04-09T18:26:31.544 INFO:tasks.workunit.client.0.smithi120.stdout:9/977: dread d19/d24/d37/f94 [0,4194304] 0 2021-04-09T18:26:31.545 INFO:tasks.workunit.client.0.smithi120.stdout:1/859: dread d5/d5c/d75/daf/d2b/f7a [0,4194304] 0 2021-04-09T18:26:31.545 INFO:tasks.workunit.client.0.smithi120.stdout:9/978: stat d19/d11d/l5c 0 2021-04-09T18:26:31.546 INFO:tasks.workunit.client.0.smithi120.stdout:7/871: getdents db/d38/d74 0 2021-04-09T18:26:31.548 INFO:tasks.workunit.client.0.smithi120.stdout:4/860: link d1f/d2c/df3/f7b d1f/d24/d42/da0/f123 0 2021-04-09T18:26:31.550 INFO:tasks.workunit.client.0.smithi120.stdout:2/957: creat d13/d15/d35/f13f x:0 0 0 2021-04-09T18:26:31.559 INFO:tasks.workunit.client.0.smithi120.stdout:2/958: creat d13/d15/d35/dae/ded/f140 x:0 0 0 2021-04-09T18:26:31.560 INFO:tasks.workunit.client.0.smithi120.stdout:1/860: getdents d5/d64/d2d/db5 0 2021-04-09T18:26:31.560 INFO:tasks.workunit.client.0.smithi120.stdout:4/861: link d1f/fb0 d1f/d2c/d34/d60/d7a/d92/d84/d104/f124 0 2021-04-09T18:26:31.561 INFO:tasks.workunit.client.0.smithi120.stdout:4/862: write d1f/d24/ffc [884411,111549] 0 2021-04-09T18:26:31.561 INFO:tasks.workunit.client.0.smithi120.stdout:7/872: getdents db/d42/d54 0 2021-04-09T18:26:31.564 INFO:tasks.workunit.client.0.smithi120.stdout:7/873: creat db/d38/dab/f12b x:0 0 0 2021-04-09T18:26:31.566 INFO:tasks.workunit.client.0.smithi120.stdout:2/959: fdatasync d13/f47 0 2021-04-09T18:26:31.571 INFO:tasks.workunit.client.0.smithi120.stdout:7/874: mknod db/d2c/d34/c12c 1 2021-04-09T18:26:31.572 INFO:tasks.workunit.client.0.smithi120.stdout:1/861: read d5/d64/d2d/f3a [5567144,51175] 0 2021-04-09T18:26:31.573 INFO:tasks.workunit.client.0.smithi120.stdout:7/875: write db/d2c/d34/f79 [1416539,111102] 0 2021-04-09T18:26:31.574 INFO:tasks.workunit.client.0.smithi120.stdout:2/960: symlink d13/d7a/d127/l141 0 2021-04-09T18:26:31.574 INFO:tasks.workunit.client.0.smithi120.stdout:4/863: creat d1f/d2c/d34/d60/d7a/d92/d3e/f125 x:0 0 0 2021-04-09T18:26:31.588 INFO:tasks.workunit.client.0.smithi120.stdout:2/961: dwrite d13/d7a/d80/d48/d49/d64/f135 [0,4194304] 0 2021-04-09T18:26:31.589 INFO:tasks.workunit.client.0.smithi120.stdout:9/979: dwrite d19/d24/d36/da8/f103 [4194304,4194304] 0 2021-04-09T18:26:31.590 INFO:tasks.workunit.client.0.smithi120.stdout:4/864: dwrite d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f7f [0,4194304] 0 2021-04-09T18:26:31.590 INFO:tasks.workunit.client.0.smithi120.stdout:7/876: truncate db/d2c/d30/d59/fa6 1607626 0 2021-04-09T18:26:31.591 INFO:tasks.workunit.client.0.smithi120.stdout:4/865: chown l1c 23160598 1 2021-04-09T18:26:31.591 INFO:tasks.workunit.client.0.smithi120.stdout:7/877: mknod db/d38/d74/d6f/c12d 1 2021-04-09T18:26:31.592 INFO:tasks.workunit.client.0.smithi120.stdout:4/866: write d1f/d2c/d34/fee [721240,1849] 0 2021-04-09T18:26:31.597 INFO:tasks.workunit.client.0.smithi120.stdout:4/867: mknod d1f/d2c/d34/d60/d7a/d92/d3e/d73/d11f/c126 1 2021-04-09T18:26:31.600 INFO:tasks.workunit.client.0.smithi120.stdout:9/980: readlink d19/d24/d36/da8/dcd/lff 0 2021-04-09T18:26:31.600 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:31.608 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:26:31.609 INFO:tasks.workunit.client.0.smithi120.stdout:2/962: getdents d13/d15/d35 0 2021-04-09T18:26:31.610 INFO:tasks.workunit.client.0.smithi120.stdout:7/878: dwrite db/d26/f5e [4194304,4194304] 0 2021-04-09T18:26:31.611 INFO:tasks.workunit.client.0.smithi120.stdout:1/862: dwrite d5/d5c/d75/daf/dc7/f98 [0,4194304] 0 2021-04-09T18:26:31.622 INFO:tasks.workunit.client.0.smithi120.stdout:1/863: fdatasync d5/d64/f82 0 2021-04-09T18:26:31.623 INFO:tasks.workunit.client.0.smithi120.stdout:2/963: mkdir d13/d7a/d80/d54/d11b/d142 0 2021-04-09T18:26:31.625 INFO:tasks.workunit.client.0.smithi120.stdout:2/964: chown d13/d7a/d80/d54/f60 0 1 2021-04-09T18:26:31.631 INFO:tasks.workunit.client.0.smithi120.stdout:1/864: symlink d5/d64/l12e 0 2021-04-09T18:26:31.640 INFO:tasks.workunit.client.0.smithi120.stdout:4/868: truncate d1f/d2c/d34/d60/d7a/d92/d84/dd0/fdd 661935 0 2021-04-09T18:26:31.641 INFO:tasks.workunit.client.0.smithi120.stdout:9/981: truncate d19/d11d/d63/fb6 196191 0 2021-04-09T18:26:31.642 INFO:tasks.workunit.client.0.smithi120.stdout:4/869: stat d1f/d2c/d34/d60/d7a/d92/d84/dfa/l10c 0 2021-04-09T18:26:31.643 INFO:tasks.workunit.client.0.smithi120.stdout:9/982: chown d19/d24/d36/d47/lbb 10 1 2021-04-09T18:26:31.644 INFO:tasks.workunit.client.0.smithi120.stdout:1/865: link d5/d5c/d75/daf/d2b/f78 d5/d64/d2d/db5/f12f 0 2021-04-09T18:26:31.648 INFO:tasks.workunit.client.0.smithi120.stdout:9/983: stat d19/d81/d119 0 2021-04-09T18:26:31.648 INFO:tasks.workunit.client.0.smithi120.stdout:4/870: creat d1f/d2c/d56/dca/f127 x:0 0 0 2021-04-09T18:26:31.654 INFO:tasks.workunit.client.0.smithi120.stdout:1/866: creat d5/f130 x:0 0 0 2021-04-09T18:26:31.663 INFO:tasks.workunit.client.0.smithi120.stdout:1/867: getdents d5/d5c/d75/daf/d2b 0 2021-04-09T18:26:31.665 INFO:tasks.workunit.client.0.smithi120.stdout:1/868: mknod d5/d1f/c131 1 2021-04-09T18:26:31.666 INFO:tasks.workunit.client.0.smithi120.stdout:7/879: write db/d38/d3c/d6e/d94/f126 [2899687,127763] 0 2021-04-09T18:26:31.667 INFO:tasks.workunit.client.0.smithi120.stdout:2/965: write d13/d15/f42 [869590,38806] 0 2021-04-09T18:26:31.670 INFO:tasks.workunit.client.0.smithi120.stdout:2/966: dread - d13/d15/d35/fee zero size 2021-04-09T18:26:31.670 INFO:tasks.workunit.client.0.smithi120.stdout:1/869: creat d5/d64/df9/d86/da3/f132 x:0 0 0 2021-04-09T18:26:31.671 INFO:tasks.workunit.client.0.smithi120.stdout:7/880: chown db/d38/ff2 14 1 2021-04-09T18:26:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:1/870: dread - d5/d5c/d75/daf/d2b/dd4/ff7 zero size 2021-04-09T18:26:31.677 INFO:tasks.workunit.client.0.smithi120.stdout:2/967: truncate d13/d15/d35/d9f/f121 167564 0 2021-04-09T18:26:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:1/871: creat d5/d5c/d75/daf/dc7/d61/deb/f133 x:0 0 0 2021-04-09T18:26:31.690 INFO:tasks.workunit.client.0.smithi120.stdout:4/871: dwrite d1f/fb0 [0,4194304] 0 2021-04-09T18:26:31.690 INFO:tasks.workunit.client.0.smithi120.stdout:1/872: dwrite d5/f130 [0,4194304] 0 2021-04-09T18:26:31.694 INFO:tasks.workunit.client.0.smithi120.stdout:1/873: mknod d5/d64/d2d/d5a/c134 1 2021-04-09T18:26:31.705 INFO:tasks.workunit.client.0.smithi120.stdout:4/872: dwrite d1f/f40 [0,4194304] 0 2021-04-09T18:26:31.708 INFO:tasks.workunit.client.0.smithi120.stdout:7/881: dwrite db/d2c/f44 [0,4194304] 0 2021-04-09T18:26:31.727 INFO:tasks.workunit.client.0.smithi120.stdout:9/984: dwrite d19/d24/d37/f97 [0,4194304] 0 2021-04-09T18:26:31.728 INFO:tasks.workunit.client.0.smithi120.stdout:1/874: rmdir d5/d64 39 2021-04-09T18:26:31.729 INFO:tasks.workunit.client.0.smithi120.stdout:7/882: rename db/d42/d54/d5a/ff0 to db/d38/d74/d6f/f12e 0 2021-04-09T18:26:31.734 INFO:tasks.workunit.client.0.smithi120.stdout:2/968: truncate f6 3109577 0 2021-04-09T18:26:31.734 INFO:tasks.workunit.client.0.smithi120.stdout:9/985: fsync d19/d24/d37/d40/d135/f131 0 2021-04-09T18:26:31.757 INFO:tasks.workunit.client.0.smithi120.stdout:9/986: rename d19/d11d/f6d to d19/d24/d37/d40/d89/d52/da7/f141 0 2021-04-09T18:26:31.768 INFO:tasks.workunit.client.0.smithi120.stdout:4/873: dread d1f/d2c/d34/d60/d7a/d92/d3e/d73/fb1 [0,4194304] 0 2021-04-09T18:26:31.769 INFO:tasks.workunit.client.0.smithi120.stdout:1/875: rename d5/d5c/d75/daf/d2b/dd4/ffe to d5/d64/df9/d86/da3/f135 0 2021-04-09T18:26:31.770 INFO:tasks.workunit.client.0.smithi120.stdout:2/969: link d13/d15/d35/d9f/f121 d13/d15/d35/d10e/f143 0 2021-04-09T18:26:31.771 INFO:tasks.workunit.client.0.smithi120.stdout:4/874: mknod d1f/d2c/d56/c128 1 2021-04-09T18:26:31.777 INFO:tasks.workunit.client.0.smithi120.stdout:2/970: symlink d13/d15/d35/l144 0 2021-04-09T18:26:31.778 INFO:tasks.workunit.client.0.smithi120.stdout:2/971: write fb [9103949,59551] 0 2021-04-09T18:26:31.781 INFO:tasks.workunit.client.0.smithi120.stdout:1/876: mkdir d5/d5c/d75/daf/d2b/d8e/d136 0 2021-04-09T18:26:31.782 INFO:tasks.workunit.client.0.smithi120.stdout:9/987: truncate d19/d24/fa4 1160514 0 2021-04-09T18:26:31.783 INFO:tasks.workunit.client.0.smithi120.stdout:2/972: rmdir d13/d7a/d80/d48/d49/d76 39 2021-04-09T18:26:31.784 INFO:tasks.workunit.client.0.smithi120.stdout:9/988: symlink d19/d24/dd8/l142 0 2021-04-09T18:26:31.785 INFO:tasks.workunit.client.0.smithi120.stdout:2/973: mknod d13/d7a/d80/d48/d49/c145 1 2021-04-09T18:26:31.787 INFO:tasks.workunit.client.0.smithi120.stdout:2/974: fsync d13/d15/f9c 0 2021-04-09T18:26:31.788 INFO:tasks.workunit.client.0.smithi120.stdout:1/877: write d5/d5c/d75/daf/d87/fea [252088,20534] 0 2021-04-09T18:26:31.790 INFO:tasks.workunit.client.0.smithi120.stdout:1/878: readlink d5/d5c/d75/daf/dc7/d61/lac 0 2021-04-09T18:26:31.791 INFO:tasks.workunit.client.0.smithi120.stdout:4/875: truncate d1f/d2c/d34/d60/d7a/d92/feb 905114 0 2021-04-09T18:26:31.792 INFO:tasks.workunit.client.0.smithi120.stdout:4/876: readlink d1f/d2c/d34/lc1 0 2021-04-09T18:26:31.799 INFO:tasks.workunit.client.0.smithi120.stdout:9/989: write d19/d24/d37/d40/d89/fe8 [1113846,97396] 0 2021-04-09T18:26:31.801 INFO:tasks.workunit.client.0.smithi120.stdout:4/877: read d1f/d2c/df3/dc6/dc5/dda/fbf [2131537,73836] 0 2021-04-09T18:26:31.801 INFO:tasks.workunit.client.0.smithi120.stdout:9/990: mknod d19/d24/d36/d47/d4b/c143 1 2021-04-09T18:26:31.802 INFO:tasks.workunit.client.0.smithi120.stdout:4/878: mknod d1f/d24/d42/c129 1 2021-04-09T18:26:31.806 INFO:tasks.workunit.client.0.smithi120.stdout:4/879: rmdir d1f/d2c/d34/d60/d7a/d92/d3e 39 2021-04-09T18:26:31.810 INFO:tasks.workunit.client.0.smithi120.stdout:1/879: dread d5/d64/f108 [0,4194304] 0 2021-04-09T18:26:31.811 INFO:tasks.workunit.client.0.smithi120.stdout:9/991: dread d19/d24/d37/d40/d89/d52/f59 [0,4194304] 0 2021-04-09T18:26:31.812 INFO:tasks.workunit.client.0.smithi120.stdout:4/880: mkdir d1f/d2c/d34/d60/d7a/d92/d3e/d12a 0 2021-04-09T18:26:31.812 INFO:tasks.workunit.client.0.smithi120.stdout:9/992: chown d19/d81/l8e 3444 1 2021-04-09T18:26:31.816 INFO:tasks.workunit.client.0.smithi120.stdout:1/880: dwrite d5/f130 [4194304,4194304] 0 2021-04-09T18:26:31.818 INFO:tasks.workunit.client.0.smithi120.stdout:4/881: rename d1f/d2c/d34/d60/d7a/d4f/fc2 to d1f/d2c/d34/d60/d7a/d4f/f12b 0 2021-04-09T18:26:31.818 INFO:tasks.workunit.client.0.smithi120.stdout:1/881: mknod d5/d64/df9/d86/c137 1 2021-04-09T18:26:31.842 INFO:tasks.workunit.client.0.smithi120.stdout:9/993: dread d19/d24/dd8/fd9 [0,4194304] 0 2021-04-09T18:26:31.843 INFO:tasks.workunit.client.0.smithi120.stdout:9/994: mknod d19/d24/d36/da8/dcd/d139/d137/c144 1 2021-04-09T18:26:31.862 INFO:tasks.workunit.client.0.smithi120.stdout:8/862: sync 2021-04-09T18:26:32.368 INFO:tasks.workunit.client.0.smithi120.stdout:9/995: dwrite f14 [4194304,4194304] 0 2021-04-09T18:26:32.382 INFO:tasks.workunit.client.0.smithi120.stdout:9/996: truncate d19/d24/d37/d40/fcf 3248331 0 2021-04-09T18:26:32.389 INFO:tasks.workunit.client.0.smithi120.stdout:9/997: chown d19/l2a 1026282188 1 2021-04-09T18:26:32.389 INFO:tasks.workunit.client.0.smithi120.stdout:9/998: creat d19/d24/d9e/f145 x:0 0 0 2021-04-09T18:26:32.400 INFO:tasks.workunit.client.0.smithi120.stdout:9/999: dwrite f16 [0,4194304] 0 2021-04-09T18:26:32.402 INFO:tasks.workunit.client.0.smithi120.stdout:2/975: dread d13/d7a/d80/d48/d49/d64/fb4 [0,4194304] 0 2021-04-09T18:26:32.405 INFO:tasks.workunit.client.0.smithi120.stdout:2/976: chown d13/d15/d35/d9f/db9/fd8 72 1 2021-04-09T18:26:32.416 INFO:tasks.workunit.client.0.smithi120.stdout:2/977: dwrite d13/d7a/d80/d54/faf [4194304,4194304] 0 2021-04-09T18:26:32.417 INFO:tasks.workunit.client.0.smithi120.stdout:2/978: write d13/d7a/d80/d48/d49/d64/d83/fa9 [4637741,73416] 0 2021-04-09T18:26:32.430 INFO:tasks.workunit.client.0.smithi120.stdout:2/979: truncate d13/d7a/d80/d48/d49/d76/ff3 2133349 0 2021-04-09T18:26:32.431 INFO:tasks.workunit.client.0.smithi120.stdout:2/980: fsync d13/d7a/d80/d54/fa8 0 2021-04-09T18:26:32.437 INFO:tasks.workunit.client.0.smithi120.stdout:3/888: sync 2021-04-09T18:26:32.438 INFO:tasks.workunit.client.0.smithi120.stdout:2/981: read d13/d7a/d80/d48/d58/f65 [2667649,30901] 0 2021-04-09T18:26:32.443 INFO:tasks.workunit.client.0.smithi120.stdout:2/982: creat d13/d7a/d80/d48/d58/f146 x:0 0 0 2021-04-09T18:26:32.453 INFO:tasks.workunit.client.0.smithi120.stdout:3/889: dwrite d3/d5/d36/d1e/d6b/d49/d4e/f6f [0,4194304] 0 2021-04-09T18:26:32.483 INFO:tasks.workunit.client.0.smithi120.stdout:1/882: dread d5/d64/d2d/f70 [0,4194304] 0 2021-04-09T18:26:32.487 INFO:tasks.workunit.client.0.smithi120.stdout:1/883: mkdir d5/d5c/d75/d138 0 2021-04-09T18:26:32.508 INFO:tasks.workunit.client.0.smithi120.stdout:1/884: dwrite d5/d64/d2d/d5a/f6a [0,4194304] 0 2021-04-09T18:26:32.512 INFO:tasks.workunit.client.0.smithi120.stdout:1/885: creat d5/d5c/d75/d104/f139 x:0 0 0 2021-04-09T18:26:32.534 INFO:tasks.workunit.client.0.smithi120.stdout:1/886: dread d5/d64/df9/d86/f9c [0,4194304] 0 2021-04-09T18:26:32.540 INFO:tasks.workunit.client.0.smithi120.stdout:1/887: dread - d5/d5c/d75/daf/f103 zero size 2021-04-09T18:26:32.542 INFO:tasks.workunit.client.0.smithi120.stdout:1/888: creat d5/d5c/d75/daf/d6c/f13a x:0 0 0 2021-04-09T18:26:32.616 INFO:tasks.workunit.client.0.smithi120.stdout:7/883: sync 2021-04-09T18:26:32.616 INFO:tasks.workunit.client.0.smithi120.stdout:0/843: sync 2021-04-09T18:26:32.616 INFO:tasks.workunit.client.0.smithi120.stdout:8/863: sync 2021-04-09T18:26:32.617 INFO:tasks.workunit.client.0.smithi120.stdout:4/882: sync 2021-04-09T18:26:32.617 INFO:tasks.workunit.client.0.smithi120.stdout:6/949: sync 2021-04-09T18:26:32.620 INFO:tasks.workunit.client.0.smithi120.stdout:7/884: read db/d26/d4c/f98 [1454613,43370] 0 2021-04-09T18:26:32.624 INFO:tasks.workunit.client.0.smithi120.stdout:0/844: write d0/d2/dd/db4/f83 [4493573,44869] 0 2021-04-09T18:26:32.626 INFO:tasks.workunit.client.0.smithi120.stdout:1/889: truncate d5/d5c/d75/daf/fc0 3153764 0 2021-04-09T18:26:32.627 INFO:tasks.workunit.client.0.smithi120.stdout:0/845: rmdir d0/d43 39 2021-04-09T18:26:32.628 INFO:tasks.workunit.client.0.smithi120.stdout:0/846: chown d0/d2/d4/d5f/d81/lb0 18385914 1 2021-04-09T18:26:32.632 INFO:tasks.workunit.client.0.smithi120.stdout:0/847: symlink d0/d2/d4/d5f/d61/lff 0 2021-04-09T18:26:32.632 INFO:tasks.workunit.client.0.smithi120.stdout:6/950: write d6/d8/db/f12b [470605,97886] 0 2021-04-09T18:26:32.637 INFO:tasks.workunit.client.0.smithi120.stdout:6/951: read d6/d8/d1a/d36/d54/d31/d37/ddd/f153 [3545430,30384] 0 2021-04-09T18:26:32.638 INFO:tasks.workunit.client.0.smithi120.stdout:6/952: chown d6/d8/db/d12/d22/fff 9160 1 2021-04-09T18:26:32.641 INFO:tasks.workunit.client.0.smithi120.stdout:0/848: truncate d0/d5a/d62/d69/dac/fcd 3699310 0 2021-04-09T18:26:32.642 INFO:tasks.workunit.client.0.smithi120.stdout:0/849: dread - d0/d2/d8d/dd1/ffa zero size 2021-04-09T18:26:32.643 INFO:tasks.workunit.client.0.smithi120.stdout:6/953: creat d6/d8/d52/f154 x:0 0 0 2021-04-09T18:26:32.644 INFO:tasks.workunit.client.0.smithi120.stdout:4/883: dread d1f/d2c/d34/d60/d7a/d92/d84/d99/dae/fe7 [0,4194304] 0 2021-04-09T18:26:32.645 INFO:tasks.workunit.client.0.smithi120.stdout:0/850: creat d0/d2/d8d/f100 x:0 0 0 2021-04-09T18:26:32.645 INFO:tasks.workunit.client.0.smithi120.stdout:4/884: chown d1f/d24/d42 4138805 1 2021-04-09T18:26:32.646 INFO:tasks.workunit.client.0.smithi120.stdout:0/851: dread - d0/d2/d8d/dd1/ffa zero size 2021-04-09T18:26:32.647 INFO:tasks.workunit.client.0.smithi120.stdout:4/885: stat d1f/d2c/d34/d60/d7a/d92/d3e/d73/d11f 0 2021-04-09T18:26:32.649 INFO:tasks.workunit.client.0.smithi120.stdout:8/864: write d2/d3/d11/fda [1591067,22011] 0 2021-04-09T18:26:32.650 INFO:tasks.workunit.client.0.smithi120.stdout:4/886: unlink d1f/d2c/df3/l6c 0 2021-04-09T18:26:32.652 INFO:tasks.workunit.client.0.smithi120.stdout:4/887: mknod d1f/d2c/d56/dca/c12c 1 2021-04-09T18:26:32.653 INFO:tasks.workunit.client.0.smithi120.stdout:0/852: dwrite d0/d5a/d6c/faa [0,4194304] 0 2021-04-09T18:26:32.656 INFO:tasks.workunit.client.0.smithi120.stdout:0/853: unlink d0/d2/da/d23/lf2 0 2021-04-09T18:26:32.658 INFO:tasks.workunit.client.0.smithi120.stdout:4/888: creat d1f/d2c/d34/d60/f12d x:0 0 0 2021-04-09T18:26:32.663 INFO:tasks.workunit.client.0.smithi120.stdout:1/890: write d5/d5c/fef [825953,67750] 0 2021-04-09T18:26:32.675 INFO:tasks.workunit.client.0.smithi120.stdout:1/891: link d5/d5c/d75/daf/dc7/d61/deb/d7c/lf8 d5/d5c/d75/daf/d87/dc3/l13b 0 2021-04-09T18:26:32.677 INFO:tasks.workunit.client.0.smithi120.stdout:4/889: dread d1f/d2c/d34/f51 [4194304,4194304] 0 2021-04-09T18:26:32.680 INFO:tasks.workunit.client.0.smithi120.stdout:1/892: creat d5/d5c/d75/f13c x:0 0 0 2021-04-09T18:26:32.681 INFO:tasks.workunit.client.0.smithi120.stdout:4/890: fsync d1f/d2c/d34/d60/d7a/d92/d84/d99/fd7 0 2021-04-09T18:26:32.683 INFO:tasks.workunit.client.0.smithi120.stdout:8/865: dread d2/d3/d11/f1f [0,4194304] 0 2021-04-09T18:26:32.686 INFO:tasks.workunit.client.0.smithi120.stdout:6/954: write d6/d8/d1a/d36/d54/d31/d37/d61/f9a [877534,105527] 0 2021-04-09T18:26:32.689 INFO:tasks.workunit.client.0.smithi120.stdout:8/866: dwrite d2/d37/d3e/d7c/fe3 [0,4194304] 0 2021-04-09T18:26:32.691 INFO:tasks.workunit.client.0.smithi120.stdout:0/854: write d0/d2/fb5 [978099,89498] 0 2021-04-09T18:26:32.692 INFO:tasks.workunit.client.0.smithi120.stdout:0/855: dread - d0/d2/da/ff9 zero size 2021-04-09T18:26:32.694 INFO:tasks.workunit.client.0.smithi120.stdout:6/955: rename d6/d8/d1a/d36/d54/f75 to d6/d8/d52/ddf/df2/f155 0 2021-04-09T18:26:32.695 INFO:tasks.workunit.client.0.smithi120.stdout:8/867: symlink d2/d3/d11/d6a/d3b/d6b/da9/l110 0 2021-04-09T18:26:32.696 INFO:tasks.workunit.client.0.smithi120.stdout:8/868: stat d2/d3/f8b 0 2021-04-09T18:26:32.697 INFO:tasks.workunit.client.0.smithi120.stdout:6/956: write d6/d8/d1a/d36/d54/d31/d37/f132 [2111378,81089] 0 2021-04-09T18:26:32.700 INFO:tasks.workunit.client.0.smithi120.stdout:4/891: getdents d1f/d2c/d34/d60/d7a/d4f 0 2021-04-09T18:26:32.700 INFO:tasks.workunit.client.0.smithi120.stdout:6/957: chown d6/d8/d52/ddf/df2/l13c 129103271 1 2021-04-09T18:26:32.702 INFO:tasks.workunit.client.0.smithi120.stdout:0/856: creat d0/d2/d8d/dd1/f101 x:0 0 0 2021-04-09T18:26:32.703 INFO:tasks.workunit.client.0.smithi120.stdout:8/869: symlink d2/d3/d11/d6a/d3b/l111 0 2021-04-09T18:26:32.705 INFO:tasks.workunit.client.0.smithi120.stdout:0/857: write d0/d2/d4/d5f/d61/feb [313112,107477] 0 2021-04-09T18:26:32.723 INFO:tasks.workunit.client.0.smithi120.stdout:1/893: dwrite d5/d64/df9/f8f [4194304,4194304] 0 2021-04-09T18:26:32.738 INFO:tasks.workunit.client.0.smithi120.stdout:0/858: dread d0/d2/d4/f59 [0,4194304] 0 2021-04-09T18:26:32.740 INFO:tasks.workunit.client.0.smithi120.stdout:1/894: symlink d5/d5c/d75/daf/d2b/l13d 0 2021-04-09T18:26:32.745 INFO:tasks.workunit.client.0.smithi120.stdout:1/895: chown d5/d5c/d75/daf/dc7/lb2 26308 1 2021-04-09T18:26:32.746 INFO:tasks.workunit.client.0.smithi120.stdout:0/859: creat d0/d2/dd/db4/dc0/f102 x:0 0 0 2021-04-09T18:26:32.762 INFO:tasks.workunit.client.0.smithi120.stdout:1/896: dread d5/f7 [4194304,4194304] 0 2021-04-09T18:26:32.765 INFO:tasks.workunit.client.0.smithi120.stdout:0/860: write d0/d2/d4/f59 [308173,65692] 0 2021-04-09T18:26:32.767 INFO:tasks.workunit.client.0.smithi120.stdout:1/897: creat d5/d5c/d75/daf/dc7/d61/f13e x:0 0 0 2021-04-09T18:26:32.771 INFO:tasks.workunit.client.0.smithi120.stdout:0/861: symlink d0/d2/d7b/l103 0 2021-04-09T18:26:32.775 INFO:tasks.workunit.client.0.smithi120.stdout:6/958: dwrite d6/d8/d1a/d36/f10f [0,4194304] 0 2021-04-09T18:26:32.777 INFO:tasks.workunit.client.0.smithi120.stdout:6/959: readlink d6/d8/d52/ddf/df2/d11a/lad 0 2021-04-09T18:26:32.807 INFO:tasks.workunit.client.0.smithi120.stdout:2/983: sync 2021-04-09T18:26:32.808 INFO:tasks.workunit.client.0.smithi120.stdout:6/960: creat d6/d8/db/d2b/d4d/f156 x:0 0 0 2021-04-09T18:26:32.809 INFO:tasks.workunit.client.0.smithi120.stdout:2/984: chown d13/d7a/d80/d48/d49/d64/d83/l9a 3366 1 2021-04-09T18:26:32.811 INFO:tasks.workunit.client.0.smithi120.stdout:2/985: stat d13/d7a/d80/d48/d58/f65 0 2021-04-09T18:26:32.813 INFO:tasks.workunit.client.0.smithi120.stdout:2/986: chown d13/d7a/d80/d48/d49/d76/f12c 91512 1 2021-04-09T18:26:32.814 INFO:tasks.workunit.client.0.smithi120.stdout:8/870: dwrite d2/dcf/dd6/f102 [0,4194304] 0 2021-04-09T18:26:32.814 INFO:tasks.workunit.client.0.smithi120.stdout:6/961: mknod d6/d8/db/d12/d22/c157 1 2021-04-09T18:26:32.815 INFO:tasks.workunit.client.0.smithi120.stdout:2/987: fdatasync d13/d7a/d80/d48/d49/d64/d83/fa9 0 2021-04-09T18:26:32.848 INFO:tasks.workunit.client.0.smithi120.stdout:6/962: chown d6/d8/db/d2b/l81 117 1 2021-04-09T18:26:32.849 INFO:tasks.workunit.client.0.smithi120.stdout:6/963: dread - d6/d8/db/d12/d22/f131 zero size 2021-04-09T18:26:32.853 INFO:tasks.workunit.client.0.smithi120.stdout:0/862: rename d0/d5a/d62/d8f/fef to d0/d2/dd/db4/f104 0 2021-04-09T18:26:32.854 INFO:tasks.workunit.client.0.smithi120.stdout:6/964: dwrite d6/d8/db/d2b/f6f [0,4194304] 0 2021-04-09T18:26:32.855 INFO:tasks.workunit.client.0.smithi120.stdout:8/871: creat d2/d27/f112 x:0 0 0 2021-04-09T18:26:32.856 INFO:tasks.workunit.client.0.smithi120.stdout:0/863: fdatasync d0/d5a/d62/d69/ff5 0 2021-04-09T18:26:32.857 INFO:tasks.workunit.client.0.smithi120.stdout:1/898: rename d5/d5c/d75/daf/d87/fee to d5/d5c/d75/daf/d2b/d8e/d136/f13f 0 2021-04-09T18:26:32.865 INFO:tasks.workunit.client.0.smithi120.stdout:6/965: read d6/d8/d1a/f34 [252441,50527] 0 2021-04-09T18:26:32.889 INFO:tasks.workunit.client.0.smithi120.stdout:3/890: sync 2021-04-09T18:26:32.891 INFO:tasks.workunit.client.0.smithi120.stdout:0/864: link d0/d2/dd/f92 d0/d5a/d62/d72/f105 0 2021-04-09T18:26:32.893 INFO:tasks.workunit.client.0.smithi120.stdout:2/988: write d13/d7a/d80/d48/d49/d64/fd1 [869253,130694] 0 2021-04-09T18:26:32.894 INFO:tasks.workunit.client.0.smithi120.stdout:8/872: mkdir d2/dcf/d113 0 2021-04-09T18:26:32.897 INFO:tasks.workunit.client.0.smithi120.stdout:1/899: write d5/d64/d2d/f110 [682218,115196] 0 2021-04-09T18:26:32.898 INFO:tasks.workunit.client.0.smithi120.stdout:6/966: write d6/d8/db/d12/d22/fff [6029,128336] 0 2021-04-09T18:26:32.899 INFO:tasks.workunit.client.0.smithi120.stdout:8/873: fsync d2/d37/fc3 0 2021-04-09T18:26:32.903 INFO:tasks.workunit.client.0.smithi120.stdout:1/900: readlink d5/d64/l56 0 2021-04-09T18:26:32.904 INFO:tasks.workunit.client.0.smithi120.stdout:3/891: creat d3/d5/d36/d1e/d6b/d49/d89/f121 x:0 0 0 2021-04-09T18:26:32.906 INFO:tasks.workunit.client.0.smithi120.stdout:1/901: write d5/d5c/fed [3358479,59756] 0 2021-04-09T18:26:32.910 INFO:tasks.workunit.client.0.smithi120.stdout:6/967: dwrite d6/d8/db/d2b/d4d/f156 [0,4194304] 0 2021-04-09T18:26:32.912 INFO:tasks.workunit.client.0.smithi120.stdout:1/902: read d5/d64/d2d/d5a/d8d/fb4 [132479,12686] 0 2021-04-09T18:26:32.913 INFO:tasks.workunit.client.0.smithi120.stdout:2/989: dwrite d13/d7a/d80/d48/de3/f12a [0,4194304] 0 2021-04-09T18:26:32.918 INFO:tasks.workunit.client.0.smithi120.stdout:1/903: read d5/d5c/d75/daf/d2b/ff4 [1364367,67121] 0 2021-04-09T18:26:32.935 INFO:tasks.workunit.client.0.smithi120.stdout:4/892: sync 2021-04-09T18:26:32.936 INFO:tasks.workunit.client.0.smithi120.stdout:6/968: mkdir d6/d8/db/d2b/d4d/dfc/d97/d158 0 2021-04-09T18:26:32.936 INFO:tasks.workunit.client.0.smithi120.stdout:8/874: dwrite d2/d3/d11/d2c/d44/f74 [4194304,4194304] 0 2021-04-09T18:26:32.943 INFO:tasks.workunit.client.0.smithi120.stdout:3/892: write d3/f6 [2103976,65580] 0 2021-04-09T18:26:32.944 INFO:tasks.workunit.client.0.smithi120.stdout:3/893: stat d3/d5/df5/d25/f99 0 2021-04-09T18:26:32.947 INFO:tasks.workunit.client.0.smithi120.stdout:8/875: link d2/d3/fc0 d2/d3/d11/d6a/d3b/dbb/f114 0 2021-04-09T18:26:32.950 INFO:tasks.workunit.client.0.smithi120.stdout:4/893: symlink d1f/d24/d42/l12e 0 2021-04-09T18:26:32.953 INFO:tasks.workunit.client.0.smithi120.stdout:7/885: dread db/dbf/fce [0,4194304] 0 2021-04-09T18:26:32.954 INFO:tasks.workunit.client.0.smithi120.stdout:2/990: truncate d13/d15/d35/d10e/f8e 3095885 0 2021-04-09T18:26:32.957 INFO:tasks.workunit.client.0.smithi120.stdout:8/876: symlink d2/d3/d11/d6a/d3b/dbb/l115 0 2021-04-09T18:26:32.958 INFO:tasks.workunit.client.0.smithi120.stdout:4/894: symlink d1f/d2c/l12f 0 2021-04-09T18:26:32.961 INFO:tasks.workunit.client.0.smithi120.stdout:2/991: stat d13/d7a/d80/d48/de3/l107 0 2021-04-09T18:26:32.963 INFO:tasks.workunit.client.0.smithi120.stdout:3/894: rename d3/l56 to d3/d5/d36/d1e/d6b/d49/d89/d68/l122 0 2021-04-09T18:26:32.963 INFO:tasks.workunit.client.0.smithi120.stdout:8/877: dwrite d2/d3/d11/d6a/d3b/f77 [0,4194304] 0 2021-04-09T18:26:32.964 INFO:tasks.workunit.client.0.smithi120.stdout:8/878: fsync d2/d3/d11/d2c/f87 0 2021-04-09T18:26:32.966 INFO:tasks.workunit.client.0.smithi120.stdout:7/886: rename db/d2c/d30/f52 to db/d42/f12f 0 2021-04-09T18:26:32.968 INFO:tasks.workunit.client.0.smithi120.stdout:4/895: symlink d1f/d2c/d34/d60/d7a/d4f/de3/l130 0 2021-04-09T18:26:32.969 INFO:tasks.workunit.client.0.smithi120.stdout:8/879: dread d2/d3/d11/d6a/d3b/f67 [0,4194304] 0 2021-04-09T18:26:32.970 INFO:tasks.workunit.client.0.smithi120.stdout:2/992: mkdir d13/d15/d35/dbc/d147 0 2021-04-09T18:26:32.972 INFO:tasks.workunit.client.0.smithi120.stdout:2/993: mknod d13/d7a/d80/d48/da3/c148 1 2021-04-09T18:26:32.973 INFO:tasks.workunit.client.0.smithi120.stdout:8/880: write d2/d37/d3e/d42/d9e/f103 [995131,55177] 0 2021-04-09T18:26:32.978 INFO:tasks.workunit.client.0.smithi120.stdout:7/887: creat db/f130 x:0 0 0 2021-04-09T18:26:32.980 INFO:tasks.workunit.client.0.smithi120.stdout:2/994: creat d13/d84/d10c/f149 x:0 0 0 2021-04-09T18:26:32.981 INFO:tasks.workunit.client.0.smithi120.stdout:4/896: write d1f/d2c/d34/d60/d7a/d92/d3e/d73/f8b [2094725,41299] 0 2021-04-09T18:26:32.983 INFO:tasks.workunit.client.0.smithi120.stdout:1/904: dread d5/d64/d2d/db5/dd1/f102 [0,4194304] 0 2021-04-09T18:26:32.990 INFO:tasks.workunit.client.0.smithi120.stdout:2/995: dread d13/d84/fff [0,4194304] 0 2021-04-09T18:26:32.991 INFO:tasks.workunit.client.0.smithi120.stdout:8/881: truncate d2/d3/d11/f34 4016198 0 2021-04-09T18:26:32.995 INFO:tasks.workunit.client.0.smithi120.stdout:3/895: read d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/dc3/ff4 [1515322,25804] 0 2021-04-09T18:26:33.005 INFO:tasks.workunit.client.0.smithi120.stdout:3/896: dread - d3/d5/d36/d1e/d6b/d49/d89/d86/f113 zero size 2021-04-09T18:26:33.006 INFO:tasks.workunit.client.0.smithi120.stdout:2/996: rename d13/d15/d35/f3e to d13/d7a/d80/d48/d49/d64/d83/d12f/d136/f14a 0 2021-04-09T18:26:33.008 INFO:tasks.workunit.client.0.smithi120.stdout:6/969: truncate d6/d8/d1a/d36/d54/d31/d37/d61/f9e 1706028 0 2021-04-09T18:26:33.010 INFO:tasks.workunit.client.0.smithi120.stdout:8/882: creat d2/d3/d3c/d4f/f116 x:0 0 0 2021-04-09T18:26:33.011 INFO:tasks.workunit.client.0.smithi120.stdout:8/883: dread - d2/d37/d8d/dc6/fec zero size 2021-04-09T18:26:33.016 INFO:tasks.workunit.client.0.smithi120.stdout:3/897: link d3/d5/df5/da6/de2/l11e d3/d5/df5/da6/dcc/l123 0 2021-04-09T18:26:33.019 INFO:tasks.workunit.client.0.smithi120.stdout:8/884: creat d2/d3/d8/dc5/f117 x:0 0 0 2021-04-09T18:26:33.024 INFO:tasks.workunit.client.0.smithi120.stdout:3/898: dwrite d3/d5/d36/d1e/d6b/d6a/d83/f9b [0,4194304] 0 2021-04-09T18:26:33.027 INFO:tasks.workunit.client.0.smithi120.stdout:7/888: dwrite db/d38/f40 [4194304,4194304] 0 2021-04-09T18:26:33.028 INFO:tasks.workunit.client.0.smithi120.stdout:8/885: dwrite d2/d3/d50/f57 [8388608,4194304] 0 2021-04-09T18:26:33.030 INFO:tasks.workunit.client.0.smithi120.stdout:6/970: link d6/d8/d1a/l55 d6/d8/db/dac/d10e/l159 0 2021-04-09T18:26:33.034 INFO:tasks.workunit.client.0.smithi120.stdout:6/971: fsync d6/d8/db/d2b/d68/d118/dc3/fc5 0 2021-04-09T18:26:33.034 INFO:tasks.workunit.client.0.smithi120.stdout:4/897: write d1f/d2c/df3/dc6/dc5/dda/fbf [54862,129738] 0 2021-04-09T18:26:33.043 INFO:tasks.workunit.client.0.smithi120.stdout:1/905: dwrite d5/d1f/fd3 [0,4194304] 0 2021-04-09T18:26:33.051 INFO:tasks.workunit.client.0.smithi120.stdout:4/898: symlink d1f/d24/l131 0 2021-04-09T18:26:33.052 INFO:tasks.workunit.client.0.smithi120.stdout:7/889: rename db/d38/d3c/d6e/d94/f10f to db/d2c/d34/f131 0 2021-04-09T18:26:33.053 INFO:tasks.workunit.client.0.smithi120.stdout:2/997: dwrite d13/d15/d35/d10e/f122 [4194304,4194304] 0 2021-04-09T18:26:33.063 INFO:tasks.workunit.client.0.smithi120.stdout:8/886: getdents d2/d37/d3e/d42 0 2021-04-09T18:26:33.063 INFO:tasks.workunit.client.0.smithi120.stdout:7/890: fdatasync db/f29 0 2021-04-09T18:26:33.064 INFO:tasks.workunit.client.0.smithi120.stdout:4/899: symlink d1f/d2c/df3/dc6/da8/l132 0 2021-04-09T18:26:33.069 INFO:tasks.workunit.client.0.smithi120.stdout:1/906: mkdir d5/d64/df9/d86/d140 0 2021-04-09T18:26:33.069 INFO:tasks.workunit.client.0.smithi120.stdout:7/891: readlink db/d2c/d34/l122 0 2021-04-09T18:26:33.070 INFO:tasks.workunit.client.0.smithi120.stdout:4/900: unlink d1f/d24/d42/l11a 0 2021-04-09T18:26:33.071 INFO:tasks.workunit.client.0.smithi120.stdout:2/998: link d13/d7a/d80/d48/da3/fdb d13/d7a/d80/d48/d49/d64/d83/d12f/f14b 0 2021-04-09T18:26:33.073 INFO:tasks.workunit.client.0.smithi120.stdout:2/999: stat d13/f73 0 2021-04-09T18:26:33.076 INFO:tasks.workunit.client.0.smithi120.stdout:4/901: chown d1f/d2c/df3/ld5 0 1 2021-04-09T18:26:33.082 INFO:tasks.workunit.client.0.smithi120.stdout:1/907: creat d5/f141 x:0 0 0 2021-04-09T18:26:33.082 INFO:tasks.workunit.client.0.smithi120.stdout:7/892: creat db/d2c/d34/f132 x:0 0 0 2021-04-09T18:26:33.086 INFO:tasks.workunit.client.0.smithi120.stdout:4/902: rmdir d1f/d2c/d34/d60/d7a/d92 39 2021-04-09T18:26:33.088 INFO:tasks.workunit.client.0.smithi120.stdout:7/893: dwrite db/d38/f69 [0,4194304] 0 2021-04-09T18:26:33.090 INFO:tasks.workunit.client.0.smithi120.stdout:7/894: chown db/d38/fdf 2164221 1 2021-04-09T18:26:33.113 INFO:tasks.workunit.client.0.smithi120.stdout:6/972: dwrite d6/d8/db/d2b/f10d [0,4194304] 0 2021-04-09T18:26:33.116 INFO:tasks.workunit.client.0.smithi120.stdout:7/895: fdatasync db/d38/d74/d6f/d76/da5/fc8 0 2021-04-09T18:26:33.136 INFO:tasks.workunit.client.0.smithi120.stdout:3/899: read d3/d5/d36/d1e/d6b/f79 [487702,87007] 0 2021-04-09T18:26:33.136 INFO:tasks.workunit.client.0.smithi120.stdout:7/896: getdents db/d42/d54 0 2021-04-09T18:26:33.142 INFO:tasks.workunit.client.0.smithi120.stdout:3/900: dwrite d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe/f92 [0,4194304] 0 2021-04-09T18:26:33.143 INFO:tasks.workunit.client.0.smithi120.stdout:1/908: write d5/d5c/d75/daf/db8/f10e [232480,60882] 0 2021-04-09T18:26:33.144 INFO:tasks.workunit.client.0.smithi120.stdout:3/901: chown d3/d5/d36/d1e/d6b/d49/d89/dd0/l85 23384614 1 2021-04-09T18:26:33.153 INFO:tasks.workunit.client.0.smithi120.stdout:4/903: dwrite d1f/d2c/df3/f7b [0,4194304] 0 2021-04-09T18:26:33.155 INFO:tasks.workunit.client.0.smithi120.stdout:1/909: dwrite d5/d5c/d75/daf/d6c/f13a [0,4194304] 0 2021-04-09T18:26:33.158 INFO:tasks.workunit.client.0.smithi120.stdout:4/904: mknod d1f/d2c/d34/c133 1 2021-04-09T18:26:33.160 INFO:tasks.workunit.client.0.smithi120.stdout:3/902: getdents d3/d5/d36/d3d 0 2021-04-09T18:26:33.162 INFO:tasks.workunit.client.0.smithi120.stdout:1/910: creat d5/d5c/d75/daf/d2b/d8e/d136/f142 x:0 0 0 2021-04-09T18:26:33.176 INFO:tasks.workunit.client.0.smithi120.stdout:6/973: dwrite d6/d8/db/d12/f4b [0,4194304] 0 2021-04-09T18:26:33.177 INFO:tasks.workunit.client.0.smithi120.stdout:6/974: mknod d6/d8/d52/ddf/df2/d11a/d125/c15a 1 2021-04-09T18:26:33.184 INFO:tasks.workunit.client.0.smithi120.stdout:7/897: dwrite db/d38/d3c/d6e/fdd [0,4194304] 0 2021-04-09T18:26:33.194 INFO:tasks.workunit.client.0.smithi120.stdout:6/975: dwrite d6/d8/db/f39 [0,4194304] 0 2021-04-09T18:26:33.239 INFO:tasks.workunit.client.0.smithi120.stdout:7/898: dread db/d38/d3c/fae [0,4194304] 0 2021-04-09T18:26:33.326 INFO:tasks.workunit.client.0.smithi120.stdout:1/911: dread d5/d64/d2d/d5a/fe3 [0,4194304] 0 2021-04-09T18:26:33.329 INFO:tasks.workunit.client.0.smithi120.stdout:4/905: rename d1f/d2c/d34/d60/d7a/d92/d84/dd0/fdd to d1f/d2c/f134 0 2021-04-09T18:26:33.330 INFO:tasks.workunit.client.0.smithi120.stdout:4/906: chown d1f/d2c/d34/d60/f12d 42 1 2021-04-09T18:26:33.331 INFO:tasks.workunit.client.0.smithi120.stdout:4/907: mknod d1f/d2c/d56/d6a/da5/d114/c135 1 2021-04-09T18:26:33.337 INFO:tasks.workunit.client.0.smithi120.stdout:4/908: rename d1f/d2c/d34/d60/d7a/d4f/f102 to d1f/d2c/d34/d60/d7a/d92/d84/d104/f136 0 2021-04-09T18:26:33.337 INFO:tasks.workunit.client.0.smithi120.stdout:3/903: write d3/d5/d36/d1e/d6b/d49/d89/dd0/fe5 [3647653,87261] 0 2021-04-09T18:26:33.344 INFO:tasks.workunit.client.0.smithi120.stdout:0/865: dread d0/f30 [0,4194304] 0 2021-04-09T18:26:33.346 INFO:tasks.workunit.client.0.smithi120.stdout:6/976: write d6/d8/d1a/d36/d54/dfa/f10c [26687,114831] 0 2021-04-09T18:26:33.347 INFO:tasks.workunit.client.0.smithi120.stdout:6/977: chown d6/d8/db/d2b/d4d 241297 1 2021-04-09T18:26:33.348 INFO:tasks.workunit.client.0.smithi120.stdout:8/887: sync 2021-04-09T18:26:33.351 INFO:tasks.workunit.client.0.smithi120.stdout:7/899: write db/d38/d3c/d6e/d94/dd7/f119 [1137812,23497] 0 2021-04-09T18:26:33.357 INFO:tasks.workunit.client.0.smithi120.stdout:6/978: dread d6/d8/d1a/d36/f10f [0,4194304] 0 2021-04-09T18:26:33.360 INFO:tasks.workunit.client.0.smithi120.stdout:7/900: dwrite db/d38/d3c/d6e/d94/f126 [0,4194304] 0 2021-04-09T18:26:33.366 INFO:tasks.workunit.client.0.smithi120.stdout:3/904: dread d3/d5/d36/d1e/d6b/d6a/d83/dd4/fb5 [0,4194304] 0 2021-04-09T18:26:33.367 INFO:tasks.workunit.client.0.smithi120.stdout:7/901: chown db/d2c/d34/f48 0 1 2021-04-09T18:26:33.377 INFO:tasks.workunit.client.0.smithi120.stdout:1/912: truncate d5/d5c/d75/daf/d6c/f13a 2578578 0 2021-04-09T18:26:33.377 INFO:tasks.workunit.client.0.smithi120.stdout:7/902: symlink db/d38/d3c/d6e/l133 0 2021-04-09T18:26:33.378 INFO:tasks.workunit.client.0.smithi120.stdout:1/913: mknod d5/d5c/d75/d138/c143 1 2021-04-09T18:26:33.380 INFO:tasks.workunit.client.0.smithi120.stdout:4/909: read d1f/d2c/d56/f11c [2383050,46610] 0 2021-04-09T18:26:33.383 INFO:tasks.workunit.client.0.smithi120.stdout:6/979: link d6/d8/d1a/d36/d54/d41/d49/f7c d6/d8/db/d2b/d68/d118/dc3/de4/f15b 0 2021-04-09T18:26:33.384 INFO:tasks.workunit.client.0.smithi120.stdout:3/905: rmdir d3/d5/d36/d1e/d6b/d49/d5e/da4 0 2021-04-09T18:26:33.385 INFO:tasks.workunit.client.0.smithi120.stdout:1/914: mkdir d5/d64/df9/d86/da3/d144 0 2021-04-09T18:26:33.385 INFO:tasks.workunit.client.0.smithi120.stdout:7/903: creat db/d2c/d34/d5d/f134 x:0 0 0 2021-04-09T18:26:33.387 INFO:tasks.workunit.client.0.smithi120.stdout:3/906: chown d3/d5/f74 31942550 1 2021-04-09T18:26:33.388 INFO:tasks.workunit.client.0.smithi120.stdout:4/910: symlink d1f/d2c/d34/d60/d7a/d92/d3e/d73/l137 0 2021-04-09T18:26:33.389 INFO:tasks.workunit.client.0.smithi120.stdout:6/980: symlink d6/d8/d1a/l15c 0 2021-04-09T18:26:33.399 INFO:tasks.workunit.client.0.smithi120.stdout:6/981: dread - d6/d8/d1a/d36/d54/f120 zero size 2021-04-09T18:26:33.399 INFO:tasks.workunit.client.0.smithi120.stdout:7/904: write db/d26/d4c/d53/f57 [3030967,36803] 0 2021-04-09T18:26:33.400 INFO:tasks.workunit.client.0.smithi120.stdout:1/915: dread d5/d5c/d75/daf/db8/f10e [0,4194304] 0 2021-04-09T18:26:33.400 INFO:tasks.workunit.client.0.smithi120.stdout:6/982: fdatasync d6/d8/db/d12/d22/fff 0 2021-04-09T18:26:33.401 INFO:tasks.workunit.client.0.smithi120.stdout:4/911: creat d1f/d2c/d34/d60/d7a/d92/d84/dd0/d111/f138 x:0 0 0 2021-04-09T18:26:33.401 INFO:tasks.workunit.client.0.smithi120.stdout:3/907: mknod d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/c124 1 2021-04-09T18:26:33.403 INFO:tasks.workunit.client.0.smithi120.stdout:7/905: rename db/d2c/d30/d59/lde to db/d42/l135 0 2021-04-09T18:26:33.404 INFO:tasks.workunit.client.0.smithi120.stdout:7/906: fsync db/f130 0 2021-04-09T18:26:33.404 INFO:tasks.workunit.client.0.smithi120.stdout:7/907: write db/d42/d54/faa [1472024,54639] 0 2021-04-09T18:26:33.405 INFO:tasks.workunit.client.0.smithi120.stdout:4/912: symlink d1f/d2c/d34/d60/d7a/d92/d84/l139 0 2021-04-09T18:26:33.409 INFO:tasks.workunit.client.0.smithi120.stdout:6/983: fsync d6/d8/d52/ddf/df2/f14e 0 2021-04-09T18:26:33.410 INFO:tasks.workunit.client.0.smithi120.stdout:6/984: mknod d6/d8/db/dac/c15d 1 2021-04-09T18:26:33.411 INFO:tasks.workunit.client.0.smithi120.stdout:8/888: write d2/d3/d3c/d4f/f8e [323822,28089] 0 2021-04-09T18:26:33.415 INFO:tasks.workunit.client.0.smithi120.stdout:0/866: dwrite d0/d5a/d62/f85 [0,4194304] 0 2021-04-09T18:26:33.419 INFO:tasks.workunit.client.0.smithi120.stdout:7/908: dwrite db/d2c/f106 [0,4194304] 0 2021-04-09T18:26:33.423 INFO:tasks.workunit.client.0.smithi120.stdout:3/908: write d3/d5/d36/d1e/d6b/d49/d4e/fed [744665,112522] 0 2021-04-09T18:26:33.424 INFO:tasks.workunit.client.0.smithi120.stdout:8/889: symlink d2/d37/d8d/l118 0 2021-04-09T18:26:33.425 INFO:tasks.workunit.client.0.smithi120.stdout:1/916: write d5/d5c/d75/daf/dc7/f119 [1962614,99493] 0 2021-04-09T18:26:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:7/909: dwrite db/d2c/d30/fb3 [0,4194304] 0 2021-04-09T18:26:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:8/890: rmdir d2/d37/d8d/dc6 39 2021-04-09T18:26:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:8/891: mknod d2/d3/d11/dbd/c119 1 2021-04-09T18:26:33.436 INFO:tasks.workunit.client.0.smithi120.stdout:6/985: creat d6/d8/db/d2b/f15e x:0 0 0 2021-04-09T18:26:33.440 INFO:tasks.workunit.client.0.smithi120.stdout:6/986: write d6/d8/d1a/d36/f5c [3965022,117145] 0 2021-04-09T18:26:33.447 INFO:tasks.workunit.client.0.smithi120.stdout:8/892: creat d2/d3/d11/d6a/dfe/f11a x:0 0 0 2021-04-09T18:26:33.451 INFO:tasks.workunit.client.0.smithi120.stdout:8/893: write d2/d37/d3e/d7c/ff1 [497631,127545] 0 2021-04-09T18:26:33.452 INFO:tasks.workunit.client.0.smithi120.stdout:7/910: dwrite db/d26/d4c/f125 [0,4194304] 0 2021-04-09T18:26:33.453 INFO:tasks.workunit.client.0.smithi120.stdout:0/867: creat d0/f106 x:0 0 0 2021-04-09T18:26:33.455 INFO:tasks.workunit.client.0.smithi120.stdout:3/909: creat d3/f125 x:0 0 0 2021-04-09T18:26:33.456 INFO:tasks.workunit.client.0.smithi120.stdout:8/894: rmdir d2/d3/d11/d6a 39 2021-04-09T18:26:33.457 INFO:tasks.workunit.client.0.smithi120.stdout:3/910: mknod d3/d5/d36/d1e/d6b/d49/d5e/d80/d114/c126 1 2021-04-09T18:26:33.462 INFO:tasks.workunit.client.0.smithi120.stdout:3/911: mknod d3/d5/d36/d1e/d6b/d49/d89/d68/da1/ddb/c127 1 2021-04-09T18:26:33.464 INFO:tasks.workunit.client.0.smithi120.stdout:6/987: dread d6/d8/db/d2b/de2/d12e/d152/f136 [0,4194304] 0 2021-04-09T18:26:33.483 INFO:tasks.workunit.client.0.smithi120.stdout:3/912: symlink d3/d5/d36/d1e/d6b/d49/d5e/d80/d114/l128 0 2021-04-09T18:26:33.495 INFO:tasks.workunit.client.0.smithi120.stdout:0/868: link d0/d52/f6d d0/d5a/d62/d69/dc6/f107 0 2021-04-09T18:26:33.496 INFO:tasks.workunit.client.0.smithi120.stdout:3/913: symlink d3/d5/d36/d1e/d6b/d49/d89/l129 0 2021-04-09T18:26:33.496 INFO:tasks.workunit.client.0.smithi120.stdout:6/988: rmdir d6/d8/db/dac/d139 0 2021-04-09T18:26:33.499 INFO:tasks.workunit.client.0.smithi120.stdout:8/895: link d2/d3/d11/d6a/lc9 d2/d3/d11/dbd/l11b 0 2021-04-09T18:26:33.499 INFO:tasks.workunit.client.0.smithi120.stdout:0/869: creat d0/d5a/d62/d69/dc6/f108 x:0 0 0 2021-04-09T18:26:33.502 INFO:tasks.workunit.client.0.smithi120.stdout:7/911: dread db/d38/d74/d6f/f12e [0,4194304] 0 2021-04-09T18:26:33.502 INFO:tasks.workunit.client.0.smithi120.stdout:7/912: chown db/d38/d74/l96 106581 1 2021-04-09T18:26:33.512 INFO:tasks.workunit.client.0.smithi120.stdout:0/870: dread d0/d2/da/f19 [4194304,4194304] 0 2021-04-09T18:26:33.515 INFO:tasks.workunit.client.0.smithi120.stdout:6/989: readlink d6/d8/d52/ddf/df2/d11a/l112 0 2021-04-09T18:26:33.517 INFO:tasks.workunit.client.0.smithi120.stdout:7/913: creat db/d38/dab/f136 x:0 0 0 2021-04-09T18:26:33.518 INFO:tasks.workunit.client.0.smithi120.stdout:0/871: creat d0/d2/dd/db4/dc0/f109 x:0 0 0 2021-04-09T18:26:33.520 INFO:tasks.workunit.client.0.smithi120.stdout:7/914: creat db/d42/f137 x:0 0 0 2021-04-09T18:26:33.521 INFO:tasks.workunit.client.0.smithi120.stdout:7/915: chown db/d2c/d34/f132 1982700756 1 2021-04-09T18:26:33.574 INFO:tasks.workunit.client.0.smithi120.stdout:0/872: rmdir d0/d5a/d62/d69 39 2021-04-09T18:26:33.577 INFO:tasks.workunit.client.0.smithi120.stdout:0/873: stat d0/d2/dd/db4/dc0/fc2 0 2021-04-09T18:26:33.581 INFO:tasks.workunit.client.0.smithi120.stdout:6/990: truncate d6/d8/db/dac/d10e/f138 665255 0 2021-04-09T18:26:33.582 INFO:tasks.workunit.client.0.smithi120.stdout:0/874: getdents d0/d43/d49/d91 0 2021-04-09T18:26:33.583 INFO:tasks.workunit.client.0.smithi120.stdout:0/875: write d0/d2/d4/f13 [7860774,46082] 0 2021-04-09T18:26:33.584 INFO:tasks.workunit.client.0.smithi120.stdout:0/876: readlink d0/le4 0 2021-04-09T18:26:33.596 INFO:tasks.workunit.client.0.smithi120.stdout:6/991: mknod d6/d8/d52/c15f 1 2021-04-09T18:26:33.600 INFO:tasks.workunit.client.0.smithi120.stdout:6/992: getdents d6/d8/d52/ddf 0 2021-04-09T18:26:33.604 INFO:tasks.workunit.client.0.smithi120.stdout:4/913: write d1f/d2c/d34/d60/d7a/d92/da6/fed [2063639,55672] 0 2021-04-09T18:26:33.616 INFO:tasks.workunit.client.0.smithi120.stdout:6/993: dread d6/d8/d1a/d36/d54/d31/d37/dcc/f127 [0,4194304] 0 2021-04-09T18:26:33.621 INFO:tasks.workunit.client.0.smithi120.stdout:6/994: dwrite d6/d8/d1a/d36/f10f [4194304,4194304] 0 2021-04-09T18:26:33.626 INFO:tasks.workunit.client.0.smithi120.stdout:6/995: dwrite d6/d8/db/d12/d93/fa9 [4194304,4194304] 0 2021-04-09T18:26:33.631 INFO:tasks.workunit.client.0.smithi120.stdout:3/914: write d3/d5/d36/d1e/d6b/d49/d4e/d54/f5f [2511657,65202] 0 2021-04-09T18:26:33.633 INFO:tasks.workunit.client.0.smithi120.stdout:3/915: chown d3/d5/d36/d1e/df1 942254 1 2021-04-09T18:26:33.634 INFO:tasks.workunit.client.0.smithi120.stdout:6/996: dwrite d6/d8/d1a/d36/d54/d31/d37/d61/f9a [0,4194304] 0 2021-04-09T18:26:33.642 INFO:tasks.workunit.client.0.smithi120.stdout:3/916: creat d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f/f12a x:0 0 0 2021-04-09T18:26:33.650 INFO:tasks.workunit.client.0.smithi120.stdout:6/997: truncate d6/d8/d52/ddf/df2/f155 2412732 0 2021-04-09T18:26:33.651 INFO:tasks.workunit.client.0.smithi120.stdout:6/998: chown d6/d8/db/d12/f18 99 1 2021-04-09T18:26:33.653 INFO:tasks.workunit.client.0.smithi120.stdout:3/917: link d3/d5/d36/d1e/laa d3/d5/df5/d25/d10e/l12b 0 2021-04-09T18:26:33.657 INFO:tasks.workunit.client.0.smithi120.stdout:6/999: rename d6/d8/d1a/d36/d54/d41/d49/f88 to d6/d8/f160 0 2021-04-09T18:26:33.659 INFO:tasks.workunit.client.0.smithi120.stdout:3/918: creat d3/d5/df5/da6/dcc/de1/f12c x:0 0 0 2021-04-09T18:26:33.666 INFO:tasks.workunit.client.0.smithi120.stdout:3/919: rename d3/d5/d36/dac/fb8 to d3/d5/d36/d1e/d6b/d49/f12d 0 2021-04-09T18:26:33.669 INFO:tasks.workunit.client.0.smithi120.stdout:3/920: symlink d3/d5/df5/da6/dcc/l12e 0 2021-04-09T18:26:33.670 INFO:tasks.workunit.client.0.smithi120.stdout:3/921: chown d3/d5/df5/d25/f117 1864112 1 2021-04-09T18:26:33.671 INFO:tasks.workunit.client.0.smithi120.stdout:3/922: stat d3/d5/d36/d1e/d6b/d49/d5e 0 2021-04-09T18:26:33.675 INFO:tasks.workunit.client.0.smithi120.stdout:3/923: dwrite d3/d5/d36/d1e/d6b/d49/d89/f96 [0,4194304] 0 2021-04-09T18:26:33.677 INFO:tasks.workunit.client.0.smithi120.stdout:4/914: truncate d1f/d107/f108 146508 0 2021-04-09T18:26:33.679 INFO:tasks.workunit.client.0.smithi120.stdout:4/915: symlink d1f/d2c/d34/l13a 0 2021-04-09T18:26:33.690 INFO:tasks.workunit.client.0.smithi120.stdout:4/916: getdents d1f/d2c/d34/d60/d7a/d4f/de3 0 2021-04-09T18:26:33.692 INFO:tasks.workunit.client.0.smithi120.stdout:4/917: chown d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f7f 147 1 2021-04-09T18:26:33.693 INFO:tasks.workunit.client.0.smithi120.stdout:4/918: stat d1f/d2c/d34/d60/d7a/d92/d3e/d73/f8b 0 2021-04-09T18:26:33.698 INFO:tasks.workunit.client.0.smithi120.stdout:4/919: creat d1f/d2c/df3/dc6/dc5/dda/f13b x:0 0 0 2021-04-09T18:26:33.699 INFO:tasks.workunit.client.0.smithi120.stdout:4/920: mknod d1f/d2c/d34/c13c 1 2021-04-09T18:26:33.702 INFO:tasks.workunit.client.0.smithi120.stdout:4/921: creat d1f/d2c/d56/d6a/f13d x:0 0 0 2021-04-09T18:26:33.704 INFO:tasks.workunit.client.0.smithi120.stdout:4/922: chown d1f/d2c/d34/d60/d7a/d92/d3e/d7c/f7f 1579935 1 2021-04-09T18:26:33.714 INFO:tasks.workunit.client.0.smithi120.stdout:3/924: dread d3/d5/df5/d87/d9e/faf [0,4194304] 0 2021-04-09T18:26:33.726 INFO:tasks.workunit.client.0.smithi120.stdout:3/925: dwrite d3/d5/d36/d1e/d6b/d6a/d83/f93 [0,4194304] 0 2021-04-09T18:26:33.728 INFO:tasks.workunit.client.0.smithi120.stdout:3/926: write d3/d5/d36/d1e/d6b/d49/d4e/f6f [221164,99979] 0 2021-04-09T18:26:33.729 INFO:tasks.workunit.client.0.smithi120.stdout:4/923: dread d1f/d2c/f86 [0,4194304] 0 2021-04-09T18:26:33.736 INFO:tasks.workunit.client.0.smithi120.stdout:4/924: symlink d1f/d24/d42/l13e 0 2021-04-09T18:26:33.737 INFO:tasks.workunit.client.0.smithi120.stdout:3/927: dwrite d3/fbe [0,4194304] 0 2021-04-09T18:26:33.739 INFO:tasks.workunit.client.0.smithi120.stdout:4/925: fdatasync d1f/d2c/d34/d60/d7a/d92/d84/d99/df5/f105 0 2021-04-09T18:26:33.743 INFO:tasks.workunit.client.0.smithi120.stdout:3/928: creat d3/d5/d36/d1e/d6b/d49/d4e/f12f x:0 0 0 2021-04-09T18:26:33.749 INFO:tasks.workunit.client.0.smithi120.stdout:3/929: dwrite d3/d5/f31 [0,4194304] 0 2021-04-09T18:26:33.759 INFO:tasks.workunit.client.0.smithi120.stdout:3/930: creat d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/dc3/dea/f130 x:0 0 0 2021-04-09T18:26:33.761 INFO:tasks.workunit.client.0.smithi120.stdout:4/926: dwrite d1f/d2c/d34/d60/d7a/d92/d84/f95 [0,4194304] 0 2021-04-09T18:26:33.767 INFO:tasks.workunit.client.0.smithi120.stdout:4/927: dwrite d1f/d2c/d34/d60/d7a/d92/da6/fed [0,4194304] 0 2021-04-09T18:26:33.775 INFO:tasks.workunit.client.0.smithi120.stdout:3/931: rmdir d3/d5/d36/d1e/d6b/d49/d89/d68/d107 0 2021-04-09T18:26:33.789 INFO:tasks.workunit.client.0.smithi120.stdout:3/932: mkdir d3/d5/d36/d1e/d6b/d49/d5e/d131 0 2021-04-09T18:26:33.795 INFO:tasks.workunit.client.0.smithi120.stdout:3/933: creat d3/d5/d36/d1e/d38/db9/dfc/f132 x:0 0 0 2021-04-09T18:26:33.799 INFO:tasks.workunit.client.0.smithi120.stdout:3/934: truncate d3/f37 1402437 0 2021-04-09T18:26:33.802 INFO:tasks.workunit.client.0.smithi120.stdout:3/935: creat d3/d5/df5/d25/d10e/f133 x:0 0 0 2021-04-09T18:26:33.804 INFO:tasks.workunit.client.0.smithi120.stdout:3/936: creat d3/d5/df5/d25/de7/f134 x:0 0 0 2021-04-09T18:26:33.806 INFO:tasks.workunit.client.0.smithi120.stdout:3/937: read - d3/d5/d36/d1e/d6b/d49/d89/d86/f113 zero size 2021-04-09T18:26:33.807 INFO:tasks.workunit.client.0.smithi120.stdout:3/938: fsync d3/d5/df5/d25/f22 0 2021-04-09T18:26:33.807 INFO:tasks.workunit.client.0.smithi120.stdout:3/939: mknod d3/d5/df5/da6/dcc/d11c/c135 1 2021-04-09T18:26:33.826 INFO:tasks.workunit.client.0.smithi120.stdout:3/940: dread d3/d5/d36/d1e/d38/f63 [0,4194304] 0 2021-04-09T18:26:33.829 INFO:tasks.workunit.client.0.smithi120.stdout:3/941: symlink d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/l136 0 2021-04-09T18:26:33.834 INFO:tasks.workunit.client.0.smithi120.stdout:3/942: link d3/d5/d36/dac/lc6 d3/d5/df5/da6/l137 0 2021-04-09T18:26:33.838 INFO:tasks.workunit.client.0.smithi120.stdout:3/943: creat d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/dfe/f138 x:0 0 0 2021-04-09T18:26:33.839 INFO:tasks.workunit.client.0.smithi120.stdout:3/944: chown d3/d5/d36/d1e/d6b/d49/d4e/fed 2006998 1 2021-04-09T18:26:33.845 INFO:tasks.workunit.client.0.smithi120.stdout:3/945: truncate d3/d5/d36/d1e/d6b/fbf 31146 0 2021-04-09T18:26:33.849 INFO:tasks.workunit.client.0.smithi120.stdout:3/946: dwrite d3/d5/d36/d1e/d6b/d6a/d83/f9b [4194304,4194304] 0 2021-04-09T18:26:33.853 INFO:tasks.workunit.client.0.smithi120.stdout:3/947: rename d3/d5/d36/d1e/d38/f63 to d3/d5/d36/d1e/d38/db9/f139 0 2021-04-09T18:26:33.855 INFO:tasks.workunit.client.0.smithi120.stdout:3/948: write d3/d5/df5/d25/de7/f134 [654123,16583] 0 2021-04-09T18:26:33.858 INFO:tasks.workunit.client.0.smithi120.stdout:3/949: write d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/dc3/dea/f130 [371811,58148] 0 2021-04-09T18:26:33.864 INFO:tasks.workunit.client.0.smithi120.stdout:3/950: creat d3/d5/d36/d1e/d38/db9/dfc/f13a x:0 0 0 2021-04-09T18:26:33.871 INFO:tasks.workunit.client.0.smithi120.stdout:3/951: rename f1 to d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/f13b 0 2021-04-09T18:26:33.884 INFO:tasks.workunit.client.0.smithi120.stdout:3/952: fsync d3/d5/d36/d1e/d6b/fbf 0 2021-04-09T18:26:33.885 INFO:tasks.workunit.client.0.smithi120.stdout:3/953: mknod d3/d5/d36/d3d/c13c 1 2021-04-09T18:26:33.902 INFO:tasks.workunit.client.0.smithi120.stdout:1/917: sync 2021-04-09T18:26:33.906 INFO:tasks.workunit.client.0.smithi120.stdout:3/954: link d3/d5/d36/d1e/d6b/fff d3/d5/d36/dac/f13d 0 2021-04-09T18:26:33.907 INFO:tasks.workunit.client.0.smithi120.stdout:1/918: write d5/d5c/d75/daf/f2c [2087384,120901] 0 2021-04-09T18:26:33.913 INFO:tasks.workunit.client.0.smithi120.stdout:3/955: getdents d3 0 2021-04-09T18:26:33.917 INFO:tasks.workunit.client.0.smithi120.stdout:3/956: dread d3/d5/df5/d87/d9e/f11b [0,4194304] 0 2021-04-09T18:26:33.919 INFO:tasks.workunit.client.0.smithi120.stdout:1/919: truncate d5/d5c/d75/fe5 476655 0 2021-04-09T18:26:33.926 INFO:tasks.workunit.client.0.smithi120.stdout:1/920: creat d5/d64/df9/d86/d140/f145 x:0 0 0 2021-04-09T18:26:33.989 INFO:tasks.workunit.client.0.smithi120.stdout:1/921: mknod d5/c146 1 2021-04-09T18:26:33.990 INFO:tasks.workunit.client.0.smithi120.stdout:1/922: write d5/d5c/d75/daf/dc7/f119 [2781674,2581] 0 2021-04-09T18:26:33.992 INFO:tasks.workunit.client.0.smithi120.stdout:3/957: truncate d3/d5/df5/d87/dc8/ffb 2325884 0 2021-04-09T18:26:33.993 INFO:tasks.workunit.client.0.smithi120.stdout:3/958: fsync d3/d5/d36/d1e/d6b/d49/d89/d68/f118 0 2021-04-09T18:26:33.996 INFO:tasks.workunit.client.0.smithi120.stdout:1/923: dread - d5/d64/df9/d86/f10c zero size 2021-04-09T18:26:33.997 INFO:tasks.workunit.client.0.smithi120.stdout:3/959: creat d3/d5/df5/da6/dcc/d11c/f13e x:0 0 0 2021-04-09T18:26:34.003 INFO:tasks.workunit.client.0.smithi120.stdout:1/924: creat d5/d5c/d75/daf/d87/dc3/f147 x:0 0 0 2021-04-09T18:26:34.109 INFO:tasks.workunit.client.0.smithi120.stdout:8/896: sync 2021-04-09T18:26:34.110 INFO:tasks.workunit.client.0.smithi120.stdout:7/916: sync 2021-04-09T18:26:34.116 INFO:tasks.workunit.client.0.smithi120.stdout:7/917: creat db/f138 x:0 0 0 2021-04-09T18:26:34.117 INFO:tasks.workunit.client.0.smithi120.stdout:3/960: truncate d3/d5/d36/d1e/f40 1264938 0 2021-04-09T18:26:34.117 INFO:tasks.workunit.client.0.smithi120.stdout:3/961: read - d3/d5/d36/d1e/d6b/fff zero size 2021-04-09T18:26:34.129 INFO:tasks.workunit.client.0.smithi120.stdout:8/897: dwrite d2/d37/d3e/d7c/d99/f9a [0,4194304] 0 2021-04-09T18:26:34.135 INFO:tasks.workunit.client.0.smithi120.stdout:8/898: rename d2/d37/d3e/d7c/d7a/f73 to d2/d3/d11/d6a/daa/dfb/f11c 0 2021-04-09T18:26:34.135 INFO:tasks.workunit.client.0.smithi120.stdout:7/918: dwrite db/f95 [0,4194304] 0 2021-04-09T18:26:34.136 INFO:tasks.workunit.client.0.smithi120.stdout:8/899: mknod d2/d37/d3e/d7c/d7a/dd1/c11d 1 2021-04-09T18:26:34.137 INFO:tasks.workunit.client.0.smithi120.stdout:8/900: stat d2/d37/d3e/d7c/d99/fa5 0 2021-04-09T18:26:34.138 INFO:tasks.workunit.client.0.smithi120.stdout:7/919: creat db/d38/dab/f139 x:0 0 0 2021-04-09T18:26:34.138 INFO:tasks.workunit.client.0.smithi120.stdout:7/920: chown db/d42/f137 33448756 1 2021-04-09T18:26:34.140 INFO:tasks.workunit.client.0.smithi120.stdout:3/962: truncate d3/d5/d36/d1e/d6b/d49/d4e/f12f 964317 0 2021-04-09T18:26:34.144 INFO:tasks.workunit.client.0.smithi120.stdout:8/901: fdatasync d2/d3/d3c/f68 0 2021-04-09T18:26:34.144 INFO:tasks.workunit.client.0.smithi120.stdout:7/921: creat db/d26/df1/f13a x:0 0 0 2021-04-09T18:26:34.145 INFO:tasks.workunit.client.0.smithi120.stdout:8/902: chown d2/d3/d11/d6a 1 1 2021-04-09T18:26:34.146 INFO:tasks.workunit.client.0.smithi120.stdout:3/963: mkdir d3/d5/d36/d1e/d6b/d49/d89/dd0/d9a/d13f 0 2021-04-09T18:26:34.149 INFO:tasks.workunit.client.0.smithi120.stdout:4/928: sync 2021-04-09T18:26:34.149 INFO:tasks.workunit.client.0.smithi120.stdout:0/877: sync 2021-04-09T18:26:34.152 INFO:tasks.workunit.client.0.smithi120.stdout:8/903: rename d2/d3/f60 to d2/d3/d8/da3/dd7/f11e 0 2021-04-09T18:26:34.154 INFO:tasks.workunit.client.0.smithi120.stdout:0/878: creat d0/d5a/d6c/df3/f10a x:0 0 0 2021-04-09T18:26:34.157 INFO:tasks.workunit.client.0.smithi120.stdout:0/879: write d0/f30 [3331276,74306] 0 2021-04-09T18:26:34.158 INFO:tasks.workunit.client.0.smithi120.stdout:0/880: write d0/d2/d8d/dd1/ffa [431236,12918] 0 2021-04-09T18:26:34.162 INFO:tasks.workunit.client.0.smithi120.stdout:0/881: write d0/d2/d4/d5f/d61/feb [1392955,15323] 0 2021-04-09T18:26:34.176 INFO:tasks.workunit.client.0.smithi120.stdout:0/882: dread d0/d43/fb1 [0,4194304] 0 2021-04-09T18:26:34.177 INFO:tasks.workunit.client.0.smithi120.stdout:7/922: dread db/d2c/d34/ffd [0,4194304] 0 2021-04-09T18:26:34.179 INFO:tasks.workunit.client.0.smithi120.stdout:3/964: write d3/d5/d36/d1e/d6b/d49/d4e/d54/f7e [3196255,36138] 0 2021-04-09T18:26:34.179 INFO:tasks.workunit.client.0.smithi120.stdout:0/883: symlink d0/d2/d4/dc1/l10b 0 2021-04-09T18:26:34.181 INFO:tasks.workunit.client.0.smithi120.stdout:3/965: mknod d3/d5/df5/c140 1 2021-04-09T18:26:34.184 INFO:tasks.workunit.client.0.smithi120.stdout:7/923: rename db/d2c/d30/f66 to db/f13b 0 2021-04-09T18:26:34.185 INFO:tasks.workunit.client.0.smithi120.stdout:3/966: symlink d3/d5/l141 0 2021-04-09T18:26:34.190 INFO:tasks.workunit.client.0.smithi120.stdout:0/884: link d0/d52/f6d d0/d2/dd/f10c 0 2021-04-09T18:26:34.193 INFO:tasks.workunit.client.0.smithi120.stdout:3/967: creat d3/d5/d36/f142 x:0 0 0 2021-04-09T18:26:34.195 INFO:tasks.workunit.client.0.smithi120.stdout:0/885: dread d0/d2/d82/d9f/fa3 [0,4194304] 0 2021-04-09T18:26:34.196 INFO:tasks.workunit.client.0.smithi120.stdout:7/924: truncate db/d38/d74/d6f/d76/da5/fec 1020755 0 2021-04-09T18:26:34.197 INFO:tasks.workunit.client.0.smithi120.stdout:1/925: sync 2021-04-09T18:26:34.197 INFO:tasks.workunit.client.0.smithi120.stdout:7/925: dread - db/d38/d74/f129 zero size 2021-04-09T18:26:34.201 INFO:tasks.workunit.client.0.smithi120.stdout:1/926: rename d5/d5c/d75/f126 to d5/d5c/d75/daf/d2b/d8e/dfa/f148 0 2021-04-09T18:26:34.203 INFO:tasks.workunit.client.0.smithi120.stdout:7/926: dwrite db/d38/d3c/f101 [0,4194304] 0 2021-04-09T18:26:34.205 INFO:tasks.workunit.client.0.smithi120.stdout:7/927: chown db/d38/d3c/f101 759606671 1 2021-04-09T18:26:34.206 INFO:tasks.workunit.client.0.smithi120.stdout:3/968: dwrite d3/d5/f4d [8388608,4194304] 0 2021-04-09T18:26:34.218 INFO:tasks.workunit.client.0.smithi120.stdout:7/928: dwrite db/d38/d3c/d6e/d94/dd7/fff [0,4194304] 0 2021-04-09T18:26:34.256 INFO:tasks.workunit.client.0.smithi120.stdout:3/969: dread d3/d5/d36/f23 [0,4194304] 0 2021-04-09T18:26:34.257 INFO:tasks.workunit.client.0.smithi120.stdout:3/970: stat d3/d5/d36/d1e/d6b/d6a/d83 0 2021-04-09T18:26:34.262 INFO:tasks.workunit.client.0.smithi120.stdout:3/971: dwrite d3/d5/d36/d1e/d6b/d49/d89/dd0/fe5 [4194304,4194304] 0 2021-04-09T18:26:34.266 INFO:tasks.workunit.client.0.smithi120.stdout:7/929: symlink db/l13c 0 2021-04-09T18:26:34.269 INFO:tasks.workunit.client.0.smithi120.stdout:3/972: creat d3/d5/d36/d1e/d6b/d49/d4e/d54/f143 x:0 0 0 2021-04-09T18:26:34.271 INFO:tasks.workunit.client.0.smithi120.stdout:3/973: write d3/d5/d36/d1e/d6b/d6a/d83/dd4/dda/dfd/f10a [808502,18014] 0 2021-04-09T18:26:34.273 INFO:tasks.workunit.client.0.smithi120.stdout:7/930: write db/d2c/d34/f131 [1821036,106930] 0 2021-04-09T18:26:34.278 INFO:tasks.workunit.client.0.smithi120.stdout:3/974: unlink d3/d5/d36/d1e/d6b/d6a/d83/dd4/f11a 0 2021-04-09T18:26:34.279 INFO:tasks.workunit.client.0.smithi120.stdout:3/975: fdatasync d3/d5/d36/d1e/d38/db9/dfc/f132 0 2021-04-09T18:26:34.286 INFO:tasks.workunit.client.0.smithi120.stdout:7/931: rmdir db/d38/d3c/d6e/d94/d123 0 2021-04-09T18:26:34.290 INFO:tasks.workunit.client.0.smithi120.stdout:7/932: mknod db/d2c/c13d 1 2021-04-09T18:26:34.298 INFO:tasks.workunit.client.0.smithi120.stdout:3/976: dwrite d3/d5/d36/d1e/d6b/d49/d89/d68/da1/dba/fc1 [0,4194304] 0 2021-04-09T18:26:34.299 INFO:tasks.workunit.client.0.smithi120.stdout:7/933: unlink db/f1a 0 2021-04-09T18:26:34.303 INFO:tasks.workunit.client.0.smithi120.stdout:7/934: creat db/d38/d74/d6f/f13e x:0 0 0 2021-04-09T18:26:34.309 INFO:tasks.workunit.client.0.smithi120.stdout:7/935: symlink db/d26/d4c/l13f 0 2021-04-09T18:26:34.311 INFO:tasks.workunit.client.0.smithi120.stdout:3/977: truncate d3/d5/df5/d25/f22 4632805 0 2021-04-09T18:26:34.316 INFO:tasks.workunit.client.0.smithi120.stdout:3/978: dwrite d3/d5/d36/d1e/d6b/d6a/d83/f9b [4194304,4194304] 0 2021-04-09T18:26:34.317 INFO:tasks.workunit.client.0.smithi120.stdout:3/979: dread - d3/d5/d36/d1e/d6b/d49/d89/d86/f113 zero size 2021-04-09T18:26:34.323 INFO:tasks.workunit.client.0.smithi120.stdout:7/936: truncate db/d26/d4c/d53/f57 7670979 0 2021-04-09T18:26:34.324 INFO:tasks.workunit.client.0.smithi120.stdout:7/937: mkdir db/d26/df1/d140 0 2021-04-09T18:26:34.325 INFO:tasks.workunit.client.0.smithi120.stdout:3/980: getdents d3/d5/d36/d1e/d6b/d49/d4e/d54/d7f 0 2021-04-09T18:26:34.328 INFO:tasks.workunit.client.0.smithi120.stdout:3/981: fdatasync d3/d5/d36/d1e/d6b/d49/fa8 0 2021-04-09T18:26:34.329 INFO:tasks.workunit.client.0.smithi120.stdout:3/982: chown d3/d5/df5/d25/de7 354870571 1 2021-04-09T18:26:34.339 INFO:tasks.workunit.client.0.smithi120.stdout:3/983: rename d3/d5/d36/l7a to d3/d5/d36/d1e/d6b/d6a/d83/dd4/de9/df6/l144 0 2021-04-09T18:26:34.345 INFO:tasks.workunit.client.0.smithi120.stdout:7/938: write db/d42/fdb [2779846,71215] 0 2021-04-09T18:26:34.351 INFO:tasks.workunit.client.0.smithi120.stdout:7/939: mknod db/d42/d54/c141 1 2021-04-09T18:26:34.357 INFO:tasks.workunit.client.0.smithi120.stdout:3/984: dwrite d3/d5/d36/d1e/d38/db9/dfc/f132 [0,4194304] 0 2021-04-09T18:26:34.359 INFO:tasks.workunit.client.0.smithi120.stdout:7/940: chown db/d38/d3c/d6e/d94/dd7/fff 1 1 2021-04-09T18:26:34.360 INFO:tasks.workunit.client.0.smithi120.stdout:8/904: dread d2/d37/d3e/d7c/fc4 [0,4194304] 0 2021-04-09T18:26:34.367 INFO:tasks.workunit.client.0.smithi120.stdout:1/927: dread d5/d64/df9/d86/da3/f135 [0,4194304] 0 2021-04-09T18:26:34.376 INFO:tasks.workunit.client.0.smithi120.stdout:8/905: mkdir d2/d37/d3e/d7c/d7a/d11f 0 2021-04-09T18:26:34.377 INFO:tasks.workunit.client.0.smithi120.stdout:1/928: dwrite d5/d5c/d75/daf/dc7/d61/deb/f133 [0,4194304] 0 2021-04-09T18:26:34.379 INFO:tasks.workunit.client.0.smithi120.stdout:7/941: creat db/d2c/f142 x:0 0 0 2021-04-09T18:26:34.381 INFO:tasks.workunit.client.0.smithi120.stdout:4/929: dread d1f/d2c/d34/d60/d7a/d92/f5e [0,4194304] 0 2021-04-09T18:26:34.381 INFO:tasks.workunit.client.0.smithi120.stdout:7/942: chown db/d26/df1/f115 4 1 2021-04-09T18:26:34.382 INFO:tasks.workunit.client.0.smithi120.stdout:7/943: chown db/d2c/d34/fda 6952874 1 2021-04-09T18:26:34.383 INFO:tasks.workunit.client.0.smithi120.stdout:1/929: dwrite d5/d5c/fed [0,4194304] 0 2021-04-09T18:26:34.385 INFO:tasks.workunit.client.0.smithi120.stdout:1/930: dread - d5/d64/df9/d86/f10c zero size 2021-04-09T18:26:34.386 INFO:tasks.workunit.client.0.smithi120.stdout:7/944: symlink db/d26/df1/l143 0 2021-04-09T18:26:34.387 INFO:tasks.workunit.client.0.smithi120.stdout:4/930: unlink d1f/d2c/df3/dc6/da8/lf1 0 2021-04-09T18:26:34.388 INFO:tasks.workunit.client.0.smithi120.stdout:1/931: fsync d5/d64/d2d/d5a/d8d/fcc 0 2021-04-09T18:26:34.390 INFO:tasks.workunit.client.0.smithi120.stdout:7/945: symlink db/d2c/d34/d5d/dd2/l144 0 2021-04-09T18:26:34.392 INFO:tasks.workunit.client.0.smithi120.stdout:4/931: fsync d1f/d2c/d34/d60/d7a/d92/d3e/d73/f85 0 2021-04-09T18:26:34.400 INFO:tasks.workunit.client.0.smithi120.stdout:1/932: creat d5/d5c/d75/daf/dc7/f149 x:0 0 0 2021-04-09T18:26:34.403 INFO:tasks.workunit.client.0.smithi120.stdout:1/933: read d5/d5c/d75/daf/dc7/f58 [4670873,23065] 0 2021-04-09T18:26:34.407 INFO:tasks.workunit.client.0.smithi120.stdout:1/934: write d5/d64/d2d/f110 [897527,45767] 0 2021-04-09T18:26:34.411 INFO:tasks.workunit.client.0.smithi120.stdout:4/932: dread d1f/d24/fde [0,4194304] 0 2021-04-09T18:26:34.419 INFO:tasks.workunit.client.0.smithi120.stdout:1/935: readlink d5/d64/d2d/d5a/lb9 0 2021-04-09T18:26:34.421 INFO:tasks.workunit.client.0.smithi120.stdout:1/936: write d5/d5c/d75/f13c [472383,117295] 0 2021-04-09T18:26:34.421 INFO:tasks.workunit.client.0.smithi120.stdout:4/933: symlink d1f/d2c/d34/d60/d7a/d4f/de4/l13f 0 2021-04-09T18:26:34.423 INFO:tasks.workunit.client.0.smithi120.stdout:7/946: dwrite db/d26/d4c/f9d [4194304,4194304] 0 2021-04-09T18:26:34.426 INFO:tasks.workunit.client.0.smithi120.stdout:4/934: unlink d1f/d24/fde 0 2021-04-09T18:26:34.430 INFO:tasks.workunit.client.0.smithi120.stdout:7/947: symlink db/d26/df1/l145 0 2021-04-09T18:26:34.430 INFO:tasks.workunit.client.0.smithi120.stdout:4/935: stat d1f/d2c/d34/d60/d7a/d92/d3e/d73 0 2021-04-09T18:26:34.431 INFO:tasks.workunit.client.0.smithi120.stdout:7/948: chown db/d2c/d34/f5b 48000164 1 2021-04-09T18:26:34.432 INFO:tasks.workunit.client.0.smithi120.stdout:7/949: chown db/d38/d3c/d6e/d94/dd7/fd9 2789 1 2021-04-09T18:26:34.438 INFO:tasks.workunit.client.0.smithi120.stdout:1/937: dwrite d5/d64/d2d/db5/dd1/ffb [0,4194304] 0 2021-04-09T18:26:34.446 INFO:tasks.workunit.client.0.smithi120.stdout:7/950: rename db/d2c/d34/ff3 to db/d38/d3c/f146 0 2021-04-09T18:26:34.449 INFO:tasks.workunit.client.0.smithi120.stdout:7/951: symlink db/d26/df1/l147 0 2021-04-09T18:26:34.453 INFO:tasks.workunit.client.0.smithi120.stdout:7/952: symlink db/d2c/d34/l148 0 2021-04-09T18:26:34.454 INFO:tasks.workunit.client.0.smithi120.stdout:4/936: dwrite d1f/d2c/d34/d60/d7a/d4f/fe1 [0,4194304] 0 2021-04-09T18:26:34.457 INFO:tasks.workunit.client.0.smithi120.stdout:7/953: mkdir db/d38/dab/d149 0 2021-04-09T18:26:34.458 INFO:tasks.workunit.client.0.smithi120.stdout:7/954: chown db/d2c/d34/d5d/dd2/l144 15 1 2021-04-09T18:26:34.459 INFO:tasks.workunit.client.0.smithi120.stdout:4/937: creat d1f/d2c/d34/d60/d7a/d92/d84/dd0/f140 x:0 0 0 2021-04-09T18:26:34.461 INFO:tasks.workunit.client.0.smithi120.stdout:7/955: creat db/d38/d3c/d6e/f14a x:0 0 0 2021-04-09T18:26:34.465 INFO:tasks.workunit.client.0.smithi120.stdout:7/956: mkdir db/dbf/d14b 0 2021-04-09T18:26:34.476 INFO:tasks.workunit.client.0.smithi120.stdout:4/938: mkdir d1f/d2c/df3/dc6/dc5/dda/d141 0 2021-04-09T18:26:34.477 INFO:tasks.workunit.client.0.smithi120.stdout:7/957: mkdir db/d38/d3c/d14c 0 2021-04-09T18:26:34.488 INFO:tasks.workunit.client.0.smithi120.stdout:7/958: write db/d2c/d30/f39 [1120409,119250] 0 2021-04-09T18:26:34.489 INFO:tasks.workunit.client.0.smithi120.stdout:4/939: write d1f/f9f [4537028,111063] 0 2021-04-09T18:26:34.494 INFO:tasks.workunit.client.0.smithi120.stdout:7/959: symlink db/d38/d3c/d6e/l14d 0 2021-04-09T18:26:34.496 INFO:tasks.workunit.client.0.smithi120.stdout:4/940: symlink d1f/d2c/df3/dc6/dc5/dda/d141/l142 0 2021-04-09T18:26:34.497 INFO:tasks.workunit.client.0.smithi120.stdout:7/960: stat db/d42/d54 0 2021-04-09T18:26:34.499 INFO:tasks.workunit.client.0.smithi120.stdout:4/941: dread - d1f/d2c/d34/d60/d7a/d92/d84/dd0/f140 zero size 2021-04-09T18:26:34.503 INFO:tasks.workunit.client.0.smithi120.stdout:4/942: symlink d1f/d2c/d34/d60/d7a/d92/d84/dd0/d111/l143 0 2021-04-09T18:26:34.504 INFO:tasks.workunit.client.0.smithi120.stdout:4/943: chown lc 22 1 2021-04-09T18:26:34.504 INFO:tasks.workunit.client.0.smithi120.stdout:7/961: truncate db/d38/d3c/d6e/f14a 956743 0 2021-04-09T18:26:34.505 INFO:tasks.workunit.client.0.smithi120.stdout:1/938: dread d5/d5c/d75/daf/d87/dc3/fcb [0,4194304] 0 2021-04-09T18:26:34.506 INFO:tasks.workunit.client.0.smithi120.stdout:4/944: symlink d1f/d2c/d56/d6a/l144 0 2021-04-09T18:26:34.507 INFO:tasks.workunit.client.0.smithi120.stdout:1/939: fsync d5/d5c/d75/daf/dc7/d61/deb/f133 0 2021-04-09T18:26:34.512 INFO:tasks.workunit.client.0.smithi120.stdout:1/940: creat d5/d5c/d75/daf/d2b/dd4/f14a x:0 0 0 2021-04-09T18:26:34.516 INFO:tasks.workunit.client.0.smithi120.stdout:1/941: creat d5/d5c/d75/daf/dc7/f14b x:0 0 0 2021-04-09T18:26:34.521 INFO:tasks.workunit.client.0.smithi120.stdout:1/942: dwrite d5/d5c/d75/f13c [0,4194304] 0 2021-04-09T18:26:34.523 INFO:tasks.workunit.client.0.smithi120.stdout:4/945: dread d1f/d2c/d34/d60/d7a/d4f/dce/fe8 [0,4194304] 0 2021-04-09T18:26:34.526 INFO:tasks.workunit.client.0.smithi120.stdout:4/946: chown d1f/d2c/d34/d60/d7a/d92/d3e/d77/fb3 7756705 1 2021-04-09T18:26:34.530 INFO:tasks.workunit.client.0.smithi120.stdout:4/947: creat d1f/d2c/df3/dc6/dc5/f145 x:0 0 0 2021-04-09T18:26:34.533 INFO:tasks.workunit.client.0.smithi120.stdout:1/943: dwrite d5/d64/df9/f109 [0,4194304] 0 2021-04-09T18:26:34.537 INFO:tasks.workunit.client.0.smithi120.stdout:4/948: rename d1f/d24/d42/da0 to d1f/d2c/df3/dc6/dc5/dda/d141/d146 0 2021-04-09T18:26:34.539 INFO:tasks.workunit.client.0.smithi120.stdout:1/944: creat d5/d64/df9/d86/da3/f14c x:0 0 0 2021-04-09T18:26:34.542 INFO:tasks.workunit.client.0.smithi120.stdout:1/945: fdatasync d5/d64/f108 0 2021-04-09T18:26:34.547 INFO:tasks.workunit.client.0.smithi120.stdout:4/949: link d1f/d2c/df3/dc6/dc5/dda/d141/d146/fe6 d1f/d2c/d34/d60/d7a/f147 0 2021-04-09T18:26:34.556 INFO:tasks.workunit.client.0.smithi120.stdout:4/950: creat d1f/d24/f148 x:0 0 0 2021-04-09T18:26:34.557 INFO:tasks.workunit.client.0.smithi120.stdout:4/951: chown d1f/d2c/d34/fee 1850 1 2021-04-09T18:26:34.557 INFO:tasks.workunit.client.0.smithi120.stdout:1/946: write d5/d64/f82 [4106595,120710] 0 2021-04-09T18:26:34.562 INFO:tasks.workunit.client.0.smithi120.stdout:1/947: mkdir d5/d64/d14d 0 2021-04-09T18:26:34.564 INFO:tasks.workunit.client.0.smithi120.stdout:4/952: rename d1f/d2c/d34/d60/dad/l113 to d1f/d2c/d34/d60/d7a/d92/l149 0 2021-04-09T18:26:34.565 INFO:tasks.workunit.client.0.smithi120.stdout:4/953: chown d1f/d2c/d34/d60/d7a/d92/d84/d104/f136 150 1 2021-04-09T18:26:34.567 INFO:tasks.workunit.client.0.smithi120.stdout:0/886: dread d0/d2/f5b [0,4194304] 0 2021-04-09T18:26:34.568 INFO:tasks.workunit.client.0.smithi120.stdout:4/954: symlink d1f/d2c/d34/d60/dad/l14a 0 2021-04-09T18:26:34.571 INFO:tasks.workunit.client.0.smithi120.stdout:0/887: dread d0/d5a/d62/d69/fba [0,4194304] 0 2021-04-09T18:26:34.572 INFO:tasks.workunit.client.0.smithi120.stdout:4/955: creat d1f/d2c/d34/d60/d7a/d4f/f14b x:0 0 0 2021-04-09T18:26:34.573 INFO:tasks.workunit.client.0.smithi120.stdout:4/956: stat d1f/d2c/d34/d60/d7a/d92/d3e/d73/f85 0 2021-04-09T18:26:34.575 INFO:tasks.workunit.client.0.smithi120.stdout:0/888: link d0/d2/d8d/f100 d0/d5a/dfc/f10d 0 2021-04-09T18:26:34.578 INFO:tasks.workunit.client.0.smithi120.stdout:4/957: creat d1f/d2c/d34/d60/d7a/d92/d84/d99/df5/d121/f14c x:0 0 0 2021-04-09T18:26:34.579 INFO:tasks.workunit.client.0.smithi120.stdout:4/958: mknod d1f/d2c/d34/d60/d7a/d92/d84/dd0/c14d 1 2021-04-09T18:26:34.581 INFO:tasks.workunit.client.0.smithi120.stdout:4/959: dread - d1f/d2c/df3/dc6/da8/fd1 zero size 2021-04-09T18:26:34.583 INFO:tasks.workunit.client.0.smithi120.stdout:0/889: link d0/d2/lbc d0/d2/d4/l10e 0 2021-04-09T18:26:34.584 INFO:tasks.workunit.client.0.smithi120.stdout:4/960: unlink d1f/d2c/d34/d60/d7a/d92/d3e/d77/fb3 0 2021-04-09T18:26:34.585 INFO:tasks.workunit.client.0.smithi120.stdout:4/961: fdatasync d1f/f9f 0 2021-04-09T18:26:34.588 INFO:tasks.workunit.client.0.smithi120.stdout:0/890: getdents d0/d2/da/d23 0 2021-04-09T18:26:34.590 INFO:tasks.workunit.client.0.smithi120.stdout:0/891: symlink d0/d2/d4/d5f/d81/l10f 0 2021-04-09T18:26:34.600 INFO:tasks.workunit.client.0.smithi120.stdout:4/962: dwrite d1f/d2c/df3/dc6/dc5/dda/d141/d146/fab [0,4194304] 0 2021-04-09T18:26:34.720 INFO:tasks.workunit.client.0.smithi120.stdout:3/985: sync 2021-04-09T18:26:34.725 INFO:tasks.workunit.client.0.smithi120.stdout:0/892: link d0/d2/d4/d5f/d61/d8b/l44 d0/d2/d4/dc1/l110 0 2021-04-09T18:26:34.726 INFO:tasks.workunit.client.0.smithi120.stdout:0/893: chown d0/d2/d7b/la1 1036030729 1 2021-04-09T18:26:34.726 INFO:tasks.workunit.client.0.smithi120.stdout:0/894: chown d0/d2/f26 424934155 1 2021-04-09T18:26:34.730 INFO:tasks.workunit.client.0.smithi120.stdout:4/963: truncate d1f/d2c/d34/d60/d7a/d92/d84/dd0/f140 357849 0 2021-04-09T18:26:34.731 INFO:tasks.workunit.client.0.smithi120.stdout:3/986: link d3/d5/d36/dac/f101 d3/d5/d36/f145 0 2021-04-09T18:26:34.743 INFO:tasks.workunit.client.0.smithi120.stdout:3/987: dwrite d3/d5/d36/d1e/d38/f44 [4194304,4194304] 0 2021-04-09T18:26:34.745 INFO:tasks.workunit.client.0.smithi120.stdout:4/964: dread d1f/d2c/f96 [0,4194304] 0 2021-04-09T18:26:34.747 INFO:tasks.workunit.client.0.smithi120.stdout:4/965: write d1f/d2c/d34/d60/d7a/d4f/fe1 [625952,57504] 0 2021-04-09T18:26:34.747 INFO:tasks.workunit.client.0.smithi120.stdout:3/988: creat d3/d5/d36/d1e/d6b/d6a/d83/f146 x:0 0 0 2021-04-09T18:26:34.748 INFO:tasks.workunit.client.0.smithi120.stdout:4/966: mknod d1f/d2c/d56/d6a/c14e 1 2021-04-09T18:26:34.749 INFO:tasks.workunit.client.0.smithi120.stdout:3/989: fsync d3/f29 0 2021-04-09T18:26:34.749 INFO:tasks.workunit.client.0.smithi120.stdout:4/967: chown d1f/d2c/d56/d6a/l144 295 1 2021-04-09T18:26:34.754 INFO:tasks.workunit.client.0.smithi120.stdout:3/990: mkdir d3/d5/df5/d25/d147 0 2021-04-09T18:26:34.758 INFO:tasks.workunit.client.0.smithi120.stdout:4/968: dwrite d1f/d24/f33 [0,4194304] 0 2021-04-09T18:26:34.759 INFO:tasks.workunit.client.0.smithi120.stdout:4/969: chown d1f/f23 619540 1 2021-04-09T18:26:34.759 INFO:tasks.workunit.client.0.smithi120.stdout:4/970: chown lc 10398010 1 2021-04-09T18:26:34.761 INFO:tasks.workunit.client.0.smithi120.stdout:3/991: dwrite d3/d5/d36/d1e/d6b/d49/d89/f96 [4194304,4194304] 0 2021-04-09T18:26:34.771 INFO:tasks.workunit.client.0.smithi120.stdout:3/992: getdents d3/d5/d36/d1e 0 2021-04-09T18:26:34.780 INFO:tasks.workunit.client.0.smithi120.stdout:3/993: rename d3/d5/l141 to d3/d5/d36/d1e/d6b/l148 0 2021-04-09T18:26:34.781 INFO:tasks.workunit.client.0.smithi120.stdout:3/994: write d3/fbe [1300352,120686] 0 2021-04-09T18:26:34.783 INFO:tasks.workunit.client.0.smithi120.stdout:8/906: sync 2021-04-09T18:26:34.786 INFO:tasks.workunit.client.0.smithi120.stdout:1/948: read d5/d64/d2d/db5/fd7 [3856575,61291] 0 2021-04-09T18:26:34.787 INFO:tasks.workunit.client.0.smithi120.stdout:1/949: fdatasync d5/f141 0 2021-04-09T18:26:34.789 INFO:tasks.workunit.client.0.smithi120.stdout:8/907: rmdir d2/d37/d8d/dc6 39 2021-04-09T18:26:34.790 INFO:tasks.workunit.client.0.smithi120.stdout:0/895: read d0/d2/da/f19 [455744,95492] 0 2021-04-09T18:26:34.796 INFO:tasks.workunit.client.0.smithi120.stdout:1/950: rename d5/d5c/d75/daf/dc7/d61/deb/f2f to d5/d5c/d75/daf/d2b/d8e/dfa/f14e 0 2021-04-09T18:26:34.796 INFO:tasks.workunit.client.0.smithi120.stdout:8/908: write d2/d37/fc3 [1332558,115794] 0 2021-04-09T18:26:34.798 INFO:tasks.workunit.client.0.smithi120.stdout:8/909: mknod d2/d3/d11/d6a/daa/dfb/c120 1 2021-04-09T18:26:34.798 INFO:tasks.workunit.client.0.smithi120.stdout:0/896: symlink d0/d5a/d6c/l111 0 2021-04-09T18:26:34.799 INFO:tasks.workunit.client.0.smithi120.stdout:0/897: readlink d0/d2/d4/d5f/d81/l10f 0 2021-04-09T18:26:34.800 INFO:tasks.workunit.client.0.smithi120.stdout:1/951: chown d5/d64/d2d/d5a/d8d/l9f 1401 1 2021-04-09T18:26:34.804 INFO:tasks.workunit.client.0.smithi120.stdout:1/952: dread d5/d64/df9/f109 [0,4194304] 0 2021-04-09T18:26:34.809 INFO:tasks.workunit.client.0.smithi120.stdout:4/971: dread d1f/d24/f9c [0,4194304] 0 2021-04-09T18:26:34.810 INFO:tasks.workunit.client.0.smithi120.stdout:1/953: readlink d5/d5c/d75/daf/d6c/l71 0 2021-04-09T18:26:34.811 INFO:tasks.workunit.client.0.smithi120.stdout:1/954: write d5/f141 [13342,33529] 0 2021-04-09T18:26:34.812 INFO:tasks.workunit.client.0.smithi120.stdout:0/898: write d0/d5a/d62/d69/dac/ff6 [377754,85083] 0 2021-04-09T18:26:34.813 INFO:tasks.workunit.client.0.smithi120.stdout:0/899: dread - d0/d2/d4/fea zero size 2021-04-09T18:26:34.814 INFO:tasks.workunit.client.0.smithi120.stdout:0/900: readlink d0/d2/d7b/la1 0 2021-04-09T18:26:34.815 INFO:tasks.workunit.client.0.smithi120.stdout:4/972: rmdir d1f/d2c/df3/dc6/da8 39 2021-04-09T18:26:34.816 INFO:tasks.workunit.client.0.smithi120.stdout:8/910: dwrite d2/d3/d11/d2c/fe1 [0,4194304] 0 2021-04-09T18:26:34.819 INFO:tasks.workunit.client.0.smithi120.stdout:1/955: symlink d5/d5c/d75/daf/d2b/d8e/l14f 0 2021-04-09T18:26:34.822 INFO:tasks.workunit.client.0.smithi120.stdout:7/962: sync 2021-04-09T18:26:34.825 INFO:tasks.workunit.client.0.smithi120.stdout:8/911: creat d2/d3/d3c/f121 x:0 0 0 2021-04-09T18:26:34.830 INFO:tasks.workunit.client.0.smithi120.stdout:8/912: creat d2/dcf/dd6/f122 x:0 0 0 2021-04-09T18:26:34.830 INFO:tasks.workunit.client.0.smithi120.stdout:0/901: dread d0/d2/d4/f73 [0,4194304] 0 2021-04-09T18:26:34.831 INFO:tasks.workunit.client.0.smithi120.stdout:8/913: mknod d2/d3/d8/da3/dd7/c123 1 2021-04-09T18:26:34.831 INFO:tasks.workunit.client.0.smithi120.stdout:1/956: write d5/d5c/d75/daf/dc7/d61/deb/f83 [1687814,91496] 0 2021-04-09T18:26:34.834 INFO:tasks.workunit.client.0.smithi120.stdout:7/963: symlink db/d26/d4c/l14e 0 2021-04-09T18:26:34.836 INFO:tasks.workunit.client.0.smithi120.stdout:8/914: creat d2/d3/d11/d6a/d3b/dbb/f124 x:0 0 0 2021-04-09T18:26:34.836 INFO:tasks.workunit.client.0.smithi120.stdout:7/964: chown db/d38/d3c/d6e/fdd 1215297 1 2021-04-09T18:26:34.838 INFO:tasks.workunit.client.0.smithi120.stdout:4/973: truncate d1f/d2c/d34/d60/d7a/d4f/f79 4445167 0 2021-04-09T18:26:34.842 INFO:tasks.workunit.client.0.smithi120.stdout:8/915: rmdir d2/d3/d11/d6a/d3b/d6b/da9/ddc 39 2021-04-09T18:26:34.846 INFO:tasks.workunit.client.0.smithi120.stdout:4/974: dwrite d1f/d2c/d34/d60/d7a/d4f/fe1 [0,4194304] 0 2021-04-09T18:26:34.849 INFO:tasks.workunit.client.0.smithi120.stdout:4/975: mknod d1f/d2c/d34/d60/d7a/d4f/dce/c14f 1 2021-04-09T18:26:34.849 INFO:tasks.workunit.client.0.smithi120.stdout:8/916: rename d2/d3/d3c/lcd to d2/d3/d11/d6a/d3b/l125 0 2021-04-09T18:26:34.856 INFO:tasks.workunit.client.0.smithi120.stdout:7/965: getdents db/d26/d4c 0 2021-04-09T18:26:34.857 INFO:tasks.workunit.client.0.smithi120.stdout:4/976: fdatasync d1f/d2c/d34/d60/d7a/d92/d84/fb9 0 2021-04-09T18:26:34.859 INFO:tasks.workunit.client.0.smithi120.stdout:4/977: mknod d1f/c150 1 2021-04-09T18:26:34.859 INFO:tasks.workunit.client.0.smithi120.stdout:0/902: dread d0/d2/d4/f13 [4194304,4194304] 0 2021-04-09T18:26:34.862 INFO:tasks.workunit.client.0.smithi120.stdout:0/903: dread - d0/d5a/d62/d69/dc6/fec zero size 2021-04-09T18:26:34.865 INFO:tasks.workunit.client.0.smithi120.stdout:1/957: dread d5/d5c/d75/daf/d2b/f47 [0,4194304] 0 2021-04-09T18:26:34.866 INFO:tasks.workunit.client.0.smithi120.stdout:4/978: symlink d1f/d2c/d34/d60/d7a/d92/d84/dd0/l151 0 2021-04-09T18:26:34.867 INFO:tasks.workunit.client.0.smithi120.stdout:0/904: mknod d0/d2/d4/d5f/d61/d8b/c112 1 2021-04-09T18:26:34.867 INFO:tasks.workunit.client.0.smithi120.stdout:4/979: write d1f/d2c/d34/f11d [671353,107863] 0 2021-04-09T18:26:34.868 INFO:tasks.workunit.client.0.smithi120.stdout:8/917: truncate d2/d3/d50/ff8 6016799 0 2021-04-09T18:26:34.872 INFO:tasks.workunit.client.0.smithi120.stdout:0/905: creat d0/d2/d4/d5f/d81/f113 x:0 0 0 2021-04-09T18:26:34.872 INFO:tasks.workunit.client.0.smithi120.stdout:7/966: truncate db/d42/f12f 2638005 0 2021-04-09T18:26:34.876 INFO:tasks.workunit.client.0.smithi120.stdout:8/918: read d2/d3/d11/d6a/d3b/f2b [5071733,102984] 0 2021-04-09T18:26:34.876 INFO:tasks.workunit.client.0.smithi120.stdout:1/958: mkdir d5/d64/d2d/d5a/d8d/d150 0 2021-04-09T18:26:34.878 INFO:tasks.workunit.client.0.smithi120.stdout:1/959: chown d5/d5c/d75/daf/d2b/d8e/dfa/f101 188033 1 2021-04-09T18:26:34.886 INFO:tasks.workunit.client.0.smithi120.stdout:7/967: chown db/d26/d4c/d53/f57 97587 1 2021-04-09T18:26:34.890 INFO:tasks.workunit.client.0.smithi120.stdout:7/968: write db/d2c/d34/f12a [261863,81428] 0 2021-04-09T18:26:34.895 INFO:tasks.workunit.client.0.smithi120.stdout:8/919: link d2/d3/f8a d2/d37/d3e/d7c/f126 0 2021-04-09T18:26:34.900 INFO:tasks.workunit.client.0.smithi120.stdout:4/980: dread d1f/f40 [0,4194304] 0 2021-04-09T18:26:34.901 INFO:tasks.workunit.client.0.smithi120.stdout:8/920: symlink d2/d3/d11/d6a/dfe/l127 0 2021-04-09T18:26:34.902 INFO:tasks.workunit.client.0.smithi120.stdout:4/981: write d1f/fb0 [3924681,78090] 0 2021-04-09T18:26:34.904 INFO:tasks.workunit.client.0.smithi120.stdout:0/906: truncate d0/d5a/d62/d72/fab 3253742 0 2021-04-09T18:26:34.905 INFO:tasks.workunit.client.0.smithi120.stdout:7/969: truncate db/d38/dab/f12b 919492 0 2021-04-09T18:26:34.906 INFO:tasks.workunit.client.0.smithi120.stdout:4/982: creat d1f/d2c/d56/d6a/f152 x:0 0 0 2021-04-09T18:26:34.912 INFO:tasks.workunit.client.0.smithi120.stdout:4/983: unlink d1f/d2c/d56/d6a/f152 0 2021-04-09T18:26:34.913 INFO:tasks.workunit.client.0.smithi120.stdout:7/970: rename db/d26/d4c/fe7 to db/d42/d54/f14f 0 2021-04-09T18:26:34.915 INFO:tasks.workunit.client.0.smithi120.stdout:0/907: dread d0/d2/d4/fbf [0,4194304] 0 2021-04-09T18:26:34.916 INFO:tasks.workunit.client.0.smithi120.stdout:7/971: dread - db/d2c/f8e zero size 2021-04-09T18:26:34.916 INFO:tasks.workunit.client.0.smithi120.stdout:1/960: dread d5/d5c/d75/daf/dc7/d61/deb/f68 [0,4194304] 0 2021-04-09T18:26:34.922 INFO:tasks.workunit.client.0.smithi120.stdout:1/961: dwrite d5/d5c/d75/daf/db8/f113 [0,4194304] 0 2021-04-09T18:26:34.923 INFO:tasks.workunit.client.0.smithi120.stdout:1/962: stat d5/d5c/d75/daf/dc7/d61/l7f 0 2021-04-09T18:26:34.926 INFO:tasks.workunit.client.0.smithi120.stdout:0/908: write d0/d5a/d62/d72/f105 [368483,9629] 0 2021-04-09T18:26:34.927 INFO:tasks.workunit.client.0.smithi120.stdout:4/984: link d1f/d2c/d34/d60/d7a/d92/l149 d1f/d2c/d34/d60/d7a/d92/d84/d104/l153 0 2021-04-09T18:26:34.928 INFO:tasks.workunit.client.0.smithi120.stdout:7/972: getdents db/dbf 0 2021-04-09T18:26:34.928 INFO:tasks.workunit.client.0.smithi120.stdout:4/985: chown d1f/d2c/d34/lc1 8069 1 2021-04-09T18:26:34.932 INFO:tasks.workunit.client.0.smithi120.stdout:4/986: write d1f/d2c/d34/d60/d7a/d92/d84/d99/df5/f105 [821195,32632] 0 2021-04-09T18:26:34.937 INFO:tasks.workunit.client.0.smithi120.stdout:4/987: mkdir d1f/d2c/d34/d60/d7a/d4f/de3/d154 0 2021-04-09T18:26:34.937 INFO:tasks.workunit.client.0.smithi120.stdout:7/973: link db/d38/d3c/lc7 db/d38/dab/d149/l150 0 2021-04-09T18:26:34.940 INFO:tasks.workunit.client.0.smithi120.stdout:0/909: dread d0/d2/f60 [0,4194304] 0 2021-04-09T18:26:34.943 INFO:tasks.workunit.client.0.smithi120.stdout:1/963: dwrite d5/d5c/d75/daf/d2b/dd4/ff7 [0,4194304] 0 2021-04-09T18:26:34.948 INFO:tasks.workunit.client.0.smithi120.stdout:4/988: getdents d1f/d2c/d34 0 2021-04-09T18:26:34.949 INFO:tasks.workunit.client.0.smithi120.stdout:7/974: dwrite db/d38/fe8 [4194304,4194304] 0 2021-04-09T18:26:34.951 INFO:tasks.workunit.client.0.smithi120.stdout:1/964: mkdir d5/d5c/d75/daf/db8/d151 0 2021-04-09T18:26:34.955 INFO:tasks.workunit.client.0.smithi120.stdout:7/975: fdatasync db/d38/d3c/f8c 0 2021-04-09T18:26:34.956 INFO:tasks.workunit.client.0.smithi120.stdout:3/995: dread d3/d5/d36/d1e/d6b/d49/d4e/f60 [0,4194304] 0 2021-04-09T18:26:34.962 INFO:tasks.workunit.client.0.smithi120.stdout:7/976: write db/d38/d74/d6f/f13e [161135,129736] 0 2021-04-09T18:26:34.962 INFO:tasks.workunit.client.0.smithi120.stdout:1/965: dread d5/d5c/d75/daf/d87/dc3/fcb [0,4194304] 0 2021-04-09T18:26:34.962 INFO:tasks.workunit.client.0.smithi120.stdout:0/910: dwrite d0/d5a/d6c/faf [0,4194304] 0 2021-04-09T18:26:34.964 INFO:tasks.workunit.client.0.smithi120.stdout:7/977: write db/d26/f5e [2668174,80583] 0 2021-04-09T18:26:34.968 INFO:tasks.workunit.client.0.smithi120.stdout:3/996: dread d3/d5/d36/d1e/d6b/d6a/d83/f9b [4194304,4194304] 0 2021-04-09T18:26:34.970 INFO:tasks.workunit.client.0.smithi120.stdout:7/978: rmdir db/d42/d54/d5a 39 2021-04-09T18:26:34.973 INFO:tasks.workunit.client.0.smithi120.stdout:7/979: stat db/d38/f6d 0 2021-04-09T18:26:34.975 INFO:tasks.workunit.client.0.smithi120.stdout:7/980: chown db/d42/fdb 25365 1 2021-04-09T18:26:34.978 INFO:tasks.workunit.client.0.smithi120.stdout:4/989: dwrite d1f/d2c/d34/d60/d7a/f98 [0,4194304] 0 2021-04-09T18:26:34.980 INFO:tasks.workunit.client.0.smithi120.stdout:7/981: rmdir db/d2c/d30/d59 39 2021-04-09T18:26:34.980 INFO:tasks.workunit.client.0.smithi120.stdout:1/966: dread d5/d5c/d75/daf/d2b/dd4/ff7 [0,4194304] 0 2021-04-09T18:26:34.982 INFO:tasks.workunit.client.0.smithi120.stdout:3/997: dwrite d3/d5/df5/d25/f22 [0,4194304] 0 2021-04-09T18:26:34.982 INFO:tasks.workunit.client.0.smithi120.stdout:0/911: truncate d0/d2/f9c 795170 0 2021-04-09T18:26:34.989 INFO:tasks.workunit.client.0.smithi120.stdout:3/998: dread d3/d5/d36/f23 [0,4194304] 0 2021-04-09T18:26:34.989 INFO:tasks.workunit.client.0.smithi120.stdout:0/912: rename d0/d43/d49/d91/lb6 to d0/d2/l114 0 2021-04-09T18:26:34.995 INFO:tasks.workunit.client.0.smithi120.stdout:1/967: truncate d5/d5c/d75/daf/d2b/f78 608020 0 2021-04-09T18:26:34.996 INFO:tasks.workunit.client.0.smithi120.stdout:0/913: dread d0/d2/f5b [0,4194304] 0 2021-04-09T18:26:34.997 INFO:tasks.workunit.client.0.smithi120.stdout:1/968: chown d5/d5c/d75/daf/d87/dc3/fcb 46 1 2021-04-09T18:26:34.998 INFO:tasks.workunit.client.0.smithi120.stdout:0/914: stat d0/d2/fb5 0 2021-04-09T18:26:34.999 INFO:tasks.workunit.client.0.smithi120.stdout:0/915: readlink d0/d2/da/l55 0 2021-04-09T18:26:34.999 INFO:tasks.workunit.client.0.smithi120.stdout:1/969: fsync d5/d5c/d75/daf/dc7/f119 0 2021-04-09T18:26:35.000 INFO:tasks.workunit.client.0.smithi120.stdout:0/916: chown d0/d2/f60 18680 1 2021-04-09T18:26:35.013 INFO:tasks.workunit.client.0.smithi120.stdout:1/970: write d5/d64/df9/f109 [2156002,109494] 0 2021-04-09T18:26:35.014 INFO:tasks.workunit.client.0.smithi120.stdout:0/917: mkdir d0/d43/d49/d87/d115 0 2021-04-09T18:26:35.016 INFO:tasks.workunit.client.0.smithi120.stdout:0/918: write d0/d5a/fd0 [1657661,20630] 0 2021-04-09T18:26:35.024 INFO:tasks.workunit.client.0.smithi120.stdout:1/971: rename d5/d64/d2d/db5/dd1/f11b to d5/d64/d14d/f152 0 2021-04-09T18:26:35.025 INFO:tasks.workunit.client.0.smithi120.stdout:3/999: truncate d3/d5/d36/d1e/d6b/d49/d89/dd0/fe5 13230110 0 2021-04-09T18:26:35.029 INFO:tasks.workunit.client.0.smithi120.stdout:0/919: creat d0/d5a/d62/f116 x:0 0 0 2021-04-09T18:26:35.043 INFO:tasks.workunit.client.0.smithi120.stdout:0/920: dread d0/d2/d4/fcb [0,4194304] 0 2021-04-09T18:26:35.047 INFO:tasks.workunit.client.0.smithi120.stdout:1/972: getdents d5/d5c/d75/daf/dc7/d61/deb/d7c 0 2021-04-09T18:26:35.049 INFO:tasks.workunit.client.0.smithi120.stdout:0/921: fdatasync d0/d2/dd/f10c 0 2021-04-09T18:26:35.178 INFO:tasks.workunit.client.0.smithi120.stdout:8/921: sync 2021-04-09T18:26:35.185 INFO:tasks.workunit.client.0.smithi120.stdout:0/922: dwrite d0/d2/d4/fcb [4194304,4194304] 0 2021-04-09T18:26:35.186 INFO:tasks.workunit.client.0.smithi120.stdout:0/923: stat d0/d2/d82/d9f 0 2021-04-09T18:26:35.187 INFO:tasks.workunit.client.0.smithi120.stdout:0/924: chown d0/d43/l45 951 1 2021-04-09T18:26:35.192 INFO:tasks.workunit.client.0.smithi120.stdout:0/925: dwrite d0/d2/fb5 [0,4194304] 0 2021-04-09T18:26:35.204 INFO:tasks.workunit.client.0.smithi120.stdout:8/922: dread d2/d3/d11/d2c/d44/f74 [4194304,4194304] 0 2021-04-09T18:26:35.214 INFO:tasks.workunit.client.0.smithi120.stdout:8/923: rename d2/d37/d3e/d7c/d99/fa5 to d2/d3/d11/d2c/f128 0 2021-04-09T18:26:35.220 INFO:tasks.workunit.client.0.smithi120.stdout:8/924: chown d2/d3/d11/d2c/la7 174668959 1 2021-04-09T18:26:35.222 INFO:tasks.workunit.client.0.smithi120.stdout:0/926: link d0/d2/d4/l39 d0/d5a/d62/d69/de7/l117 0 2021-04-09T18:26:35.225 INFO:tasks.workunit.client.0.smithi120.stdout:0/927: write d0/d2/f26 [4908569,26145] 0 2021-04-09T18:26:35.232 INFO:tasks.workunit.client.0.smithi120.stdout:0/928: creat d0/d5a/d62/d72/f118 x:0 0 0 2021-04-09T18:26:35.233 INFO:tasks.workunit.client.0.smithi120.stdout:0/929: dread - d0/d2/d8d/f100 zero size 2021-04-09T18:26:35.237 INFO:tasks.workunit.client.0.smithi120.stdout:1/973: write d5/d5c/d75/daf/d2b/f47 [3024652,71001] 0 2021-04-09T18:26:35.241 INFO:tasks.workunit.client.0.smithi120.stdout:0/930: mknod d0/d52/c119 1 2021-04-09T18:26:35.261 INFO:tasks.workunit.client.0.smithi120.stdout:0/931: creat d0/d2/d4/d5f/d61/d8b/f11a x:0 0 0 2021-04-09T18:26:35.262 INFO:tasks.workunit.client.0.smithi120.stdout:1/974: getdents d5/d64 0 2021-04-09T18:26:35.267 INFO:tasks.workunit.client.0.smithi120.stdout:1/975: dwrite d5/d5c/d75/daf/d2b/f47 [4194304,4194304] 0 2021-04-09T18:26:35.271 INFO:tasks.workunit.client.0.smithi120.stdout:8/925: dwrite d2/d3/d11/d2c/f93 [0,4194304] 0 2021-04-09T18:26:35.274 INFO:tasks.workunit.client.0.smithi120.stdout:1/976: rmdir d5/d5c/d75/daf/db8/d151 0 2021-04-09T18:26:35.275 INFO:tasks.workunit.client.0.smithi120.stdout:4/990: sync 2021-04-09T18:26:35.278 INFO:tasks.workunit.client.0.smithi120.stdout:4/991: write d1f/d2c/d34/d60/d7a/d92/d84/f95 [237960,80245] 0 2021-04-09T18:26:35.280 INFO:tasks.workunit.client.0.smithi120.stdout:1/977: rmdir d5/d5c/d75/daf/d2b/d8e/d136 39 2021-04-09T18:26:35.281 INFO:tasks.workunit.client.0.smithi120.stdout:8/926: creat d2/d3/d3c/f129 x:0 0 0 2021-04-09T18:26:35.282 INFO:tasks.workunit.client.0.smithi120.stdout:4/992: symlink d1f/d2c/d34/d60/d7a/d4f/dce/l155 0 2021-04-09T18:26:35.287 INFO:tasks.workunit.client.0.smithi120.stdout:8/927: dwrite d2/d37/d3e/d7c/fe3 [0,4194304] 0 2021-04-09T18:26:35.293 INFO:tasks.workunit.client.0.smithi120.stdout:0/932: write d0/d2/d4/f73 [1546403,81722] 0 2021-04-09T18:26:35.294 INFO:tasks.workunit.client.0.smithi120.stdout:0/933: readlink d0/d5a/d62/d69/dc6/le0 0 2021-04-09T18:26:35.295 INFO:tasks.workunit.client.0.smithi120.stdout:1/978: rename d5/d64/d2d/db5/fd7 to d5/d64/d2d/d5a/f153 0 2021-04-09T18:26:35.305 INFO:tasks.workunit.client.0.smithi120.stdout:8/928: rmdir d2/d3/d11/d6a/d3b/d6b/da9/ddc/d107 0 2021-04-09T18:26:35.308 INFO:tasks.workunit.client.0.smithi120.stdout:8/929: readlink d2/d37/lb6 0 2021-04-09T18:26:35.322 INFO:tasks.workunit.client.0.smithi120.stdout:8/930: getdents d2/d3/d11/d6a/d3b 0 2021-04-09T18:26:35.327 INFO:tasks.workunit.client.0.smithi120.stdout:8/931: symlink d2/d3/d11/d6a/d3b/d6b/da9/l12a 0 2021-04-09T18:26:35.331 INFO:tasks.workunit.client.0.smithi120.stdout:8/932: creat d2/d3/d3c/d4f/f12b x:0 0 0 2021-04-09T18:26:35.332 INFO:tasks.workunit.client.0.smithi120.stdout:8/933: write d2/f39 [7591897,108450] 0 2021-04-09T18:26:35.338 INFO:tasks.workunit.client.0.smithi120.stdout:0/934: dread d0/d5a/d62/d72/fab [0,4194304] 0 2021-04-09T18:26:35.339 INFO:tasks.workunit.client.0.smithi120.stdout:0/935: stat d0/d43/d49/d87 0 2021-04-09T18:26:35.342 INFO:tasks.workunit.client.0.smithi120.stdout:8/934: dread d2/d37/d3e/d42/d9e/f103 [0,4194304] 0 2021-04-09T18:26:35.355 INFO:tasks.workunit.client.0.smithi120.stdout:4/993: dread d1f/d2c/d34/d60/d7a/d4f/f79 [0,4194304] 0 2021-04-09T18:26:35.358 INFO:tasks.workunit.client.0.smithi120.stdout:4/994: getdents d1f/d2c/df3/dc6 0 2021-04-09T18:26:35.360 INFO:tasks.workunit.client.0.smithi120.stdout:4/995: read - d1f/d2c/d34/d60/d7a/d4f/fb5 zero size 2021-04-09T18:26:35.362 INFO:tasks.workunit.client.0.smithi120.stdout:4/996: write d1f/d2c/d34/d60/d7a/d92/d84/d104/f124 [4691311,84035] 0 2021-04-09T18:26:35.366 INFO:tasks.workunit.client.0.smithi120.stdout:4/997: symlink d1f/d2c/df3/dc6/dc5/dda/l156 0 2021-04-09T18:26:35.369 INFO:tasks.workunit.client.0.smithi120.stdout:4/998: creat d1f/d2c/d34/d60/d7a/d4f/f157 x:0 0 0 2021-04-09T18:26:35.371 INFO:tasks.workunit.client.0.smithi120.stdout:4/999: write d1f/d2c/d34/d60/d7a/d92/d84/f95 [1303934,18706] 0 2021-04-09T18:26:35.460 INFO:tasks.workunit.client.0.smithi120.stdout:7/982: sync 2021-04-09T18:26:35.461 INFO:tasks.workunit.client.0.smithi120.stdout:7/983: chown db/d2c/d34/l122 83983551 1 2021-04-09T18:26:35.461 INFO:tasks.workunit.client.0.smithi120.stdout:7/984: fdatasync db/d2c/d34/f79 0 2021-04-09T18:26:35.465 INFO:tasks.workunit.client.0.smithi120.stdout:7/985: getdents db/d42 0 2021-04-09T18:26:35.466 INFO:tasks.workunit.client.0.smithi120.stdout:7/986: write db/d2c/f142 [750574,114171] 0 2021-04-09T18:26:35.478 INFO:tasks.workunit.client.0.smithi120.stdout:7/987: truncate db/d26/d4c/f125 6096015 0 2021-04-09T18:26:35.504 INFO:tasks.workunit.client.0.smithi120.stdout:7/988: dread db/d38/d74/d6f/fd6 [0,4194304] 0 2021-04-09T18:26:35.506 INFO:tasks.workunit.client.0.smithi120.stdout:7/989: mkdir db/d38/d74/d151 0 2021-04-09T18:26:35.507 INFO:tasks.workunit.client.0.smithi120.stdout:7/990: stat db/d38/dab/f12b 0 2021-04-09T18:26:35.515 INFO:tasks.workunit.client.0.smithi120.stdout:7/991: dwrite db/d42/d54/fa2 [0,4194304] 0 2021-04-09T18:26:35.528 INFO:tasks.workunit.client.0.smithi120.stdout:8/935: dread d2/d37/d3e/d7c/f90 [0,4194304] 0 2021-04-09T18:26:35.530 INFO:tasks.workunit.client.0.smithi120.stdout:8/936: write d2/d3/d11/d6a/dfe/f109 [79509,82751] 0 2021-04-09T18:26:35.539 INFO:tasks.workunit.client.0.smithi120.stdout:8/937: dwrite d2/d3/f4c [0,4194304] 0 2021-04-09T18:26:35.545 INFO:tasks.workunit.client.0.smithi120.stdout:8/938: dwrite d2/d3/d11/d2c/d44/f10d [0,4194304] 0 2021-04-09T18:26:35.549 INFO:tasks.workunit.client.0.smithi120.stdout:8/939: link d2/d3/d11/d2c/f128 d2/d3/d8/da3/dd7/f12c 0 2021-04-09T18:26:35.555 INFO:tasks.workunit.client.0.smithi120.stdout:8/940: dwrite d2/dcf/f100 [0,4194304] 0 2021-04-09T18:26:35.557 INFO:tasks.workunit.client.0.smithi120.stdout:8/941: mknod d2/d3/d11/d6a/daa/c12d 1 2021-04-09T18:26:35.563 INFO:tasks.workunit.client.0.smithi120.stdout:8/942: fdatasync d2/d3/d11/f46 0 2021-04-09T18:26:35.568 INFO:tasks.workunit.client.0.smithi120.stdout:7/992: read db/f2f [1446116,87336] 0 2021-04-09T18:26:35.569 INFO:tasks.workunit.client.0.smithi120.stdout:8/943: creat d2/d3/d11/d6a/d3b/d6b/da9/ddc/f12e x:0 0 0 2021-04-09T18:26:35.569 INFO:tasks.workunit.client.0.smithi120.stdout:7/993: readlink db/d38/d3c/d6e/l73 0 2021-04-09T18:26:35.570 INFO:tasks.workunit.client.0.smithi120.stdout:8/944: mknod d2/d3/d8/da3/c12f 1 2021-04-09T18:26:35.571 INFO:tasks.workunit.client.0.smithi120.stdout:7/994: write db/d2c/d34/d5d/f134 [803339,98947] 0 2021-04-09T18:26:35.577 INFO:tasks.workunit.client.0.smithi120.stdout:8/945: chown d2/d3/f8a 518 1 2021-04-09T18:26:35.583 INFO:tasks.workunit.client.0.smithi120.stdout:8/946: dread d2/d3/f1a [0,4194304] 0 2021-04-09T18:26:35.583 INFO:tasks.workunit.client.0.smithi120.stdout:1/979: sync 2021-04-09T18:26:35.585 INFO:tasks.workunit.client.0.smithi120.stdout:8/947: fsync d2/d37/d3e/d42/d9e/fe2 0 2021-04-09T18:26:35.585 INFO:tasks.workunit.client.0.smithi120.stdout:1/980: fsync d5/d64/df9/d86/da3/f132 0 2021-04-09T18:26:35.586 INFO:tasks.workunit.client.0.smithi120.stdout:7/995: truncate db/d2c/d30/d59/fa6 1624709 0 2021-04-09T18:26:35.589 INFO:tasks.workunit.client.0.smithi120.stdout:7/996: creat db/d38/dab/d149/f152 x:0 0 0 2021-04-09T18:26:35.590 INFO:tasks.workunit.client.0.smithi120.stdout:1/981: creat d5/d64/df9/d86/f154 x:0 0 0 2021-04-09T18:26:35.591 INFO:tasks.workunit.client.0.smithi120.stdout:7/997: chown db/d42/d54/d5a/f75 1120492 1 2021-04-09T18:26:35.593 INFO:tasks.workunit.client.0.smithi120.stdout:8/948: rename d2/d37/d8d/dc6/fec to d2/d3/d3c/f130 0 2021-04-09T18:26:35.594 INFO:tasks.workunit.client.0.smithi120.stdout:7/998: creat db/d42/f153 x:0 0 0 2021-04-09T18:26:35.596 INFO:tasks.workunit.client.0.smithi120.stdout:1/982: creat d5/d5c/d75/daf/dc7/d61/deb/f155 x:0 0 0 2021-04-09T18:26:35.599 INFO:tasks.workunit.client.0.smithi120.stdout:1/983: symlink d5/d64/df9/d86/d140/l156 0 2021-04-09T18:26:35.603 INFO:tasks.workunit.client.0.smithi120.stdout:7/999: write db/d2c/d30/d59/fc6 [785221,125516] 0 2021-04-09T18:26:35.606 INFO:tasks.workunit.client.0.smithi120.stdout:1/984: write d5/d64/df9/d86/f88 [413930,30255] 0 2021-04-09T18:26:35.608 INFO:tasks.workunit.client.0.smithi120.stdout:1/985: stat d5/d5c/d75/daf/dc7/d61/deb/lf1 0 2021-04-09T18:26:35.614 INFO:tasks.workunit.client.0.smithi120.stdout:1/986: dwrite d5/d64/df9/d86/f88 [0,4194304] 0 2021-04-09T18:26:35.615 INFO:tasks.workunit.client.0.smithi120.stdout:1/987: mknod d5/d64/d2d/db5/dd1/c157 1 2021-04-09T18:26:35.617 INFO:tasks.workunit.client.0.smithi120.stdout:1/988: rmdir d5/d64/d2d 39 2021-04-09T18:26:35.618 INFO:tasks.workunit.client.0.smithi120.stdout:1/989: write d5/d5c/d75/daf/d2b/d8e/dfa/f123 [846604,47503] 0 2021-04-09T18:26:35.622 INFO:tasks.workunit.client.0.smithi120.stdout:1/990: dread d5/d1f/f96 [0,4194304] 0 2021-04-09T18:26:35.624 INFO:tasks.workunit.client.0.smithi120.stdout:0/936: sync 2021-04-09T18:26:35.625 INFO:tasks.workunit.client.0.smithi120.stdout:0/937: chown d0/d2/dd/db4/dc0/f109 576133265 1 2021-04-09T18:26:35.627 INFO:tasks.workunit.client.0.smithi120.stdout:1/991: mkdir d5/d64/d2d/d158 0 2021-04-09T18:26:35.634 INFO:tasks.workunit.client.0.smithi120.stdout:1/992: fsync d5/d5c/d75/f13c 0 2021-04-09T18:26:35.640 INFO:tasks.workunit.client.0.smithi120.stdout:1/993: rename d5/d5c/d75/daf/d6c to d5/d5c/d75/daf/d2b/d8e/d159 0 2021-04-09T18:26:35.643 INFO:tasks.workunit.client.0.smithi120.stdout:1/994: readlink d5/d64/df9/lec 0 2021-04-09T18:26:35.652 INFO:tasks.workunit.client.0.smithi120.stdout:1/995: dwrite d5/d5c/d75/daf/d2b/d8e/dfa/f14e [0,4194304] 0 2021-04-09T18:26:35.655 INFO:tasks.workunit.client.0.smithi120.stdout:1/996: mkdir d5/d15a 0 2021-04-09T18:26:35.658 INFO:tasks.workunit.client.0.smithi120.stdout:1/997: creat d5/d5c/d75/f15b x:0 0 0 2021-04-09T18:26:35.663 INFO:tasks.workunit.client.0.smithi120.stdout:1/998: write d5/d5c/f72 [514945,50297] 0 2021-04-09T18:26:35.669 INFO:tasks.workunit.client.0.smithi120.stdout:0/938: dread d0/d5a/f99 [0,4194304] 0 2021-04-09T18:26:35.671 INFO:tasks.workunit.client.0.smithi120.stdout:0/939: readlink d0/d2/d4/l21 0 2021-04-09T18:26:35.699 INFO:tasks.workunit.client.0.smithi120.stdout:1/999: dread d5/d5c/d75/daf/d2b/ff4 [0,4194304] 0 2021-04-09T18:26:35.702 INFO:tasks.workunit.client.0.smithi120.stdout:8/949: dread d2/d3/d11/d2c/f87 [0,4194304] 0 2021-04-09T18:26:35.706 INFO:tasks.workunit.client.0.smithi120.stdout:8/950: rmdir d2/d3/d8/da3/d101 0 2021-04-09T18:26:35.707 INFO:tasks.workunit.client.0.smithi120.stdout:8/951: write d2/d37/d3e/d7c/fe3 [385183,64990] 0 2021-04-09T18:26:35.709 INFO:tasks.workunit.client.0.smithi120.stdout:8/952: dread - d2/d3/d11/d6a/d3b/d6b/da9/ddc/f12e zero size 2021-04-09T18:26:35.710 INFO:tasks.workunit.client.0.smithi120.stdout:8/953: mknod d2/d3/c131 1 2021-04-09T18:26:35.714 INFO:tasks.workunit.client.0.smithi120.stdout:8/954: dwrite d2/d37/d8d/dc6/fd0 [0,4194304] 0 2021-04-09T18:26:35.716 INFO:tasks.workunit.client.0.smithi120.stdout:8/955: fdatasync d2/d3/d3c/f68 0 2021-04-09T18:26:35.717 INFO:tasks.workunit.client.0.smithi120.stdout:8/956: mknod d2/d37/d3e/d7c/c132 1 2021-04-09T18:26:35.721 INFO:tasks.workunit.client.0.smithi120.stdout:8/957: write d2/d3/d11/d6a/d3b/d6b/da9/ddc/fdd [1080417,21199] 0 2021-04-09T18:26:35.723 INFO:tasks.workunit.client.0.smithi120.stdout:8/958: chown d2/d3/d11/d6a/d3b/f77 3348922 1 2021-04-09T18:26:35.737 INFO:tasks.workunit.client.0.smithi120.stdout:8/959: truncate d2/d37/d3e/d7c/fc4 484741 0 2021-04-09T18:26:35.738 INFO:tasks.workunit.client.0.smithi120.stdout:8/960: fdatasync d2/d3/d11/d2c/fe1 0 2021-04-09T18:26:35.740 INFO:tasks.workunit.client.0.smithi120.stdout:8/961: mkdir d2/d37/d3e/d7c/d99/d133 0 2021-04-09T18:26:35.742 INFO:tasks.workunit.client.0.smithi120.stdout:8/962: chown d2/d3/d11/d6a/d3b/d6b/da9/ddc/f12e 1208000144 1 2021-04-09T18:26:35.749 INFO:tasks.workunit.client.0.smithi120.stdout:8/963: dwrite d2/d3/d11/d6a/daa/dfb/f11c [0,4194304] 0 2021-04-09T18:26:35.751 INFO:tasks.workunit.client.0.smithi120.stdout:8/964: mkdir d2/d3/d8/da3/dd7/d134 0 2021-04-09T18:26:35.755 INFO:tasks.workunit.client.0.smithi120.stdout:8/965: write d2/d37/fdf [1944482,51902] 0 2021-04-09T18:26:35.760 INFO:tasks.workunit.client.0.smithi120.stdout:8/966: creat d2/d3/d11/d2c/d44/f135 x:0 0 0 2021-04-09T18:26:35.780 INFO:tasks.workunit.client.0.smithi120.stdout:8/967: dwrite d2/d3/d8/f6d [0,4194304] 0 2021-04-09T18:26:35.782 INFO:tasks.workunit.client.0.smithi120.stdout:8/968: symlink d2/d3/d11/d2c/l136 0 2021-04-09T18:26:35.785 INFO:tasks.workunit.client.0.smithi120.stdout:8/969: symlink d2/d37/d10f/l137 0 2021-04-09T18:26:35.790 INFO:tasks.workunit.client.0.smithi120.stdout:8/970: dwrite d2/d37/d3e/d7c/d7a/f106 [0,4194304] 0 2021-04-09T18:26:35.790 INFO:tasks.workunit.client.0.smithi120.stdout:8/971: stat d2/d37/d8d 0 2021-04-09T18:26:35.794 INFO:tasks.workunit.client.0.smithi120.stdout:8/972: rename d2/d3/d8/f65 to d2/d37/d3e/d42/f138 0 2021-04-09T18:26:35.796 INFO:tasks.workunit.client.0.smithi120.stdout:8/973: readlink d2/d3/d11/dbd/lef 0 2021-04-09T18:26:35.797 INFO:tasks.workunit.client.0.smithi120.stdout:8/974: chown d2/dcf/d113 43931 1 2021-04-09T18:26:35.802 INFO:tasks.workunit.client.0.smithi120.stdout:8/975: rename d2/de7/ld4 to d2/d37/d8d/dc6/l139 0 2021-04-09T18:26:35.808 INFO:tasks.workunit.client.0.smithi120.stdout:8/976: dwrite d2/d3/d11/d2c/f9f [0,4194304] 0 2021-04-09T18:26:35.818 INFO:tasks.workunit.client.0.smithi120.stdout:8/977: write d2/d3/d11/d6a/d3b/f47 [3833183,70696] 0 2021-04-09T18:26:35.824 INFO:tasks.workunit.client.0.smithi120.stdout:0/940: dread d0/d2/da/fa9 [0,4194304] 0 2021-04-09T18:26:35.827 INFO:tasks.workunit.client.0.smithi120.stdout:0/941: mknod d0/d5a/db2/c11b 1 2021-04-09T18:26:35.834 INFO:tasks.workunit.client.0.smithi120.stdout:8/978: dwrite d2/d37/fc3 [0,4194304] 0 2021-04-09T18:26:35.836 INFO:tasks.workunit.client.0.smithi120.stdout:0/942: truncate d0/f3c 932539 0 2021-04-09T18:26:35.836 INFO:tasks.workunit.client.0.smithi120.stdout:8/979: readlink d2/d3/d11/d6a/d3b/d6b/da9/l110 0 2021-04-09T18:26:35.837 INFO:tasks.workunit.client.0.smithi120.stdout:0/943: mkdir d0/d5a/db2/d11c 0 2021-04-09T18:26:35.839 INFO:tasks.workunit.client.0.smithi120.stdout:8/980: creat d2/d3/d11/d6a/d3b/dbb/f13a x:0 0 0 2021-04-09T18:26:35.841 INFO:tasks.workunit.client.0.smithi120.stdout:8/981: write d2/d3/d3c/d4f/f116 [989084,32177] 0 2021-04-09T18:26:35.841 INFO:tasks.workunit.client.0.smithi120.stdout:0/944: mkdir d0/d2/d11d 0 2021-04-09T18:26:35.848 INFO:tasks.workunit.client.0.smithi120.stdout:8/982: write d2/d3/d11/d6a/f85 [4704178,61413] 0 2021-04-09T18:26:35.851 INFO:tasks.workunit.client.0.smithi120.stdout:0/945: link d0/d2/dd/db4/dc0/f109 d0/d2/d8d/dd1/f11e 0 2021-04-09T18:26:35.852 INFO:tasks.workunit.client.0.smithi120.stdout:8/983: mkdir d2/dcf/d13b 0 2021-04-09T18:26:35.855 INFO:tasks.workunit.client.0.smithi120.stdout:0/946: dread d0/d2/dd/db4/dc0/fc2 [0,4194304] 0 2021-04-09T18:26:35.859 INFO:tasks.workunit.client.0.smithi120.stdout:0/947: symlink d0/d2/d8d/l11f 0 2021-04-09T18:26:35.859 INFO:tasks.workunit.client.0.smithi120.stdout:0/948: dread - d0/f106 zero size 2021-04-09T18:26:35.863 INFO:tasks.workunit.client.0.smithi120.stdout:0/949: write d0/d2/d4/f73 [2187400,16612] 0 2021-04-09T18:26:35.867 INFO:tasks.workunit.client.0.smithi120.stdout:0/950: rmdir d0/d2/d82 39 2021-04-09T18:26:35.868 INFO:tasks.workunit.client.0.smithi120.stdout:0/951: chown d0/d52/d56/f5d 12221 1 2021-04-09T18:26:35.870 INFO:tasks.workunit.client.0.smithi120.stdout:8/984: dwrite d2/d37/ff6 [0,4194304] 0 2021-04-09T18:26:35.870 INFO:tasks.workunit.client.0.smithi120.stdout:0/952: write d0/d5a/d6c/df3/f10a [29054,121777] 0 2021-04-09T18:26:35.877 INFO:tasks.workunit.client.0.smithi120.stdout:8/985: dwrite d2/d3/d11/d6a/d3b/d6b/da9/fa1 [0,4194304] 0 2021-04-09T18:26:35.891 INFO:tasks.workunit.client.0.smithi120.stdout:0/953: dwrite d0/f30 [0,4194304] 0 2021-04-09T18:26:35.893 INFO:tasks.workunit.client.0.smithi120.stdout:0/954: write d0/d2/d7b/fe9 [889570,72088] 0 2021-04-09T18:26:35.894 INFO:tasks.workunit.client.0.smithi120.stdout:8/986: symlink d2/dcf/d13b/l13c 0 2021-04-09T18:26:35.899 INFO:tasks.workunit.client.0.smithi120.stdout:8/987: creat d2/d37/d3e/d7c/d7a/d11f/f13d x:0 0 0 2021-04-09T18:26:35.930 INFO:tasks.workunit.client.0.smithi120.stdout:0/955: dread d0/d2/dd/db4/f83 [4194304,4194304] 0 2021-04-09T18:26:35.937 INFO:tasks.workunit.client.0.smithi120.stdout:0/956: dwrite d0/d5a/d62/d69/fba [0,4194304] 0 2021-04-09T18:26:35.942 INFO:tasks.workunit.client.0.smithi120.stdout:8/988: dread d2/d3/d11/d6a/d3b/f47 [0,4194304] 0 2021-04-09T18:26:35.947 INFO:tasks.workunit.client.0.smithi120.stdout:0/957: creat d0/d5a/d62/f120 x:0 0 0 2021-04-09T18:26:35.948 INFO:tasks.workunit.client.0.smithi120.stdout:0/958: readlink d0/d2/d8d/l11f 0 2021-04-09T18:26:35.951 INFO:tasks.workunit.client.0.smithi120.stdout:8/989: rename d2/d3/d11/d2c/d44/fed to d2/d3/f13e 0 2021-04-09T18:26:35.952 INFO:tasks.workunit.client.0.smithi120.stdout:0/959: creat d0/d5a/db2/f121 x:0 0 0 2021-04-09T18:26:35.955 INFO:tasks.workunit.client.0.smithi120.stdout:8/990: dread d2/d3/f5a [0,4194304] 0 2021-04-09T18:26:35.958 INFO:tasks.workunit.client.0.smithi120.stdout:8/991: symlink d2/dcf/l13f 0 2021-04-09T18:26:35.960 INFO:tasks.workunit.client.0.smithi120.stdout:0/960: truncate d0/d2/d4/d5f/d61/d8b/f11a 232862 0 2021-04-09T18:26:35.964 INFO:tasks.workunit.client.0.smithi120.stdout:0/961: creat d0/d52/d56/df8/f122 x:0 0 0 2021-04-09T18:26:35.974 INFO:tasks.workunit.client.0.smithi120.stdout:8/992: truncate d2/dcf/f100 4403611 0 2021-04-09T18:26:35.996 INFO:tasks.workunit.client.0.smithi120.stdout:0/962: dread d0/d2/d7b/fe9 [0,4194304] 0 2021-04-09T18:26:36.000 INFO:tasks.workunit.client.0.smithi120.stdout:0/963: dwrite d0/f106 [0,4194304] 0 2021-04-09T18:26:36.001 INFO:tasks.workunit.client.0.smithi120.stdout:0/964: dread - d0/d2/d8d/dd1/f11e zero size 2021-04-09T18:26:36.003 INFO:tasks.workunit.client.0.smithi120.stdout:0/965: write d0/d2/fb5 [2475507,94852] 0 2021-04-09T18:26:36.008 INFO:tasks.workunit.client.0.smithi120.stdout:0/966: truncate d0/d52/d56/f5d 4361608 0 2021-04-09T18:26:36.011 INFO:tasks.workunit.client.0.smithi120.stdout:0/967: mkdir d0/d5a/d6c/dda/d123 0 2021-04-09T18:26:36.014 INFO:tasks.workunit.client.0.smithi120.stdout:0/968: creat d0/d2/d4/dc1/f124 x:0 0 0 2021-04-09T18:26:36.484 INFO:tasks.workunit.client.0.smithi120.stdout:8/993: sync 2021-04-09T18:26:36.485 INFO:tasks.workunit.client.0.smithi120.stdout:0/969: sync 2021-04-09T18:26:36.485 INFO:tasks.workunit.client.0.smithi120.stdout:8/994: stat d2/d3/d11/d2c/f31 0 2021-04-09T18:26:36.486 INFO:tasks.workunit.client.0.smithi120.stdout:8/995: mknod d2/d3/de9/c140 1 2021-04-09T18:26:36.487 INFO:tasks.workunit.client.0.smithi120.stdout:8/996: write d2/d37/fdf [1579052,23755] 0 2021-04-09T18:26:36.492 INFO:tasks.workunit.client.0.smithi120.stdout:8/997: creat d2/d37/d3e/d42/f141 x:0 0 0 2021-04-09T18:26:36.498 INFO:tasks.workunit.client.0.smithi120.stdout:8/998: dwrite d2/d3/d3c/d4f/f8e [4194304,4194304] 0 2021-04-09T18:26:36.502 INFO:tasks.workunit.client.0.smithi120.stdout:8/999: rename d2/d27/f2f to d2/d3/d8/f142 0 2021-04-09T18:26:36.504 INFO:tasks.workunit.client.0.smithi120.stdout:0/970: dread d0/d2/dd/db4/f98 [0,4194304] 0 2021-04-09T18:26:36.508 INFO:tasks.workunit.client.0.smithi120.stdout:0/971: creat d0/d5a/d62/d8f/f125 x:0 0 0 2021-04-09T18:26:36.511 INFO:tasks.workunit.client.0.smithi120.stdout:0/972: mkdir d0/d2/d82/d126 0 2021-04-09T18:26:36.514 INFO:tasks.workunit.client.0.smithi120.stdout:0/973: creat d0/d5a/d6c/f127 x:0 0 0 2021-04-09T18:26:36.516 INFO:tasks.workunit.client.0.smithi120.stdout:0/974: creat d0/d5a/db2/f128 x:0 0 0 2021-04-09T18:26:36.519 INFO:tasks.workunit.client.0.smithi120.stdout:0/975: unlink d0/d2/d4/dc1/lc4 0 2021-04-09T18:26:36.520 INFO:tasks.workunit.client.0.smithi120.stdout:0/976: chown d0/d5a/d62/l6f 3574 1 2021-04-09T18:26:36.527 INFO:tasks.workunit.client.0.smithi120.stdout:0/977: truncate d0/d2/d4/d5f/d61/d8b/f11a 412434 0 2021-04-09T18:26:36.529 INFO:tasks.workunit.client.0.smithi120.stdout:0/978: symlink d0/d43/d49/d87/l129 0 2021-04-09T18:26:36.530 INFO:tasks.workunit.client.0.smithi120.stdout:0/979: stat d0/d2/d4/fea 0 2021-04-09T18:26:36.548 INFO:tasks.workunit.client.0.smithi120.stdout:0/980: dread d0/d5a/d62/f85 [0,4194304] 0 2021-04-09T18:26:36.549 INFO:tasks.workunit.client.0.smithi120.stdout:0/981: fsync d0/d2/d8d/dd1/f101 0 2021-04-09T18:26:36.554 INFO:tasks.workunit.client.0.smithi120.stdout:0/982: creat d0/d5a/d62/d8f/dfb/f12a x:0 0 0 2021-04-09T18:26:37.338 INFO:tasks.workunit.client.0.smithi120.stdout:0/983: truncate d0/d2/da/ff9 586744 0 2021-04-09T18:26:37.342 INFO:tasks.workunit.client.0.smithi120.stdout:0/984: getdents d0/d52/d56 0 2021-04-09T18:26:37.355 INFO:tasks.workunit.client.0.smithi120.stdout:0/985: dread d0/d5a/d62/fde [0,4194304] 0 2021-04-09T18:26:37.356 INFO:tasks.workunit.client.0.smithi120.stdout:0/986: stat d0/l95 0 2021-04-09T18:26:37.358 INFO:tasks.workunit.client.0.smithi120.stdout:0/987: fsync d0/d2/da/d23/fbd 0 2021-04-09T18:26:37.360 INFO:tasks.workunit.client.0.smithi120.stdout:0/988: mkdir d0/d2/d4/d5f/d61/d12b 0 2021-04-09T18:26:37.374 INFO:tasks.workunit.client.0.smithi120.stdout:0/989: read d0/d2/da/ff9 [535106,127915] 0 2021-04-09T18:26:37.382 INFO:tasks.workunit.client.0.smithi120.stdout:0/990: truncate d0/d5a/d62/f85 2899743 0 2021-04-09T18:26:37.386 INFO:tasks.workunit.client.0.smithi120.stdout:0/991: write d0/d2/d4/d5f/f76 [3540862,11831] 0 2021-04-09T18:26:37.387 INFO:tasks.workunit.client.0.smithi120.stdout:0/992: chown d0/d2/d4/dc1/f124 1 1 2021-04-09T18:26:37.389 INFO:tasks.workunit.client.0.smithi120.stdout:0/993: mknod d0/d2/c12c 1 2021-04-09T18:26:37.390 INFO:tasks.workunit.client.0.smithi120.stdout:0/994: stat d0/d2/d82/d9f/fa3 0 2021-04-09T18:26:37.392 INFO:tasks.workunit.client.0.smithi120.stdout:0/995: mknod d0/d43/d49/d87/d115/c12d 1 2021-04-09T18:26:37.395 INFO:tasks.workunit.client.0.smithi120.stdout:0/996: creat d0/d5a/d62/d69/de7/f12e x:0 0 0 2021-04-09T18:26:37.399 INFO:tasks.workunit.client.0.smithi120.stdout:0/997: write d0/d2/f46 [1104104,71158] 0 2021-04-09T18:26:37.402 INFO:tasks.workunit.client.0.smithi120.stdout:0/998: creat d0/d2/dd/db4/dd2/f12f x:0 0 0 2021-04-09T18:26:37.510 INFO:tasks.workunit.client.0.smithi120.stdout:0/999: sync 2021-04-09T18:26:37.513 INFO:tasks.workunit.client.0.smithi120.stderr:+ rm -rf -- ./tmp.kNIFAW6UNL 2021-04-09T18:27:02.437 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:02.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:25.198 INFO:teuthology.orchestra.run:Running command with timeout 3600 2021-04-09T18:27:25.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2021-04-09T18:27:35.453 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:35.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:27:43.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:43.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.408 7f40dde28700 1 Processor -- start 2021-04-09T18:27:43.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.408 7f40dde28700 1 -- start start 2021-04-09T18:27:43.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40dde28700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d80d7160 0x7f40d80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40dde28700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f40d80e70a0 0x7f40d80d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40dde28700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d80d6be0 con 0x7f40d80d7560 2021-04-09T18:27:43.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40dde28700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d80d80f0 con 0x7f40d80e70a0 2021-04-09T18:27:43.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40dde28700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80e7f00 con 0x7f40d80d7160 2021-04-09T18:27:43.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d7fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f40d80e70a0 0x7f40d80d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d77fe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d80d7160 0x7f40d80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d6ffd700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f40d80d7560 0x7f40d80d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:47180/0 (socket says 172.21.15.120:47180) 2021-04-09T18:27:43.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d6ffd700 1 -- 172.21.15.120:0/1949409153 learned_addr learned my addr 172.21.15.120:0/1949409153 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:27:43.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d67fc700 1 -- 172.21.15.120:0/1949409153 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463210438 0 0) 0x7f40cc0009b0 con 0x7f40d80d7560 2021-04-09T18:27:43.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d67fc700 1 -- 172.21.15.120:0/1949409153 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40c0002fe0 con 0x7f40d80d7560 2021-04-09T18:27:43.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d77fe700 1 -- 172.21.15.120:0/1949409153 >> v2:172.21.15.134:3300/0 conn(0x7f40d80e70a0 msgr2=0x7f40d80d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:43.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d77fe700 1 --2- 172.21.15.120:0/1949409153 >> v2:172.21.15.134:3300/0 conn(0x7f40d80e70a0 0x7f40d80d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d77fe700 1 -- 172.21.15.120:0/1949409153 >> v1:172.21.15.134:6789/0 conn(0x7f40d80d7560 legacy=0x7f40d80d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d77fe700 1 -- 172.21.15.120:0/1949409153 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d81a2ac0 con 0x7f40d80d7160 2021-04-09T18:27:43.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.409 7f40d7fff700 1 --2- 172.21.15.120:0/1949409153 >> v2:172.21.15.134:3300/0 conn(0x7f40d80e70a0 0x7f40d80d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:27:43.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40d77fe700 1 --2- 172.21.15.120:0/1949409153 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d80d7160 0x7f40d80e78e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f40c80069d0 tx=0x7f40c8009e40).ready entity=mon.2 client_cookie=ce803039c9bf0313 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:43.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40d67fc700 1 -- 172.21.15.120:0/1949409153 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f40c800b510 con 0x7f40d80d7160 2021-04-09T18:27:43.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40d67fc700 1 -- 172.21.15.120:0/1949409153 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800b890 con 0x7f40d80d7160 2021-04-09T18:27:43.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40d67fc700 1 -- 172.21.15.120:0/1949409153 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f40c800bd70 con 0x7f40d80d7160 2021-04-09T18:27:43.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40dde28700 1 -- 172.21.15.120:0/1949409153 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d80d7160 msgr2=0x7f40d80e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40dde28700 1 --2- 172.21.15.120:0/1949409153 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d80d7160 0x7f40d80e78e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f40c80069d0 tx=0x7f40c8009e40).stop 2021-04-09T18:27:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40dde28700 1 -- 172.21.15.120:0/1949409153 shutdown_connections 2021-04-09T18:27:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40dde28700 1 --2- 172.21.15.120:0/1949409153 >> v2:172.21.15.134:3300/0 conn(0x7f40d80e70a0 0x7f40d80d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40dde28700 1 --2- 172.21.15.120:0/1949409153 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d80d7160 0x7f40d80e78e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.410 7f40dde28700 1 -- 172.21.15.120:0/1949409153 >> 172.21.15.120:0/1949409153 conn(0x7f40d80d1590 msgr2=0x7f40d80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.411 7f40dde28700 1 -- 172.21.15.120:0/1949409153 shutdown_connections 2021-04-09T18:27:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.411 7f40dde28700 1 -- 172.21.15.120:0/1949409153 wait complete. 2021-04-09T18:27:43.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.429 7f40dde28700 1 Processor -- start 2021-04-09T18:27:43.434 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.429 7f40dde28700 1 -- start start 2021-04-09T18:27:43.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40dde28700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40d808aca0 0x7f40d817ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40dde28700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40d808b0a0 0x7f40d8095890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.435 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40dde28700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d817f0b0 0x7f40d80aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40dde28700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d808b690 con 0x7f40d808b0a0 2021-04-09T18:27:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40dde28700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d808b910 con 0x7f40d808aca0 2021-04-09T18:27:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40dde28700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8095eb0 con 0x7f40d817f0b0 2021-04-09T18:27:43.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d6ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40d808b0a0 0x7f40d8095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.437 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d6ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40d808b0a0 0x7f40d8095890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57456/0 (socket says 172.21.15.120:57456) 2021-04-09T18:27:43.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d6ffd700 1 -- 172.21.15.120:0/1259410264 learned_addr learned my addr 172.21.15.120:0/1259410264 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:43.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d77fe700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40d808aca0 0x7f40d817ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d7fff700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d817f0b0 0x7f40d80aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.439 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d6ffd700 1 -- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d817f0b0 msgr2=0x7f40d80aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d6ffd700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d817f0b0 0x7f40d80aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d6ffd700 1 -- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40d808aca0 msgr2=0x7f40d817ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d6ffd700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40d808aca0 0x7f40d817ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d6ffd700 1 -- 172.21.15.120:0/1259410264 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d80960d0 con 0x7f40d808b0a0 2021-04-09T18:27:43.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40d6ffd700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40d808b0a0 0x7f40d8095890 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f40cc001c60 tx=0x7f40cc00a8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:43.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40bffff700 1 -- 172.21.15.120:0/1259410264 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f40cc00acc0 con 0x7f40d808b0a0 2021-04-09T18:27:43.442 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40bffff700 1 -- 172.21.15.120:0/1259410264 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc004140 con 0x7f40d808b0a0 2021-04-09T18:27:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.430 7f40dde28700 1 -- 172.21.15.120:0/1259410264 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d80960d0 con 0x7f40d808b0a0 2021-04-09T18:27:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.431 7f40bffff700 1 -- 172.21.15.120:0/1259410264 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f40cc004590 con 0x7f40d808b0a0 2021-04-09T18:27:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.431 7f40dde28700 1 -- 172.21.15.120:0/1259410264 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d80960d0 con 0x7f40d808b0a0 2021-04-09T18:27:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.431 7f40bffff700 1 -- 172.21.15.120:0/1259410264 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f40cc004320 con 0x7f40d808b0a0 2021-04-09T18:27:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.431 7f40bffff700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f40b8018930 0x7f40b801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.445 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.431 7f40bffff700 1 -- 172.21.15.120:0/1259410264 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7f40cc032cc0 con 0x7f40d808b0a0 2021-04-09T18:27:43.445 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.431 7f40d77fe700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f40b8018930 0x7f40b801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.445 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.432 7f40d77fe700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f40b8018930 0x7f40b801ae10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:43.446 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.455 7f40dde28700 1 -- 172.21.15.120:0/1259410264 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d80e48e0 con 0x7f40d808b0a0 2021-04-09T18:27:43.449 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.458 7f40bffff700 1 -- 172.21.15.120:0/1259410264 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f40cc000990 con 0x7f40d808b0a0 2021-04-09T18:27:43.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.640 7f40dde28700 1 -- 172.21.15.120:0/1259410264 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d80e48e0 con 0x7f40d808b0a0 2021-04-09T18:27:43.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.641 7f40bffff700 1 -- 172.21.15.120:0/1259410264 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f40cc004140 con 0x7f40d808b0a0 2021-04-09T18:27:43.633 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2021-04-09T18:27:43.634 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:27:43.634 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:27:43.636 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.644 7f40dde28700 1 -- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f40b8018930 msgr2=0x7f40b801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.644 7f40dde28700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f40b8018930 0x7f40b801ae10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.644 7f40dde28700 1 -- 172.21.15.120:0/1259410264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40d808b0a0 msgr2=0x7f40d8095890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.644 7f40dde28700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40d808b0a0 0x7f40d8095890 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f40cc001c60 tx=0x7f40cc00a8d0).stop 2021-04-09T18:27:43.637 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.645 7f40dde28700 1 -- 172.21.15.120:0/1259410264 shutdown_connections 2021-04-09T18:27:43.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.645 7f40dde28700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f40b8018930 0x7f40b801ae10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.645 7f40dde28700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40d817f0b0 0x7f40d80aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.645 7f40dde28700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40d808b0a0 0x7f40d8095890 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.645 7f40dde28700 1 --2- 172.21.15.120:0/1259410264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40d808aca0 0x7f40d817ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.638 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.645 7f40dde28700 1 -- 172.21.15.120:0/1259410264 >> 172.21.15.120:0/1259410264 conn(0x7f40d81993c0 msgr2=0x7f40d8199820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:43.639 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.645 7f40dde28700 1 -- 172.21.15.120:0/1259410264 shutdown_connections 2021-04-09T18:27:43.639 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.645 7f40dde28700 1 -- 172.21.15.120:0/1259410264 wait complete. 2021-04-09T18:27:43.647 INFO:tasks.mds_thrash.fs.[None]:kill mds.b (rank=0) 2021-04-09T18:27:43.648 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:27:43.648 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:27:43.661 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:27:43.661 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:43.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.846 7f3b4abbe700 1 Processor -- start 2021-04-09T18:27:43.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.846 7f3b4abbe700 1 -- start start 2021-04-09T18:27:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b4abbe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3b440d7560 0x7f3b440d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b4abbe700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b440d7960 con 0x7f3b440d7160 2021-04-09T18:27:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b4abbe700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b440d6be0 con 0x7f3b440d63b0 2021-04-09T18:27:43.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b4abbe700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b440d80f0 con 0x7f3b440d7560 2021-04-09T18:27:43.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b3bfff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3b440d7560 0x7f3b440d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b489da700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3b440d7160 0x7f3b440d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52380/0 (socket says 172.21.15.120:52380) 2021-04-09T18:27:43.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b489da700 1 -- 172.21.15.120:0/2664395784 learned_addr learned my addr 172.21.15.120:0/2664395784 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:27:43.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b3bfff700 1 -- 172.21.15.120:0/2664395784 >> v1:172.21.15.134:6789/0 conn(0x7f3b440d63b0 legacy=0x7f3b441ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b3bfff700 1 -- 172.21.15.120:0/2664395784 >> v1:172.21.15.120:6789/0 conn(0x7f3b440d7160 legacy=0x7f3b440d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b3bfff700 1 -- 172.21.15.120:0/2664395784 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b441a2af0 con 0x7f3b440d7560 2021-04-09T18:27:43.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b3b7fe700 1 -- 172.21.15.120:0/2664395784 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413702307 0 0) 0x7f3b40001060 con 0x7f3b440d7160 2021-04-09T18:27:43.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b3bfff700 1 --2- 172.21.15.120:0/2664395784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b440d7560 0x7f3b440d5d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f3b34006650 tx=0x7f3b34009a00).ready entity=mon.0 client_cookie=3f42dea60144122c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:43.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b3b7fe700 1 -- 172.21.15.120:0/2664395784 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3b34009df0 con 0x7f3b440d7560 2021-04-09T18:27:43.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b3b7fe700 1 -- 172.21.15.120:0/2664395784 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b340009b0 con 0x7f3b440d7560 2021-04-09T18:27:43.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b3b7fe700 1 -- 172.21.15.120:0/2664395784 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3b3400c2b0 con 0x7f3b440d7560 2021-04-09T18:27:43.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b4abbe700 1 -- 172.21.15.120:0/2664395784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b440d7560 msgr2=0x7f3b440d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.847 7f3b4abbe700 1 --2- 172.21.15.120:0/2664395784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b440d7560 0x7f3b440d5d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f3b34006650 tx=0x7f3b34009a00).stop 2021-04-09T18:27:43.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.848 7f3b4abbe700 1 -- 172.21.15.120:0/2664395784 shutdown_connections 2021-04-09T18:27:43.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.848 7f3b4abbe700 1 --2- 172.21.15.120:0/2664395784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b440d7560 0x7f3b440d5d90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.848 7f3b4abbe700 1 -- 172.21.15.120:0/2664395784 >> 172.21.15.120:0/2664395784 conn(0x7f3b440d1590 msgr2=0x7f3b440d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:43.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.848 7f3b4abbe700 1 -- 172.21.15.120:0/2664395784 shutdown_connections 2021-04-09T18:27:43.864 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.848 7f3b4abbe700 1 -- 172.21.15.120:0/2664395784 wait complete. 2021-04-09T18:27:43.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.867 7f3b4abbe700 1 Processor -- start 2021-04-09T18:27:43.867 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.867 7f3b4abbe700 1 -- start start 2021-04-09T18:27:43.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.867 7f3b4abbe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b44186ed0 0x7f3b44180850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b4abbe700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b44180e70 0x7f3b440b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b4abbe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b441872d0 0x7f3b440b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.868 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b4abbe700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b44186950 con 0x7f3b441872d0 2021-04-09T18:27:43.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b4abbe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440b2450 con 0x7f3b44186ed0 2021-04-09T18:27:43.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b4abbe700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440b2630 con 0x7f3b44180e70 2021-04-09T18:27:43.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b491db700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b441872d0 0x7f3b440b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b491db700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b441872d0 0x7f3b440b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57480/0 (socket says 172.21.15.120:57480) 2021-04-09T18:27:43.869 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b491db700 1 -- 172.21.15.120:0/1322869332 learned_addr learned my addr 172.21.15.120:0/1322869332 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:43.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b489da700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b44186ed0 0x7f3b44180850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b3bfff700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b44180e70 0x7f3b440b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b491db700 1 -- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b44180e70 msgr2=0x7f3b440b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.870 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b491db700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b44180e70 0x7f3b440b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b491db700 1 -- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b44186ed0 msgr2=0x7f3b44180850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:43.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b491db700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b44186ed0 0x7f3b44180850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:43.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b491db700 1 -- 172.21.15.120:0/1322869332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4419d110 con 0x7f3b441872d0 2021-04-09T18:27:43.871 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b3bfff700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b44180e70 0x7f3b440b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:27:43.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b491db700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b441872d0 0x7f3b440b1e30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f3b3c006ed0 tx=0x7f3b3c00b960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:43.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b397fa700 1 -- 172.21.15.120:0/1322869332 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3b3c00bd50 con 0x7f3b441872d0 2021-04-09T18:27:43.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b397fa700 1 -- 172.21.15.120:0/1322869332 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c006020 con 0x7f3b441872d0 2021-04-09T18:27:43.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b397fa700 1 -- 172.21.15.120:0/1322869332 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3b3c0054b0 con 0x7f3b441872d0 2021-04-09T18:27:43.872 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4419d110 con 0x7f3b441872d0 2021-04-09T18:27:43.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.868 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4419d110 con 0x7f3b441872d0 2021-04-09T18:27:43.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.869 7f3b397fa700 1 -- 172.21.15.120:0/1322869332 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3b3c0054b0 con 0x7f3b441872d0 2021-04-09T18:27:43.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.869 7f3b397fa700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b24018930 0x7f3b2401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:43.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.869 7f3b397fa700 1 -- 172.21.15.120:0/1322869332 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7f3b3c032cb0 con 0x7f3b441872d0 2021-04-09T18:27:43.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.869 7f3b489da700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b24018930 0x7f3b2401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:43.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.870 7f3b489da700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b24018930 0x7f3b2401ae10 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:43.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.892 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4417f360 con 0x7f3b441872d0 2021-04-09T18:27:43.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:43.896 7f3b397fa700 1 -- 172.21.15.120:0/1322869332 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3b3c006000 con 0x7f3b441872d0 2021-04-09T18:27:44.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.074 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b4417f360 con 0x7f3b441872d0 2021-04-09T18:27:44.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.074 7f3b397fa700 1 -- 172.21.15.120:0/1322869332 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f3b3c006000 con 0x7f3b441872d0 2021-04-09T18:27:44.067 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2021-04-09T18:27:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:27:44.068 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:27:44.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.076 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b24018930 msgr2=0x7f3b2401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:44.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.076 7f3b4abbe700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b24018930 0x7f3b2401ae10 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:44.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.076 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b441872d0 msgr2=0x7f3b440b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:44.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.076 7f3b4abbe700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b441872d0 0x7f3b440b1e30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f3b3c006ed0 tx=0x7f3b3c00b960).stop 2021-04-09T18:27:44.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.077 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 shutdown_connections 2021-04-09T18:27:44.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.077 7f3b4abbe700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b441872d0 0x7f3b440b1e30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:44.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.077 7f3b4abbe700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3b24018930 0x7f3b2401ae10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:44.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.077 7f3b4abbe700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b44180e70 0x7f3b440b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:44.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.077 7f3b4abbe700 1 --2- 172.21.15.120:0/1322869332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b44186ed0 0x7f3b44180850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:44.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.077 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 >> 172.21.15.120:0/1322869332 conn(0x7f3b440945f0 msgr2=0x7f3b44097cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:44.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.077 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 shutdown_connections 2021-04-09T18:27:44.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:44.077 7f3b4abbe700 1 -- 172.21.15.120:0/1322869332 wait complete. 2021-04-09T18:27:44.078 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:27:46.079 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.273 7f78af596700 1 Processor -- start 2021-04-09T18:27:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.273 7f78af596700 1 -- start start 2021-04-09T18:27:46.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78af596700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f78a80d7160 0x7f78a80d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:46.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78af596700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a80d6190 0x7f78a80d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:46.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78af596700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80d6be0 con 0x7f78a80d55a0 2021-04-09T18:27:46.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78af596700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80d80f0 con 0x7f78a80d7160 2021-04-09T18:27:46.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78af596700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81a2ac0 con 0x7f78a80d6190 2021-04-09T18:27:46.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78adbb3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a80d6190 0x7f78a80d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:46.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78ad3b2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f78a80d7160 0x7f78a80d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:46.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78acbb1700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f78a80d55a0 0x7f78a80d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:47220/0 (socket says 172.21.15.120:47220) 2021-04-09T18:27:46.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78acbb1700 1 -- 172.21.15.120:0/4211189724 learned_addr learned my addr 172.21.15.120:0/4211189724 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:27:46.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78adbb3700 1 -- 172.21.15.120:0/4211189724 >> v2:172.21.15.134:3300/0 conn(0x7f78a80d7160 msgr2=0x7f78a80d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:46.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78adbb3700 1 --2- 172.21.15.120:0/4211189724 >> v2:172.21.15.134:3300/0 conn(0x7f78a80d7160 0x7f78a80d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78adbb3700 1 -- 172.21.15.120:0/4211189724 >> v1:172.21.15.134:6789/0 conn(0x7f78a80d55a0 legacy=0x7f78a80d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:46.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78adbb3700 1 -- 172.21.15.120:0/4211189724 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a81a2cb0 con 0x7f78a80d6190 2021-04-09T18:27:46.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.274 7f78ad3b2700 1 --2- 172.21.15.120:0/4211189724 >> v2:172.21.15.134:3300/0 conn(0x7f78a80d7160 0x7f78a80d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:27:46.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.275 7f78adbb3700 1 --2- 172.21.15.120:0/4211189724 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a80d6190 0x7f78a80d6590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f78a0006ad0 tx=0x7f78a0009ad0).ready entity=mon.2 client_cookie=20cde4aed78a0ae3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:46.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.275 7f789ffff700 1 -- 172.21.15.120:0/4211189724 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78a00022e0 con 0x7f78a80d6190 2021-04-09T18:27:46.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.275 7f789ffff700 1 -- 172.21.15.120:0/4211189724 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0006410 con 0x7f78a80d6190 2021-04-09T18:27:46.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.275 7f789ffff700 1 -- 172.21.15.120:0/4211189724 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78a0002620 con 0x7f78a80d6190 2021-04-09T18:27:46.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.275 7f78af596700 1 -- 172.21.15.120:0/4211189724 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a80d6190 msgr2=0x7f78a80d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:46.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.275 7f78af596700 1 --2- 172.21.15.120:0/4211189724 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a80d6190 0x7f78a80d6590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f78a0006ad0 tx=0x7f78a0009ad0).stop 2021-04-09T18:27:46.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.276 7f78af596700 1 -- 172.21.15.120:0/4211189724 shutdown_connections 2021-04-09T18:27:46.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.276 7f78af596700 1 --2- 172.21.15.120:0/4211189724 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a80d6190 0x7f78a80d6590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.276 7f78af596700 1 --2- 172.21.15.120:0/4211189724 >> v2:172.21.15.134:3300/0 conn(0x7f78a80d7160 0x7f78a80d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.276 7f78af596700 1 -- 172.21.15.120:0/4211189724 >> 172.21.15.120:0/4211189724 conn(0x7f78a80d1590 msgr2=0x7f78a80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:46.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.276 7f78af596700 1 -- 172.21.15.120:0/4211189724 shutdown_connections 2021-04-09T18:27:46.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.276 7f78af596700 1 -- 172.21.15.120:0/4211189724 wait complete. 2021-04-09T18:27:46.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78af596700 1 Processor -- start 2021-04-09T18:27:46.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78af596700 1 -- start start 2021-04-09T18:27:46.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78af596700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a817b4b0 0x7f78a81a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:46.296 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78af596700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78a81a1760 0x7f78a819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:46.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78af596700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a817b8b0 0x7f78a819ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:46.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78af596700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81a0c40 con 0x7f78a81a1760 2021-04-09T18:27:46.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78af596700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a817be20 con 0x7f78a817b8b0 2021-04-09T18:27:46.297 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78af596700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81a0550 con 0x7f78a817b4b0 2021-04-09T18:27:46.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78acbb1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78a81a1760 0x7f78a819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:46.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78acbb1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78a81a1760 0x7f78a819f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57496/0 (socket says 172.21.15.120:57496) 2021-04-09T18:27:46.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.295 7f78acbb1700 1 -- 172.21.15.120:0/2263877216 learned_addr learned my addr 172.21.15.120:0/2263877216 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:46.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78adbb3700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a817b8b0 0x7f78a819ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:46.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78ad3b2700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a817b4b0 0x7f78a81a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:46.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78acbb1700 1 -- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a817b4b0 msgr2=0x7f78a81a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:46.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78acbb1700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a817b4b0 0x7f78a81a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78acbb1700 1 -- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a817b8b0 msgr2=0x7f78a819ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:46.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78acbb1700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a817b8b0 0x7f78a819ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78acbb1700 1 -- 172.21.15.120:0/2263877216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a81a0770 con 0x7f78a81a1760 2021-04-09T18:27:46.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78adbb3700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a817b8b0 0x7f78a819ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:27:46.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78ad3b2700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a817b4b0 0x7f78a81a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:27:46.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78acbb1700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78a81a1760 0x7f78a819f910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7898007650 tx=0x7f789800a900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:46.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f789dffb700 1 -- 172.21.15.120:0/2263877216 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7898000de0 con 0x7f78a81a1760 2021-04-09T18:27:46.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f789dffb700 1 -- 172.21.15.120:0/2263877216 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7898004140 con 0x7f78a81a1760 2021-04-09T18:27:46.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78af596700 1 -- 172.21.15.120:0/2263877216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a81a0770 con 0x7f78a81a1760 2021-04-09T18:27:46.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f789dffb700 1 -- 172.21.15.120:0/2263877216 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7898004620 con 0x7f78a81a1760 2021-04-09T18:27:46.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.296 7f78af596700 1 -- 172.21.15.120:0/2263877216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a81a0770 con 0x7f78a81a1760 2021-04-09T18:27:46.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.297 7f789dffb700 1 -- 172.21.15.120:0/2263877216 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7898000ce0 con 0x7f78a81a1760 2021-04-09T18:27:46.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.297 7f789dffb700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7888018930 0x7f788801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:46.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.297 7f789dffb700 1 -- 172.21.15.120:0/2263877216 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7f7898032e20 con 0x7f78a81a1760 2021-04-09T18:27:46.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.297 7f78ad3b2700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7888018930 0x7f788801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:46.303 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.297 7f78ad3b2700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7888018930 0x7f788801ae10 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:46.311 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.320 7f78af596700 1 -- 172.21.15.120:0/2263877216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a817a2b0 con 0x7f78a81a1760 2021-04-09T18:27:46.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.323 7f789dffb700 1 -- 172.21.15.120:0/2263877216 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7898000990 con 0x7f78a81a1760 2021-04-09T18:27:46.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.500 7f78af596700 1 -- 172.21.15.120:0/2263877216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78a817a2b0 con 0x7f78a81a1760 2021-04-09T18:27:46.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.501 7f789dffb700 1 -- 172.21.15.120:0/2263877216 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f7898000ce0 con 0x7f78a81a1760 2021-04-09T18:27:46.493 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2021-04-09T18:27:46.494 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:27:46.494 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:27:46.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 -- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7888018930 msgr2=0x7f788801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:46.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7888018930 0x7f788801ae10 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 -- 172.21.15.120:0/2263877216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78a81a1760 msgr2=0x7f78a819f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:46.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78a81a1760 0x7f78a819f910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7898007650 tx=0x7f789800a900).stop 2021-04-09T18:27:46.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 -- 172.21.15.120:0/2263877216 shutdown_connections 2021-04-09T18:27:46.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a817b8b0 0x7f78a819ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78a81a1760 0x7f78a819f910 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7888018930 0x7f788801ae10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 --2- 172.21.15.120:0/2263877216 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78a817b4b0 0x7f78a81a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:46.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 -- 172.21.15.120:0/2263877216 >> 172.21.15.120:0/2263877216 conn(0x7f78a8185580 msgr2=0x7f78a8188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:46.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 -- 172.21.15.120:0/2263877216 shutdown_connections 2021-04-09T18:27:46.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:46.503 7f78af596700 1 -- 172.21.15.120:0/2263877216 wait complete. 2021-04-09T18:27:46.505 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:27:48.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:48.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.695 7fced36d7700 1 Processor -- start 2021-04-09T18:27:48.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.695 7fced36d7700 1 -- start start 2021-04-09T18:27:48.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.695 7fced36d7700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcecc0eac40 0x7fcecc0dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:48.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.695 7fced36d7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcecc0d1b40 0x7fcecc088000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:48.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.695 7fced36d7700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc0d61e0 con 0x7fcecc088620 2021-04-09T18:27:48.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.695 7fced36d7700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcecc0eaa10 con 0x7fcecc0eac40 2021-04-09T18:27:48.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.695 7fced36d7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcecc0f38e0 con 0x7fcecc0d1b40 2021-04-09T18:27:48.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.695 7fced14f3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcecc0eac40 0x7fcecc0dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:48.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.695 7fced14f3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcecc0eac40 0x7fcecc0dc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57504/0 (socket says 172.21.15.120:57504) 2021-04-09T18:27:48.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fced14f3700 1 -- 172.21.15.120:0/2504039622 learned_addr learned my addr 172.21.15.120:0/2504039622 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:48.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fced0cf2700 1 --2- 172.21.15.120:0/2504039622 >> v2:172.21.15.134:3300/0 conn(0x7fcecc0d1b40 0x7fcecc088000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:48.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fced14f3700 1 -- 172.21.15.120:0/2504039622 >> v2:172.21.15.134:3300/0 conn(0x7fcecc0d1b40 msgr2=0x7fcecc088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:48.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fced14f3700 1 --2- 172.21.15.120:0/2504039622 >> v2:172.21.15.134:3300/0 conn(0x7fcecc0d1b40 0x7fcecc088000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fced14f3700 1 -- 172.21.15.120:0/2504039622 >> v1:172.21.15.134:6789/0 conn(0x7fcecc088620 legacy=0x7fcecc0d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:48.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fced14f3700 1 -- 172.21.15.120:0/2504039622 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0d6f50 con 0x7fcecc0eac40 2021-04-09T18:27:48.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fced14f3700 1 --2- 172.21.15.120:0/2504039622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc0eac40 0x7fcecc0dc6b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fcebc006700 tx=0x7fcebc009b80).ready entity=mon.0 client_cookie=c4704deb405920ea server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:48.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fcec3fff700 1 -- 172.21.15.120:0/2504039622 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcebc00c0c0 con 0x7fcecc0eac40 2021-04-09T18:27:48.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fcec3fff700 1 -- 172.21.15.120:0/2504039622 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc00c440 con 0x7fcecc0eac40 2021-04-09T18:27:48.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fcec3fff700 1 -- 172.21.15.120:0/2504039622 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcebc00c920 con 0x7fcecc0eac40 2021-04-09T18:27:48.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fced36d7700 1 -- 172.21.15.120:0/2504039622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc0eac40 msgr2=0x7fcecc0dc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:48.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.696 7fced36d7700 1 --2- 172.21.15.120:0/2504039622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc0eac40 0x7fcecc0dc6b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fcebc006700 tx=0x7fcebc009b80).stop 2021-04-09T18:27:48.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.697 7fced36d7700 1 -- 172.21.15.120:0/2504039622 shutdown_connections 2021-04-09T18:27:48.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.697 7fced36d7700 1 --2- 172.21.15.120:0/2504039622 >> v2:172.21.15.134:3300/0 conn(0x7fcecc0d1b40 0x7fcecc088000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.697 7fced36d7700 1 --2- 172.21.15.120:0/2504039622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc0eac40 0x7fcecc0dc6b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.697 7fced36d7700 1 -- 172.21.15.120:0/2504039622 >> 172.21.15.120:0/2504039622 conn(0x7fcecc0e93c0 msgr2=0x7fcecc100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:48.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.697 7fced36d7700 1 -- 172.21.15.120:0/2504039622 shutdown_connections 2021-04-09T18:27:48.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.697 7fced36d7700 1 -- 172.21.15.120:0/2504039622 wait complete. 2021-04-09T18:27:48.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced36d7700 1 Processor -- start 2021-04-09T18:27:48.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced36d7700 1 -- start start 2021-04-09T18:27:48.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced36d7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc18b580 0x7fcecc1a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:48.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced36d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcecc18b980 0x7fcecc1a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:48.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced36d7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcecc1a6ed0 0x7fcecc189280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:48.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced36d7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc18d220 con 0x7fcecc18b580 2021-04-09T18:27:48.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced36d7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc18b000 con 0x7fcecc18b980 2021-04-09T18:27:48.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced36d7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc18cd60 con 0x7fcecc1a6ed0 2021-04-09T18:27:48.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced14f3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc18b580 0x7fcecc1a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:48.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced14f3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc18b580 0x7fcecc1a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57510/0 (socket says 172.21.15.120:57510) 2021-04-09T18:27:48.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced14f3700 1 -- 172.21.15.120:0/222529232 learned_addr learned my addr 172.21.15.120:0/222529232 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:48.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.716 7fced0cf2700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcecc18b980 0x7fcecc1a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:48.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced1cf4700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcecc1a6ed0 0x7fcecc189280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced14f3700 1 -- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcecc1a6ed0 msgr2=0x7fcecc189280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced14f3700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcecc1a6ed0 0x7fcecc189280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced14f3700 1 -- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcecc18b980 msgr2=0x7fcecc1a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced14f3700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcecc18b980 0x7fcecc1a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced14f3700 1 -- 172.21.15.120:0/222529232 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc1a72d0 con 0x7fcecc18b580 2021-04-09T18:27:48.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced1cf4700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcecc1a6ed0 0x7fcecc189280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:48.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced14f3700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc18b580 0x7fcecc1a6290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fcebc00b650 tx=0x7fcebc00b9f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:48.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fcec1ffb700 1 -- 172.21.15.120:0/222529232 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcebc00bde0 con 0x7fcecc18b580 2021-04-09T18:27:48.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fcec1ffb700 1 -- 172.21.15.120:0/222529232 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc0091e0 con 0x7fcecc18b580 2021-04-09T18:27:48.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced36d7700 1 -- 172.21.15.120:0/222529232 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc1a72d0 con 0x7fcecc18b580 2021-04-09T18:27:48.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fcec1ffb700 1 -- 172.21.15.120:0/222529232 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcebc002220 con 0x7fcecc18b580 2021-04-09T18:27:48.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.717 7fced36d7700 1 -- 172.21.15.120:0/222529232 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc1a72d0 con 0x7fcecc18b580 2021-04-09T18:27:48.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.718 7fcec1ffb700 1 -- 172.21.15.120:0/222529232 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fcebc000c90 con 0x7fcecc18b580 2021-04-09T18:27:48.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.718 7fcec1ffb700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fceac018930 0x7fceac01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:48.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.718 7fcec1ffb700 1 -- 172.21.15.120:0/222529232 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7fcebc032d50 con 0x7fcecc18b580 2021-04-09T18:27:48.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.718 7fced0cf2700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fceac018930 0x7fceac01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:48.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.718 7fced0cf2700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fceac018930 0x7fceac01ae10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:48.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.741 7fced36d7700 1 -- 172.21.15.120:0/222529232 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc18cd60 con 0x7fcecc18b580 2021-04-09T18:27:48.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.745 7fcec1ffb700 1 -- 172.21.15.120:0/222529232 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fcebc000940 con 0x7fcecc18b580 2021-04-09T18:27:48.914 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.922 7fced36d7700 1 -- 172.21.15.120:0/222529232 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcecc18cd60 con 0x7fcecc18b580 2021-04-09T18:27:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.922 7fcec1ffb700 1 -- 172.21.15.120:0/222529232 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fcebc00bde0 con 0x7fcecc18b580 2021-04-09T18:27:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2021-04-09T18:27:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:27:48.916 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:27:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 -- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fceac018930 msgr2=0x7fceac01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:48.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fceac018930 0x7fceac01ae10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 -- 172.21.15.120:0/222529232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc18b580 msgr2=0x7fcecc1a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:48.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc18b580 0x7fcecc1a6290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fcebc00b650 tx=0x7fcebc00b9f0).stop 2021-04-09T18:27:48.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 -- 172.21.15.120:0/222529232 shutdown_connections 2021-04-09T18:27:48.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fceac018930 0x7fceac01ae10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcecc1a6ed0 0x7fcecc189280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcecc18b980 0x7fcecc1a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 --2- 172.21.15.120:0/222529232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcecc18b580 0x7fcecc1a6290 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:48.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 -- 172.21.15.120:0/222529232 >> 172.21.15.120:0/222529232 conn(0x7fcecc0948b0 msgr2=0x7fcecc088760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 -- 172.21.15.120:0/222529232 shutdown_connections 2021-04-09T18:27:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:48.925 7fced36d7700 1 -- 172.21.15.120:0/222529232 wait complete. 2021-04-09T18:27:48.927 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:27:50.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:51.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.117 7f88a8c32700 1 Processor -- start 2021-04-09T18:27:51.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.117 7f88a8c32700 1 -- start start 2021-04-09T18:27:51.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a8c32700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a40d7160 0x7f88a40e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:51.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a8c32700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f88a40d7560 0x7f88a40d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:51.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a8c32700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a40d6be0 con 0x7f88a40d5bc0 2021-04-09T18:27:51.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a8c32700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40d80f0 con 0x7f88a40d7560 2021-04-09T18:27:51.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a8c32700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40e7f00 con 0x7f88a40d7160 2021-04-09T18:27:51.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a205d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f88a40d7560 0x7f88a40d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:51.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a205d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f88a40d7560 0x7f88a40d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57522/0 (socket says 172.21.15.120:57522) 2021-04-09T18:27:51.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a205d700 1 -- 172.21.15.120:0/3402435538 learned_addr learned my addr 172.21.15.120:0/3402435538 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:51.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a285e700 1 --2- 172.21.15.120:0/3402435538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a40d7160 0x7f88a40e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:51.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a205d700 1 -- 172.21.15.120:0/3402435538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a40d7160 msgr2=0x7f88a40e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:51.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a205d700 1 --2- 172.21.15.120:0/3402435538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a40d7160 0x7f88a40e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a205d700 1 -- 172.21.15.120:0/3402435538 >> v1:172.21.15.134:6789/0 conn(0x7f88a40d5bc0 legacy=0x7f88a40d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:51.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.118 7f88a205d700 1 -- 172.21.15.120:0/3402435538 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a41a2ac0 con 0x7f88a40d7560 2021-04-09T18:27:51.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.119 7f88a205d700 1 --2- 172.21.15.120:0/3402435538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a40d7560 0x7f88a40d55a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f8898006700 tx=0x7f8898009b80).ready entity=mon.0 client_cookie=caa9631ec2b2a2af server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:51.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.119 7f88a185c700 1 -- 172.21.15.120:0/3402435538 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f889800c0c0 con 0x7f88a40d7560 2021-04-09T18:27:51.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.119 7f88a185c700 1 -- 172.21.15.120:0/3402435538 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889800c440 con 0x7f88a40d7560 2021-04-09T18:27:51.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.119 7f88a185c700 1 -- 172.21.15.120:0/3402435538 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f889800c920 con 0x7f88a40d7560 2021-04-09T18:27:51.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.119 7f88a8c32700 1 -- 172.21.15.120:0/3402435538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a40d7560 msgr2=0x7f88a40d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:51.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.119 7f88a8c32700 1 --2- 172.21.15.120:0/3402435538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a40d7560 0x7f88a40d55a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f8898006700 tx=0x7f8898009b80).stop 2021-04-09T18:27:51.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.120 7f88a8c32700 1 -- 172.21.15.120:0/3402435538 shutdown_connections 2021-04-09T18:27:51.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.120 7f88a8c32700 1 --2- 172.21.15.120:0/3402435538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a40d7560 0x7f88a40d55a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.120 7f88a8c32700 1 --2- 172.21.15.120:0/3402435538 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a40d7160 0x7f88a40e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.120 7f88a8c32700 1 -- 172.21.15.120:0/3402435538 >> 172.21.15.120:0/3402435538 conn(0x7f88a40d1590 msgr2=0x7f88a40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:51.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.120 7f88a8c32700 1 -- 172.21.15.120:0/3402435538 shutdown_connections 2021-04-09T18:27:51.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.120 7f88a8c32700 1 -- 172.21.15.120:0/3402435538 wait complete. 2021-04-09T18:27:51.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.138 7f88a8c32700 1 Processor -- start 2021-04-09T18:27:51.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.138 7f88a8c32700 1 -- start start 2021-04-09T18:27:51.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a8c32700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88a41971c0 0x7f88a4193ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:51.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a8c32700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a418ad80 0x7f88a418b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:51.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a8c32700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a418bd70 0x7f88a418c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:51.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a8c32700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40b0e80 con 0x7f88a418bd70 2021-04-09T18:27:51.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a8c32700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40b1070 con 0x7f88a41971c0 2021-04-09T18:27:51.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a8c32700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40b1290 con 0x7f88a418ad80 2021-04-09T18:27:51.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a305f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a418bd70 0x7f88a418c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:51.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a305f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a418bd70 0x7f88a418c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57528/0 (socket says 172.21.15.120:57528) 2021-04-09T18:27:51.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a305f700 1 -- 172.21.15.120:0/4114363778 learned_addr learned my addr 172.21.15.120:0/4114363778 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:51.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a285e700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88a41971c0 0x7f88a4193ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:51.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a205d700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a418ad80 0x7f88a418b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:51.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a305f700 1 -- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a418ad80 msgr2=0x7f88a418b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:51.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a305f700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a418ad80 0x7f88a418b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a305f700 1 -- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88a41971c0 msgr2=0x7f88a4193ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:51.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a305f700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88a41971c0 0x7f88a4193ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a305f700 1 -- 172.21.15.120:0/4114363778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40b14b0 con 0x7f88a418bd70 2021-04-09T18:27:51.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a305f700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a418bd70 0x7f88a418c170 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f889c00b530 tx=0x7f889c00b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:51.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88937fe700 1 -- 172.21.15.120:0/4114363778 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f889c00e250 con 0x7f88a418bd70 2021-04-09T18:27:51.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88937fe700 1 -- 172.21.15.120:0/4114363778 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c00e5d0 con 0x7f88a418bd70 2021-04-09T18:27:51.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a40b14b0 con 0x7f88a418bd70 2021-04-09T18:27:51.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88937fe700 1 -- 172.21.15.120:0/4114363778 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f889c00eab0 con 0x7f88a418bd70 2021-04-09T18:27:51.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.139 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a40b14b0 con 0x7f88a418bd70 2021-04-09T18:27:51.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.140 7f88937fe700 1 -- 172.21.15.120:0/4114363778 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f889c00e7b0 con 0x7f88a418bd70 2021-04-09T18:27:51.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.140 7f88937fe700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8888018930 0x7f888801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:51.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.140 7f88937fe700 1 -- 172.21.15.120:0/4114363778 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7f889c034f00 con 0x7f88a418bd70 2021-04-09T18:27:51.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.140 7f88a285e700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8888018930 0x7f888801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:51.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.141 7f88a285e700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8888018930 0x7f888801ae10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:51.155 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.164 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a4182a20 con 0x7f88a418bd70 2021-04-09T18:27:51.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.167 7f88937fe700 1 -- 172.21.15.120:0/4114363778 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f889c021980 con 0x7f88a418bd70 2021-04-09T18:27:51.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.346 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88a4182a20 con 0x7f88a418bd70 2021-04-09T18:27:51.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.347 7f88937fe700 1 -- 172.21.15.120:0/4114363778 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f889c021b90 con 0x7f88a418bd70 2021-04-09T18:27:51.340 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2021-04-09T18:27:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:27:51.341 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:27:51.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8888018930 msgr2=0x7f888801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:51.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8888018930 0x7f888801ae10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a418bd70 msgr2=0x7f88a418c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:51.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a418bd70 0x7f88a418c170 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f889c00b530 tx=0x7f889c00b8d0).stop 2021-04-09T18:27:51.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 shutdown_connections 2021-04-09T18:27:51.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88a418bd70 0x7f88a418c170 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8888018930 0x7f888801ae10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.347 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88a418ad80 0x7f88a418b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.347 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 --2- 172.21.15.120:0/4114363778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88a41971c0 0x7f88a4193ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:51.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.349 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 >> 172.21.15.120:0/4114363778 conn(0x7f88a418dcd0 msgr2=0x7f88a4187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:51.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.350 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 shutdown_connections 2021-04-09T18:27:51.348 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:51.350 7f88a8c32700 1 -- 172.21.15.120:0/4114363778 wait complete. 2021-04-09T18:27:51.351 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:27:53.353 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:53.559 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.546 7ff340e63700 1 Processor -- start 2021-04-09T18:27:53.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.546 7ff340e63700 1 -- start start 2021-04-09T18:27:53.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.547 7ff340e63700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff33c0d7560 0x7ff33c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:53.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.547 7ff340e63700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c0d7960 con 0x7ff33c0d7160 2021-04-09T18:27:53.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.547 7ff340e63700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c0d6be0 con 0x7ff33c0d63b0 2021-04-09T18:27:53.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.547 7ff340e63700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c1a2ac0 con 0x7ff33c0d7560 2021-04-09T18:27:53.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.547 7ff33ab13700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff33c0d7160 0x7ff33c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52444/0 (socket says 172.21.15.120:52444) 2021-04-09T18:27:53.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.547 7ff33ab13700 1 -- 172.21.15.120:0/3021635387 learned_addr learned my addr 172.21.15.120:0/3021635387 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:27:53.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.547 7ff33a312700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff33c0d7560 0x7ff33c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:53.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.547 7ff339b11700 1 -- 172.21.15.120:0/3021635387 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118645242 0 0) 0x7ff32c001060 con 0x7ff33c0d7160 2021-04-09T18:27:53.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.547 7ff339b11700 1 -- 172.21.15.120:0/3021635387 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff324002fe0 con 0x7ff33c0d7160 2021-04-09T18:27:53.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1020370724 0 0) 0x7ff32c001460 con 0x7ff33c0d7160 2021-04-09T18:27:53.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff33c0d7560 msgr2=0x7ff33c0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:53.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff33c0d7560 0x7ff33c0d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:53.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 >> v1:172.21.15.134:6789/0 conn(0x7ff33c0d63b0 legacy=0x7ff33c1ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:53.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c1a2cb0 con 0x7ff33c0d7160 2021-04-09T18:27:53.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7ff32c001980 con 0x7ff33c0d7160 2021-04-09T18:27:53.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 >> v1:172.21.15.120:6789/0 conn(0x7ff33c0d7160 legacy=0x7ff33c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:53.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff324003a70 0x7ff324005f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:53.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff324006780 0x7ff324008c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:53.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff324009510 0x7ff32400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:53.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32400c2e0 con 0x7ff324003a70 2021-04-09T18:27:53.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32400c500 con 0x7ff324009510 2021-04-09T18:27:53.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33ab13700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff324003a70 0x7ff324005f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:53.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff324050730 con 0x7ff324006780 2021-04-09T18:27:53.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33a312700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff324006780 0x7ff324008c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:53.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33b314700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff324009510 0x7ff32400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:53.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33ab13700 1 -- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff324006780 msgr2=0x7ff324008c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:53.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33ab13700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff324006780 0x7ff324008c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:53.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33ab13700 1 -- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff324009510 msgr2=0x7ff32400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:53.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33ab13700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff324009510 0x7ff32400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:53.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33ab13700 1 -- 172.21.15.120:0/3021635387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324050990 con 0x7ff324003a70 2021-04-09T18:27:53.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33b314700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff324009510 0x7ff32400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:53.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33ab13700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff324003a70 0x7ff324005f00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7ff32c0079f0 tx=0x7ff32c00a310).ready entity=mon.0 client_cookie=29d84fabc94c784b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:53.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff32c001460 con 0x7ff324003a70 2021-04-09T18:27:53.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c0070c0 con 0x7ff324003a70 2021-04-09T18:27:53.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff339b11700 1 -- 172.21.15.120:0/3021635387 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff32c0075e0 con 0x7ff324003a70 2021-04-09T18:27:53.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff340e63700 1 -- 172.21.15.120:0/3021635387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff324003a70 msgr2=0x7ff324005f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:53.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff340e63700 1 --2- 172.21.15.120:0/3021635387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff324003a70 0x7ff324005f00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7ff32c0079f0 tx=0x7ff32c00a310).stop 2021-04-09T18:27:53.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.548 7ff33b314700 1 -- 172.21.15.120:0/3021635387 reap_dead start 2021-04-09T18:27:53.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.549 7ff340e63700 1 -- 172.21.15.120:0/3021635387 shutdown_connections 2021-04-09T18:27:53.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.549 7ff340e63700 1 -- 172.21.15.120:0/3021635387 >> 172.21.15.120:0/3021635387 conn(0x7ff33c0d1590 msgr2=0x7ff33c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:53.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.549 7ff340e63700 1 -- 172.21.15.120:0/3021635387 shutdown_connections 2021-04-09T18:27:53.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.549 7ff340e63700 1 -- 172.21.15.120:0/3021635387 wait complete. 2021-04-09T18:27:53.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.568 7ff340e63700 1 Processor -- start 2021-04-09T18:27:53.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.568 7ff340e63700 1 -- start start 2021-04-09T18:27:53.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.568 7ff340e63700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff33c187670 0x7ff33c0a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:53.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.568 7ff340e63700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff33c0a5050 0x7ff33c0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:53.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.568 7ff340e63700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff33c0b5710 0x7ff33c1838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:53.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.568 7ff340e63700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0b5b10 con 0x7ff33c0a5050 2021-04-09T18:27:53.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.568 7ff340e63700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0b5d30 con 0x7ff33c0b5710 2021-04-09T18:27:53.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.568 7ff340e63700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0b5f50 con 0x7ff33c187670 2021-04-09T18:27:53.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff33a312700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff33c0a5050 0x7ff33c0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:53.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff33a312700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff33c0a5050 0x7ff33c0b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57544/0 (socket says 172.21.15.120:57544) 2021-04-09T18:27:53.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff33a312700 1 -- 172.21.15.120:0/3996062613 learned_addr learned my addr 172.21.15.120:0/3996062613 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:53.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff33a312700 1 -- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff33c187670 msgr2=0x7ff33c0a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:53.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff33a312700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff33c187670 0x7ff33c0a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:27:53.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff33a312700 1 -- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff33c0b5710 msgr2=0x7ff33c1838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:53.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff33a312700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff33c0b5710 0x7ff33c1838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:27:53.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff33a312700 1 -- 172.21.15.120:0/3996062613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c183ef0 con 0x7ff33c0a5050 2021-04-09T18:27:53.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff33a312700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff33c0a5050 0x7ff33c0b50f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7ff33000b560 tx=0x7ff33000b900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:53.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff32b7fe700 1 -- 172.21.15.120:0/3996062613 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff33000bcf0 con 0x7ff33c0a5050 2021-04-09T18:27:53.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff32b7fe700 1 -- 172.21.15.120:0/3996062613 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330000c90 con 0x7ff33c0a5050 2021-04-09T18:27:53.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff32b7fe700 1 -- 172.21.15.120:0/3996062613 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff330002220 con 0x7ff33c0a5050 2021-04-09T18:27:53.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff340e63700 1 -- 172.21.15.120:0/3996062613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c183ef0 con 0x7ff33c0a5050 2021-04-09T18:27:53.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.569 7ff340e63700 1 -- 172.21.15.120:0/3996062613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c183ef0 con 0x7ff33c0a5050 2021-04-09T18:27:53.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.570 7ff32b7fe700 1 -- 172.21.15.120:0/3996062613 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff33000a000 con 0x7ff33c0a5050 2021-04-09T18:27:53.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.570 7ff32b7fe700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3200188c0 0x7ff32001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:53.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.570 7ff32b7fe700 1 -- 172.21.15.120:0/3996062613 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7ff330032a80 con 0x7ff33c0a5050 2021-04-09T18:27:53.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.570 7ff33ab13700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3200188c0 0x7ff32001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:53.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.570 7ff33ab13700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3200188c0 0x7ff32001adc0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:53.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.593 7ff340e63700 1 -- 172.21.15.120:0/3996062613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c1829e0 con 0x7ff33c0a5050 2021-04-09T18:27:53.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.596 7ff32b7fe700 1 -- 172.21.15.120:0/3996062613 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff330006b00 con 0x7ff33c0a5050 2021-04-09T18:27:53.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.774 7ff340e63700 1 -- 172.21.15.120:0/3996062613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff33c1829e0 con 0x7ff33c0a5050 2021-04-09T18:27:53.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.774 7ff32b7fe700 1 -- 172.21.15.120:0/3996062613 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2107 (secure 0 0 0) 0x7ff330006b00 con 0x7ff33c0a5050 2021-04-09T18:27:53.767 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2021-04-09T18:27:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:27:53.768 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:27:53.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.776 7ff340e63700 1 -- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3200188c0 msgr2=0x7ff32001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:53.771 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.776 7ff340e63700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3200188c0 0x7ff32001adc0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:53.771 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.776 7ff340e63700 1 -- 172.21.15.120:0/3996062613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff33c0a5050 msgr2=0x7ff33c0b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:53.772 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.776 7ff340e63700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff33c0a5050 0x7ff33c0b50f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7ff33000b560 tx=0x7ff33000b900).stop 2021-04-09T18:27:53.772 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.777 7ff340e63700 1 -- 172.21.15.120:0/3996062613 shutdown_connections 2021-04-09T18:27:53.772 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.777 7ff340e63700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff33c0b5710 0x7ff33c1838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:27:53.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.777 7ff340e63700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff33c0a5050 0x7ff33c0b50f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:53.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.777 7ff340e63700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff3200188c0 0x7ff32001adc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:53.774 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.777 7ff340e63700 1 --2- 172.21.15.120:0/3996062613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff33c187670 0x7ff33c0a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:27:53.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.777 7ff340e63700 1 -- 172.21.15.120:0/3996062613 >> 172.21.15.120:0/3996062613 conn(0x7ff33c18dc90 msgr2=0x7ff33c08fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:53.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.777 7ff340e63700 1 -- 172.21.15.120:0/3996062613 shutdown_connections 2021-04-09T18:27:53.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:53.777 7ff340e63700 1 -- 172.21.15.120:0/3996062613 wait complete. 2021-04-09T18:27:53.779 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:27:55.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:55.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.973 7ff086a8d700 1 Processor -- start 2021-04-09T18:27:55.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.973 7ff086a8d700 1 -- start start 2021-04-09T18:27:55.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff086a8d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0800d7160 0x7ff0800e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:55.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff086a8d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff0800d7560 0x7ff0800d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:55.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff086a8d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff0800d5bc0 0x7ff0800d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:55.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff086a8d700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0800d80f0 con 0x7ff0800d5bc0 2021-04-09T18:27:55.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff086a8d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0800d6be0 con 0x7ff0800d7560 2021-04-09T18:27:55.993 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff086a8d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0800e7f00 con 0x7ff0800d7160 2021-04-09T18:27:55.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0850aa700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff0800d5bc0 0x7ff0800d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:55.994 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0850aa700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff0800d5bc0 0x7ff0800d5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57556/0 (socket says 172.21.15.120:57556) 2021-04-09T18:27:55.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0850aa700 1 -- 172.21.15.120:0/4225237624 learned_addr learned my addr 172.21.15.120:0/4225237624 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:55.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff07ffff700 1 --2- 172.21.15.120:0/4225237624 >> v2:172.21.15.134:3300/0 conn(0x7ff0800d7560 0x7ff0800d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:55.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0848a9700 1 --2- 172.21.15.120:0/4225237624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0800d7160 0x7ff0800e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:55.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0850aa700 1 -- 172.21.15.120:0/4225237624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0800d7160 msgr2=0x7ff0800e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:55.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0850aa700 1 --2- 172.21.15.120:0/4225237624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0800d7160 0x7ff0800e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:55.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0850aa700 1 -- 172.21.15.120:0/4225237624 >> v2:172.21.15.134:3300/0 conn(0x7ff0800d7560 msgr2=0x7ff0800d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:55.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0850aa700 1 --2- 172.21.15.120:0/4225237624 >> v2:172.21.15.134:3300/0 conn(0x7ff0800d7560 0x7ff0800d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:55.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0850aa700 1 -- 172.21.15.120:0/4225237624 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0801a2ac0 con 0x7ff0800d5bc0 2021-04-09T18:27:55.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.974 7ff0850aa700 1 --2- 172.21.15.120:0/4225237624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800d5bc0 0x7ff0800d5fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7ff078006f00 tx=0x7ff078009e90).ready entity=mon.0 client_cookie=e696396506cf04db server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:55.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff07f7fe700 1 -- 172.21.15.120:0/4225237624 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff07800b300 con 0x7ff0800d5bc0 2021-04-09T18:27:55.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff07f7fe700 1 -- 172.21.15.120:0/4225237624 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07800b640 con 0x7ff0800d5bc0 2021-04-09T18:27:55.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff07f7fe700 1 -- 172.21.15.120:0/4225237624 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff07800bb20 con 0x7ff0800d5bc0 2021-04-09T18:27:56.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff086a8d700 1 -- 172.21.15.120:0/4225237624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800d5bc0 msgr2=0x7ff0800d5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:56.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff086a8d700 1 --2- 172.21.15.120:0/4225237624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800d5bc0 0x7ff0800d5fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7ff078006f00 tx=0x7ff078009e90).stop 2021-04-09T18:27:56.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff086a8d700 1 -- 172.21.15.120:0/4225237624 shutdown_connections 2021-04-09T18:27:56.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff086a8d700 1 --2- 172.21.15.120:0/4225237624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800d5bc0 0x7ff0800d5fc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff086a8d700 1 --2- 172.21.15.120:0/4225237624 >> v2:172.21.15.134:3300/0 conn(0x7ff0800d7560 0x7ff0800d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff086a8d700 1 --2- 172.21.15.120:0/4225237624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0800d7160 0x7ff0800e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff086a8d700 1 -- 172.21.15.120:0/4225237624 >> 172.21.15.120:0/4225237624 conn(0x7ff0800d1590 msgr2=0x7ff0800d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:56.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff086a8d700 1 -- 172.21.15.120:0/4225237624 shutdown_connections 2021-04-09T18:27:56.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.975 7ff086a8d700 1 -- 172.21.15.120:0/4225237624 wait complete. 2021-04-09T18:27:56.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.994 7ff086a8d700 1 Processor -- start 2021-04-09T18:27:56.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.994 7ff086a8d700 1 -- start start 2021-04-09T18:27:56.005 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff086a8d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff080191390 0x7ff08008ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:56.005 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff086a8d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800b1f70 0x7ff0800b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:56.005 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff086a8d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0801838d0 0x7ff080183cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:56.006 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff086a8d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08008b330 con 0x7ff0800b1f70 2021-04-09T18:27:56.006 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff086a8d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0801842f0 con 0x7ff0801838d0 2021-04-09T18:27:56.007 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff086a8d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff080184510 con 0x7ff080191390 2021-04-09T18:27:56.007 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800b1f70 0x7ff0800b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:56.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800b1f70 0x7ff0800b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57564/0 (socket says 172.21.15.120:57564) 2021-04-09T18:27:56.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07ffff700 1 -- 172.21.15.120:0/404272560 learned_addr learned my addr 172.21.15.120:0/404272560 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:56.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff0848a9700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff080191390 0x7ff08008ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:56.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff0850aa700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0801838d0 0x7ff080183cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:56.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07ffff700 1 -- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff080191390 msgr2=0x7ff08008ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:56.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07ffff700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff080191390 0x7ff08008ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07ffff700 1 -- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0801838d0 msgr2=0x7ff080183cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:56.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07ffff700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0801838d0 0x7ff080183cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.011 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07ffff700 1 -- 172.21.15.120:0/404272560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0800b9ca0 con 0x7ff0800b1f70 2021-04-09T18:27:56.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07ffff700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800b1f70 0x7ff0800b2370 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ff07400b560 tx=0x7ff07400b900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:56.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07d7fa700 1 -- 172.21.15.120:0/404272560 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff07400bcf0 con 0x7ff0800b1f70 2021-04-09T18:27:56.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07d7fa700 1 -- 172.21.15.120:0/404272560 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff074000c90 con 0x7ff0800b1f70 2021-04-09T18:27:56.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff07d7fa700 1 -- 172.21.15.120:0/404272560 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff074002220 con 0x7ff0800b1f70 2021-04-09T18:27:56.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff086a8d700 1 -- 172.21.15.120:0/404272560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0800b9ca0 con 0x7ff0800b1f70 2021-04-09T18:27:56.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.995 7ff086a8d700 1 -- 172.21.15.120:0/404272560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0800b9ca0 con 0x7ff0800b1f70 2021-04-09T18:27:56.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.996 7ff07d7fa700 1 -- 172.21.15.120:0/404272560 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff0740052e0 con 0x7ff0800b1f70 2021-04-09T18:27:56.015 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.996 7ff07d7fa700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff060018930 0x7ff06001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:56.015 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.996 7ff07d7fa700 1 -- 172.21.15.120:0/404272560 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7ff074032ce0 con 0x7ff0800b1f70 2021-04-09T18:27:56.015 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.996 7ff0848a9700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff060018930 0x7ff06001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:56.016 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:55.997 7ff0848a9700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff060018930 0x7ff06001ae10 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:56.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.020 7ff086a8d700 1 -- 172.21.15.120:0/404272560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08018cc10 con 0x7ff0800b1f70 2021-04-09T18:27:56.017 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.023 7ff07d7fa700 1 -- 172.21.15.120:0/404272560 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff074000c90 con 0x7ff0800b1f70 2021-04-09T18:27:56.192 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.200 7ff086a8d700 1 -- 172.21.15.120:0/404272560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff08018cc10 con 0x7ff0800b1f70 2021-04-09T18:27:56.193 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.201 7ff07d7fa700 1 -- 172.21.15.120:0/404272560 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2107 (secure 0 0 0) 0x7ff074006b00 con 0x7ff0800b1f70 2021-04-09T18:27:56.194 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2021-04-09T18:27:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:27:56.195 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:27:56.197 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 -- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff060018930 msgr2=0x7ff06001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:56.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff060018930 0x7ff06001ae10 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 -- 172.21.15.120:0/404272560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800b1f70 msgr2=0x7ff0800b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:56.199 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800b1f70 0x7ff0800b2370 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ff07400b560 tx=0x7ff07400b900).stop 2021-04-09T18:27:56.199 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 -- 172.21.15.120:0/404272560 shutdown_connections 2021-04-09T18:27:56.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0801838d0 0x7ff080183cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0800b1f70 0x7ff0800b2370 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff060018930 0x7ff06001ae10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 --2- 172.21.15.120:0/404272560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff080191390 0x7ff08008ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:56.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 -- 172.21.15.120:0/404272560 >> 172.21.15.120:0/404272560 conn(0x7ff08019a7e0 msgr2=0x7ff080093af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:56.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.203 7ff086a8d700 1 -- 172.21.15.120:0/404272560 shutdown_connections 2021-04-09T18:27:56.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:56.204 7ff086a8d700 1 -- 172.21.15.120:0/404272560 wait complete. 2021-04-09T18:27:56.205 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:27:58.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:27:58.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.400 7f44aa85a700 1 Processor -- start 2021-04-09T18:27:58.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.400 7f44aa85a700 1 -- start start 2021-04-09T18:27:58.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44aa85a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44a40d7160 0x7f44a40e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44aa85a700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a40d6be0 con 0x7f44a40d7560 2021-04-09T18:27:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44aa85a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a40e7f00 con 0x7f44a40e70a0 2021-04-09T18:27:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44aa85a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40d80f0 con 0x7f44a40d7160 2021-04-09T18:27:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f449bfff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f44a40d7560 0x7f44a40d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52486/0 (socket says 172.21.15.120:52486) 2021-04-09T18:27:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f449bfff700 1 -- 172.21.15.120:0/3922244051 learned_addr learned my addr 172.21.15.120:0/3922244051 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:27:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444999425 0 0) 0x7f448c000ce0 con 0x7f44a40d7560 2021-04-09T18:27:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44a3fff700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44a40d7160 0x7f44a40e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4490002fe0 con 0x7f44a40d7560 2021-04-09T18:27:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 969321982 0 0) 0x7f448c0010e0 con 0x7f44a40d7560 2021-04-09T18:27:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44a40d7160 msgr2=0x7f44a40e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.401 7f44a37fe700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44a40d7160 0x7f44a40e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 >> v1:172.21.15.134:6789/0 conn(0x7f44a40e70a0 legacy=0x7f44a40d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a41a2ac0 con 0x7f44a40d7560 2021-04-09T18:27:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f448c001600 con 0x7f44a40d7560 2021-04-09T18:27:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 >> v1:172.21.15.120:6789/0 conn(0x7f44a40d7560 legacy=0x7f44a40d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4490003a40 0x7f4490005eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4490006730 0x7f4490008c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:58.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44900094f0 0x7f449000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:58.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449000c2c0 con 0x7f4490006730 2021-04-09T18:27:58.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449000c4e0 con 0x7f44900094f0 2021-04-09T18:27:58.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4490050710 con 0x7f4490003a40 2021-04-09T18:27:58.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f449bfff700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4490006730 0x7f4490008c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:58.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a3fff700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4490003a40 0x7f4490005eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:58.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a8e77700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44900094f0 0x7f449000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:58.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f449bfff700 1 -- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4490003a40 msgr2=0x7f4490005eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:58.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f449bfff700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4490003a40 0x7f4490005eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f449bfff700 1 -- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44900094f0 msgr2=0x7f449000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:27:58.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f449bfff700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44900094f0 0x7f449000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f449bfff700 1 -- 172.21.15.120:0/3922244051 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490050970 con 0x7f4490006730 2021-04-09T18:27:58.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a8e77700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44900094f0 0x7f449000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:27:58.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f449bfff700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4490006730 0x7f4490008c50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f448c0014c0 tx=0x7f448c007d20).ready entity=mon.0 client_cookie=f377d6f333a688c3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:58.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f448c0070c0 con 0x7f4490006730 2021-04-09T18:27:58.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c001600 con 0x7f4490006730 2021-04-09T18:27:58.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a37fe700 1 -- 172.21.15.120:0/3922244051 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f448c0010e0 con 0x7f4490006730 2021-04-09T18:27:58.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44aa85a700 1 -- 172.21.15.120:0/3922244051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4490006730 msgr2=0x7f4490008c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:58.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44aa85a700 1 --2- 172.21.15.120:0/3922244051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4490006730 0x7f4490008c50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f448c0014c0 tx=0x7f448c007d20).stop 2021-04-09T18:27:58.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.402 7f44a8e77700 1 -- 172.21.15.120:0/3922244051 reap_dead start 2021-04-09T18:27:58.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.403 7f44aa85a700 1 -- 172.21.15.120:0/3922244051 shutdown_connections 2021-04-09T18:27:58.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.403 7f44aa85a700 1 -- 172.21.15.120:0/3922244051 >> 172.21.15.120:0/3922244051 conn(0x7f44a40d1590 msgr2=0x7f44a40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:58.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.403 7f44aa85a700 1 -- 172.21.15.120:0/3922244051 shutdown_connections 2021-04-09T18:27:58.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.403 7f44aa85a700 1 -- 172.21.15.120:0/3922244051 wait complete. 2021-04-09T18:27:58.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.422 7f44aa85a700 1 Processor -- start 2021-04-09T18:27:58.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.422 7f44aa85a700 1 -- start start 2021-04-09T18:27:58.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.422 7f44aa85a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a4187380 0x7f44a4189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:58.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44aa85a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4187780 0x7f44a40987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:58.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44aa85a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44a4189c50 0x7f44a40b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:58.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44aa85a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a418ce60 con 0x7f44a4187380 2021-04-09T18:27:58.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44aa85a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4098e10 con 0x7f44a4187780 2021-04-09T18:27:58.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44aa85a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4099030 con 0x7f44a4189c50 2021-04-09T18:27:58.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a4187380 0x7f44a4189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:58.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a4187380 0x7f44a4189630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57586/0 (socket says 172.21.15.120:57586) 2021-04-09T18:27:58.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a3fff700 1 -- 172.21.15.120:0/3948287762 learned_addr learned my addr 172.21.15.120:0/3948287762 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:27:58.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a8e77700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44a4189c50 0x7f44a40b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:58.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f449bfff700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4187780 0x7f44a40987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:58.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a3fff700 1 -- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44a4189c50 msgr2=0x7f44a40b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:58.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a3fff700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44a4189c50 0x7f44a40b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a3fff700 1 -- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4187780 msgr2=0x7f44a40987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:58.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a3fff700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4187780 0x7f44a40987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a3fff700 1 -- 172.21.15.120:0/3948287762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40b8b30 con 0x7f44a4187380 2021-04-09T18:27:58.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a3fff700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a4187380 0x7f44a4189630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f449400b560 tx=0x7f449400b900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:58.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a17fa700 1 -- 172.21.15.120:0/3948287762 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f449400bcf0 con 0x7f44a4187380 2021-04-09T18:27:58.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a17fa700 1 -- 172.21.15.120:0/3948287762 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4494000c90 con 0x7f44a4187380 2021-04-09T18:27:58.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a40b8b30 con 0x7f44a4187380 2021-04-09T18:27:58.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44a17fa700 1 -- 172.21.15.120:0/3948287762 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4494002220 con 0x7f44a4187380 2021-04-09T18:27:58.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.423 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a40b8b30 con 0x7f44a4187380 2021-04-09T18:27:58.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.424 7f44a17fa700 1 -- 172.21.15.120:0/3948287762 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f449400a000 con 0x7f44a4187380 2021-04-09T18:27:58.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.424 7f44a17fa700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 0x7f448801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:27:58.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.424 7f44a17fa700 1 -- 172.21.15.120:0/3948287762 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6279+0+0 (secure 0 0 0) 0x7f4494032cd0 con 0x7f44a4187380 2021-04-09T18:27:58.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.424 7f449bfff700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 0x7f448801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:58.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.424 7f449bfff700 1 -- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 msgr2=0x7f448801ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-04-09T18:27:58.432 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.424 7f449bfff700 1 -- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 msgr2=0x7f448801ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:27:58.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.424 7f449bfff700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 0x7f448801ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:27:58.433 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.424 7f449bfff700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 0x7f448801ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-04-09T18:27:58.438 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.447 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a4189100 con 0x7f44a4187380 2021-04-09T18:27:58.441 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.450 7f44a17fa700 1 -- 172.21.15.120:0/3948287762 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4494000c90 con 0x7f44a4187380 2021-04-09T18:27:58.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.625 7f449bfff700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 0x7f448801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:27:58.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.625 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44a4189100 con 0x7f44a4187380 2021-04-09T18:27:58.617 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.625 7f449bfff700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 0x7f448801ae10 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:27:58.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.626 7f44a17fa700 1 -- 172.21.15.120:0/3948287762 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f449400a000 con 0x7f44a4187380 2021-04-09T18:27:58.618 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2021-04-09T18:27:58.619 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:27:58.619 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:26:11.578163","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4718":{"gid":4718,"name":"b","rank":0,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.134:6835/497894564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":497894564},{"type":"v1","addr":"172.21.15.134:6835","nonce":497894564}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:27:58.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 msgr2=0x7f448801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:58.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 0x7f448801ae10 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a4187380 msgr2=0x7f44a4189630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:27:58.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a4187380 0x7f44a4189630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f449400b560 tx=0x7f449400b900).stop 2021-04-09T18:27:58.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 shutdown_connections 2021-04-09T18:27:58.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4488018930 0x7f448801ae10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44a4189c50 0x7f44a40b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a4187780 0x7f44a40987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 --2- 172.21.15.120:0/3948287762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a4187380 0x7f44a4189630 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:27:58.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 >> 172.21.15.120:0/3948287762 conn(0x7f44a418dc90 msgr2=0x7f44a408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:27:58.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 shutdown_connections 2021-04-09T18:27:58.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:27:58.628 7f44aa85a700 1 -- 172.21.15.120:0/3948287762 wait complete. 2021-04-09T18:27:58.629 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:28:00.631 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:00.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.820 7fb3ad175700 1 Processor -- start 2021-04-09T18:28:00.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.820 7fb3ad175700 1 -- start start 2021-04-09T18:28:00.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.821 7fb3ad175700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a80d7560 0x7fb3a80d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:00.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.821 7fb3ad175700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a80d7960 con 0x7fb3a80d7160 2021-04-09T18:28:00.843 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.821 7fb3ad175700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a80d6be0 con 0x7fb3a80d63b0 2021-04-09T18:28:00.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.821 7fb3ad175700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81a2ac0 con 0x7fb3a80d7560 2021-04-09T18:28:00.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.821 7fb3a6d9d700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb3a80d7160 0x7fb3a80d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52518/0 (socket says 172.21.15.120:52518) 2021-04-09T18:28:00.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.821 7fb3a6d9d700 1 -- 172.21.15.120:0/323283220 learned_addr learned my addr 172.21.15.120:0/323283220 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:00.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.821 7fb3a659c700 1 -- 172.21.15.120:0/323283220 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365867878 0 0) 0x7fb398000ce0 con 0x7fb3a80d7160 2021-04-09T18:28:00.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb388002fe0 con 0x7fb3a80d7160 2021-04-09T18:28:00.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2887458252 0 0) 0x7fb3980010e0 con 0x7fb3a80d7160 2021-04-09T18:28:00.845 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a80d7560 msgr2=0x7fb3a80d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:00.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb39ffff700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a80d7560 0x7fb3a80d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:00.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a80d7560 0x7fb3a80d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:00.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 >> v1:172.21.15.134:6789/0 conn(0x7fb3a80d63b0 legacy=0x7fb3a81ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:00.846 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a81a2cb0 con 0x7fb3a80d7160 2021-04-09T18:28:00.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7fb398001600 con 0x7fb3a80d7160 2021-04-09T18:28:00.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 >> v1:172.21.15.120:6789/0 conn(0x7fb3a80d7160 legacy=0x7fb3a80d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:00.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb388003af0 0x7fb388005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:00.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb388006840 0x7fb388008d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:00.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3880095b0 0x7fb38800bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:00.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38800c380 con 0x7fb388003af0 2021-04-09T18:28:00.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38800c5a0 con 0x7fb3880095b0 2021-04-09T18:28:00.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a659c700 1 -- 172.21.15.120:0/323283220 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38800c7c0 con 0x7fb388006840 2021-04-09T18:28:00.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb39ffff700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a80d7560 0x7fb3a80d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:28:00.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a6d9d700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb388003af0 0x7fb388005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:00.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a759e700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3880095b0 0x7fb38800bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:00.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb39ffff700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb388006840 0x7fb388008d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:00.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a6d9d700 1 -- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb388006840 msgr2=0x7fb388008d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:00.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a6d9d700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb388006840 0x7fb388008d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:00.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a6d9d700 1 -- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3880095b0 msgr2=0x7fb38800bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:00.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a6d9d700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3880095b0 0x7fb38800bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:00.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a6d9d700 1 -- 172.21.15.120:0/323283220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38800ca60 con 0x7fb388003af0 2021-04-09T18:28:00.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb39ffff700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb388006840 0x7fb388008d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:00.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.822 7fb3a759e700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3880095b0 0x7fb38800bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:00.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.823 7fb3a6d9d700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb388003af0 0x7fb388005fa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fb3980017a0 tx=0x7fb398007d10).ready entity=mon.0 client_cookie=537d9cf969a468dc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:00.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.823 7fb3a659c700 1 -- 172.21.15.120:0/323283220 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3980010e0 con 0x7fb388003af0 2021-04-09T18:28:00.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.823 7fb3a659c700 1 -- 172.21.15.120:0/323283220 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3980070d0 con 0x7fb388003af0 2021-04-09T18:28:00.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.823 7fb3a659c700 1 -- 172.21.15.120:0/323283220 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb398004590 con 0x7fb388003af0 2021-04-09T18:28:00.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.823 7fb3ad175700 1 -- 172.21.15.120:0/323283220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb388003af0 msgr2=0x7fb388005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:00.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.823 7fb3ad175700 1 --2- 172.21.15.120:0/323283220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb388003af0 0x7fb388005fa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fb3980017a0 tx=0x7fb398007d10).stop 2021-04-09T18:28:00.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.824 7fb3a759e700 1 -- 172.21.15.120:0/323283220 reap_dead start 2021-04-09T18:28:00.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.824 7fb3ad175700 1 -- 172.21.15.120:0/323283220 shutdown_connections 2021-04-09T18:28:00.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.824 7fb3ad175700 1 -- 172.21.15.120:0/323283220 >> 172.21.15.120:0/323283220 conn(0x7fb3a80d1590 msgr2=0x7fb3a80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:00.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.824 7fb3ad175700 1 -- 172.21.15.120:0/323283220 shutdown_connections 2021-04-09T18:28:00.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.824 7fb3ad175700 1 -- 172.21.15.120:0/323283220 wait complete. 2021-04-09T18:28:00.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.846 7fb3ad175700 1 Processor -- start 2021-04-09T18:28:00.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.846 7fb3ad175700 1 -- start start 2021-04-09T18:28:00.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3ad175700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3a8187380 0x7fb3a819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:00.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3ad175700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a8187780 0x7fb3a819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:00.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3ad175700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a819b5a0 0x7fb3a81838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:00.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3ad175700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a819c920 con 0x7fb3a8187380 2021-04-09T18:28:00.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3ad175700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a819b9a0 con 0x7fb3a8187780 2021-04-09T18:28:00.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3ad175700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a8183ef0 con 0x7fb3a819b5a0 2021-04-09T18:28:00.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3a6d9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3a8187380 0x7fb3a819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:00.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3a6d9d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3a8187380 0x7fb3a819c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57622/0 (socket says 172.21.15.120:57622) 2021-04-09T18:28:00.855 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3a6d9d700 1 -- 172.21.15.120:0/1831250558 learned_addr learned my addr 172.21.15.120:0/1831250558 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:00.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3a759e700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a819b5a0 0x7fb3a81838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:00.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb39ffff700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a8187780 0x7fb3a819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:00.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3a6d9d700 1 -- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a819b5a0 msgr2=0x7fb3a81838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:00.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3a6d9d700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a819b5a0 0x7fb3a81838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:00.856 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3a6d9d700 1 -- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a8187780 msgr2=0x7fb3a819af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:00.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3a6d9d700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a8187780 0x7fb3a819af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:00.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.847 7fb3a6d9d700 1 -- 172.21.15.120:0/1831250558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8184110 con 0x7fb3a8187380 2021-04-09T18:28:00.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.848 7fb3a6d9d700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3a8187380 0x7fb3a819c300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fb398007f40 tx=0x7fb39804f8c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:00.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.848 7fb39f7fe700 1 -- 172.21.15.120:0/1831250558 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb39804fcb0 con 0x7fb3a8187380 2021-04-09T18:28:00.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.848 7fb39f7fe700 1 -- 172.21.15.120:0/1831250558 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb398050070 con 0x7fb3a8187380 2021-04-09T18:28:00.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.848 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a8184110 con 0x7fb3a8187380 2021-04-09T18:28:00.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.848 7fb39f7fe700 1 -- 172.21.15.120:0/1831250558 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3980504c0 con 0x7fb3a8187380 2021-04-09T18:28:00.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.848 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a8184110 con 0x7fb3a8187380 2021-04-09T18:28:00.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.848 7fb39f7fe700 1 -- 172.21.15.120:0/1831250558 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb3980043a0 con 0x7fb3a8187380 2021-04-09T18:28:00.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.849 7fb39f7fe700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb380018930 0x7fb38001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:00.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.849 7fb39f7fe700 1 -- 172.21.15.120:0/1831250558 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fb398076d90 con 0x7fb3a8187380 2021-04-09T18:28:00.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.849 7fb39ffff700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb380018930 0x7fb38001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:00.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.849 7fb39ffff700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb380018930 0x7fb38001ae10 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:00.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.864 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb384002fd0 con 0x7fb3a8187380 2021-04-09T18:28:00.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:00.868 7fb39f7fe700 1 -- 172.21.15.120:0/1831250558 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb3980070d0 con 0x7fb3a8187380 2021-04-09T18:28:01.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.067 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb384002de0 con 0x7fb3a8187380 2021-04-09T18:28:01.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.068 7fb39f7fe700 1 -- 172.21.15.120:0/1831250558 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+1770 (secure 0 0 0) 0x7fb3980043a0 con 0x7fb3a8187380 2021-04-09T18:28:01.060 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 31 2021-04-09T18:28:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:01.061 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:00.800836","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:01.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb380018930 msgr2=0x7fb38001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb380018930 0x7fb38001ae10 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3a8187380 msgr2=0x7fb3a819c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3a8187380 0x7fb3a819c300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fb398007f40 tx=0x7fb39804f8c0).stop 2021-04-09T18:28:01.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 shutdown_connections 2021-04-09T18:28:01.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb380018930 0x7fb38001ae10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3a819b5a0 0x7fb3a81838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a8187780 0x7fb3a819af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 --2- 172.21.15.120:0/1831250558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3a8187380 0x7fb3a819c300 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 >> 172.21.15.120:0/1831250558 conn(0x7fb3a818dc90 msgr2=0x7fb3a808fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:01.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 shutdown_connections 2021-04-09T18:28:01.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.071 7fb3ad175700 1 -- 172.21.15.120:0/1831250558 wait complete. 2021-04-09T18:28:01.072 INFO:tasks.mds_thrash.fs.[None]:mds.b down, removed from mdsmap 2021-04-09T18:28:01.073 INFO:tasks.mds_thrash.fs.[None]:waiting for mds cluster to stabilize... 2021-04-09T18:28:01.073 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:01.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.262 7f2588b21700 1 Processor -- start 2021-04-09T18:28:01.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.262 7f2588b21700 1 -- start start 2021-04-09T18:28:01.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.262 7f2588b21700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f25840dc6b0 0x7f25840d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:01.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.262 7f2588b21700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840d61e0 con 0x7f25840eac40 2021-04-09T18:28:01.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.262 7f2588b21700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840dcab0 con 0x7f25840d6760 2021-04-09T18:28:01.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.262 7f2588b21700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2584100d60 con 0x7f25840dc6b0 2021-04-09T18:28:01.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.262 7f258285e700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f25840eac40 0x7f2584088000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52542/0 (socket says 172.21.15.120:52542) 2021-04-09T18:28:01.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.262 7f258285e700 1 -- 172.21.15.120:0/1259600159 learned_addr learned my addr 172.21.15.120:0/1259600159 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:01.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258205d700 1 --2- 172.21.15.120:0/1259600159 >> v2:172.21.15.134:3300/0 conn(0x7f25840dc6b0 0x7f25840d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:01.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258185c700 1 -- 172.21.15.120:0/1259600159 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515900464 0 0) 0x7f2574001060 con 0x7f25840eac40 2021-04-09T18:28:01.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258185c700 1 -- 172.21.15.120:0/1259600159 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2570002fe0 con 0x7f25840eac40 2021-04-09T18:28:01.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258185c700 1 -- 172.21.15.120:0/1259600159 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689689173 0 0) 0x7f257c0009b0 con 0x7f25840d6760 2021-04-09T18:28:01.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258185c700 1 -- 172.21.15.120:0/1259600159 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2570003210 con 0x7f25840d6760 2021-04-09T18:28:01.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258205d700 1 -- 172.21.15.120:0/1259600159 >> v1:172.21.15.134:6789/0 conn(0x7f25840d6760 legacy=0x7f25840d5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258205d700 1 -- 172.21.15.120:0/1259600159 >> v1:172.21.15.120:6789/0 conn(0x7f25840eac40 legacy=0x7f2584088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258205d700 1 -- 172.21.15.120:0/1259600159 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25840d0ee0 con 0x7f25840dc6b0 2021-04-09T18:28:01.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258205d700 1 --2- 172.21.15.120:0/1259600159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25840dc6b0 0x7f25840d1b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f256c006650 tx=0x7f256c009a80).ready entity=mon.1 client_cookie=cae3c6d7b49b2165 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:01.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258185c700 1 -- 172.21.15.120:0/1259600159 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f256c0009b0 con 0x7f25840dc6b0 2021-04-09T18:28:01.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258185c700 1 -- 172.21.15.120:0/1259600159 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c00c0c0 con 0x7f25840dc6b0 2021-04-09T18:28:01.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f258185c700 1 -- 172.21.15.120:0/1259600159 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f256c0009b0 con 0x7f25840dc6b0 2021-04-09T18:28:01.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f2588b21700 1 -- 172.21.15.120:0/1259600159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25840dc6b0 msgr2=0x7f25840d1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.263 7f2588b21700 1 --2- 172.21.15.120:0/1259600159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25840dc6b0 0x7f25840d1b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f256c006650 tx=0x7f256c009a80).stop 2021-04-09T18:28:01.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.264 7f2588b21700 1 -- 172.21.15.120:0/1259600159 shutdown_connections 2021-04-09T18:28:01.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.264 7f2588b21700 1 --2- 172.21.15.120:0/1259600159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25840dc6b0 0x7f25840d1b40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.264 7f2588b21700 1 -- 172.21.15.120:0/1259600159 >> 172.21.15.120:0/1259600159 conn(0x7f25840e93c0 msgr2=0x7f2584100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:01.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.264 7f2588b21700 1 -- 172.21.15.120:0/1259600159 shutdown_connections 2021-04-09T18:28:01.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.264 7f2588b21700 1 -- 172.21.15.120:0/1259600159 wait complete. 2021-04-09T18:28:01.284 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.284 7f2588b21700 1 Processor -- start 2021-04-09T18:28:01.284 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.284 7f2588b21700 1 -- start start 2021-04-09T18:28:01.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f2588b21700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f258418b580 0x7f25841a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:01.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f2588b21700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f258418b980 0x7f25841a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:01.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f2588b21700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25841a6ed0 0x7f2584189280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:01.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f2588b21700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258418d220 con 0x7f258418b580 2021-04-09T18:28:01.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f2588b21700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258418b000 con 0x7f25841a6ed0 2021-04-09T18:28:01.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f2588b21700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258418cd60 con 0x7f258418b980 2021-04-09T18:28:01.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258285e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f258418b580 0x7f25841a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:01.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258285e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f258418b580 0x7f25841a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57636/0 (socket says 172.21.15.120:57636) 2021-04-09T18:28:01.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258285e700 1 -- 172.21.15.120:0/858210860 learned_addr learned my addr 172.21.15.120:0/858210860 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:01.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258205d700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f258418b980 0x7f25841a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:01.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258305f700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25841a6ed0 0x7f2584189280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:01.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258285e700 1 -- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f258418b980 msgr2=0x7f25841a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258285e700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f258418b980 0x7f25841a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258285e700 1 -- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25841a6ed0 msgr2=0x7f2584189280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258285e700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25841a6ed0 0x7f2584189280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258285e700 1 -- 172.21.15.120:0/858210860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25841a72d0 con 0x7f258418b580 2021-04-09T18:28:01.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f258285e700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f258418b580 0x7f25841a6290 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f257400a880 tx=0x7f257400ac20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:01.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.285 7f257b7fe700 1 -- 172.21.15.120:0/858210860 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2574001270 con 0x7f258418b580 2021-04-09T18:28:01.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.286 7f257b7fe700 1 -- 172.21.15.120:0/858210860 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25740070d0 con 0x7f258418b580 2021-04-09T18:28:01.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.286 7f257b7fe700 1 -- 172.21.15.120:0/858210860 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2574004720 con 0x7f258418b580 2021-04-09T18:28:01.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.286 7f2588b21700 1 -- 172.21.15.120:0/858210860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25841a72d0 con 0x7f258418b580 2021-04-09T18:28:01.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.286 7f2588b21700 1 -- 172.21.15.120:0/858210860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25841a72d0 con 0x7f258418b580 2021-04-09T18:28:01.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.287 7f257b7fe700 1 -- 172.21.15.120:0/858210860 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f257400ad60 con 0x7f258418b580 2021-04-09T18:28:01.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.287 7f257b7fe700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f25680188c0 0x7f256801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:01.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.287 7f257b7fe700 1 -- 172.21.15.120:0/858210860 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f2574032e00 con 0x7f258418b580 2021-04-09T18:28:01.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.287 7f258205d700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f25680188c0 0x7f256801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:01.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.288 7f258205d700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f25680188c0 0x7f256801adc0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.307 7f2588b21700 1 -- 172.21.15.120:0/858210860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258418d1d0 con 0x7f258418b580 2021-04-09T18:28:01.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.311 7f257b7fe700 1 -- 172.21.15.120:0/858210860 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2574007cb0 con 0x7f258418b580 2021-04-09T18:28:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.498 7f2588b21700 1 -- 172.21.15.120:0/858210860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f258418d1d0 con 0x7f258418b580 2021-04-09T18:28:01.491 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.499 7f257b7fe700 1 -- 172.21.15.120:0/858210860 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f257400ad60 con 0x7f258418b580 2021-04-09T18:28:01.492 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 31 2021-04-09T18:28:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:01.493 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:00.800836","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:01.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 -- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f25680188c0 msgr2=0x7f256801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f25680188c0 0x7f256801adc0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 -- 172.21.15.120:0/858210860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f258418b580 msgr2=0x7f25841a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f258418b580 0x7f25841a6290 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f257400a880 tx=0x7f257400ac20).stop 2021-04-09T18:28:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 -- 172.21.15.120:0/858210860 shutdown_connections 2021-04-09T18:28:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25841a6ed0 0x7f2584189280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f25680188c0 0x7f256801adc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f258418b980 0x7f25841a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 --2- 172.21.15.120:0/858210860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f258418b580 0x7f25841a6290 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:01.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 -- 172.21.15.120:0/858210860 >> 172.21.15.120:0/858210860 conn(0x7f25840948b0 msgr2=0x7f2584088760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:01.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 -- 172.21.15.120:0/858210860 shutdown_connections 2021-04-09T18:28:01.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:01.502 7f2588b21700 1 -- 172.21.15.120:0/858210860 wait complete. 2021-04-09T18:28:01.504 INFO:tasks.mds_thrash.fs.[None]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 31, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-04-09 18:19:55.049244", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 31, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5028": { "addr": "172.21.15.120:6833/4282122355", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 4282122355, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 4282122355, "type": "v1" } ] }, "export_targets": [], "features": 4611087854035861503, "flags": 0, "gid": 5028, "incarnation": 31, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 27, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "-1 (unspecified)", "modified": "2021-04-09 18:28:00.800836", "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5028 } } } ], "standbys": [] } 2021-04-09T18:28:03.505 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:03.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.693 7f0844023700 1 Processor -- start 2021-04-09T18:28:03.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.693 7f0844023700 1 -- start start 2021-04-09T18:28:03.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.693 7f0844023700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f083c0d7160 0x7f083c0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:03.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0844023700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0d55a0 0x7f083c0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:03.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0844023700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083c0d6be0 con 0x7f083c0d5fc0 2021-04-09T18:28:03.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0844023700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083c0d80f0 con 0x7f083c0d7160 2021-04-09T18:28:03.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0844023700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c1a2ac0 con 0x7f083c0d55a0 2021-04-09T18:28:03.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0841e3f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f083c0d7160 0x7f083c0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:03.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0841e3f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f083c0d7160 0x7f083c0d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57646/0 (socket says 172.21.15.120:57646) 2021-04-09T18:28:03.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0842640700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f083c0d5fc0 0x7f083c0d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52562/0 (socket says 172.21.15.120:52562) 2021-04-09T18:28:03.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0841e3f700 1 -- 172.21.15.120:0/2273904515 learned_addr learned my addr 172.21.15.120:0/2273904515 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:03.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f084163e700 1 --2- 172.21.15.120:0/2273904515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0d55a0 0x7f083c0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:03.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0841e3f700 1 -- 172.21.15.120:0/2273904515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0d55a0 msgr2=0x7f083c0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:03.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0841e3f700 1 --2- 172.21.15.120:0/2273904515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0d55a0 0x7f083c0d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0841e3f700 1 -- 172.21.15.120:0/2273904515 >> v1:172.21.15.120:6789/0 conn(0x7f083c0d5fc0 legacy=0x7f083c0d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:03.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0840e3d700 1 -- 172.21.15.120:0/2273904515 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426697968 0 0) 0x7f08340009b0 con 0x7f083c0d5fc0 2021-04-09T18:28:03.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0841e3f700 1 -- 172.21.15.120:0/2273904515 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c1a2cb0 con 0x7f083c0d7160 2021-04-09T18:28:03.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0841e3f700 1 --2- 172.21.15.120:0/2273904515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c0d7160 0x7f083c0d7560 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f0838006a80 tx=0x7f0838009e80).ready entity=mon.0 client_cookie=d105488d9faac84b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:03.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0840e3d700 1 -- 172.21.15.120:0/2273904515 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f083800b510 con 0x7f083c0d7160 2021-04-09T18:28:03.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0840e3d700 1 -- 172.21.15.120:0/2273904515 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083800b7d0 con 0x7f083c0d7160 2021-04-09T18:28:03.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.694 7f0840e3d700 1 -- 172.21.15.120:0/2273904515 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f083800bcb0 con 0x7f083c0d7160 2021-04-09T18:28:03.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.695 7f0844023700 1 -- 172.21.15.120:0/2273904515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c0d7160 msgr2=0x7f083c0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:03.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.695 7f0844023700 1 --2- 172.21.15.120:0/2273904515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c0d7160 0x7f083c0d7560 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f0838006a80 tx=0x7f0838009e80).stop 2021-04-09T18:28:03.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.695 7f0844023700 1 -- 172.21.15.120:0/2273904515 shutdown_connections 2021-04-09T18:28:03.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.695 7f0844023700 1 --2- 172.21.15.120:0/2273904515 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0d55a0 0x7f083c0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.695 7f0844023700 1 --2- 172.21.15.120:0/2273904515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c0d7160 0x7f083c0d7560 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.695 7f0844023700 1 -- 172.21.15.120:0/2273904515 >> 172.21.15.120:0/2273904515 conn(0x7f083c0d1590 msgr2=0x7f083c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:03.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.696 7f0844023700 1 -- 172.21.15.120:0/2273904515 shutdown_connections 2021-04-09T18:28:03.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.696 7f0844023700 1 -- 172.21.15.120:0/2273904515 wait complete. 2021-04-09T18:28:03.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.730 7f0844023700 1 Processor -- start 2021-04-09T18:28:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.730 7f0844023700 1 -- start start 2021-04-09T18:28:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f0844023700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083c1830d0 0x7f083c0915f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f0844023700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c1837a0 0x7f083c183ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f0844023700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0ab8d0 0x7f083c0abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f0844023700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c091070 con 0x7f083c1837a0 2021-04-09T18:28:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f0844023700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c090d30 con 0x7f083c1830d0 2021-04-09T18:28:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f0844023700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c091c10 con 0x7f083c0ab8d0 2021-04-09T18:28:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f084163e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c1837a0 0x7f083c183ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f084163e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c1837a0 0x7f083c183ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57652/0 (socket says 172.21.15.120:57652) 2021-04-09T18:28:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f084163e700 1 -- 172.21.15.120:0/2498992016 learned_addr learned my addr 172.21.15.120:0/2498992016 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f0842640700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0ab8d0 0x7f083c0abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.731 7f0841e3f700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083c1830d0 0x7f083c0915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f084163e700 1 -- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0ab8d0 msgr2=0x7f083c0abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f084163e700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0ab8d0 0x7f083c0abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f084163e700 1 -- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083c1830d0 msgr2=0x7f083c0915f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f084163e700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083c1830d0 0x7f083c0915f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f084163e700 1 -- 172.21.15.120:0/2498992016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c1841c0 con 0x7f083c1837a0 2021-04-09T18:28:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f0842640700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0ab8d0 0x7f083c0abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f0841e3f700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083c1830d0 0x7f083c0915f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f084163e700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c1837a0 0x7f083c183ba0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f082c006f60 tx=0x7f082c009b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f08327fc700 1 -- 172.21.15.120:0/2498992016 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f082c00a070 con 0x7f083c1837a0 2021-04-09T18:28:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f08327fc700 1 -- 172.21.15.120:0/2498992016 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c00a330 con 0x7f083c1837a0 2021-04-09T18:28:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f08327fc700 1 -- 172.21.15.120:0/2498992016 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f082c00a810 con 0x7f083c1837a0 2021-04-09T18:28:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f0844023700 1 -- 172.21.15.120:0/2498992016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083c1841c0 con 0x7f083c1837a0 2021-04-09T18:28:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.732 7f0844023700 1 -- 172.21.15.120:0/2498992016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c0ac5e0 con 0x7f083c1837a0 2021-04-09T18:28:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.734 7f08327fc700 1 -- 172.21.15.120:0/2498992016 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f082c0052e0 con 0x7f083c1837a0 2021-04-09T18:28:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.734 7f08327fc700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f08240188c0 0x7f082401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.734 7f08327fc700 1 -- 172.21.15.120:0/2498992016 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f082c032ab0 con 0x7f083c1837a0 2021-04-09T18:28:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.734 7f0841e3f700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f08240188c0 0x7f082401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.734 7f0841e3f700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f08240188c0 0x7f082401adc0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.739 7f0844023700 1 -- 172.21.15.120:0/2498992016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083c17a2b0 con 0x7f083c1837a0 2021-04-09T18:28:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.745 7f08327fc700 1 -- 172.21.15.120:0/2498992016 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f082c000940 con 0x7f083c1837a0 2021-04-09T18:28:03.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.929 7f0844023700 1 -- 172.21.15.120:0/2498992016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f083c17a2b0 con 0x7f083c1837a0 2021-04-09T18:28:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.929 7f08327fc700 1 -- 172.21.15.120:0/2498992016 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f082c0052e0 con 0x7f083c1837a0 2021-04-09T18:28:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 31 2021-04-09T18:28:03.922 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:03.922 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:00.800836","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:03.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 -- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f08240188c0 msgr2=0x7f082401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:03.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f08240188c0 0x7f082401adc0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 -- 172.21.15.120:0/2498992016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c1837a0 msgr2=0x7f083c183ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:03.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c1837a0 0x7f083c183ba0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f082c006f60 tx=0x7f082c009b60).stop 2021-04-09T18:28:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 -- 172.21.15.120:0/2498992016 shutdown_connections 2021-04-09T18:28:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f08240188c0 0x7f082401adc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f083c0ab8d0 0x7f083c0abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f083c1837a0 0x7f083c183ba0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 --2- 172.21.15.120:0/2498992016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083c1830d0 0x7f083c0915f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 -- 172.21.15.120:0/2498992016 >> 172.21.15.120:0/2498992016 conn(0x7f083c185580 msgr2=0x7f083c188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 -- 172.21.15.120:0/2498992016 shutdown_connections 2021-04-09T18:28:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:03.932 7f0844023700 1 -- 172.21.15.120:0/2498992016 wait complete. 2021-04-09T18:28:03.933 INFO:tasks.mds_thrash.fs.[None]:no change 2021-04-09T18:28:05.789 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:05.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:05.935 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:06.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.145 7f59552df700 1 Processor -- start 2021-04-09T18:28:06.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.145 7f59552df700 1 -- start start 2021-04-09T18:28:06.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.145 7f59552df700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f59500d7160 0x7f59500d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.145 7f59552df700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f59500d6190 0x7f59500d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f59552df700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59500d6be0 con 0x7f59500d55a0 2021-04-09T18:28:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f59552df700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59500d80f0 con 0x7f59500d6190 2021-04-09T18:28:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f59552df700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59501a2ac0 con 0x7f59500d7160 2021-04-09T18:28:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594f87e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f59500d6190 0x7f59500d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594e87c700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f59500d55a0 0x7f59500d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52584/0 (socket says 172.21.15.120:52584) 2021-04-09T18:28:06.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594f87e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f59500d6190 0x7f59500d6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57676/0 (socket says 172.21.15.120:57676) 2021-04-09T18:28:06.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594e87c700 1 -- 172.21.15.120:0/811921886 learned_addr learned my addr 172.21.15.120:0/811921886 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:06.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594f07d700 1 --2- 172.21.15.120:0/811921886 >> v2:172.21.15.134:3300/0 conn(0x7f59500d7160 0x7f59500d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594e07b700 1 -- 172.21.15.120:0/811921886 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437244233 0 0) 0x7f5938000ce0 con 0x7f59500d55a0 2021-04-09T18:28:06.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594f87e700 1 -- 172.21.15.120:0/811921886 >> v2:172.21.15.134:3300/0 conn(0x7f59500d7160 msgr2=0x7f59500d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:06.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594f87e700 1 --2- 172.21.15.120:0/811921886 >> v2:172.21.15.134:3300/0 conn(0x7f59500d7160 0x7f59500d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594f87e700 1 -- 172.21.15.120:0/811921886 >> v1:172.21.15.120:6789/0 conn(0x7f59500d55a0 legacy=0x7f59500d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594f87e700 1 -- 172.21.15.120:0/811921886 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59501ac1f0 con 0x7f59500d6190 2021-04-09T18:28:06.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594f07d700 1 --2- 172.21.15.120:0/811921886 >> v2:172.21.15.134:3300/0 conn(0x7f59500d7160 0x7f59500d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:06.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.146 7f594f87e700 1 --2- 172.21.15.120:0/811921886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59500d6190 0x7f59500d6590 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f5948006e30 tx=0x7f5948009e60).ready entity=mon.0 client_cookie=733162f491eb7694 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:06.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.148 7f594e07b700 1 -- 172.21.15.120:0/811921886 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5948006a50 con 0x7f59500d6190 2021-04-09T18:28:06.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.148 7f594e07b700 1 -- 172.21.15.120:0/811921886 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594800b300 con 0x7f59500d6190 2021-04-09T18:28:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.148 7f594e07b700 1 -- 172.21.15.120:0/811921886 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f594800b760 con 0x7f59500d6190 2021-04-09T18:28:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.148 7f59552df700 1 -- 172.21.15.120:0/811921886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59500d6190 msgr2=0x7f59500d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.148 7f59552df700 1 --2- 172.21.15.120:0/811921886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59500d6190 0x7f59500d6590 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f5948006e30 tx=0x7f5948009e60).stop 2021-04-09T18:28:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.149 7f59552df700 1 -- 172.21.15.120:0/811921886 shutdown_connections 2021-04-09T18:28:06.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.149 7f59552df700 1 --2- 172.21.15.120:0/811921886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59500d6190 0x7f59500d6590 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.149 7f59552df700 1 --2- 172.21.15.120:0/811921886 >> v2:172.21.15.134:3300/0 conn(0x7f59500d7160 0x7f59500d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.149 7f59552df700 1 -- 172.21.15.120:0/811921886 >> 172.21.15.120:0/811921886 conn(0x7f59500d1590 msgr2=0x7f59500d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:06.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.149 7f59552df700 1 -- 172.21.15.120:0/811921886 shutdown_connections 2021-04-09T18:28:06.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.150 7f59552df700 1 -- 172.21.15.120:0/811921886 wait complete. 2021-04-09T18:28:06.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.175 7f59552df700 1 Processor -- start 2021-04-09T18:28:06.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.175 7f59552df700 1 -- start start 2021-04-09T18:28:06.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.176 7f59552df700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f595008a9b0 0x7f595008b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.176 7f59552df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59500b1fe0 0x7f59500b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.176 7f59552df700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5950183f10 0x7f5950184310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.176 7f59552df700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5950197600 con 0x7f5950183f10 2021-04-09T18:28:06.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.176 7f59552df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595008ae30 con 0x7f59500b1fe0 2021-04-09T18:28:06.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.176 7f59552df700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595008b990 con 0x7f595008a9b0 2021-04-09T18:28:06.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.176 7f594e87c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59500b1fe0 0x7f59500b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.176 7f594e87c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59500b1fe0 0x7f59500b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:46518/0 (socket says 172.21.15.120:46518) 2021-04-09T18:28:06.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.176 7f594e87c700 1 -- 172.21.15.120:0/1052701705 learned_addr learned my addr 172.21.15.120:0/1052701705 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:06.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.177 7f594e87c700 1 -- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f595008a9b0 msgr2=0x7f595008b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.177 7f594e87c700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f595008a9b0 0x7f595008b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:28:06.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.177 7f594e87c700 1 -- 172.21.15.120:0/1052701705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5950183f10 msgr2=0x7f5950184310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-04-09T18:28:06.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.177 7f594e87c700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5950183f10 0x7f5950184310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:28:06.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.177 7f594e87c700 1 -- 172.21.15.120:0/1052701705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59501971c0 con 0x7f59500b1fe0 2021-04-09T18:28:06.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.177 7f594e87c700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59500b1fe0 0x7f59500b23e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f593800b530 tx=0x7f593800b8d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:06.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.178 7f5947fff700 1 -- 172.21.15.120:0/1052701705 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f593800bcc0 con 0x7f59500b1fe0 2021-04-09T18:28:06.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.179 7f5947fff700 1 -- 172.21.15.120:0/1052701705 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59380060d0 con 0x7f59500b1fe0 2021-04-09T18:28:06.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.179 7f5947fff700 1 -- 172.21.15.120:0/1052701705 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59380043a0 con 0x7f59500b1fe0 2021-04-09T18:28:06.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.179 7f59552df700 1 -- 172.21.15.120:0/1052701705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59501971c0 con 0x7f59500b1fe0 2021-04-09T18:28:06.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.180 7f59552df700 1 -- 172.21.15.120:0/1052701705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59501971c0 con 0x7f59500b1fe0 2021-04-09T18:28:06.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.181 7f5947fff700 1 -- 172.21.15.120:0/1052701705 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5938007000 con 0x7f59500b1fe0 2021-04-09T18:28:06.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.181 7f5947fff700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f593401ccc0 0x7f593401f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:06.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.181 7f5947fff700 1 -- 172.21.15.120:0/1052701705 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f5938032ae0 con 0x7f59500b1fe0 2021-04-09T18:28:06.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.182 7f594f07d700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f593401ccc0 0x7f593401f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:06.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.182 7f594f07d700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f593401ccc0 0x7f593401f1e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:06.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.184 7f59552df700 1 -- 172.21.15.120:0/1052701705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5950182a20 con 0x7f59500b1fe0 2021-04-09T18:28:06.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.189 7f5947fff700 1 -- 172.21.15.120:0/1052701705 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f59380060d0 con 0x7f59500b1fe0 2021-04-09T18:28:06.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.397 7f59552df700 1 -- 172.21.15.120:0/1052701705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59501975b0 con 0x7f59500b1fe0 2021-04-09T18:28:06.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.397 7f5947fff700 1 -- 172.21.15.120:0/1052701705 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1777 (secure 0 0 0) 0x7f5938007000 con 0x7f59500b1fe0 2021-04-09T18:28:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 34 2021-04-09T18:28:06.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:06.390 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:06.009422","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:clientreplay","state_seq":29,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:06.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 -- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f593401ccc0 msgr2=0x7f593401f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f593401ccc0 0x7f593401f1e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 -- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59500b1fe0 msgr2=0x7f59500b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:06.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59500b1fe0 0x7f59500b23e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f593800b530 tx=0x7f593800b8d0).stop 2021-04-09T18:28:06.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 -- 172.21.15.120:0/1052701705 shutdown_connections 2021-04-09T18:28:06.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5950183f10 0x7f5950184310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:28:06.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59500b1fe0 0x7f59500b23e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f593401ccc0 0x7f593401f1e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 --2- 172.21.15.120:0/1052701705 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f595008a9b0 0x7f595008b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-04-09T18:28:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 -- 172.21.15.120:0/1052701705 >> 172.21.15.120:0/1052701705 conn(0x7f595018dcd0 msgr2=0x7f5950187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 -- 172.21.15.120:0/1052701705 shutdown_connections 2021-04-09T18:28:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:06.400 7f59552df700 1 -- 172.21.15.120:0/1052701705 wait complete. 2021-04-09T18:28:06.401 INFO:tasks.mds_thrash.fs.[None]:no change 2021-04-09T18:28:08.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:08.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.592 7fcc86b04700 1 Processor -- start 2021-04-09T18:28:08.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.592 7fcc86b04700 1 -- start start 2021-04-09T18:28:08.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc86b04700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcc800d7560 0x7fcc800d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc86b04700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcc800d63b0 0x7fcc801ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc86b04700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800d7960 con 0x7fcc800d7160 2021-04-09T18:28:08.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc86b04700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800d80f0 con 0x7fcc800d7560 2021-04-09T18:28:08.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc86b04700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800d6be0 con 0x7fcc800d63b0 2021-04-09T18:28:08.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7ffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcc800d7560 0x7fcc800d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7ffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcc800d7560 0x7fcc800d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57728/0 (socket says 172.21.15.120:57728) 2021-04-09T18:28:08.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7ffff700 1 -- 172.21.15.120:0/2192867382 learned_addr learned my addr 172.21.15.120:0/2192867382 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:08.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc85121700 1 --2- 172.21.15.120:0/2192867382 >> v2:172.21.15.134:3300/0 conn(0x7fcc800d63b0 0x7fcc801ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7ffff700 1 -- 172.21.15.120:0/2192867382 >> v2:172.21.15.134:3300/0 conn(0x7fcc800d63b0 msgr2=0x7fcc801ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:08.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7ffff700 1 --2- 172.21.15.120:0/2192867382 >> v2:172.21.15.134:3300/0 conn(0x7fcc800d63b0 0x7fcc801ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7ffff700 1 -- 172.21.15.120:0/2192867382 >> v1:172.21.15.134:6789/0 conn(0x7fcc800d7160 legacy=0x7fcc800d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7ffff700 1 -- 172.21.15.120:0/2192867382 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc801a2ac0 con 0x7fcc800d7560 2021-04-09T18:28:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7ffff700 1 --2- 172.21.15.120:0/2192867382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc800d7560 0x7fcc800d5d90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fcc70006a80 tx=0x7fcc70009f00).ready entity=mon.0 client_cookie=92329a5d27a09763 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7f7fe700 1 -- 172.21.15.120:0/2192867382 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcc7000b5c0 con 0x7fcc800d7560 2021-04-09T18:28:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7f7fe700 1 -- 172.21.15.120:0/2192867382 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7000b8c0 con 0x7fcc800d7560 2021-04-09T18:28:08.610 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc7f7fe700 1 -- 172.21.15.120:0/2192867382 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcc7000bda0 con 0x7fcc800d7560 2021-04-09T18:28:08.610 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.593 7fcc86b04700 1 -- 172.21.15.120:0/2192867382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc800d7560 msgr2=0x7fcc800d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.594 7fcc86b04700 1 --2- 172.21.15.120:0/2192867382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc800d7560 0x7fcc800d5d90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fcc70006a80 tx=0x7fcc70009f00).stop 2021-04-09T18:28:08.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.594 7fcc86b04700 1 -- 172.21.15.120:0/2192867382 shutdown_connections 2021-04-09T18:28:08.611 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.594 7fcc86b04700 1 --2- 172.21.15.120:0/2192867382 >> v2:172.21.15.134:3300/0 conn(0x7fcc800d63b0 0x7fcc801ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.594 7fcc86b04700 1 --2- 172.21.15.120:0/2192867382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc800d7560 0x7fcc800d5d90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.594 7fcc86b04700 1 -- 172.21.15.120:0/2192867382 >> 172.21.15.120:0/2192867382 conn(0x7fcc800d1590 msgr2=0x7fcc800d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:08.612 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.594 7fcc86b04700 1 -- 172.21.15.120:0/2192867382 shutdown_connections 2021-04-09T18:28:08.613 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.594 7fcc86b04700 1 -- 172.21.15.120:0/2192867382 wait complete. 2021-04-09T18:28:08.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.613 7fcc86b04700 1 Processor -- start 2021-04-09T18:28:08.618 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.613 7fcc86b04700 1 -- start start 2021-04-09T18:28:08.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc86b04700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc80187380 0x7fcc80189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.619 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc86b04700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc80187780 0x7fcc800987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc86b04700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc80189c50 0x7fcc800b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc86b04700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8018ce60 con 0x7fcc80187780 2021-04-09T18:28:08.620 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc86b04700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80098e10 con 0x7fcc80189c50 2021-04-09T18:28:08.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc86b04700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80099030 con 0x7fcc80187380 2021-04-09T18:28:08.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc80187780 0x7fcc800987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc80187780 0x7fcc800987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57734/0 (socket says 172.21.15.120:57734) 2021-04-09T18:28:08.622 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7ffff700 1 -- 172.21.15.120:0/897329809 learned_addr learned my addr 172.21.15.120:0/897329809 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:08.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc85121700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc80189c50 0x7fcc800b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc84920700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc80187380 0x7fcc80189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.623 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7ffff700 1 -- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc80187380 msgr2=0x7fcc80189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7ffff700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc80187380 0x7fcc80189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7ffff700 1 -- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc80189c50 msgr2=0x7fcc800b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7ffff700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc80189c50 0x7fcc800b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.625 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7ffff700 1 -- 172.21.15.120:0/897329809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800b8b30 con 0x7fcc80187780 2021-04-09T18:28:08.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc84920700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc80187380 0x7fcc80189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:08.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7ffff700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc80187780 0x7fcc800987f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fcc70009450 tx=0x7fcc7000bd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:08.626 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7d7fa700 1 -- 172.21.15.120:0/897329809 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcc70006e40 con 0x7fcc80187780 2021-04-09T18:28:08.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7d7fa700 1 -- 172.21.15.120:0/897329809 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7000be60 con 0x7fcc80187780 2021-04-09T18:28:08.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc86b04700 1 -- 172.21.15.120:0/897329809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc800b8b30 con 0x7fcc80187780 2021-04-09T18:28:08.627 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc7d7fa700 1 -- 172.21.15.120:0/897329809 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcc7000c4e0 con 0x7fcc80187780 2021-04-09T18:28:08.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.614 7fcc86b04700 1 -- 172.21.15.120:0/897329809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc800b8b30 con 0x7fcc80187780 2021-04-09T18:28:08.628 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.615 7fcc7d7fa700 1 -- 172.21.15.120:0/897329809 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fcc70005660 con 0x7fcc80187780 2021-04-09T18:28:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.615 7fcc7d7fa700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcc64018930 0x7fcc6401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.615 7fcc7d7fa700 1 -- 172.21.15.120:0/897329809 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fcc700330c0 con 0x7fcc80187780 2021-04-09T18:28:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.615 7fcc84920700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcc64018930 0x7fcc6401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:08.630 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.616 7fcc84920700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcc64018930 0x7fcc6401adc0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:08.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.639 7fcc86b04700 1 -- 172.21.15.120:0/897329809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80189100 con 0x7fcc80187780 2021-04-09T18:28:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.643 7fcc7d7fa700 1 -- 172.21.15.120:0/897329809 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fcc7001faf0 con 0x7fcc80187780 2021-04-09T18:28:08.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.837 7fcc86b04700 1 -- 172.21.15.120:0/897329809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc80189100 con 0x7fcc80187780 2021-04-09T18:28:08.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.837 7fcc7d7fa700 1 -- 172.21.15.120:0/897329809 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1771 (secure 0 0 0) 0x7fcc70005660 con 0x7fcc80187780 2021-04-09T18:28:08.829 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2021-04-09T18:28:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:08.830 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:08.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 -- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcc64018930 msgr2=0x7fcc6401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcc64018930 0x7fcc6401adc0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 -- 172.21.15.120:0/897329809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc80187780 msgr2=0x7fcc800987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:08.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc80187780 0x7fcc800987f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fcc70009450 tx=0x7fcc7000bd20).stop 2021-04-09T18:28:08.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 -- 172.21.15.120:0/897329809 shutdown_connections 2021-04-09T18:28:08.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc80189c50 0x7fcc800b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc80187780 0x7fcc800987f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fcc64018930 0x7fcc6401adc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 --2- 172.21.15.120:0/897329809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc80187380 0x7fcc80189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:08.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 -- 172.21.15.120:0/897329809 >> 172.21.15.120:0/897329809 conn(0x7fcc8018dc90 msgr2=0x7fcc8008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:08.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.841 7fcc86b04700 1 -- 172.21.15.120:0/897329809 shutdown_connections 2021-04-09T18:28:08.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:08.842 7fcc86b04700 1 -- 172.21.15.120:0/897329809 wait complete. 2021-04-09T18:28:08.845 INFO:tasks.mds_thrash.fs.[None]:mds.a has gained rank=0, replacing gid=4718 2021-04-09T18:28:08.845 INFO:tasks.mds_thrash.fs.[None]:waiting for 1 secs before reviving mds.b 2021-04-09T18:28:09.846 INFO:tasks.mds_thrash.fs.[None]:reviving mds.b 2021-04-09T18:28:09.846 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:28:09.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:28:09.849 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:28:09.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:10.022 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2021-04-09T18:28:10.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.034 7f825803f700 1 Processor -- start 2021-04-09T18:28:10.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.034 7f825803f700 1 -- start start 2021-04-09T18:28:10.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825803f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82500d7560 0x7f82500d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825803f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f82500d63b0 0x7f82501ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825803f700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82500d7960 con 0x7f82500d7160 2021-04-09T18:28:10.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825803f700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82500d80f0 con 0x7f82500d63b0 2021-04-09T18:28:10.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825803f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82500d6be0 con 0x7f82500d7560 2021-04-09T18:28:10.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f8255e5b700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f82500d7160 0x7f82500d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52662/0 (socket says 172.21.15.120:52662) 2021-04-09T18:28:10.057 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825665c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f82500d63b0 0x7f82501ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f8255e5b700 1 -- 172.21.15.120:0/2258259372 learned_addr learned my addr 172.21.15.120:0/2258259372 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:10.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825565a700 1 --2- 172.21.15.120:0/2258259372 >> v2:172.21.15.134:3300/0 conn(0x7f82500d7560 0x7f82500d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f8254e59700 1 -- 172.21.15.120:0/2258259372 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67284757 0 0) 0x7f824c000ce0 con 0x7f82500d7160 2021-04-09T18:28:10.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f8254e59700 1 -- 172.21.15.120:0/2258259372 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f823c002fe0 con 0x7f82500d7160 2021-04-09T18:28:10.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825665c700 1 -- 172.21.15.120:0/2258259372 >> v2:172.21.15.134:3300/0 conn(0x7f82500d7560 msgr2=0x7f82500d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:10.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825665c700 1 --2- 172.21.15.120:0/2258259372 >> v2:172.21.15.134:3300/0 conn(0x7f82500d7560 0x7f82500d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825665c700 1 -- 172.21.15.120:0/2258259372 >> v1:172.21.15.120:6789/0 conn(0x7f82500d7160 legacy=0x7f82500d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825665c700 1 -- 172.21.15.120:0/2258259372 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82501a2ac0 con 0x7f82500d63b0 2021-04-09T18:28:10.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825665c700 1 --2- 172.21.15.120:0/2258259372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82500d63b0 0x7f82501ab1e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f8248006c30 tx=0x7f8248009e10).ready entity=mon.0 client_cookie=2eac7eeec2d16f9d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f8254e59700 1 -- 172.21.15.120:0/2258259372 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f824800b300 con 0x7f82500d63b0 2021-04-09T18:28:10.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f8254e59700 1 -- 172.21.15.120:0/2258259372 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824800b640 con 0x7f82500d63b0 2021-04-09T18:28:10.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f8254e59700 1 -- 172.21.15.120:0/2258259372 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f824800ba90 con 0x7f82500d63b0 2021-04-09T18:28:10.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825803f700 1 -- 172.21.15.120:0/2258259372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82500d63b0 msgr2=0x7f82501ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.035 7f825803f700 1 --2- 172.21.15.120:0/2258259372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82500d63b0 0x7f82501ab1e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f8248006c30 tx=0x7f8248009e10).stop 2021-04-09T18:28:10.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.036 7f825803f700 1 -- 172.21.15.120:0/2258259372 shutdown_connections 2021-04-09T18:28:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.036 7f825803f700 1 --2- 172.21.15.120:0/2258259372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82500d63b0 0x7f82501ab1e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.036 7f825803f700 1 --2- 172.21.15.120:0/2258259372 >> v2:172.21.15.134:3300/0 conn(0x7f82500d7560 0x7f82500d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.036 7f825803f700 1 -- 172.21.15.120:0/2258259372 >> 172.21.15.120:0/2258259372 conn(0x7f82500d1590 msgr2=0x7f82500d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.036 7f825803f700 1 -- 172.21.15.120:0/2258259372 shutdown_connections 2021-04-09T18:28:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.036 7f825803f700 1 -- 172.21.15.120:0/2258259372 wait complete. 2021-04-09T18:28:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.059 7f825803f700 1 Processor -- start 2021-04-09T18:28:10.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.059 7f825803f700 1 -- start start 2021-04-09T18:28:10.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.059 7f825803f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8250187380 0x7f8250189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.059 7f825803f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8250187780 0x7f82500987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.059 7f825803f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8250189c50 0x7f82500b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.059 7f825803f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825018ce60 con 0x7f8250187380 2021-04-09T18:28:10.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.059 7f825803f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8250098e10 con 0x7f8250189c50 2021-04-09T18:28:10.068 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.059 7f825803f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8250099030 con 0x7f8250187780 2021-04-09T18:28:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f8255e5b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8250187380 0x7f8250189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f8255e5b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8250187380 0x7f8250189630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57762/0 (socket says 172.21.15.120:57762) 2021-04-09T18:28:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f8255e5b700 1 -- 172.21.15.120:0/3965074008 learned_addr learned my addr 172.21.15.120:0/3965074008 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f825565a700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8250187780 0x7f82500987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f825665c700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8250189c50 0x7f82500b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f8255e5b700 1 -- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8250187780 msgr2=0x7f82500987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f8255e5b700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8250187780 0x7f82500987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f8255e5b700 1 -- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8250189c50 msgr2=0x7f82500b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f8255e5b700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8250189c50 0x7f82500b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f8255e5b700 1 -- 172.21.15.120:0/3965074008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82500b8b30 con 0x7f8250187380 2021-04-09T18:28:10.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f8255e5b700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8250187380 0x7f8250189630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f824c00b530 tx=0x7f824c00b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f82467fc700 1 -- 172.21.15.120:0/3965074008 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f824c00bcc0 con 0x7f8250187380 2021-04-09T18:28:10.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f82467fc700 1 -- 172.21.15.120:0/3965074008 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c006180 con 0x7f8250187380 2021-04-09T18:28:10.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f82467fc700 1 -- 172.21.15.120:0/3965074008 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f824c004620 con 0x7f8250187380 2021-04-09T18:28:10.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.060 7f825803f700 1 -- 172.21.15.120:0/3965074008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82500b8b30 con 0x7f8250187380 2021-04-09T18:28:10.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.061 7f825803f700 1 -- 172.21.15.120:0/3965074008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82500b8b30 con 0x7f8250187380 2021-04-09T18:28:10.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.061 7f82467fc700 1 -- 172.21.15.120:0/3965074008 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f824c00a000 con 0x7f8250187380 2021-04-09T18:28:10.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.062 7f82467fc700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f82380188c0 0x7f823801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:10.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.062 7f82467fc700 1 -- 172.21.15.120:0/3965074008 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f824c032a80 con 0x7f8250187380 2021-04-09T18:28:10.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.062 7f825565a700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f82380188c0 0x7f823801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:10.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.062 7f825565a700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f82380188c0 0x7f823801adc0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:10.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.080 7f825803f700 1 -- 172.21.15.120:0/3965074008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8250189100 con 0x7f8250187380 2021-04-09T18:28:10.077 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.084 7f82467fc700 1 -- 172.21.15.120:0/3965074008 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f824c0009b0 con 0x7f8250187380 2021-04-09T18:28:10.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.269 7f825803f700 1 -- 172.21.15.120:0/3965074008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8250189100 con 0x7f8250187380 2021-04-09T18:28:10.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.270 7f82467fc700 1 -- 172.21.15.120:0/3965074008 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1771 (secure 0 0 0) 0x7f824c009fb0 con 0x7f8250187380 2021-04-09T18:28:10.262 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2021-04-09T18:28:10.262 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:10.263 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:10.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 -- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f82380188c0 msgr2=0x7f823801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f82380188c0 0x7f823801adc0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 -- 172.21.15.120:0/3965074008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8250187380 msgr2=0x7f8250189630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:10.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8250187380 0x7f8250189630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f824c00b530 tx=0x7f824c00b8d0).stop 2021-04-09T18:28:10.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 -- 172.21.15.120:0/3965074008 shutdown_connections 2021-04-09T18:28:10.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8250189c50 0x7f82500b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f82380188c0 0x7f823801adc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8250187780 0x7f82500987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 --2- 172.21.15.120:0/3965074008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8250187380 0x7f8250189630 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:10.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 -- 172.21.15.120:0/3965074008 >> 172.21.15.120:0/3965074008 conn(0x7f825018dc90 msgr2=0x7f825008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:10.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 -- 172.21.15.120:0/3965074008 shutdown_connections 2021-04-09T18:28:10.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:10.272 7f825803f700 1 -- 172.21.15.120:0/3965074008 wait complete. 2021-04-09T18:28:10.273 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-04-09T18:28:12.274 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:12.492 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.481 7f6853095700 1 Processor -- start 2021-04-09T18:28:12.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.481 7f6853095700 1 -- start start 2021-04-09T18:28:12.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.481 7f6853095700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0d7160 0x7f684c0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.481 7f6853095700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684c0d6be0 con 0x7f684c0d7560 2021-04-09T18:28:12.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.481 7f6853095700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684c0e7f00 con 0x7f684c0e70a0 2021-04-09T18:28:12.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.481 7f6853095700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0d80f0 con 0x7f684c0d7160 2021-04-09T18:28:12.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.481 7f684bfff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f684c0d7560 0x7f684c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52708/0 (socket says 172.21.15.120:52708) 2021-04-09T18:28:12.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.481 7f684bfff700 1 -- 172.21.15.120:0/1898268206 learned_addr learned my addr 172.21.15.120:0/1898268206 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:12.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f6850eb1700 1 --2- 172.21.15.120:0/1898268206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0d7160 0x7f684c0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f684b7fe700 1 -- 172.21.15.120:0/1898268206 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377850427 0 0) 0x7f6838000ce0 con 0x7f684c0d7560 2021-04-09T18:28:12.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f684b7fe700 1 -- 172.21.15.120:0/1898268206 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f683c002fe0 con 0x7f684c0d7560 2021-04-09T18:28:12.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f684b7fe700 1 -- 172.21.15.120:0/1898268206 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736532972 0 0) 0x7f6844000d30 con 0x7f684c0e70a0 2021-04-09T18:28:12.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f684b7fe700 1 -- 172.21.15.120:0/1898268206 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f683c003210 con 0x7f684c0e70a0 2021-04-09T18:28:12.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f684b7fe700 1 -- 172.21.15.120:0/1898268206 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3114204899 0 0) 0x7f68380010e0 con 0x7f684c0d7560 2021-04-09T18:28:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f6850eb1700 1 -- 172.21.15.120:0/1898268206 >> v1:172.21.15.134:6789/0 conn(0x7f684c0e70a0 legacy=0x7f684c0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f6850eb1700 1 -- 172.21.15.120:0/1898268206 >> v1:172.21.15.120:6789/0 conn(0x7f684c0d7560 legacy=0x7f684c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f6850eb1700 1 -- 172.21.15.120:0/1898268206 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c1a2ac0 con 0x7f684c0d7160 2021-04-09T18:28:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f6850eb1700 1 --2- 172.21.15.120:0/1898268206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0d7160 0x7f684c0e78e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6840006650 tx=0x7f6840009a80).ready entity=mon.2 client_cookie=e4f1ca6d687e077b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f684b7fe700 1 -- 172.21.15.120:0/1898268206 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68400009b0 con 0x7f684c0d7160 2021-04-09T18:28:12.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f684b7fe700 1 -- 172.21.15.120:0/1898268206 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684000c0c0 con 0x7f684c0d7160 2021-04-09T18:28:12.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f684b7fe700 1 -- 172.21.15.120:0/1898268206 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f684000c510 con 0x7f684c0d7160 2021-04-09T18:28:12.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f6853095700 1 -- 172.21.15.120:0/1898268206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0d7160 msgr2=0x7f684c0e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.482 7f6853095700 1 --2- 172.21.15.120:0/1898268206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0d7160 0x7f684c0e78e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6840006650 tx=0x7f6840009a80).stop 2021-04-09T18:28:12.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.483 7f6853095700 1 -- 172.21.15.120:0/1898268206 shutdown_connections 2021-04-09T18:28:12.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.483 7f6853095700 1 --2- 172.21.15.120:0/1898268206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0d7160 0x7f684c0e78e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.483 7f6853095700 1 -- 172.21.15.120:0/1898268206 >> 172.21.15.120:0/1898268206 conn(0x7f684c0d1590 msgr2=0x7f684c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:12.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.483 7f6853095700 1 -- 172.21.15.120:0/1898268206 shutdown_connections 2021-04-09T18:28:12.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.483 7f6853095700 1 -- 172.21.15.120:0/1898268206 wait complete. 2021-04-09T18:28:12.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.502 7f6853095700 1 Processor -- start 2021-04-09T18:28:12.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.502 7f6853095700 1 -- start start 2021-04-09T18:28:12.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.502 7f6853095700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c187670 0x7f684c0a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.502 7f6853095700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0a5050 0x7f684c0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.502 7f6853095700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f684c0b5710 0x7f684c1838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.502 7f6853095700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0b5b10 con 0x7f684c0b5710 2021-04-09T18:28:12.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.502 7f6853095700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0b5d30 con 0x7f684c187670 2021-04-09T18:28:12.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.502 7f6853095700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0b5f50 con 0x7f684c0a5050 2021-04-09T18:28:12.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.502 7f68516b2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f684c0b5710 0x7f684c1838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68516b2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f684c0b5710 0x7f684c1838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57804/0 (socket says 172.21.15.120:57804) 2021-04-09T18:28:12.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68516b2700 1 -- 172.21.15.120:0/2448994089 learned_addr learned my addr 172.21.15.120:0/2448994089 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:12.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f684bfff700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0a5050 0x7f684c0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f6850eb1700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c187670 0x7f684c0a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68516b2700 1 -- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0a5050 msgr2=0x7f684c0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68516b2700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0a5050 0x7f684c0b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68516b2700 1 -- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c187670 msgr2=0x7f684c0a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68516b2700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c187670 0x7f684c0a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68516b2700 1 -- 172.21.15.120:0/2448994089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c183ef0 con 0x7f684c0b5710 2021-04-09T18:28:12.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f6850eb1700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c187670 0x7f684c0a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:28:12.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f684bfff700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0a5050 0x7f684c0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:12.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68516b2700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f684c0b5710 0x7f684c1838d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f6844009980 tx=0x7f684400bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68497fa700 1 -- 172.21.15.120:0/2448994089 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6844003020 con 0x7f684c0b5710 2021-04-09T18:28:12.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68497fa700 1 -- 172.21.15.120:0/2448994089 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684400be10 con 0x7f684c0b5710 2021-04-09T18:28:12.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f6853095700 1 -- 172.21.15.120:0/2448994089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c183ef0 con 0x7f684c0b5710 2021-04-09T18:28:12.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f68497fa700 1 -- 172.21.15.120:0/2448994089 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6844005c70 con 0x7f684c0b5710 2021-04-09T18:28:12.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.503 7f6853095700 1 -- 172.21.15.120:0/2448994089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c183ef0 con 0x7f684c0b5710 2021-04-09T18:28:12.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.504 7f68497fa700 1 -- 172.21.15.120:0/2448994089 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6844005a80 con 0x7f684c0b5710 2021-04-09T18:28:12.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.504 7f68497fa700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f682c0188c0 0x7f682c01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:12.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.504 7f68497fa700 1 -- 172.21.15.120:0/2448994089 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f6844032e00 con 0x7f684c0b5710 2021-04-09T18:28:12.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.504 7f6850eb1700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f682c0188c0 0x7f682c01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:12.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.505 7f6850eb1700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f682c0188c0 0x7f682c01adc0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:12.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.527 7f6853095700 1 -- 172.21.15.120:0/2448994089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684c1829e0 con 0x7f684c0b5710 2021-04-09T18:28:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.532 7f68497fa700 1 -- 172.21.15.120:0/2448994089 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6844005870 con 0x7f684c0b5710 2021-04-09T18:28:12.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.726 7f6853095700 1 -- 172.21.15.120:0/2448994089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f684c1829e0 con 0x7f684c0b5710 2021-04-09T18:28:12.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.727 7f68497fa700 1 -- 172.21.15.120:0/2448994089 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1771 (secure 0 0 0) 0x7f6844005a80 con 0x7f684c0b5710 2021-04-09T18:28:12.719 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2021-04-09T18:28:12.720 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:12.721 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.729 7f6853095700 1 -- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f682c0188c0 msgr2=0x7f682c01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.723 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.729 7f6853095700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f682c0188c0 0x7f682c01adc0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.729 7f6853095700 1 -- 172.21.15.120:0/2448994089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f684c0b5710 msgr2=0x7f684c1838d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:12.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.729 7f6853095700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f684c0b5710 0x7f684c1838d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f6844009980 tx=0x7f684400bcd0).stop 2021-04-09T18:28:12.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.730 7f6853095700 1 -- 172.21.15.120:0/2448994089 shutdown_connections 2021-04-09T18:28:12.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.730 7f6853095700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f684c0b5710 0x7f684c1838d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.725 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.730 7f6853095700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f682c0188c0 0x7f682c01adc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.730 7f6853095700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f684c0a5050 0x7f684c0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.730 7f6853095700 1 --2- 172.21.15.120:0/2448994089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c187670 0x7f684c0a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.730 7f6853095700 1 -- 172.21.15.120:0/2448994089 >> 172.21.15.120:0/2448994089 conn(0x7f684c18dc90 msgr2=0x7f684c08fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.730 7f6853095700 1 -- 172.21.15.120:0/2448994089 shutdown_connections 2021-04-09T18:28:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:12.730 7f6853095700 1 -- 172.21.15.120:0/2448994089 wait complete. 2021-04-09T18:28:12.732 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-04-09T18:28:14.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:14.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.933 7f2527a0d700 1 Processor -- start 2021-04-09T18:28:14.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.933 7f2527a0d700 1 -- start start 2021-04-09T18:28:14.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2527a0d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f25200d7560 0x7f25200d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2527a0d700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25200d7960 con 0x7f25200d7160 2021-04-09T18:28:14.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2527a0d700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25200d6be0 con 0x7f25200d63b0 2021-04-09T18:28:14.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2527a0d700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25200d80f0 con 0x7f25200d7560 2021-04-09T18:28:14.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2525028700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f25200d7560 0x7f25200d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2525829700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f25200d7160 0x7f25200d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52738/0 (socket says 172.21.15.120:52738) 2021-04-09T18:28:14.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2525829700 1 -- 172.21.15.120:0/2970777203 learned_addr learned my addr 172.21.15.120:0/2970777203 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:14.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2524827700 1 -- 172.21.15.120:0/2970777203 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778326848 0 0) 0x7f251c000ce0 con 0x7f25200d7160 2021-04-09T18:28:14.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2524827700 1 -- 172.21.15.120:0/2970777203 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f250c002fe0 con 0x7f25200d7160 2021-04-09T18:28:14.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2525028700 1 -- 172.21.15.120:0/2970777203 >> v1:172.21.15.134:6789/0 conn(0x7f25200d63b0 legacy=0x7f25201ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:14.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2525028700 1 -- 172.21.15.120:0/2970777203 >> v1:172.21.15.120:6789/0 conn(0x7f25200d7160 legacy=0x7f25200d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2525028700 1 -- 172.21.15.120:0/2970777203 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25201a2af0 con 0x7f25200d7560 2021-04-09T18:28:14.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2525028700 1 --2- 172.21.15.120:0/2970777203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200d7560 0x7f25200d5d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f25140069d0 tx=0x7f2514009e40).ready entity=mon.0 client_cookie=2d815400555f3b9f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:14.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2524827700 1 -- 172.21.15.120:0/2970777203 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f251400b510 con 0x7f25200d7560 2021-04-09T18:28:14.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2524827700 1 -- 172.21.15.120:0/2970777203 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400b890 con 0x7f25200d7560 2021-04-09T18:28:14.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2524827700 1 -- 172.21.15.120:0/2970777203 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f251400bd70 con 0x7f25200d7560 2021-04-09T18:28:14.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2527a0d700 1 -- 172.21.15.120:0/2970777203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200d7560 msgr2=0x7f25200d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.934 7f2527a0d700 1 --2- 172.21.15.120:0/2970777203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200d7560 0x7f25200d5d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f25140069d0 tx=0x7f2514009e40).stop 2021-04-09T18:28:14.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.935 7f2527a0d700 1 -- 172.21.15.120:0/2970777203 shutdown_connections 2021-04-09T18:28:14.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.935 7f2527a0d700 1 --2- 172.21.15.120:0/2970777203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200d7560 0x7f25200d5d90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.935 7f2527a0d700 1 -- 172.21.15.120:0/2970777203 >> 172.21.15.120:0/2970777203 conn(0x7f25200d1590 msgr2=0x7f25200d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:14.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.935 7f2527a0d700 1 -- 172.21.15.120:0/2970777203 shutdown_connections 2021-04-09T18:28:14.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.935 7f2527a0d700 1 -- 172.21.15.120:0/2970777203 wait complete. 2021-04-09T18:28:14.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.954 7f2527a0d700 1 Processor -- start 2021-04-09T18:28:14.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.954 7f2527a0d700 1 -- start start 2021-04-09T18:28:14.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.954 7f2527a0d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2520191b80 0x7f2520195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.954 7f2527a0d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25201952c0 0x7f25200902f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.954 7f2527a0d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200b19b0 0x7f25200b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.954 7f2527a0d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520195870 con 0x7f25200b19b0 2021-04-09T18:28:14.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.954 7f2527a0d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520196410 con 0x7f2520191b80 2021-04-09T18:28:14.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.954 7f2527a0d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2520090910 con 0x7f25201952c0 2021-04-09T18:28:14.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.954 7f252602a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200b19b0 0x7f25200b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f252602a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200b19b0 0x7f25200b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57834/0 (socket says 172.21.15.120:57834) 2021-04-09T18:28:14.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f252602a700 1 -- 172.21.15.120:0/233737916 learned_addr learned my addr 172.21.15.120:0/233737916 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:14.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f2525829700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2520191b80 0x7f2520195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f2525028700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25201952c0 0x7f25200902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f252602a700 1 -- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25201952c0 msgr2=0x7f25200902f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f252602a700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25201952c0 0x7f25200902f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f252602a700 1 -- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2520191b80 msgr2=0x7f2520195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:14.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f252602a700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2520191b80 0x7f2520195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:14.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f252602a700 1 -- 172.21.15.120:0/233737916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200b23d0 con 0x7f25200b19b0 2021-04-09T18:28:14.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f252602a700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200b19b0 0x7f25200b1db0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f2518006ed0 tx=0x7f251800b960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:14.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f25127fc700 1 -- 172.21.15.120:0/233737916 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f251800bd50 con 0x7f25200b19b0 2021-04-09T18:28:14.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f25127fc700 1 -- 172.21.15.120:0/233737916 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2518006020 con 0x7f25200b19b0 2021-04-09T18:28:14.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f2527a0d700 1 -- 172.21.15.120:0/233737916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25200b23d0 con 0x7f25200b19b0 2021-04-09T18:28:14.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f25127fc700 1 -- 172.21.15.120:0/233737916 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25180054b0 con 0x7f25200b19b0 2021-04-09T18:28:14.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.955 7f2527a0d700 1 -- 172.21.15.120:0/233737916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25200b23d0 con 0x7f25200b19b0 2021-04-09T18:28:14.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.956 7f25127fc700 1 -- 172.21.15.120:0/233737916 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2518006200 con 0x7f25200b19b0 2021-04-09T18:28:14.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.956 7f25127fc700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2508018930 0x7f250801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:14.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.956 7f25127fc700 1 -- 172.21.15.120:0/233737916 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f2518032ce0 con 0x7f25200b19b0 2021-04-09T18:28:14.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.956 7f2525829700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2508018930 0x7f250801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:14.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.956 7f2525829700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2508018930 0x7f250801ae10 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:14.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.979 7f2527a0d700 1 -- 172.21.15.120:0/233737916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252017f6c0 con 0x7f25200b19b0 2021-04-09T18:28:14.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:14.983 7f25127fc700 1 -- 172.21.15.120:0/233737916 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2518006230 con 0x7f25200b19b0 2021-04-09T18:28:15.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.165 7f2527a0d700 1 -- 172.21.15.120:0/233737916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f252017f6c0 con 0x7f25200b19b0 2021-04-09T18:28:15.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.166 7f25127fc700 1 -- 172.21.15.120:0/233737916 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f251800bd50 con 0x7f25200b19b0 2021-04-09T18:28:15.157 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 36 2021-04-09T18:28:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:15.157 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4844,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:15.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 -- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2508018930 msgr2=0x7f250801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2508018930 0x7f250801ae10 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 -- 172.21.15.120:0/233737916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200b19b0 msgr2=0x7f25200b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:15.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200b19b0 0x7f25200b1db0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f2518006ed0 tx=0x7f251800b960).stop 2021-04-09T18:28:15.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 -- 172.21.15.120:0/233737916 shutdown_connections 2021-04-09T18:28:15.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25200b19b0 0x7f25200b1db0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2508018930 0x7f250801ae10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25201952c0 0x7f25200902f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 --2- 172.21.15.120:0/233737916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2520191b80 0x7f2520195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:15.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 -- 172.21.15.120:0/233737916 >> 172.21.15.120:0/233737916 conn(0x7f252018a9d0 msgr2=0x7f2520198100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:15.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 -- 172.21.15.120:0/233737916 shutdown_connections 2021-04-09T18:28:15.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:15.169 7f2527a0d700 1 -- 172.21.15.120:0/233737916 wait complete. 2021-04-09T18:28:15.169 INFO:tasks.mds_thrash.fs.[None]:mds.b reported in up:standby state 2021-04-09T18:28:15.169 INFO:tasks.mds_thrash.fs.[None]:waiting for 22 secs before thrashing 2021-04-09T18:28:35.914 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:35.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:28:37.170 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:37.379 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.369 7f24ab942700 1 Processor -- start 2021-04-09T18:28:37.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.369 7f24ab942700 1 -- start start 2021-04-09T18:28:37.380 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.369 7f24ab942700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a40d7160 0x7f24a40e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24ab942700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f24a40e70a0 0x7f24a40d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.381 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24ab942700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40d6be0 con 0x7f24a40d7560 2021-04-09T18:28:37.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24ab942700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a40d80f0 con 0x7f24a40e70a0 2021-04-09T18:28:37.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24ab942700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40e7f00 con 0x7f24a40d7160 2021-04-09T18:28:37.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a8f5d700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f24a40d7560 0x7f24a40d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52872/0 (socket says 172.21.15.120:52872) 2021-04-09T18:28:37.382 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a8f5d700 1 -- 172.21.15.120:0/2185912477 learned_addr learned my addr 172.21.15.120:0/2185912477 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:37.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a9f5f700 1 --2- 172.21.15.120:0/2185912477 >> v2:172.21.15.134:3300/0 conn(0x7f24a40e70a0 0x7f24a40d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.383 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a975e700 1 --2- 172.21.15.120:0/2185912477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a40d7160 0x7f24a40e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f2497fff700 1 -- 172.21.15.120:0/2185912477 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539591829 0 0) 0x7f2498000d30 con 0x7f24a40d7560 2021-04-09T18:28:37.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f2497fff700 1 -- 172.21.15.120:0/2185912477 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2490002fe0 con 0x7f24a40d7560 2021-04-09T18:28:37.384 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a9f5f700 1 -- 172.21.15.120:0/2185912477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a40d7160 msgr2=0x7f24a40e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:37.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a9f5f700 1 --2- 172.21.15.120:0/2185912477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a40d7160 0x7f24a40e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a9f5f700 1 -- 172.21.15.120:0/2185912477 >> v1:172.21.15.120:6789/0 conn(0x7f24a40d7560 legacy=0x7f24a40d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f2497fff700 1 -- 172.21.15.120:0/2185912477 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1585518739 0 0) 0x7f2498001390 con 0x7f24a40d7560 2021-04-09T18:28:37.385 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a9f5f700 1 -- 172.21.15.120:0/2185912477 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a41a2ac0 con 0x7f24a40e70a0 2021-04-09T18:28:37.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a975e700 1 --2- 172.21.15.120:0/2185912477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a40d7160 0x7f24a40e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:37.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.370 7f24a9f5f700 1 --2- 172.21.15.120:0/2185912477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a40e70a0 0x7f24a40d5d90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f249c006ad0 tx=0x7f249c009ad0).ready entity=mon.1 client_cookie=d70bee874485b6be server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:37.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.371 7f2497fff700 1 -- 172.21.15.120:0/2185912477 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f249c0022e0 con 0x7f24a40e70a0 2021-04-09T18:28:37.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.371 7f2497fff700 1 -- 172.21.15.120:0/2185912477 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c006410 con 0x7f24a40e70a0 2021-04-09T18:28:37.386 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.371 7f2497fff700 1 -- 172.21.15.120:0/2185912477 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f249c002620 con 0x7f24a40e70a0 2021-04-09T18:28:37.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.371 7f24ab942700 1 -- 172.21.15.120:0/2185912477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a40e70a0 msgr2=0x7f24a40d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.371 7f24ab942700 1 --2- 172.21.15.120:0/2185912477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a40e70a0 0x7f24a40d5d90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f249c006ad0 tx=0x7f249c009ad0).stop 2021-04-09T18:28:37.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.371 7f24ab942700 1 -- 172.21.15.120:0/2185912477 shutdown_connections 2021-04-09T18:28:37.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.371 7f24ab942700 1 --2- 172.21.15.120:0/2185912477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a40e70a0 0x7f24a40d5d90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.371 7f24ab942700 1 --2- 172.21.15.120:0/2185912477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a40d7160 0x7f24a40e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.371 7f24ab942700 1 -- 172.21.15.120:0/2185912477 >> 172.21.15.120:0/2185912477 conn(0x7f24a40d1590 msgr2=0x7f24a40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:37.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.372 7f24ab942700 1 -- 172.21.15.120:0/2185912477 shutdown_connections 2021-04-09T18:28:37.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.372 7f24ab942700 1 -- 172.21.15.120:0/2185912477 wait complete. 2021-04-09T18:28:37.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.390 7f24ab942700 1 Processor -- start 2021-04-09T18:28:37.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.390 7f24ab942700 1 -- start start 2021-04-09T18:28:37.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24ab942700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a4187380 0x7f24a4189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24ab942700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a4187780 0x7f24a40987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24ab942700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a4189c50 0x7f24a40b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24ab942700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a418ce60 con 0x7f24a4187380 2021-04-09T18:28:37.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24ab942700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4098e10 con 0x7f24a4189c50 2021-04-09T18:28:37.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24ab942700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4099030 con 0x7f24a4187780 2021-04-09T18:28:37.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a975e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a4187380 0x7f24a4189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a975e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a4187380 0x7f24a4189630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57962/0 (socket says 172.21.15.120:57962) 2021-04-09T18:28:37.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a975e700 1 -- 172.21.15.120:0/2447376158 learned_addr learned my addr 172.21.15.120:0/2447376158 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:37.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a9f5f700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a4189c50 0x7f24a40b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a8f5d700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a4187780 0x7f24a40987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a975e700 1 -- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a4187780 msgr2=0x7f24a40987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a975e700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a4187780 0x7f24a40987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a975e700 1 -- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a4189c50 msgr2=0x7f24a40b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a975e700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a4189c50 0x7f24a40b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a975e700 1 -- 172.21.15.120:0/2447376158 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40b8b30 con 0x7f24a4187380 2021-04-09T18:28:37.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24a975e700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a4187380 0x7f24a4189630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f24a000b580 tx=0x7f24a000b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:37.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f2495ffb700 1 -- 172.21.15.120:0/2447376158 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24a000bd10 con 0x7f24a4187380 2021-04-09T18:28:37.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f2495ffb700 1 -- 172.21.15.120:0/2447376158 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a0000c90 con 0x7f24a4187380 2021-04-09T18:28:37.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f24ab942700 1 -- 172.21.15.120:0/2447376158 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a40b8b30 con 0x7f24a4187380 2021-04-09T18:28:37.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.391 7f2495ffb700 1 -- 172.21.15.120:0/2447376158 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24a0002220 con 0x7f24a4187380 2021-04-09T18:28:37.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.392 7f24ab942700 1 -- 172.21.15.120:0/2447376158 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40b8b30 con 0x7f24a4187380 2021-04-09T18:28:37.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.392 7f2495ffb700 1 -- 172.21.15.120:0/2447376158 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f24a0006b00 con 0x7f24a4187380 2021-04-09T18:28:37.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.392 7f2495ffb700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2484018930 0x7f248401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.392 7f2495ffb700 1 -- 172.21.15.120:0/2447376158 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f24a0032d00 con 0x7f24a4187380 2021-04-09T18:28:37.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.392 7f24a8f5d700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2484018930 0x7f248401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.393 7f24a8f5d700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2484018930 0x7f248401ae10 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:37.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.415 7f24ab942700 1 -- 172.21.15.120:0/2447376158 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a4189100 con 0x7f24a4187380 2021-04-09T18:28:37.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.419 7f2495ffb700 1 -- 172.21.15.120:0/2447376158 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f24a000bd10 con 0x7f24a4187380 2021-04-09T18:28:37.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.597 7f24ab942700 1 -- 172.21.15.120:0/2447376158 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24a4189100 con 0x7f24a4187380 2021-04-09T18:28:37.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.597 7f2495ffb700 1 -- 172.21.15.120:0/2447376158 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f24a0000c90 con 0x7f24a4187380 2021-04-09T18:28:37.588 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 36 2021-04-09T18:28:37.588 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:37.588 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4844,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:37.589 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 -- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2484018930 msgr2=0x7f248401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2484018930 0x7f248401ae10 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 -- 172.21.15.120:0/2447376158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a4187380 msgr2=0x7f24a4189630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a4187380 0x7f24a4189630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f24a000b580 tx=0x7f24a000b920).stop 2021-04-09T18:28:37.590 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 -- 172.21.15.120:0/2447376158 shutdown_connections 2021-04-09T18:28:37.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a4189c50 0x7f24a40b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2484018930 0x7f248401ae10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a4187780 0x7f24a40987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 --2- 172.21.15.120:0/2447376158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a4187380 0x7f24a4189630 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 -- 172.21.15.120:0/2447376158 >> 172.21.15.120:0/2447376158 conn(0x7f24a418dc90 msgr2=0x7f24a408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 -- 172.21.15.120:0/2447376158 shutdown_connections 2021-04-09T18:28:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.600 7f24ab942700 1 -- 172.21.15.120:0/2447376158 wait complete. 2021-04-09T18:28:37.599 INFO:tasks.mds_thrash.fs.[None]:kill mds.a (rank=0) 2021-04-09T18:28:37.600 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:28:37.600 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:28:37.610 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:28:37.611 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:37.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.837 7f6cbf09c700 1 Processor -- start 2021-04-09T18:28:37.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.837 7f6cbf09c700 1 -- start start 2021-04-09T18:28:37.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbf09c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6cb80d7160 0x7f6cb80d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.848 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbf09c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb80d55a0 0x7f6cb80d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbf09c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb80d6be0 con 0x7f6cb80d5fc0 2021-04-09T18:28:37.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbf09c700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb80d80f0 con 0x7f6cb80d7160 2021-04-09T18:28:37.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbf09c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb81a2ac0 con 0x7f6cb80d55a0 2021-04-09T18:28:37.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbceb8700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6cb80d7160 0x7f6cb80d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.849 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbceb8700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6cb80d7160 0x7f6cb80d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57972/0 (socket says 172.21.15.120:57972) 2021-04-09T18:28:37.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6caffff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb80d55a0 0x7f6cb80d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbceb8700 1 -- 172.21.15.120:0/1085675804 learned_addr learned my addr 172.21.15.120:0/1085675804 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:37.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbceb8700 1 -- 172.21.15.120:0/1085675804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb80d55a0 msgr2=0x7f6cb80d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:37.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbceb8700 1 --2- 172.21.15.120:0/1085675804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb80d55a0 0x7f6cb80d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6cbceb8700 1 -- 172.21.15.120:0/1085675804 >> v1:172.21.15.134:6789/0 conn(0x7f6cb80d5fc0 legacy=0x7f6cb80d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.838 7f6caf7fe700 1 -- 172.21.15.120:0/1085675804 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168180169 0 0) 0x7f6cb0000f90 con 0x7f6cb80d5fc0 2021-04-09T18:28:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.839 7f6cbceb8700 1 -- 172.21.15.120:0/1085675804 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb81a2cb0 con 0x7f6cb80d7160 2021-04-09T18:28:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.839 7f6caffff700 1 --2- 172.21.15.120:0/1085675804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb80d55a0 0x7f6cb80d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.839 7f6cbceb8700 1 --2- 172.21.15.120:0/1085675804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb80d7160 0x7f6cb80d7560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f6cb4006700 tx=0x7f6cb4009b80).ready entity=mon.0 client_cookie=420249e9c07d244d server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.839 7f6caf7fe700 1 -- 172.21.15.120:0/1085675804 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6cb400c0c0 con 0x7f6cb80d7160 2021-04-09T18:28:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.839 7f6caf7fe700 1 -- 172.21.15.120:0/1085675804 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb400c440 con 0x7f6cb80d7160 2021-04-09T18:28:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.839 7f6caf7fe700 1 -- 172.21.15.120:0/1085675804 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6cb400c920 con 0x7f6cb80d7160 2021-04-09T18:28:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.839 7f6cbf09c700 1 -- 172.21.15.120:0/1085675804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb80d7160 msgr2=0x7f6cb80d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.839 7f6cbf09c700 1 --2- 172.21.15.120:0/1085675804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb80d7160 0x7f6cb80d7560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f6cb4006700 tx=0x7f6cb4009b80).stop 2021-04-09T18:28:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.840 7f6cbf09c700 1 -- 172.21.15.120:0/1085675804 shutdown_connections 2021-04-09T18:28:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.840 7f6cbf09c700 1 --2- 172.21.15.120:0/1085675804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb80d55a0 0x7f6cb80d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.840 7f6cbf09c700 1 --2- 172.21.15.120:0/1085675804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb80d7160 0x7f6cb80d7560 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.840 7f6cbf09c700 1 -- 172.21.15.120:0/1085675804 >> 172.21.15.120:0/1085675804 conn(0x7f6cb80d1590 msgr2=0x7f6cb80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:37.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.840 7f6cbf09c700 1 -- 172.21.15.120:0/1085675804 shutdown_connections 2021-04-09T18:28:37.854 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.840 7f6cbf09c700 1 -- 172.21.15.120:0/1085675804 wait complete. 2021-04-09T18:28:37.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.858 7f6cbf09c700 1 Processor -- start 2021-04-09T18:28:37.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.858 7f6cbf09c700 1 -- start start 2021-04-09T18:28:37.857 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbf09c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb808f270 0x7f6cb80b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbf09c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb8094730 0x7f6cb8094b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbf09c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb808fbc0 0x7f6cb808ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbf09c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb808f970 con 0x7f6cb808fbc0 2021-04-09T18:28:37.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbf09c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb80b14f0 con 0x7f6cb808f270 2021-04-09T18:28:37.858 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbf09c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb80b1710 con 0x7f6cb8094730 2021-04-09T18:28:37.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbd6b9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb808fbc0 0x7f6cb808ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbd6b9700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb808fbc0 0x7f6cb808ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57980/0 (socket says 172.21.15.120:57980) 2021-04-09T18:28:37.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbd6b9700 1 -- 172.21.15.120:0/3989815365 learned_addr learned my addr 172.21.15.120:0/3989815365 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:37.859 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6caffff700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb8094730 0x7f6cb8094b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbceb8700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb808f270 0x7f6cb80b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbd6b9700 1 -- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb8094730 msgr2=0x7f6cb8094b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbd6b9700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb8094730 0x7f6cb8094b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbd6b9700 1 -- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb808f270 msgr2=0x7f6cb80b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:37.860 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbd6b9700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb808f270 0x7f6cb80b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:37.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbd6b9700 1 -- 172.21.15.120:0/3989815365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb8090650 con 0x7f6cb808fbc0 2021-04-09T18:28:37.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.859 7f6cbd6b9700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb808fbc0 0x7f6cb808ffc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f6cb000b8c0 tx=0x7f6cb000bc60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:37.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.860 7f6cad7fa700 1 -- 172.21.15.120:0/3989815365 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6cb00058a0 con 0x7f6cb808fbc0 2021-04-09T18:28:37.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.860 7f6cad7fa700 1 -- 172.21.15.120:0/3989815365 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0003210 con 0x7f6cb808fbc0 2021-04-09T18:28:37.861 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.860 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb8090650 con 0x7f6cb808fbc0 2021-04-09T18:28:37.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.860 7f6cad7fa700 1 -- 172.21.15.120:0/3989815365 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6cb0006030 con 0x7f6cb808fbc0 2021-04-09T18:28:37.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.860 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb8090650 con 0x7f6cb808fbc0 2021-04-09T18:28:37.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.860 7f6cad7fa700 1 -- 172.21.15.120:0/3989815365 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6cb0006030 con 0x7f6cb808fbc0 2021-04-09T18:28:37.862 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.861 7f6cad7fa700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c98018930 0x7f6c9801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:37.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.861 7f6cad7fa700 1 -- 172.21.15.120:0/3989815365 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f6cb00330e0 con 0x7f6cb808fbc0 2021-04-09T18:28:37.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.861 7f6cbceb8700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c98018930 0x7f6c9801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:37.863 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.861 7f6cbceb8700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c98018930 0x7f6c9801adc0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:37.873 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.883 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb8182a30 con 0x7f6cb808fbc0 2021-04-09T18:28:37.876 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:37.887 7f6cad7fa700 1 -- 172.21.15.120:0/3989815365 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6cb0005aa0 con 0x7f6cb808fbc0 2021-04-09T18:28:38.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.064 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cb8182a30 con 0x7f6cb808fbc0 2021-04-09T18:28:38.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.065 7f6cad7fa700 1 -- 172.21.15.120:0/3989815365 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f6cb0006030 con 0x7f6cb808fbc0 2021-04-09T18:28:38.055 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 36 2021-04-09T18:28:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:38.056 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4844,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.067 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c98018930 msgr2=0x7f6c9801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.067 7f6cbf09c700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c98018930 0x7f6c9801adc0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.067 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb808fbc0 msgr2=0x7f6cb808ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.067 7f6cbf09c700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb808fbc0 0x7f6cb808ffc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f6cb000b8c0 tx=0x7f6cb000bc60).stop 2021-04-09T18:28:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.068 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 shutdown_connections 2021-04-09T18:28:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.068 7f6cbf09c700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb808fbc0 0x7f6cb808ffc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.068 7f6cbf09c700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6c98018930 0x7f6c9801adc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.068 7f6cbf09c700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6cb8094730 0x7f6cb8094b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.068 7f6cbf09c700 1 --2- 172.21.15.120:0/3989815365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cb808f270 0x7f6cb80b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:38.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.068 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 >> 172.21.15.120:0/3989815365 conn(0x7f6cb818dcc0 msgr2=0x7f6cb8186a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:38.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.068 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 shutdown_connections 2021-04-09T18:28:38.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:38.068 7f6cbf09c700 1 -- 172.21.15.120:0/3989815365 wait complete. 2021-04-09T18:28:38.067 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:28:40.069 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:40.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.265 7fec52df5700 1 Processor -- start 2021-04-09T18:28:40.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.265 7fec52df5700 1 -- start start 2021-04-09T18:28:40.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.265 7fec52df5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0d7160 0x7fec4c0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:40.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.265 7fec52df5700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fec4c0e70a0 0x7fec4c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:40.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.265 7fec52df5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c0d6be0 con 0x7fec4c0d7560 2021-04-09T18:28:40.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.265 7fec52df5700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4c0d80f0 con 0x7fec4c0e70a0 2021-04-09T18:28:40.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.265 7fec52df5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0e7f00 con 0x7fec4c0d7160 2021-04-09T18:28:40.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec51412700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fec4c0e70a0 0x7fec4c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:40.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec51412700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fec4c0e70a0 0x7fec4c0d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57988/0 (socket says 172.21.15.120:57988) 2021-04-09T18:28:40.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec51412700 1 -- 172.21.15.120:0/1518806646 learned_addr learned my addr 172.21.15.120:0/1518806646 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:40.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec50c11700 1 --2- 172.21.15.120:0/1518806646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0d7160 0x7fec4c0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:40.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec51412700 1 -- 172.21.15.120:0/1518806646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0d7160 msgr2=0x7fec4c0e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:40.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec51412700 1 --2- 172.21.15.120:0/1518806646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0d7160 0x7fec4c0e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec51412700 1 -- 172.21.15.120:0/1518806646 >> v1:172.21.15.134:6789/0 conn(0x7fec4c0d7560 legacy=0x7fec4c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:40.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec51412700 1 -- 172.21.15.120:0/1518806646 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c1a2ac0 con 0x7fec4c0e70a0 2021-04-09T18:28:40.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec51412700 1 --2- 172.21.15.120:0/1518806646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0e70a0 0x7fec4c0d5d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fec44006f00 tx=0x7fec44009f10).ready entity=mon.0 client_cookie=2206a77dbda248fa server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:40.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec4b7fe700 1 -- 172.21.15.120:0/1518806646 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec4400b3b0 con 0x7fec4c0e70a0 2021-04-09T18:28:40.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec4b7fe700 1 -- 172.21.15.120:0/1518806646 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4400b730 con 0x7fec4c0e70a0 2021-04-09T18:28:40.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec4b7fe700 1 -- 172.21.15.120:0/1518806646 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec4400bc10 con 0x7fec4c0e70a0 2021-04-09T18:28:40.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec52df5700 1 -- 172.21.15.120:0/1518806646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0e70a0 msgr2=0x7fec4c0d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:40.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.266 7fec52df5700 1 --2- 172.21.15.120:0/1518806646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0e70a0 0x7fec4c0d5d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fec44006f00 tx=0x7fec44009f10).stop 2021-04-09T18:28:40.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.267 7fec52df5700 1 -- 172.21.15.120:0/1518806646 shutdown_connections 2021-04-09T18:28:40.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.267 7fec52df5700 1 --2- 172.21.15.120:0/1518806646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0e70a0 0x7fec4c0d5d90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.267 7fec52df5700 1 --2- 172.21.15.120:0/1518806646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0d7160 0x7fec4c0e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.267 7fec52df5700 1 -- 172.21.15.120:0/1518806646 >> 172.21.15.120:0/1518806646 conn(0x7fec4c0d1590 msgr2=0x7fec4c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:40.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.267 7fec52df5700 1 -- 172.21.15.120:0/1518806646 shutdown_connections 2021-04-09T18:28:40.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.267 7fec52df5700 1 -- 172.21.15.120:0/1518806646 wait complete. 2021-04-09T18:28:40.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.286 7fec52df5700 1 Processor -- start 2021-04-09T18:28:40.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.286 7fec52df5700 1 -- start start 2021-04-09T18:28:40.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.286 7fec52df5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec4c187670 0x7fec4c0a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:40.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.286 7fec52df5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0a5050 0x7fec4c0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:40.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.286 7fec52df5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0b5710 0x7fec4c1838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:40.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.286 7fec52df5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0b5b10 con 0x7fec4c0b5710 2021-04-09T18:28:40.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.286 7fec52df5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0b5d30 con 0x7fec4c187670 2021-04-09T18:28:40.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.286 7fec52df5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0b5f50 con 0x7fec4c0a5050 2021-04-09T18:28:40.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec51412700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0b5710 0x7fec4c1838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:40.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec51412700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0b5710 0x7fec4c1838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57994/0 (socket says 172.21.15.120:57994) 2021-04-09T18:28:40.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec51412700 1 -- 172.21.15.120:0/3942719448 learned_addr learned my addr 172.21.15.120:0/3942719448 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:40.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec4bfff700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0a5050 0x7fec4c0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:40.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec50c11700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec4c187670 0x7fec4c0a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:40.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec51412700 1 -- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0a5050 msgr2=0x7fec4c0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:40.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec51412700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0a5050 0x7fec4c0b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec51412700 1 -- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec4c187670 msgr2=0x7fec4c0a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:40.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec51412700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec4c187670 0x7fec4c0a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec51412700 1 -- 172.21.15.120:0/3942719448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c183ef0 con 0x7fec4c0b5710 2021-04-09T18:28:40.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec51412700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0b5710 0x7fec4c1838d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fec4400b8e0 tx=0x7fec4400bc80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:40.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec497fa700 1 -- 172.21.15.120:0/3942719448 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec44009450 con 0x7fec4c0b5710 2021-04-09T18:28:40.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec497fa700 1 -- 172.21.15.120:0/3942719448 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec44005820 con 0x7fec4c0b5710 2021-04-09T18:28:40.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec497fa700 1 -- 172.21.15.120:0/3942719448 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec44005c70 con 0x7fec4c0b5710 2021-04-09T18:28:40.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec52df5700 1 -- 172.21.15.120:0/3942719448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c183ef0 con 0x7fec4c0b5710 2021-04-09T18:28:40.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.287 7fec52df5700 1 -- 172.21.15.120:0/3942719448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c183ef0 con 0x7fec4c0b5710 2021-04-09T18:28:40.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.288 7fec497fa700 1 -- 172.21.15.120:0/3942719448 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fec44005a00 con 0x7fec4c0b5710 2021-04-09T18:28:40.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.288 7fec497fa700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec30018930 0x7fec3001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:40.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.288 7fec497fa700 1 -- 172.21.15.120:0/3942719448 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7fec44033080 con 0x7fec4c0b5710 2021-04-09T18:28:40.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.288 7fec50c11700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec30018930 0x7fec3001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:40.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.289 7fec50c11700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec30018930 0x7fec3001ae10 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:40.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.311 7fec52df5700 1 -- 172.21.15.120:0/3942719448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c1829e0 con 0x7fec4c0b5710 2021-04-09T18:28:40.304 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.315 7fec497fa700 1 -- 172.21.15.120:0/3942719448 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fec44000f90 con 0x7fec4c0b5710 2021-04-09T18:28:40.482 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.492 7fec52df5700 1 -- 172.21.15.120:0/3942719448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec4c1829e0 con 0x7fec4c0b5710 2021-04-09T18:28:40.483 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.493 7fec497fa700 1 -- 172.21.15.120:0/3942719448 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fec44005820 con 0x7fec4c0b5710 2021-04-09T18:28:40.483 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 36 2021-04-09T18:28:40.484 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:40.484 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4844,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:40.485 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.495 7fec52df5700 1 -- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec30018930 msgr2=0x7fec3001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:40.486 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.495 7fec52df5700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec30018930 0x7fec3001ae10 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.486 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.495 7fec52df5700 1 -- 172.21.15.120:0/3942719448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0b5710 msgr2=0x7fec4c1838d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:40.486 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.495 7fec52df5700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0b5710 0x7fec4c1838d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fec4400b8e0 tx=0x7fec4400bc80).stop 2021-04-09T18:28:40.486 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.496 7fec52df5700 1 -- 172.21.15.120:0/3942719448 shutdown_connections 2021-04-09T18:28:40.487 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.496 7fec52df5700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c0b5710 0x7fec4c1838d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.487 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.496 7fec52df5700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fec30018930 0x7fec3001ae10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.487 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.496 7fec52df5700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec4c0a5050 0x7fec4c0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.487 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.496 7fec52df5700 1 --2- 172.21.15.120:0/3942719448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec4c187670 0x7fec4c0a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:40.488 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.496 7fec52df5700 1 -- 172.21.15.120:0/3942719448 >> 172.21.15.120:0/3942719448 conn(0x7fec4c18dc90 msgr2=0x7fec4c08fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:40.488 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.496 7fec52df5700 1 -- 172.21.15.120:0/3942719448 shutdown_connections 2021-04-09T18:28:40.488 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:40.496 7fec52df5700 1 -- 172.21.15.120:0/3942719448 wait complete. 2021-04-09T18:28:40.495 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:28:42.497 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:42.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.692 7f4377824700 1 Processor -- start 2021-04-09T18:28:42.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.692 7f4377824700 1 -- start start 2021-04-09T18:28:42.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.692 7f4377824700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f43700d7160 0x7f43700d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:42.703 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.692 7f4377824700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43700d55a0 0x7f43700d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:42.703 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.692 7f4377824700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43700d6be0 con 0x7f43700d5fc0 2021-04-09T18:28:42.703 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.692 7f4377824700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43700d80f0 con 0x7f43700d7160 2021-04-09T18:28:42.703 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4377824700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43701a2ac0 con 0x7f43700d55a0 2021-04-09T18:28:42.704 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4375640700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f43700d7160 0x7f43700d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:42.704 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4375640700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f43700d7160 0x7f43700d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58004/0 (socket says 172.21.15.120:58004) 2021-04-09T18:28:42.704 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4375640700 1 -- 172.21.15.120:0/1467674981 learned_addr learned my addr 172.21.15.120:0/1467674981 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:42.704 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4374e3f700 1 --2- 172.21.15.120:0/1467674981 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43700d55a0 0x7f43700d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:42.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4375640700 1 -- 172.21.15.120:0/1467674981 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43700d55a0 msgr2=0x7f43700d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:42.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4375640700 1 --2- 172.21.15.120:0/1467674981 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43700d55a0 0x7f43700d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4375640700 1 -- 172.21.15.120:0/1467674981 >> v1:172.21.15.134:6789/0 conn(0x7f43700d5fc0 legacy=0x7f43700d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:42.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4375640700 1 -- 172.21.15.120:0/1467674981 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43701a2cb0 con 0x7f43700d7160 2021-04-09T18:28:42.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4375640700 1 --2- 172.21.15.120:0/1467674981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43700d7160 0x7f43700d7560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f436c006700 tx=0x7f436c009b00).ready entity=mon.0 client_cookie=cd108757bc0c48a0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:42.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4367fff700 1 -- 172.21.15.120:0/1467674981 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f436c00c0c0 con 0x7f43700d7160 2021-04-09T18:28:42.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4367fff700 1 -- 172.21.15.120:0/1467674981 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c00c400 con 0x7f43700d7160 2021-04-09T18:28:42.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4367fff700 1 -- 172.21.15.120:0/1467674981 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f436c00c8e0 con 0x7f43700d7160 2021-04-09T18:28:42.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4377824700 1 -- 172.21.15.120:0/1467674981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43700d7160 msgr2=0x7f43700d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:42.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.693 7f4377824700 1 --2- 172.21.15.120:0/1467674981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43700d7160 0x7f43700d7560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f436c006700 tx=0x7f436c009b00).stop 2021-04-09T18:28:42.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.694 7f4377824700 1 -- 172.21.15.120:0/1467674981 shutdown_connections 2021-04-09T18:28:42.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.694 7f4377824700 1 --2- 172.21.15.120:0/1467674981 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43700d55a0 0x7f43700d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.694 7f4377824700 1 --2- 172.21.15.120:0/1467674981 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43700d7160 0x7f43700d7560 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.694 7f4377824700 1 -- 172.21.15.120:0/1467674981 >> 172.21.15.120:0/1467674981 conn(0x7f43700d1590 msgr2=0x7f43700d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:42.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.694 7f4377824700 1 -- 172.21.15.120:0/1467674981 shutdown_connections 2021-04-09T18:28:42.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.694 7f4377824700 1 -- 172.21.15.120:0/1467674981 wait complete. 2021-04-09T18:28:42.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4377824700 1 Processor -- start 2021-04-09T18:28:42.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4377824700 1 -- start start 2021-04-09T18:28:42.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4377824700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43701830d0 0x7f43700915f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:42.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4377824700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43701837a0 0x7f4370183ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:42.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4377824700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43700ab8d0 0x7f43700abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:42.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4377824700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4370091070 con 0x7f43701837a0 2021-04-09T18:28:42.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4377824700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4370090d30 con 0x7f43700ab8d0 2021-04-09T18:28:42.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4377824700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4370091c10 con 0x7f43701830d0 2021-04-09T18:28:42.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4374e3f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43701837a0 0x7f4370183ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:42.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4374e3f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43701837a0 0x7f4370183ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58010/0 (socket says 172.21.15.120:58010) 2021-04-09T18:28:42.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.713 7f4374e3f700 1 -- 172.21.15.120:0/682083252 learned_addr learned my addr 172.21.15.120:0/682083252 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:42.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4375640700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43701830d0 0x7f43700915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:42.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4375e41700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43700ab8d0 0x7f43700abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:42.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4374e3f700 1 -- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43701830d0 msgr2=0x7f43700915f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:42.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4374e3f700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43701830d0 0x7f43700915f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4374e3f700 1 -- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43700ab8d0 msgr2=0x7f43700abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:42.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4374e3f700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43700ab8d0 0x7f43700abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4374e3f700 1 -- 172.21.15.120:0/682083252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43701841c0 con 0x7f43701837a0 2021-04-09T18:28:42.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4374e3f700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43701837a0 0x7f4370183ba0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f436000b530 tx=0x7f436000b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:42.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4365ffb700 1 -- 172.21.15.120:0/682083252 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f436000bcc0 con 0x7f43701837a0 2021-04-09T18:28:42.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4365ffb700 1 -- 172.21.15.120:0/682083252 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360002030 con 0x7f43701837a0 2021-04-09T18:28:42.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4377824700 1 -- 172.21.15.120:0/682083252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43701841c0 con 0x7f43701837a0 2021-04-09T18:28:42.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4365ffb700 1 -- 172.21.15.120:0/682083252 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4360002480 con 0x7f43701837a0 2021-04-09T18:28:42.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.714 7f4377824700 1 -- 172.21.15.120:0/682083252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43701841c0 con 0x7f43701837a0 2021-04-09T18:28:42.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.715 7f4365ffb700 1 -- 172.21.15.120:0/682083252 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4360002210 con 0x7f43701837a0 2021-04-09T18:28:42.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.715 7f4365ffb700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4350018930 0x7f435001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:42.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.715 7f4365ffb700 1 -- 172.21.15.120:0/682083252 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f4360032d00 con 0x7f43701837a0 2021-04-09T18:28:42.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.715 7f4375640700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4350018930 0x7f435001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:42.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.715 7f4375640700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4350018930 0x7f435001ae10 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:42.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.738 7f4377824700 1 -- 172.21.15.120:0/682083252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437017a2b0 con 0x7f43701837a0 2021-04-09T18:28:42.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.742 7f4365ffb700 1 -- 172.21.15.120:0/682083252 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f4360002240 con 0x7f43701837a0 2021-04-09T18:28:42.909 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.920 7f4377824700 1 -- 172.21.15.120:0/682083252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f437017a2b0 con 0x7f43701837a0 2021-04-09T18:28:42.910 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.920 7f4365ffb700 1 -- 172.21.15.120:0/682083252 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f4360002030 con 0x7f43701837a0 2021-04-09T18:28:42.911 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 36 2021-04-09T18:28:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:42.911 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4844,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:42.913 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 -- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4350018930 msgr2=0x7f435001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:42.913 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4350018930 0x7f435001ae10 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.914 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 -- 172.21.15.120:0/682083252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43701837a0 msgr2=0x7f4370183ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:42.914 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43701837a0 0x7f4370183ba0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f436000b530 tx=0x7f436000b8d0).stop 2021-04-09T18:28:42.914 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 -- 172.21.15.120:0/682083252 shutdown_connections 2021-04-09T18:28:42.914 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43700ab8d0 0x7f43700abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.914 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43701837a0 0x7f4370183ba0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4350018930 0x7f435001ae10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 --2- 172.21.15.120:0/682083252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43701830d0 0x7f43700915f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:42.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 -- 172.21.15.120:0/682083252 >> 172.21.15.120:0/682083252 conn(0x7f4370185580 msgr2=0x7f4370188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:42.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 -- 172.21.15.120:0/682083252 shutdown_connections 2021-04-09T18:28:42.916 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:42.923 7f4377824700 1 -- 172.21.15.120:0/682083252 wait complete. 2021-04-09T18:28:42.923 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:28:44.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.118 7f6c14633700 1 Processor -- start 2021-04-09T18:28:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.118 7f6c14633700 1 -- start start 2021-04-09T18:28:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c14633700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0d1b40 0x7f6c0c0d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c14633700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c0d61e0 con 0x7f6c0c0dc6b0 2021-04-09T18:28:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c14633700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c0dcab0 con 0x7f6c0c0eac40 2021-04-09T18:28:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c14633700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0f38e0 con 0x7f6c0c0d1b40 2021-04-09T18:28:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c11c4e700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6c0c0dc6b0 0x7f6c0c0d6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52936/0 (socket says 172.21.15.120:52936) 2021-04-09T18:28:45.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c11c4e700 1 -- 172.21.15.120:0/372798577 learned_addr learned my addr 172.21.15.120:0/372798577 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:45.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c12c50700 1 --2- 172.21.15.120:0/372798577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0d1b40 0x7f6c0c0d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:45.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c1144d700 1 -- 172.21.15.120:0/372798577 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404374921 0 0) 0x7f6c080009b0 con 0x7f6c0c0dc6b0 2021-04-09T18:28:45.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c1144d700 1 -- 172.21.15.120:0/372798577 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf8002fe0 con 0x7f6c0c0dc6b0 2021-04-09T18:28:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c1144d700 1 -- 172.21.15.120:0/372798577 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278656245 0 0) 0x7f6c00001400 con 0x7f6c0c0eac40 2021-04-09T18:28:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c1144d700 1 -- 172.21.15.120:0/372798577 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf8003210 con 0x7f6c0c0eac40 2021-04-09T18:28:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c1144d700 1 -- 172.21.15.120:0/372798577 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1628763724 0 0) 0x7f6c08001010 con 0x7f6c0c0dc6b0 2021-04-09T18:28:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c12c50700 1 -- 172.21.15.120:0/372798577 >> v1:172.21.15.134:6789/0 conn(0x7f6c0c0eac40 legacy=0x7f6c0c088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:45.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c12c50700 1 -- 172.21.15.120:0/372798577 >> v1:172.21.15.120:6789/0 conn(0x7f6c0c0dc6b0 legacy=0x7f6c0c0d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:45.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.119 7f6c12c50700 1 -- 172.21.15.120:0/372798577 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0887f0 con 0x7f6c0c0d1b40 2021-04-09T18:28:45.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.120 7f6c12c50700 1 --2- 172.21.15.120:0/372798577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0d1b40 0x7f6c0c0d5590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6c04006ad0 tx=0x7f6c04009ad0).ready entity=mon.2 client_cookie=2c45c750012a3dd6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:45.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.120 7f6c1144d700 1 -- 172.21.15.120:0/372798577 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c040022e0 con 0x7f6c0c0d1b40 2021-04-09T18:28:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.120 7f6c1144d700 1 -- 172.21.15.120:0/372798577 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04006410 con 0x7f6c0c0d1b40 2021-04-09T18:28:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.120 7f6c1144d700 1 -- 172.21.15.120:0/372798577 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c04000c10 con 0x7f6c0c0d1b40 2021-04-09T18:28:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.120 7f6c14633700 1 -- 172.21.15.120:0/372798577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0d1b40 msgr2=0x7f6c0c0d5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.120 7f6c14633700 1 --2- 172.21.15.120:0/372798577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0d1b40 0x7f6c0c0d5590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6c04006ad0 tx=0x7f6c04009ad0).stop 2021-04-09T18:28:45.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.121 7f6c14633700 1 -- 172.21.15.120:0/372798577 shutdown_connections 2021-04-09T18:28:45.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.121 7f6c14633700 1 --2- 172.21.15.120:0/372798577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0d1b40 0x7f6c0c0d5590 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:45.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.121 7f6c14633700 1 -- 172.21.15.120:0/372798577 >> 172.21.15.120:0/372798577 conn(0x7f6c0c0e93c0 msgr2=0x7f6c0c100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:45.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.121 7f6c14633700 1 -- 172.21.15.120:0/372798577 shutdown_connections 2021-04-09T18:28:45.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.121 7f6c14633700 1 -- 172.21.15.120:0/372798577 wait complete. 2021-04-09T18:28:45.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c14633700 1 Processor -- start 2021-04-09T18:28:45.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c14633700 1 -- start start 2021-04-09T18:28:45.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c14633700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0c39c0 0x7f6c0c095450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:45.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c14633700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c0c095a70 0x7f6c0c0941d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:45.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c14633700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c0947f0 0x7f6c0c191c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:45.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c14633700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0c3200 con 0x7f6c0c095a70 2021-04-09T18:28:45.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c14633700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0c3550 con 0x7f6c0c0947f0 2021-04-09T18:28:45.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c14633700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c192230 con 0x7f6c0c0c39c0 2021-04-09T18:28:45.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c11c4e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c0c095a70 0x7f6c0c0941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:45.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c11c4e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c0c095a70 0x7f6c0c0941d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58028/0 (socket says 172.21.15.120:58028) 2021-04-09T18:28:45.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.140 7f6c11c4e700 1 -- 172.21.15.120:0/712710493 learned_addr learned my addr 172.21.15.120:0/712710493 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:45.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c1244f700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0c39c0 0x7f6c0c095450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:45.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c12c50700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c0947f0 0x7f6c0c191c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:45.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c11c4e700 1 -- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0c39c0 msgr2=0x7f6c0c095450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:45.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c11c4e700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0c39c0 0x7f6c0c095450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:45.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c11c4e700 1 -- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c0947f0 msgr2=0x7f6c0c191c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:45.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c11c4e700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c0947f0 0x7f6c0c191c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:45.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c11c4e700 1 -- 172.21.15.120:0/712710493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c192450 con 0x7f6c0c095a70 2021-04-09T18:28:45.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c11c4e700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c0c095a70 0x7f6c0c0941d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f6c0800a4c0 tx=0x7f6c0800a860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:45.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6bfeffd700 1 -- 172.21.15.120:0/712710493 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c0800ac50 con 0x7f6c0c095a70 2021-04-09T18:28:45.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6bfeffd700 1 -- 172.21.15.120:0/712710493 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08004140 con 0x7f6c0c095a70 2021-04-09T18:28:45.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c14633700 1 -- 172.21.15.120:0/712710493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c192450 con 0x7f6c0c095a70 2021-04-09T18:28:45.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6bfeffd700 1 -- 172.21.15.120:0/712710493 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c08004620 con 0x7f6c0c095a70 2021-04-09T18:28:45.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.141 7f6c14633700 1 -- 172.21.15.120:0/712710493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c192450 con 0x7f6c0c095a70 2021-04-09T18:28:45.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.142 7f6bfeffd700 1 -- 172.21.15.120:0/712710493 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6c08004320 con 0x7f6c0c095a70 2021-04-09T18:28:45.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.142 7f6bfeffd700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6bf4018930 0x7f6bf401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:45.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.142 7f6bfeffd700 1 -- 172.21.15.120:0/712710493 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f6c08032d20 con 0x7f6c0c095a70 2021-04-09T18:28:45.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.142 7f6c1244f700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6bf4018930 0x7f6bf401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:45.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.142 7f6c1244f700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6bf4018930 0x7f6bf401ae10 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:45.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.165 7f6c14633700 1 -- 172.21.15.120:0/712710493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c094c80 con 0x7f6c0c095a70 2021-04-09T18:28:45.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.168 7f6bfeffd700 1 -- 172.21.15.120:0/712710493 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6c08000e20 con 0x7f6c0c095a70 2021-04-09T18:28:45.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.349 7f6c14633700 1 -- 172.21.15.120:0/712710493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c0c094c80 con 0x7f6c0c095a70 2021-04-09T18:28:45.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.349 7f6bfeffd700 1 -- 172.21.15.120:0/712710493 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f6c08004140 con 0x7f6c0c095a70 2021-04-09T18:28:45.340 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 36 2021-04-09T18:28:45.340 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:45.341 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4844,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:45.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 -- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6bf4018930 msgr2=0x7f6bf401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:45.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6bf4018930 0x7f6bf401ae10 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:45.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 -- 172.21.15.120:0/712710493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c0c095a70 msgr2=0x7f6c0c0941d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:45.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c0c095a70 0x7f6c0c0941d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f6c0800a4c0 tx=0x7f6c0800a860).stop 2021-04-09T18:28:45.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 -- 172.21.15.120:0/712710493 shutdown_connections 2021-04-09T18:28:45.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c0947f0 0x7f6c0c191c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:45.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c0c095a70 0x7f6c0c0941d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:45.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6bf4018930 0x7f6bf401ae10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:45.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 --2- 172.21.15.120:0/712710493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c0c0c39c0 0x7f6c0c095450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:45.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 -- 172.21.15.120:0/712710493 >> 172.21.15.120:0/712710493 conn(0x7f6c0c0ab640 msgr2=0x7f6c0c09fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:45.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 -- 172.21.15.120:0/712710493 shutdown_connections 2021-04-09T18:28:45.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:45.352 7f6c14633700 1 -- 172.21.15.120:0/712710493 wait complete. 2021-04-09T18:28:45.352 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:28:47.352 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:47.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.548 7f7329f30700 1 Processor -- start 2021-04-09T18:28:47.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.548 7f7329f30700 1 -- start start 2021-04-09T18:28:47.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.548 7f7329f30700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73240d7160 0x7f73240e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:47.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.548 7f7329f30700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f73240d7560 0x7f73240d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:47.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.548 7f7329f30700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73240d6be0 con 0x7f73240d5bc0 2021-04-09T18:28:47.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.548 7f7329f30700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73240d80f0 con 0x7f73240d7560 2021-04-09T18:28:47.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7329f30700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73240e7f00 con 0x7f73240d7160 2021-04-09T18:28:47.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7322ffd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f73240d7560 0x7f73240d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:47.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7322ffd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f73240d7560 0x7f73240d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58042/0 (socket says 172.21.15.120:58042) 2021-04-09T18:28:47.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7322ffd700 1 -- 172.21.15.120:0/465033166 learned_addr learned my addr 172.21.15.120:0/465033166 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:47.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f73237fe700 1 --2- 172.21.15.120:0/465033166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73240d7160 0x7f73240e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:47.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7322ffd700 1 -- 172.21.15.120:0/465033166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73240d7160 msgr2=0x7f73240e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:47.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7322ffd700 1 --2- 172.21.15.120:0/465033166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73240d7160 0x7f73240e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7322ffd700 1 -- 172.21.15.120:0/465033166 >> v1:172.21.15.134:6789/0 conn(0x7f73240d5bc0 legacy=0x7f73240d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7322ffd700 1 -- 172.21.15.120:0/465033166 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73241a2ac0 con 0x7f73240d7560 2021-04-09T18:28:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f73237fe700 1 --2- 172.21.15.120:0/465033166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73240d7160 0x7f73240e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:47.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7322ffd700 1 --2- 172.21.15.120:0/465033166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73240d7560 0x7f73240d55a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f7318006700 tx=0x7f7318009b80).ready entity=mon.0 client_cookie=4e388f470dac165b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:47.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f73227fc700 1 -- 172.21.15.120:0/465033166 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f731800c0c0 con 0x7f73240d7560 2021-04-09T18:28:47.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f73227fc700 1 -- 172.21.15.120:0/465033166 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731800c440 con 0x7f73240d7560 2021-04-09T18:28:47.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f73227fc700 1 -- 172.21.15.120:0/465033166 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f731800c920 con 0x7f73240d7560 2021-04-09T18:28:47.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7329f30700 1 -- 172.21.15.120:0/465033166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73240d7560 msgr2=0x7f73240d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:47.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.549 7f7329f30700 1 --2- 172.21.15.120:0/465033166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73240d7560 0x7f73240d55a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f7318006700 tx=0x7f7318009b80).stop 2021-04-09T18:28:47.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.550 7f7329f30700 1 -- 172.21.15.120:0/465033166 shutdown_connections 2021-04-09T18:28:47.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.550 7f7329f30700 1 --2- 172.21.15.120:0/465033166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73240d7560 0x7f73240d55a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.550 7f7329f30700 1 --2- 172.21.15.120:0/465033166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73240d7160 0x7f73240e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.550 7f7329f30700 1 -- 172.21.15.120:0/465033166 >> 172.21.15.120:0/465033166 conn(0x7f73240d1590 msgr2=0x7f73240d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:47.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.550 7f7329f30700 1 -- 172.21.15.120:0/465033166 shutdown_connections 2021-04-09T18:28:47.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.550 7f7329f30700 1 -- 172.21.15.120:0/465033166 wait complete. 2021-04-09T18:28:47.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.569 7f7329f30700 1 Processor -- start 2021-04-09T18:28:47.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.569 7f7329f30700 1 -- start start 2021-04-09T18:28:47.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.569 7f7329f30700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f732408aca0 0x7f732417ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:47.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.569 7f7329f30700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f732408b0a0 0x7f7324095890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:47.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7329f30700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f732417f0b0 0x7f73240aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:47.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7329f30700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732408b690 con 0x7f732408b0a0 2021-04-09T18:28:47.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7329f30700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732408b910 con 0x7f732408aca0 2021-04-09T18:28:47.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7329f30700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7324095eb0 con 0x7f732417f0b0 2021-04-09T18:28:47.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7322ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f732408b0a0 0x7f7324095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:47.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7322ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f732408b0a0 0x7f7324095890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58046/0 (socket says 172.21.15.120:58046) 2021-04-09T18:28:47.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7322ffd700 1 -- 172.21.15.120:0/3587915070 learned_addr learned my addr 172.21.15.120:0/3587915070 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:47.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f73237fe700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f732408aca0 0x7f732417ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:47.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7323fff700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f732417f0b0 0x7f73240aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:47.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7322ffd700 1 -- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f732417f0b0 msgr2=0x7f73240aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:47.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7322ffd700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f732417f0b0 0x7f73240aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7322ffd700 1 -- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f732408aca0 msgr2=0x7f732417ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:47.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7322ffd700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f732408aca0 0x7f732417ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7322ffd700 1 -- 172.21.15.120:0/3587915070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73240960d0 con 0x7f732408b0a0 2021-04-09T18:28:47.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7322ffd700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f732408b0a0 0x7f7324095890 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f731800b5e0 tx=0x7f731800b980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:47.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f730bfff700 1 -- 172.21.15.120:0/3587915070 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f731800bd70 con 0x7f732408b0a0 2021-04-09T18:28:47.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f730bfff700 1 -- 172.21.15.120:0/3587915070 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318002030 con 0x7f732408b0a0 2021-04-09T18:28:47.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7329f30700 1 -- 172.21.15.120:0/3587915070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73240960d0 con 0x7f732408b0a0 2021-04-09T18:28:47.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f730bfff700 1 -- 172.21.15.120:0/3587915070 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7318002550 con 0x7f732408b0a0 2021-04-09T18:28:47.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.570 7f7329f30700 1 -- 172.21.15.120:0/3587915070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73240960d0 con 0x7f732408b0a0 2021-04-09T18:28:47.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.571 7f730bfff700 1 -- 172.21.15.120:0/3587915070 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7318000c90 con 0x7f732408b0a0 2021-04-09T18:28:47.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.571 7f730bfff700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7304018930 0x7f730401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:47.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.571 7f730bfff700 1 -- 172.21.15.120:0/3587915070 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f7318032d70 con 0x7f732408b0a0 2021-04-09T18:28:47.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.571 7f73237fe700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7304018930 0x7f730401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:47.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.572 7f73237fe700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7304018930 0x7f730401ae10 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:47.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.594 7f7329f30700 1 -- 172.21.15.120:0/3587915070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73240e48e0 con 0x7f732408b0a0 2021-04-09T18:28:47.587 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.598 7f730bfff700 1 -- 172.21.15.120:0/3587915070 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f731801f7a0 con 0x7f732408b0a0 2021-04-09T18:28:47.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.775 7f7329f30700 1 -- 172.21.15.120:0/3587915070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73240e48e0 con 0x7f732408b0a0 2021-04-09T18:28:47.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.775 7f730bfff700 1 -- 172.21.15.120:0/3587915070 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f731801f7a0 con 0x7f732408b0a0 2021-04-09T18:28:47.766 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 36 2021-04-09T18:28:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:47.766 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4844,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:47.768 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 -- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7304018930 msgr2=0x7f730401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:47.768 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7304018930 0x7f730401ae10 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.768 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 -- 172.21.15.120:0/3587915070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f732408b0a0 msgr2=0x7f7324095890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:47.768 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f732408b0a0 0x7f7324095890 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f731800b5e0 tx=0x7f731800b980).stop 2021-04-09T18:28:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 -- 172.21.15.120:0/3587915070 shutdown_connections 2021-04-09T18:28:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7304018930 0x7f730401ae10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f732417f0b0 0x7f73240aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f732408b0a0 0x7f7324095890 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 --2- 172.21.15.120:0/3587915070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f732408aca0 0x7f732417ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:47.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 -- 172.21.15.120:0/3587915070 >> 172.21.15.120:0/3587915070 conn(0x7f73241993c0 msgr2=0x7f7324199820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:47.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 -- 172.21.15.120:0/3587915070 shutdown_connections 2021-04-09T18:28:47.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:47.778 7f7329f30700 1 -- 172.21.15.120:0/3587915070 wait complete. 2021-04-09T18:28:47.777 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:28:49.779 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:50.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.975 7f2413cf7700 1 Processor -- start 2021-04-09T18:28:50.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.975 7f2413cf7700 1 -- start start 2021-04-09T18:28:50.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2413cf7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f240c0d7560 0x7f240c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2413cf7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c0d63b0 0x7f240c1ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2413cf7700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c0d7960 con 0x7f240c0d7160 2021-04-09T18:28:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2413cf7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c0d80f0 con 0x7f240c0d7560 2021-04-09T18:28:50.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2413cf7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0d6be0 con 0x7f240c0d63b0 2021-04-09T18:28:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2411312700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f240c0d7560 0x7f240c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2412314700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c0d63b0 0x7f240c1ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2411b13700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f240c0d7160 0x7f240c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:47784/0 (socket says 172.21.15.120:47784) 2021-04-09T18:28:50.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2411b13700 1 -- 172.21.15.120:0/1348152088 learned_addr learned my addr 172.21.15.120:0/1348152088 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2410b11700 1 -- 172.21.15.120:0/1348152088 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770596426 0 0) 0x7f2408001440 con 0x7f240c0d7160 2021-04-09T18:28:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.976 7f2410b11700 1 -- 172.21.15.120:0/1348152088 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f8002fe0 con 0x7f240c0d7160 2021-04-09T18:28:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2412314700 1 -- 172.21.15.120:0/1348152088 >> v2:172.21.15.134:3300/0 conn(0x7f240c0d7560 msgr2=0x7f240c0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:50.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2412314700 1 --2- 172.21.15.120:0/1348152088 >> v2:172.21.15.134:3300/0 conn(0x7f240c0d7560 0x7f240c0d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2412314700 1 -- 172.21.15.120:0/1348152088 >> v1:172.21.15.134:6789/0 conn(0x7f240c0d7160 legacy=0x7f240c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2412314700 1 -- 172.21.15.120:0/1348152088 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c1a2ac0 con 0x7f240c0d63b0 2021-04-09T18:28:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2411312700 1 --2- 172.21.15.120:0/1348152088 >> v2:172.21.15.134:3300/0 conn(0x7f240c0d7560 0x7f240c0d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2412314700 1 --2- 172.21.15.120:0/1348152088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c0d63b0 0x7f240c1ab1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2404006ad0 tx=0x7f2404009ad0).ready entity=mon.2 client_cookie=f70a1c69957a85e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2410b11700 1 -- 172.21.15.120:0/1348152088 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24040022e0 con 0x7f240c0d63b0 2021-04-09T18:28:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2410b11700 1 -- 172.21.15.120:0/1348152088 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2404006410 con 0x7f240c0d63b0 2021-04-09T18:28:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2410b11700 1 -- 172.21.15.120:0/1348152088 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2404002620 con 0x7f240c0d63b0 2021-04-09T18:28:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2413cf7700 1 -- 172.21.15.120:0/1348152088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c0d63b0 msgr2=0x7f240c1ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.977 7f2413cf7700 1 --2- 172.21.15.120:0/1348152088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c0d63b0 0x7f240c1ab1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2404006ad0 tx=0x7f2404009ad0).stop 2021-04-09T18:28:50.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.978 7f2413cf7700 1 -- 172.21.15.120:0/1348152088 shutdown_connections 2021-04-09T18:28:50.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.978 7f2413cf7700 1 --2- 172.21.15.120:0/1348152088 >> v2:172.21.15.134:3300/0 conn(0x7f240c0d7560 0x7f240c0d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.978 7f2413cf7700 1 --2- 172.21.15.120:0/1348152088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c0d63b0 0x7f240c1ab1e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.217 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.978 7f2413cf7700 1 -- 172.21.15.120:0/1348152088 >> 172.21.15.120:0/1348152088 conn(0x7f240c0d1590 msgr2=0x7f240c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:50.218 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.978 7f2413cf7700 1 -- 172.21.15.120:0/1348152088 shutdown_connections 2021-04-09T18:28:50.218 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:49.978 7f2413cf7700 1 -- 172.21.15.120:0/1348152088 wait complete. 2021-04-09T18:28:50.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.222 7f2413cf7700 1 Processor -- start 2021-04-09T18:28:50.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.222 7f2413cf7700 1 -- start start 2021-04-09T18:28:50.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.222 7f2413cf7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c095880 0x7f240c17e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:50.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.222 7f2413cf7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f240c194c90 0x7f240c17c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:50.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.222 7f2413cf7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240c17cb40 0x7f240c17cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:50.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.222 7f2413cf7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c184000 con 0x7f240c194c90 2021-04-09T18:28:50.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.222 7f2413cf7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c17d560 con 0x7f240c17cb40 2021-04-09T18:28:50.222 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.222 7f2413cf7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c17d780 con 0x7f240c095880 2021-04-09T18:28:50.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411312700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f240c194c90 0x7f240c17c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:50.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411312700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f240c194c90 0x7f240c17c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58062/0 (socket says 172.21.15.120:58062) 2021-04-09T18:28:50.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411312700 1 -- 172.21.15.120:0/2668618397 learned_addr learned my addr 172.21.15.120:0/2668618397 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:50.223 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411b13700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c095880 0x7f240c17e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:50.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2412314700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240c17cb40 0x7f240c17cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:50.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411312700 1 -- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c095880 msgr2=0x7f240c17e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:50.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411312700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c095880 0x7f240c17e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.224 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411312700 1 -- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240c17cb40 msgr2=0x7f240c17cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:50.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411312700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240c17cb40 0x7f240c17cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411312700 1 -- 172.21.15.120:0/2668618397 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c093880 con 0x7f240c194c90 2021-04-09T18:28:50.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2412314700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240c17cb40 0x7f240c17cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:28:50.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2411312700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f240c194c90 0x7f240c17c520 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f23fc006f40 tx=0x7f23fc00b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:50.225 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f24027fc700 1 -- 172.21.15.120:0/2668618397 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23fc00bd80 con 0x7f240c194c90 2021-04-09T18:28:50.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f24027fc700 1 -- 172.21.15.120:0/2668618397 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc000c90 con 0x7f240c194c90 2021-04-09T18:28:50.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f24027fc700 1 -- 172.21.15.120:0/2668618397 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23fc002220 con 0x7f240c194c90 2021-04-09T18:28:50.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.223 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c093880 con 0x7f240c194c90 2021-04-09T18:28:50.226 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.224 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c093880 con 0x7f240c194c90 2021-04-09T18:28:50.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.224 7f24027fc700 1 -- 172.21.15.120:0/2668618397 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f23fc00a000 con 0x7f240c194c90 2021-04-09T18:28:50.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.224 7f24027fc700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f23f4018930 0x7f23f401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:50.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.224 7f24027fc700 1 -- 172.21.15.120:0/2668618397 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6365+0+0 (secure 0 0 0) 0x7f23fc032cf0 con 0x7f240c194c90 2021-04-09T18:28:50.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.224 7f2411b13700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f23f4018930 0x7f23f401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:50.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.225 7f2411b13700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f23f4018930 0x7f23f401ae10 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:50.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.273 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c179cb0 con 0x7f240c194c90 2021-04-09T18:28:50.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.276 7f24027fc700 1 -- 172.21.15.120:0/2668618397 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f23fc000c90 con 0x7f240c194c90 2021-04-09T18:28:50.447 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.457 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f240c179cb0 con 0x7f240c194c90 2021-04-09T18:28:50.448 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.458 7f24027fc700 1 -- 172.21.15.120:0/2668618397 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f23fc006b00 con 0x7f240c194c90 2021-04-09T18:28:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:50.448 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4844,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:07.015366","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":30,"addr":"172.21.15.120:6833/4282122355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4282122355},{"type":"v1","addr":"172.21.15.120:6833","nonce":4282122355}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:50.449 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 36 2021-04-09T18:28:50.450 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f23f4018930 msgr2=0x7f23f401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:50.450 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f23f4018930 0x7f23f401ae10 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.451 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f240c194c90 msgr2=0x7f240c17c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:50.451 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f240c194c90 0x7f240c17c520 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f23fc006f40 tx=0x7f23fc00b990).stop 2021-04-09T18:28:50.451 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 shutdown_connections 2021-04-09T18:28:50.452 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f240c17cb40 0x7f240c17cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.452 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f240c194c90 0x7f240c17c520 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.452 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f23f4018930 0x7f23f401ae10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.452 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 --2- 172.21.15.120:0/2668618397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f240c095880 0x7f240c17e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:50.453 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 >> 172.21.15.120:0/2668618397 conn(0x7f240c186700 msgr2=0x7f240c17e730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:50.453 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 shutdown_connections 2021-04-09T18:28:50.453 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:50.460 7f2413cf7700 1 -- 172.21.15.120:0/2668618397 wait complete. 2021-04-09T18:28:50.460 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:28:52.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:52.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.649 7fdf980a7700 1 Processor -- start 2021-04-09T18:28:52.667 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.649 7fdf980a7700 1 -- start start 2021-04-09T18:28:52.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf980a7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf900d7160 0x7fdf900d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:52.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf980a7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf900d6190 0x7fdf900d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:52.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf980a7700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf900d6be0 con 0x7fdf900d55a0 2021-04-09T18:28:52.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf980a7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf900d80f0 con 0x7fdf900d7160 2021-04-09T18:28:52.668 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf980a7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf901a2ac0 con 0x7fdf900d6190 2021-04-09T18:28:52.669 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf956c2700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fdf900d55a0 0x7fdf900d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52988/0 (socket says 172.21.15.120:52988) 2021-04-09T18:28:52.669 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf956c2700 1 -- 172.21.15.120:0/1939541853 learned_addr learned my addr 172.21.15.120:0/1939541853 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:52.669 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf956c2700 1 -- 172.21.15.120:0/1939541853 >> v1:172.21.15.120:6789/0 conn(0x7fdf900d55a0 legacy=0x7fdf900d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-04-09T18:28:52.669 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf956c2700 1 -- 172.21.15.120:0/1939541853 >> v1:172.21.15.120:6789/0 conn(0x7fdf900d55a0 legacy=0x7fdf900d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:28:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf95ec3700 1 --2- 172.21.15.120:0/1939541853 >> v2:172.21.15.134:3300/0 conn(0x7fdf900d7160 0x7fdf900d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf956c2700 1 --1- 172.21.15.120:0/1939541853 >> v1:172.21.15.120:6789/0 conn(0x7fdf900d55a0 0x7fdf900d59a0 :-1 s=OPENED pgs=393 cs=1 l=1).handle_message read tag failed 2021-04-09T18:28:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf956c2700 1 --1- 172.21.15.120:0/1939541853 >> v1:172.21.15.120:6789/0 conn(0x7fdf900d55a0 0x7fdf900d59a0 :-1 s=OPENED pgs=393 cs=1 l=1).fault on lossy channel, failing 2021-04-09T18:28:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf966c4700 1 --2- 172.21.15.120:0/1939541853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf900d6190 0x7fdf900d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:52.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf95ec3700 1 -- 172.21.15.120:0/1939541853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf900d6190 msgr2=0x7fdf900d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:52.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf95ec3700 1 --2- 172.21.15.120:0/1939541853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf900d6190 0x7fdf900d6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf95ec3700 1 -- 172.21.15.120:0/1939541853 >> v1:172.21.15.120:6789/0 conn(0x7fdf900d55a0 legacy=0x7fdf900d59a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-04-09T18:28:52.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf95ec3700 1 -- 172.21.15.120:0/1939541853 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf901a2cb0 con 0x7fdf900d7160 2021-04-09T18:28:52.671 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.650 7fdf966c4700 1 --2- 172.21.15.120:0/1939541853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf900d6190 0x7fdf900d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:52.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.651 7fdf95ec3700 1 --2- 172.21.15.120:0/1939541853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf900d7160 0x7fdf900d7560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fdf8c0069d0 tx=0x7fdf8c009d90).ready entity=mon.1 client_cookie=6632d6418e5931c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:52.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.651 7fdf94ec1700 1 -- 172.21.15.120:0/1939541853 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdf8c000d30 con 0x7fdf900d7160 2021-04-09T18:28:52.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.651 7fdf94ec1700 1 -- 172.21.15.120:0/1939541853 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c00b510 con 0x7fdf900d7160 2021-04-09T18:28:52.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.651 7fdf94ec1700 1 -- 172.21.15.120:0/1939541853 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdf8c00b9f0 con 0x7fdf900d7160 2021-04-09T18:28:52.672 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.651 7fdf980a7700 1 -- 172.21.15.120:0/1939541853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf900d7160 msgr2=0x7fdf900d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:52.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.651 7fdf980a7700 1 --2- 172.21.15.120:0/1939541853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf900d7160 0x7fdf900d7560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fdf8c0069d0 tx=0x7fdf8c009d90).stop 2021-04-09T18:28:52.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.652 7fdf980a7700 1 -- 172.21.15.120:0/1939541853 shutdown_connections 2021-04-09T18:28:52.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.652 7fdf980a7700 1 --2- 172.21.15.120:0/1939541853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf900d6190 0x7fdf900d6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.673 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.652 7fdf980a7700 1 --2- 172.21.15.120:0/1939541853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf900d7160 0x7fdf900d7560 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.652 7fdf980a7700 1 -- 172.21.15.120:0/1939541853 >> 172.21.15.120:0/1939541853 conn(0x7fdf900d1590 msgr2=0x7fdf900d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:52.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.652 7fdf980a7700 1 -- 172.21.15.120:0/1939541853 shutdown_connections 2021-04-09T18:28:52.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.652 7fdf980a7700 1 -- 172.21.15.120:0/1939541853 wait complete. 2021-04-09T18:28:52.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf980a7700 1 Processor -- start 2021-04-09T18:28:52.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf980a7700 1 -- start start 2021-04-09T18:28:52.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf980a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf90187380 0x7fdf90189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:52.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf980a7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf90187780 0x7fdf900987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:52.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf980a7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf90189c50 0x7fdf900b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:52.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf980a7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9018ce60 con 0x7fdf90187780 2021-04-09T18:28:52.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf980a7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf90098e10 con 0x7fdf90187380 2021-04-09T18:28:52.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf980a7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf90099030 con 0x7fdf90189c50 2021-04-09T18:28:52.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf956c2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf90187780 0x7fdf900987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:52.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf956c2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf90187780 0x7fdf900987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58080/0 (socket says 172.21.15.120:58080) 2021-04-09T18:28:52.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf966c4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf90189c50 0x7fdf900b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:52.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf956c2700 1 -- 172.21.15.120:0/457810970 learned_addr learned my addr 172.21.15.120:0/457810970 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:52.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.678 7fdf95ec3700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf90187380 0x7fdf90189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:52.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf956c2700 1 -- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf90189c50 msgr2=0x7fdf900b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:52.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf956c2700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf90189c50 0x7fdf900b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf956c2700 1 -- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf90187380 msgr2=0x7fdf90189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:52.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf956c2700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf90187380 0x7fdf90189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf956c2700 1 -- 172.21.15.120:0/457810970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf900b8b30 con 0x7fdf90187780 2021-04-09T18:28:52.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf966c4700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf90189c50 0x7fdf900b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:52.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf956c2700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf90187780 0x7fdf900987f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fdf80001c60 tx=0x7fdf8000a8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:52.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf867fc700 1 -- 172.21.15.120:0/457810970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdf8000acc0 con 0x7fdf90187780 2021-04-09T18:28:52.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf867fc700 1 -- 172.21.15.120:0/457810970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80004140 con 0x7fdf90187780 2021-04-09T18:28:52.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf980a7700 1 -- 172.21.15.120:0/457810970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf900b8b30 con 0x7fdf90187780 2021-04-09T18:28:52.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf867fc700 1 -- 172.21.15.120:0/457810970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdf800045a0 con 0x7fdf90187780 2021-04-09T18:28:52.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.679 7fdf980a7700 1 -- 172.21.15.120:0/457810970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf900b8b30 con 0x7fdf90187780 2021-04-09T18:28:52.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.680 7fdf867fc700 1 -- 172.21.15.120:0/457810970 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdf80000ce0 con 0x7fdf90187780 2021-04-09T18:28:52.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.680 7fdf867fc700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdf78018930 0x7fdf7801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:52.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.680 7fdf867fc700 1 -- 172.21.15.120:0/457810970 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7fdf80032d30 con 0x7fdf90187780 2021-04-09T18:28:52.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.680 7fdf95ec3700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdf78018930 0x7fdf7801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:52.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.681 7fdf95ec3700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdf78018930 0x7fdf7801ae10 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:52.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.696 7fdf980a7700 1 -- 172.21.15.120:0/457810970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf90189100 con 0x7fdf90187780 2021-04-09T18:28:52.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.699 7fdf867fc700 1 -- 172.21.15.120:0/457810970 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdf800009b0 con 0x7fdf90187780 2021-04-09T18:28:52.874 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.884 7fdf980a7700 1 -- 172.21.15.120:0/457810970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf90189100 con 0x7fdf90187780 2021-04-09T18:28:52.875 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.885 7fdf867fc700 1 -- 172.21.15.120:0/457810970 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+1767 (secure 0 0 0) 0x7fdf80000ce0 con 0x7fdf90187780 2021-04-09T18:28:52.876 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 37 2021-04-09T18:28:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:52.878 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:50.809115","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:replay","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:52.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 -- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdf78018930 msgr2=0x7fdf7801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:52.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdf78018930 0x7fdf7801ae10 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 -- 172.21.15.120:0/457810970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf90187780 msgr2=0x7fdf900987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:52.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf90187780 0x7fdf900987f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fdf80001c60 tx=0x7fdf8000a8d0).stop 2021-04-09T18:28:52.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 -- 172.21.15.120:0/457810970 shutdown_connections 2021-04-09T18:28:52.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdf78018930 0x7fdf7801ae10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.882 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf90189c50 0x7fdf900b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf90187780 0x7fdf900987f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 --2- 172.21.15.120:0/457810970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf90187380 0x7fdf90189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:52.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 -- 172.21.15.120:0/457810970 >> 172.21.15.120:0/457810970 conn(0x7fdf9018dc90 msgr2=0x7fdf9008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:52.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.887 7fdf980a7700 1 -- 172.21.15.120:0/457810970 shutdown_connections 2021-04-09T18:28:52.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:52.888 7fdf980a7700 1 -- 172.21.15.120:0/457810970 wait complete. 2021-04-09T18:28:52.887 INFO:tasks.mds_thrash.fs.[None]:mds.a down, removed from mdsmap 2021-04-09T18:28:52.888 INFO:tasks.mds_thrash.fs.[None]:waiting for mds cluster to stabilize... 2021-04-09T18:28:52.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:53.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.077 7f5ebf3c2700 1 Processor -- start 2021-04-09T18:28:53.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.077 7f5ebf3c2700 1 -- start start 2021-04-09T18:28:53.088 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebf3c2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb80d7160 0x7f5eb80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:53.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebf3c2700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5eb80e70a0 0x7f5eb80d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:53.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebf3c2700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb80d6be0 con 0x7f5eb80d7560 2021-04-09T18:28:53.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebf3c2700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb80d80f0 con 0x7f5eb80e70a0 2021-04-09T18:28:53.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebf3c2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80e7f00 con 0x7f5eb80d7160 2021-04-09T18:28:53.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebd1de700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb80d7160 0x7f5eb80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:53.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebc9dd700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5eb80d7560 0x7f5eb80d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:47822/0 (socket says 172.21.15.120:47822) 2021-04-09T18:28:53.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebd1de700 1 --2- 172.21.15.120:0/3970823180 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb80d7160 0x7f5eb80e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:44754/0 (socket says 172.21.15.120:44754) 2021-04-09T18:28:53.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebc9dd700 1 -- 172.21.15.120:0/3970823180 learned_addr learned my addr 172.21.15.120:0/3970823180 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:53.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.078 7f5ebd9df700 1 --2- 172.21.15.120:0/3970823180 >> v2:172.21.15.134:3300/0 conn(0x7f5eb80e70a0 0x7f5eb80d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:53.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5eaffff700 1 -- 172.21.15.120:0/3970823180 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917920326 0 0) 0x7f5ea80010b0 con 0x7f5eb80d7560 2021-04-09T18:28:53.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5ebd1de700 1 -- 172.21.15.120:0/3970823180 >> v2:172.21.15.134:3300/0 conn(0x7f5eb80e70a0 msgr2=0x7f5eb80d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:53.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5ebd1de700 1 --2- 172.21.15.120:0/3970823180 >> v2:172.21.15.134:3300/0 conn(0x7f5eb80e70a0 0x7f5eb80d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5ebd1de700 1 -- 172.21.15.120:0/3970823180 >> v1:172.21.15.134:6789/0 conn(0x7f5eb80d7560 legacy=0x7f5eb80d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:53.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5ebd1de700 1 -- 172.21.15.120:0/3970823180 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb81a2ac0 con 0x7f5eb80d7160 2021-04-09T18:28:53.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5ebd9df700 1 --2- 172.21.15.120:0/3970823180 >> v2:172.21.15.134:3300/0 conn(0x7f5eb80e70a0 0x7f5eb80d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:53.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5ebd1de700 1 --2- 172.21.15.120:0/3970823180 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb80d7160 0x7f5eb80e78e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5eb40069d0 tx=0x7f5eb4009e40).ready entity=mon.2 client_cookie=9211baf7cbcf5510 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:53.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5eaffff700 1 -- 172.21.15.120:0/3970823180 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5eb400b510 con 0x7f5eb80d7160 2021-04-09T18:28:53.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5eaffff700 1 -- 172.21.15.120:0/3970823180 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb400b890 con 0x7f5eb80d7160 2021-04-09T18:28:53.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5eaffff700 1 -- 172.21.15.120:0/3970823180 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5eb4000d30 con 0x7f5eb80d7160 2021-04-09T18:28:53.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5ebf3c2700 1 -- 172.21.15.120:0/3970823180 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb80d7160 msgr2=0x7f5eb80e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:53.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.079 7f5ebf3c2700 1 --2- 172.21.15.120:0/3970823180 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb80d7160 0x7f5eb80e78e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5eb40069d0 tx=0x7f5eb4009e40).stop 2021-04-09T18:28:53.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.080 7f5ebf3c2700 1 -- 172.21.15.120:0/3970823180 shutdown_connections 2021-04-09T18:28:53.093 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.080 7f5ebf3c2700 1 --2- 172.21.15.120:0/3970823180 >> v2:172.21.15.134:3300/0 conn(0x7f5eb80e70a0 0x7f5eb80d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.080 7f5ebf3c2700 1 --2- 172.21.15.120:0/3970823180 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb80d7160 0x7f5eb80e78e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.080 7f5ebf3c2700 1 -- 172.21.15.120:0/3970823180 >> 172.21.15.120:0/3970823180 conn(0x7f5eb80d1590 msgr2=0x7f5eb80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:53.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.080 7f5ebf3c2700 1 -- 172.21.15.120:0/3970823180 shutdown_connections 2021-04-09T18:28:53.094 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.080 7f5ebf3c2700 1 -- 172.21.15.120:0/3970823180 wait complete. 2021-04-09T18:28:53.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebf3c2700 1 Processor -- start 2021-04-09T18:28:53.095 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebf3c2700 1 -- start start 2021-04-09T18:28:53.097 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebf3c2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb8095e20 0x7f5eb817ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:53.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebf3c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb8096220 0x7f5eb817a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:53.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebf3c2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb817aa00 0x7f5eb817ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:53.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebf3c2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80a5b00 con 0x7f5eb817aa00 2021-04-09T18:28:53.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebf3c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb808c760 con 0x7f5eb8096220 2021-04-09T18:28:53.098 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebf3c2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb817f1f0 con 0x7f5eb8095e20 2021-04-09T18:28:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebd9df700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb817aa00 0x7f5eb817ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebd9df700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb817aa00 0x7f5eb817ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58098/0 (socket says 172.21.15.120:58098) 2021-04-09T18:28:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebd9df700 1 -- 172.21.15.120:0/4229096656 learned_addr learned my addr 172.21.15.120:0/4229096656 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:53.099 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebd1de700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb8095e20 0x7f5eb817ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:53.100 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.099 7f5ebc9dd700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb8096220 0x7f5eb817a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:53.100 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5ebd9df700 1 -- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb8095e20 msgr2=0x7f5eb817ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:53.100 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5ebd9df700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb8095e20 0x7f5eb817ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.100 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5ebd9df700 1 -- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb8096220 msgr2=0x7f5eb817a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:53.100 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5ebd9df700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb8096220 0x7f5eb817a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5ebd9df700 1 -- 172.21.15.120:0/4229096656 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb808a9b0 con 0x7f5eb817aa00 2021-04-09T18:28:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5ebd9df700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb817aa00 0x7f5eb817ae00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f5eb000b5e0 tx=0x7f5eb000b980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5eadffb700 1 -- 172.21.15.120:0/4229096656 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5eb0000c10 con 0x7f5eb817aa00 2021-04-09T18:28:53.101 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5eadffb700 1 -- 172.21.15.120:0/4229096656 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb000bd70 con 0x7f5eb817aa00 2021-04-09T18:28:53.102 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb808a9b0 con 0x7f5eb817aa00 2021-04-09T18:28:53.102 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5eadffb700 1 -- 172.21.15.120:0/4229096656 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5eb00024d0 con 0x7f5eb817aa00 2021-04-09T18:28:53.102 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.100 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb808a9b0 con 0x7f5eb817aa00 2021-04-09T18:28:53.102 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.101 7f5eadffb700 1 -- 172.21.15.120:0/4229096656 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5eb0006720 con 0x7f5eb817aa00 2021-04-09T18:28:53.102 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.101 7f5eadffb700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e98018930 0x7f5e9801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:53.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.101 7f5eadffb700 1 -- 172.21.15.120:0/4229096656 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f5eb0032da0 con 0x7f5eb817aa00 2021-04-09T18:28:53.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.101 7f5ebd1de700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e98018930 0x7f5e9801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:53.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.101 7f5ebd1de700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e98018930 0x7f5e9801ae10 crc :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:53.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.124 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb808c760 con 0x7f5eb817aa00 2021-04-09T18:28:53.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.127 7f5eadffb700 1 -- 172.21.15.120:0/4229096656 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f5eb0006370 con 0x7f5eb817aa00 2021-04-09T18:28:53.294 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.305 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5eb808c760 con 0x7f5eb817aa00 2021-04-09T18:28:53.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.305 7f5eadffb700 1 -- 172.21.15.120:0/4229096656 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+1767 (secure 0 0 0) 0x7f5eb000bd70 con 0x7f5eb817aa00 2021-04-09T18:28:53.296 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 37 2021-04-09T18:28:53.296 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:53.296 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:50.809115","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:replay","state_seq":2,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:53.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e98018930 msgr2=0x7f5e9801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:53.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e98018930 0x7f5e9801ae10 crc :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb817aa00 msgr2=0x7f5eb817ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:53.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb817aa00 0x7f5eb817ae00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f5eb000b5e0 tx=0x7f5eb000b980).stop 2021-04-09T18:28:53.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 shutdown_connections 2021-04-09T18:28:53.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5eb817aa00 0x7f5eb817ae00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eb8096220 0x7f5eb817a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5e98018930 0x7f5e9801ae10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 --2- 172.21.15.120:0/4229096656 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5eb8095e20 0x7f5eb817ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:53.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 >> 172.21.15.120:0/4229096656 conn(0x7f5eb81993c0 msgr2=0x7f5eb8199820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:53.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 shutdown_connections 2021-04-09T18:28:53.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:53.308 7f5ebf3c2700 1 -- 172.21.15.120:0/4229096656 wait complete. 2021-04-09T18:28:53.308 INFO:tasks.mds_thrash.fs.[None]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 37, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-04-09 18:19:55.049244", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 37, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4844": { "addr": "172.21.15.134:6835/782463162", "addrs": { "addrvec": [ { "addr": "172.21.15.134:6834", "nonce": 782463162, "type": "v2" }, { "addr": "172.21.15.134:6835", "nonce": 782463162, "type": "v1" } ] }, "export_targets": [], "features": 4611087854035861503, "flags": 0, "gid": 4844, "incarnation": 37, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "-1 (unspecified)", "modified": "2021-04-09 18:28:50.809115", "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4844 } } } ], "standbys": [] } 2021-04-09T18:28:55.310 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:55.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.504 7fbbfe9c5700 1 Processor -- start 2021-04-09T18:28:55.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.504 7fbbfe9c5700 1 -- start start 2021-04-09T18:28:55.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbfe9c5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbf80d7160 0x7fbbf80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:55.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbfe9c5700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf80d6be0 con 0x7fbbf80d7560 2021-04-09T18:28:55.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbfe9c5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf80e7f00 con 0x7fbbf80e70a0 2021-04-09T18:28:55.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbfe9c5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80d80f0 con 0x7fbbf80d7160 2021-04-09T18:28:55.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbeffff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbbf80d7560 0x7fbbf80d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53018/0 (socket says 172.21.15.120:53018) 2021-04-09T18:28:55.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbeffff700 1 -- 172.21.15.120:0/2116065220 learned_addr learned my addr 172.21.15.120:0/2116065220 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:55.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbf7fff700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbf80d7160 0x7fbbf80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:55.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074345769 0 0) 0x7fbbe0000ce0 con 0x7fbbf80d7560 2021-04-09T18:28:55.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe4002fe0 con 0x7fbbf80d7560 2021-04-09T18:28:55.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.505 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 796580324 0 0) 0x7fbbe00010e0 con 0x7fbbf80d7560 2021-04-09T18:28:55.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbf80d7160 msgr2=0x7fbbf80e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:55.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbf80d7160 0x7fbbf80e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 >> v1:172.21.15.134:6789/0 conn(0x7fbbf80e70a0 legacy=0x7fbbf80d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:55.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf81a2ac0 con 0x7fbbf80d7560 2021-04-09T18:28:55.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7fbbe0001600 con 0x7fbbf80d7560 2021-04-09T18:28:55.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 >> v1:172.21.15.120:6789/0 conn(0x7fbbf80d7560 legacy=0x7fbbf80d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:55.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbe4003a70 0x7fbbe4005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:55.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe4006760 0x7fbbe4008c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:55.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe4009500 0x7fbbe400ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:55.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe400c2d0 con 0x7fbbe4009500 2021-04-09T18:28:55.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe400c4f0 con 0x7fbbe4006760 2021-04-09T18:28:55.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4050720 con 0x7fbbe4003a70 2021-04-09T18:28:55.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfcfe2700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe4009500 0x7fbbe400ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:55.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf7fff700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbe4003a70 0x7fbbe4005ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:55.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbeffff700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe4006760 0x7fbbe4008c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:55.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfcfe2700 1 -- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbe4003a70 msgr2=0x7fbbe4005ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:55.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfcfe2700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbe4003a70 0x7fbbe4005ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfcfe2700 1 -- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe4006760 msgr2=0x7fbbe4008c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:55.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfcfe2700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe4006760 0x7fbbe4008c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfcfe2700 1 -- 172.21.15.120:0/2116065220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4050980 con 0x7fbbe4009500 2021-04-09T18:28:55.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfcfe2700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe4009500 0x7fbbe400ba20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fbbf0006e40 tx=0x7fbbf0009e30).ready entity=mon.0 client_cookie=ddb51a76c2e7ff4e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:55.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbbf0006a60 con 0x7fbbe4009500 2021-04-09T18:28:55.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf000b300 con 0x7fbbe4009500 2021-04-09T18:28:55.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbf77fe700 1 -- 172.21.15.120:0/2116065220 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbbf000b820 con 0x7fbbe4009500 2021-04-09T18:28:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfe9c5700 1 -- 172.21.15.120:0/2116065220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe4009500 msgr2=0x7fbbe400ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfe9c5700 1 --2- 172.21.15.120:0/2116065220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe4009500 0x7fbbe400ba20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fbbf0006e40 tx=0x7fbbf0009e30).stop 2021-04-09T18:28:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.506 7fbbfcfe2700 1 -- 172.21.15.120:0/2116065220 reap_dead start 2021-04-09T18:28:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.507 7fbbfe9c5700 1 -- 172.21.15.120:0/2116065220 shutdown_connections 2021-04-09T18:28:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.507 7fbbfe9c5700 1 -- 172.21.15.120:0/2116065220 >> 172.21.15.120:0/2116065220 conn(0x7fbbf80d1590 msgr2=0x7fbbf80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.507 7fbbfe9c5700 1 -- 172.21.15.120:0/2116065220 shutdown_connections 2021-04-09T18:28:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.507 7fbbfe9c5700 1 -- 172.21.15.120:0/2116065220 wait complete. 2021-04-09T18:28:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.526 7fbbfe9c5700 1 Processor -- start 2021-04-09T18:28:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.526 7fbbfe9c5700 1 -- start start 2021-04-09T18:28:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.526 7fbbfe9c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf80b1f90 0x7fbbf80b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.526 7fbbfe9c5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbf809c9a0 0x7fbbf809cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:55.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.526 7fbbfe9c5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbf819ffd0 0x7fbbf81a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:55.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.526 7fbbfe9c5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf81a09f0 con 0x7fbbf819ffd0 2021-04-09T18:28:55.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.526 7fbbfe9c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf809c420 con 0x7fbbf80b1f90 2021-04-09T18:28:55.532 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.526 7fbbfe9c5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf8196810 con 0x7fbbf809c9a0 2021-04-09T18:28:55.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfcfe2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbf819ffd0 0x7fbbf81a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:55.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfcfe2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbf819ffd0 0x7fbbf81a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58122/0 (socket says 172.21.15.120:58122) 2021-04-09T18:28:55.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfcfe2700 1 -- 172.21.15.120:0/2264664568 learned_addr learned my addr 172.21.15.120:0/2264664568 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:55.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbeffff700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbf809c9a0 0x7fbbf809cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:55.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbf7fff700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf80b1f90 0x7fbbf80b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:55.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfcfe2700 1 -- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbf809c9a0 msgr2=0x7fbbf809cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:55.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfcfe2700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbf809c9a0 0x7fbbf809cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfcfe2700 1 -- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf80b1f90 msgr2=0x7fbbf80b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:55.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfcfe2700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf80b1f90 0x7fbbf80b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfcfe2700 1 -- 172.21.15.120:0/2264664568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8196370 con 0x7fbbf819ffd0 2021-04-09T18:28:55.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfcfe2700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbf819ffd0 0x7fbbf81a03d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fbbf00099e0 tx=0x7fbbf000bd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:55.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbf57fa700 1 -- 172.21.15.120:0/2264664568 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbbf000c2f0 con 0x7fbbf819ffd0 2021-04-09T18:28:55.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbf57fa700 1 -- 172.21.15.120:0/2264664568 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf000be60 con 0x7fbbf819ffd0 2021-04-09T18:28:55.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf8196370 con 0x7fbbf819ffd0 2021-04-09T18:28:55.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbf57fa700 1 -- 172.21.15.120:0/2264664568 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbbf000c630 con 0x7fbbf819ffd0 2021-04-09T18:28:55.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.527 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf8196370 con 0x7fbbf819ffd0 2021-04-09T18:28:55.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.528 7fbbf57fa700 1 -- 172.21.15.120:0/2264664568 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fbbf0009650 con 0x7fbbf819ffd0 2021-04-09T18:28:55.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.528 7fbbf57fa700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbbdc0188c0 0x7fbbdc01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:55.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.528 7fbbf57fa700 1 -- 172.21.15.120:0/2264664568 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7fbbf0033180 con 0x7fbbf819ffd0 2021-04-09T18:28:55.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.528 7fbbf7fff700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbbdc0188c0 0x7fbbdc01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:55.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.528 7fbbf7fff700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbbdc0188c0 0x7fbbdc01adc0 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:55.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.551 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf81a09f0 con 0x7fbbf819ffd0 2021-04-09T18:28:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.554 7fbbf57fa700 1 -- 172.21.15.120:0/2264664568 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fbbf001fb50 con 0x7fbbf819ffd0 2021-04-09T18:28:55.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.732 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbf81a09f0 con 0x7fbbf819ffd0 2021-04-09T18:28:55.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.732 7fbbf57fa700 1 -- 172.21.15.120:0/2264664568 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+1771 (secure 0 0 0) 0x7fbbf0009650 con 0x7fbbf819ffd0 2021-04-09T18:28:55.724 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 38 2021-04-09T18:28:55.725 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:55.725 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:54.938898","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbbdc0188c0 msgr2=0x7fbbdc01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbbdc0188c0 0x7fbbdc01adc0 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbf819ffd0 msgr2=0x7fbbf81a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbf819ffd0 0x7fbbf81a03d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fbbf00099e0 tx=0x7fbbf000bd20).stop 2021-04-09T18:28:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 shutdown_connections 2021-04-09T18:28:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbf819ffd0 0x7fbbf81a03d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fbbdc0188c0 0x7fbbdc01adc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbf809c9a0 0x7fbbf809cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 --2- 172.21.15.120:0/2264664568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf80b1f90 0x7fbbf80b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 >> 172.21.15.120:0/2264664568 conn(0x7fbbf818d420 msgr2=0x7fbbf81996f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 shutdown_connections 2021-04-09T18:28:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:55.735 7fbbfe9c5700 1 -- 172.21.15.120:0/2264664568 wait complete. 2021-04-09T18:28:55.735 INFO:tasks.mds_thrash.fs.[None]:no change 2021-04-09T18:28:57.736 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:57.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.929 7f47bd7f2700 1 Processor -- start 2021-04-09T18:28:57.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.929 7f47bd7f2700 1 -- start start 2021-04-09T18:28:57.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47bd7f2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b80d7160 0x7f47b80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:57.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47bd7f2700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b80d6be0 con 0x7f47b80d7560 2021-04-09T18:28:57.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47bd7f2700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b80e7f00 con 0x7f47b80e70a0 2021-04-09T18:28:57.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47bd7f2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80d80f0 con 0x7f47b80d7160 2021-04-09T18:28:57.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b6d73700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f47b80d7560 0x7f47b80d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53064/0 (socket says 172.21.15.120:53064) 2021-04-09T18:28:57.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b6d73700 1 -- 172.21.15.120:0/4023806573 learned_addr learned my addr 172.21.15.120:0/4023806573 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:28:57.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b7574700 1 --2- 172.21.15.120:0/4023806573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b80d7160 0x7f47b80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:57.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b6572700 1 -- 172.21.15.120:0/4023806573 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079018662 0 0) 0x7f47a8000ce0 con 0x7f47b80d7560 2021-04-09T18:28:57.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b6572700 1 -- 172.21.15.120:0/4023806573 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f479c002fe0 con 0x7f47b80d7560 2021-04-09T18:28:57.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b6572700 1 -- 172.21.15.120:0/4023806573 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906132520 0 0) 0x7f47b0000d30 con 0x7f47b80e70a0 2021-04-09T18:28:57.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b6572700 1 -- 172.21.15.120:0/4023806573 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f479c003210 con 0x7f47b80e70a0 2021-04-09T18:28:57.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b6572700 1 -- 172.21.15.120:0/4023806573 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3518657194 0 0) 0x7f47a80010e0 con 0x7f47b80d7560 2021-04-09T18:28:57.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b7574700 1 -- 172.21.15.120:0/4023806573 >> v1:172.21.15.134:6789/0 conn(0x7f47b80e70a0 legacy=0x7f47b80d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:57.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b7574700 1 -- 172.21.15.120:0/4023806573 >> v1:172.21.15.120:6789/0 conn(0x7f47b80d7560 legacy=0x7f47b80d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:57.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b7574700 1 -- 172.21.15.120:0/4023806573 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b81a2ac0 con 0x7f47b80d7160 2021-04-09T18:28:57.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.930 7f47b7574700 1 --2- 172.21.15.120:0/4023806573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b80d7160 0x7f47b80e78e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f47a4006650 tx=0x7f47a4009a80).ready entity=mon.2 client_cookie=ade99e0f516c5e90 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:57.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47b6572700 1 -- 172.21.15.120:0/4023806573 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47a40009b0 con 0x7f47b80d7160 2021-04-09T18:28:57.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47b6572700 1 -- 172.21.15.120:0/4023806573 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a400c0c0 con 0x7f47b80d7160 2021-04-09T18:28:57.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47b6572700 1 -- 172.21.15.120:0/4023806573 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47a400c510 con 0x7f47b80d7160 2021-04-09T18:28:57.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47bd7f2700 1 -- 172.21.15.120:0/4023806573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b80d7160 msgr2=0x7f47b80e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:57.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47bd7f2700 1 --2- 172.21.15.120:0/4023806573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b80d7160 0x7f47b80e78e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f47a4006650 tx=0x7f47a4009a80).stop 2021-04-09T18:28:57.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47bd7f2700 1 -- 172.21.15.120:0/4023806573 shutdown_connections 2021-04-09T18:28:57.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47bd7f2700 1 --2- 172.21.15.120:0/4023806573 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b80d7160 0x7f47b80e78e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:57.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47bd7f2700 1 -- 172.21.15.120:0/4023806573 >> 172.21.15.120:0/4023806573 conn(0x7f47b80d1590 msgr2=0x7f47b80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:57.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47bd7f2700 1 -- 172.21.15.120:0/4023806573 shutdown_connections 2021-04-09T18:28:57.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.931 7f47bd7f2700 1 -- 172.21.15.120:0/4023806573 wait complete. 2021-04-09T18:28:57.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.950 7f47bd7f2700 1 Processor -- start 2021-04-09T18:28:57.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.950 7f47bd7f2700 1 -- start start 2021-04-09T18:28:57.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47bd7f2700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b8187670 0x7f47b80a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:57.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47bd7f2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b80a5050 0x7f47b80b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:57.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47bd7f2700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b80b5710 0x7f47b81838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:57.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47bd7f2700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80b5b10 con 0x7f47b80b5710 2021-04-09T18:28:57.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47bd7f2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80b5d30 con 0x7f47b80a5050 2021-04-09T18:28:57.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47bd7f2700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80b5f50 con 0x7f47b8187670 2021-04-09T18:28:57.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7d75700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b80b5710 0x7f47b81838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:57.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7574700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b8187670 0x7f47b80a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:57.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7d75700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b80b5710 0x7f47b81838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58156/0 (socket says 172.21.15.120:58156) 2021-04-09T18:28:57.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7d75700 1 -- 172.21.15.120:0/1568734542 learned_addr learned my addr 172.21.15.120:0/1568734542 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:57.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b6d73700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b80a5050 0x7f47b80b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:57.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7d75700 1 -- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b8187670 msgr2=0x7f47b80a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:57.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7d75700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b8187670 0x7f47b80a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:57.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7d75700 1 -- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b80a5050 msgr2=0x7f47b80b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:57.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7d75700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b80a5050 0x7f47b80b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:57.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7d75700 1 -- 172.21.15.120:0/1568734542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b8183ef0 con 0x7f47b80b5710 2021-04-09T18:28:57.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7574700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b8187670 0x7f47b80a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:28:57.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.951 7f47b7d75700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b80b5710 0x7f47b81838d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f47b0009940 tx=0x7f47b000bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:57.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.952 7f47affff700 1 -- 172.21.15.120:0/1568734542 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47b0000d30 con 0x7f47b80b5710 2021-04-09T18:28:57.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.952 7f47affff700 1 -- 172.21.15.120:0/1568734542 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b000c2f0 con 0x7f47b80b5710 2021-04-09T18:28:57.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.952 7f47affff700 1 -- 172.21.15.120:0/1568734542 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47b000c790 con 0x7f47b80b5710 2021-04-09T18:28:57.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.952 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b8183ef0 con 0x7f47b80b5710 2021-04-09T18:28:57.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.952 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b8183ef0 con 0x7f47b80b5710 2021-04-09T18:28:57.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.953 7f47affff700 1 -- 172.21.15.120:0/1568734542 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f47b0000cc0 con 0x7f47b80b5710 2021-04-09T18:28:57.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.953 7f47affff700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f47940188c0 0x7f479401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:57.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.953 7f47affff700 1 -- 172.21.15.120:0/1568734542 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f47b0033090 con 0x7f47b80b5710 2021-04-09T18:28:57.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.953 7f47b7574700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f47940188c0 0x7f479401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:57.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.953 7f47b7574700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f47940188c0 0x7f479401adc0 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:57.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.976 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b81829e0 con 0x7f47b80b5710 2021-04-09T18:28:57.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:57.979 7f47affff700 1 -- 172.21.15.120:0/1568734542 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f47b000be30 con 0x7f47b80b5710 2021-04-09T18:28:58.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.173 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47b81829e0 con 0x7f47b80b5710 2021-04-09T18:28:58.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.173 7f47affff700 1 -- 172.21.15.120:0/1568734542 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+1768 (secure 0 0 0) 0x7f47b0000cc0 con 0x7f47b80b5710 2021-04-09T18:28:58.163 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 41 2021-04-09T18:28:58.164 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:58.164 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:58.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f47940188c0 msgr2=0x7f479401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:58.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f47940188c0 0x7f479401adc0 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:58.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b80b5710 msgr2=0x7f47b81838d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:58.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b80b5710 0x7f47b81838d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f47b0009940 tx=0x7f47b000bcf0).stop 2021-04-09T18:28:58.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 shutdown_connections 2021-04-09T18:28:58.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b80b5710 0x7f47b81838d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:58.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b80a5050 0x7f47b80b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:58.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f47940188c0 0x7f479401adc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:58.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 --2- 172.21.15.120:0/1568734542 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b8187670 0x7f47b80a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:58.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 >> 172.21.15.120:0/1568734542 conn(0x7f47b818dc90 msgr2=0x7f47b808fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:58.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 shutdown_connections 2021-04-09T18:28:58.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:58.176 7f47bd7f2700 1 -- 172.21.15.120:0/1568734542 wait complete. 2021-04-09T18:28:58.175 INFO:tasks.mds_thrash.fs.[None]:mds.b has gained rank=0, replacing gid=5028 2021-04-09T18:28:58.176 INFO:tasks.mds_thrash.fs.[None]:waiting for 1 secs before reviving mds.a 2021-04-09T18:28:59.177 INFO:tasks.mds_thrash.fs.[None]:reviving mds.a 2021-04-09T18:28:59.177 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:28:59.178 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:28:59.181 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:28:59.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:28:59.367 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2021-04-09T18:28:59.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.377 7f05bfdae700 1 Processor -- start 2021-04-09T18:28:59.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bfdae700 1 -- start start 2021-04-09T18:28:59.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bfdae700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b80d7160 0x7f05b80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:59.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bfdae700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f05b80d7560 0x7f05b80d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:59.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bfdae700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b80d6be0 con 0x7f05b80d5bc0 2021-04-09T18:28:59.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bfdae700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80d80f0 con 0x7f05b80d7560 2021-04-09T18:28:59.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bfdae700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80d0f10 con 0x7f05b80d7160 2021-04-09T18:28:59.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bd3c9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f05b80d7560 0x7f05b80d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:59.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bd3c9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f05b80d7560 0x7f05b80d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58174/0 (socket says 172.21.15.120:58174) 2021-04-09T18:28:59.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bd3c9700 1 -- 172.21.15.120:0/528538502 learned_addr learned my addr 172.21.15.120:0/528538502 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:59.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.378 7f05bdbca700 1 --2- 172.21.15.120:0/528538502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b80d7160 0x7f05b80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:59.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bd3c9700 1 -- 172.21.15.120:0/528538502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b80d7160 msgr2=0x7f05b80e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:28:59.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bd3c9700 1 --2- 172.21.15.120:0/528538502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b80d7160 0x7f05b80e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bd3c9700 1 -- 172.21.15.120:0/528538502 >> v1:172.21.15.134:6789/0 conn(0x7f05b80d5bc0 legacy=0x7f05b80d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:59.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bd3c9700 1 -- 172.21.15.120:0/528538502 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80e7f00 con 0x7f05b80d7560 2021-04-09T18:28:59.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bcbc8700 1 -- 172.21.15.120:0/528538502 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474394475 0 0) 0x7f05b40009b0 con 0x7f05b80d5bc0 2021-04-09T18:28:59.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bd3c9700 1 --2- 172.21.15.120:0/528538502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b80d7560 0x7f05b80d55a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f05ac006a80 tx=0x7f05ac009e80).ready entity=mon.0 client_cookie=6c9306b81ef1d0cd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:59.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bcbc8700 1 -- 172.21.15.120:0/528538502 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05ac00b510 con 0x7f05b80d7560 2021-04-09T18:28:59.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bcbc8700 1 -- 172.21.15.120:0/528538502 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac00b790 con 0x7f05b80d7560 2021-04-09T18:28:59.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bcbc8700 1 -- 172.21.15.120:0/528538502 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05ac00bb60 con 0x7f05b80d7560 2021-04-09T18:28:59.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bfdae700 1 -- 172.21.15.120:0/528538502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b80d7560 msgr2=0x7f05b80d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:59.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.379 7f05bfdae700 1 --2- 172.21.15.120:0/528538502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b80d7560 0x7f05b80d55a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f05ac006a80 tx=0x7f05ac009e80).stop 2021-04-09T18:28:59.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.380 7f05bfdae700 1 -- 172.21.15.120:0/528538502 shutdown_connections 2021-04-09T18:28:59.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.380 7f05bfdae700 1 --2- 172.21.15.120:0/528538502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b80d7560 0x7f05b80d55a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.380 7f05bfdae700 1 --2- 172.21.15.120:0/528538502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b80d7160 0x7f05b80e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.380 7f05bfdae700 1 -- 172.21.15.120:0/528538502 >> 172.21.15.120:0/528538502 conn(0x7f05b80d1590 msgr2=0x7f05b80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:59.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.380 7f05bfdae700 1 -- 172.21.15.120:0/528538502 shutdown_connections 2021-04-09T18:28:59.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.380 7f05bfdae700 1 -- 172.21.15.120:0/528538502 wait complete. 2021-04-09T18:28:59.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.400 7f05bfdae700 1 Processor -- start 2021-04-09T18:28:59.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bfdae700 1 -- start start 2021-04-09T18:28:59.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bfdae700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b8182d50 0x7f05b817edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:59.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bfdae700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b8183150 0x7f05b817f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:59.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bfdae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b817fa30 0x7f05b817fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:59.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bfdae700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b81827d0 con 0x7f05b8182d50 2021-04-09T18:28:59.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bfdae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80a49f0 con 0x7f05b817fa30 2021-04-09T18:28:59.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bfdae700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80aef20 con 0x7f05b8183150 2021-04-09T18:28:59.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bdbca700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b8182d50 0x7f05b817edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:59.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bdbca700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b8182d50 0x7f05b817edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58184/0 (socket says 172.21.15.120:58184) 2021-04-09T18:28:59.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bdbca700 1 -- 172.21.15.120:0/3928551295 learned_addr learned my addr 172.21.15.120:0/3928551295 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:28:59.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bd3c9700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b8183150 0x7f05b817f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:59.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05be3cb700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b817fa30 0x7f05b817fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:59.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.401 7f05bdbca700 1 -- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b8183150 msgr2=0x7f05b817f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:59.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05bdbca700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b8183150 0x7f05b817f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05bdbca700 1 -- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b817fa30 msgr2=0x7f05b817fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:59.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05bdbca700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b817fa30 0x7f05b817fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05bdbca700 1 -- 172.21.15.120:0/3928551295 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80af140 con 0x7f05b8182d50 2021-04-09T18:28:59.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05bdbca700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b8182d50 0x7f05b817edf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f05b0006be0 tx=0x7f05b000b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:59.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05aa7fc700 1 -- 172.21.15.120:0/3928551295 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05b00064d0 con 0x7f05b8182d50 2021-04-09T18:28:59.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05aa7fc700 1 -- 172.21.15.120:0/3928551295 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b000bd80 con 0x7f05b8182d50 2021-04-09T18:28:59.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b80af140 con 0x7f05b8182d50 2021-04-09T18:28:59.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05aa7fc700 1 -- 172.21.15.120:0/3928551295 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05b0002030 con 0x7f05b8182d50 2021-04-09T18:28:59.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b80af140 con 0x7f05b8182d50 2021-04-09T18:28:59.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05aa7fc700 1 -- 172.21.15.120:0/3928551295 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f05b0006cb0 con 0x7f05b8182d50 2021-04-09T18:28:59.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.402 7f05aa7fc700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a0018930 0x7f05a001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:28:59.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.403 7f05aa7fc700 1 -- 172.21.15.120:0/3928551295 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f05b0032d80 con 0x7f05b8182d50 2021-04-09T18:28:59.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.403 7f05bd3c9700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a0018930 0x7f05a001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:28:59.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.403 7f05bd3c9700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a0018930 0x7f05a001ae10 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:28:59.411 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.422 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b80e4960 con 0x7f05b8182d50 2021-04-09T18:28:59.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.426 7f05aa7fc700 1 -- 172.21.15.120:0/3928551295 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f05b0006820 con 0x7f05b8182d50 2021-04-09T18:28:59.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.614 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05b80e4960 con 0x7f05b8182d50 2021-04-09T18:28:59.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.615 7f05aa7fc700 1 -- 172.21.15.120:0/3928551295 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+1768 (secure 0 0 0) 0x7f05b000bd80 con 0x7f05b8182d50 2021-04-09T18:28:59.605 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 41 2021-04-09T18:28:59.605 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:28:59.605 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:28:59.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a0018930 msgr2=0x7f05a001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:59.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a0018930 0x7f05a001ae10 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b8182d50 msgr2=0x7f05b817edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:28:59.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b8182d50 0x7f05b817edf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f05b0006be0 tx=0x7f05b000b990).stop 2021-04-09T18:28:59.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 shutdown_connections 2021-04-09T18:28:59.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b817fa30 0x7f05b817fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.608 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a0018930 0x7f05a001ae10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05b8183150 0x7f05b817f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 --2- 172.21.15.120:0/3928551295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05b8182d50 0x7f05b817edf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:28:59.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 >> 172.21.15.120:0/3928551295 conn(0x7f05b818b040 msgr2=0x7f05b817b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:28:59.609 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.617 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 shutdown_connections 2021-04-09T18:28:59.610 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:28:59.618 7f05bfdae700 1 -- 172.21.15.120:0/3928551295 wait complete. 2021-04-09T18:28:59.617 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-04-09T18:29:01.618 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:01.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.805 7f6eb1f23700 1 Processor -- start 2021-04-09T18:29:01.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.805 7f6eb1f23700 1 -- start start 2021-04-09T18:29:01.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.805 7f6eb1f23700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6eac0d7160 0x7f6eac0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:01.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.805 7f6eb1f23700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac0d55a0 0x7f6eac0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:01.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.805 7f6eb1f23700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6eac0d5fc0 0x7f6eac0d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:01.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.805 7f6eb1f23700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0e80a0 con 0x7f6eac0d7160 2021-04-09T18:29:01.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.805 7f6eb1f23700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0d80f0 con 0x7f6eac0d5fc0 2021-04-09T18:29:01.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.805 7f6eb1f23700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0d6be0 con 0x7f6eac0d55a0 2021-04-09T18:29:01.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eab7fe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6eac0d7160 0x7f6eac0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:01.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eab7fe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6eac0d7160 0x7f6eac0d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58204/0 (socket says 172.21.15.120:58204) 2021-04-09T18:29:01.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eab7fe700 1 -- 172.21.15.120:0/2699973507 learned_addr learned my addr 172.21.15.120:0/2699973507 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eaaffd700 1 --2- 172.21.15.120:0/2699973507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac0d55a0 0x7f6eac0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eabfff700 1 --2- 172.21.15.120:0/2699973507 >> v2:172.21.15.134:3300/0 conn(0x7f6eac0d5fc0 0x7f6eac0d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eab7fe700 1 -- 172.21.15.120:0/2699973507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac0d55a0 msgr2=0x7f6eac0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eab7fe700 1 --2- 172.21.15.120:0/2699973507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac0d55a0 0x7f6eac0d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:01.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eab7fe700 1 -- 172.21.15.120:0/2699973507 >> v2:172.21.15.134:3300/0 conn(0x7f6eac0d5fc0 msgr2=0x7f6eac0d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:01.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eab7fe700 1 --2- 172.21.15.120:0/2699973507 >> v2:172.21.15.134:3300/0 conn(0x7f6eac0d5fc0 0x7f6eac0d63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:01.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eab7fe700 1 -- 172.21.15.120:0/2699973507 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac1a2ac0 con 0x7f6eac0d7160 2021-04-09T18:29:01.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eabfff700 1 --2- 172.21.15.120:0/2699973507 >> v2:172.21.15.134:3300/0 conn(0x7f6eac0d5fc0 0x7f6eac0d63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:01.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eaaffd700 1 --2- 172.21.15.120:0/2699973507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac0d55a0 0x7f6eac0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:01.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eab7fe700 1 --2- 172.21.15.120:0/2699973507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac0d7160 0x7f6eac0d7560 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f6e9c006a80 tx=0x7f6e9c009f00).ready entity=mon.0 client_cookie=5f49c752cc547f55 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:01.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eaa7fc700 1 -- 172.21.15.120:0/2699973507 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e9c00b5c0 con 0x7f6eac0d7160 2021-04-09T18:29:01.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eaa7fc700 1 -- 172.21.15.120:0/2699973507 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00b8c0 con 0x7f6eac0d7160 2021-04-09T18:29:01.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eaa7fc700 1 -- 172.21.15.120:0/2699973507 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e9c00bda0 con 0x7f6eac0d7160 2021-04-09T18:29:01.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eb1f23700 1 -- 172.21.15.120:0/2699973507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac0d7160 msgr2=0x7f6eac0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:01.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.806 7f6eb1f23700 1 --2- 172.21.15.120:0/2699973507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac0d7160 0x7f6eac0d7560 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f6e9c006a80 tx=0x7f6e9c009f00).stop 2021-04-09T18:29:01.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.807 7f6eb1f23700 1 -- 172.21.15.120:0/2699973507 shutdown_connections 2021-04-09T18:29:01.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.807 7f6eb1f23700 1 --2- 172.21.15.120:0/2699973507 >> v2:172.21.15.134:3300/0 conn(0x7f6eac0d5fc0 0x7f6eac0d63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:01.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.807 7f6eb1f23700 1 --2- 172.21.15.120:0/2699973507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac0d55a0 0x7f6eac0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:01.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.807 7f6eb1f23700 1 --2- 172.21.15.120:0/2699973507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac0d7160 0x7f6eac0d7560 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:01.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.807 7f6eb1f23700 1 -- 172.21.15.120:0/2699973507 >> 172.21.15.120:0/2699973507 conn(0x7f6eac0d1590 msgr2=0x7f6eac0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:01.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.807 7f6eb1f23700 1 -- 172.21.15.120:0/2699973507 shutdown_connections 2021-04-09T18:29:01.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.807 7f6eb1f23700 1 -- 172.21.15.120:0/2699973507 wait complete. 2021-04-09T18:29:01.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eb1f23700 1 Processor -- start 2021-04-09T18:29:01.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eb1f23700 1 -- start start 2021-04-09T18:29:01.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eb1f23700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac1971c0 0x7f6eac193ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:01.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eb1f23700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eac18ad80 0x7f6eac18b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:01.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eb1f23700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac18bd70 0x7f6eac18c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:01.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eb1f23700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0b0e80 con 0x7f6eac1971c0 2021-04-09T18:29:01.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eb1f23700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0b1070 con 0x7f6eac18ad80 2021-04-09T18:29:01.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eb1f23700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0b1290 con 0x7f6eac18bd70 2021-04-09T18:29:01.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eab7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac1971c0 0x7f6eac193ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:01.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eab7fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac1971c0 0x7f6eac193ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58214/0 (socket says 172.21.15.120:58214) 2021-04-09T18:29:01.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.826 7f6eab7fe700 1 -- 172.21.15.120:0/3548432212 learned_addr learned my addr 172.21.15.120:0/3548432212 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eabfff700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac18bd70 0x7f6eac18c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eaaffd700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eac18ad80 0x7f6eac18b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eab7fe700 1 -- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac18bd70 msgr2=0x7f6eac18c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eab7fe700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac18bd70 0x7f6eac18c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:01.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eab7fe700 1 -- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eac18ad80 msgr2=0x7f6eac18b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:01.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eab7fe700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eac18ad80 0x7f6eac18b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:01.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eab7fe700 1 -- 172.21.15.120:0/3548432212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0b14b0 con 0x7f6eac1971c0 2021-04-09T18:29:01.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eaaffd700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eac18ad80 0x7f6eac18b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:29:01.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eab7fe700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac1971c0 0x7f6eac193ca0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6e9c00b910 tx=0x7f6e9c00bcb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6ea3fff700 1 -- 172.21.15.120:0/3548432212 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e9c00c2f0 con 0x7f6eac1971c0 2021-04-09T18:29:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6ea3fff700 1 -- 172.21.15.120:0/3548432212 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00c630 con 0x7f6eac1971c0 2021-04-09T18:29:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac0b14b0 con 0x7f6eac1971c0 2021-04-09T18:29:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6ea3fff700 1 -- 172.21.15.120:0/3548432212 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e9c00cb10 con 0x7f6eac1971c0 2021-04-09T18:29:01.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.827 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac0b14b0 con 0x7f6eac1971c0 2021-04-09T18:29:01.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.828 7f6ea3fff700 1 -- 172.21.15.120:0/3548432212 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6e9c001010 con 0x7f6eac1971c0 2021-04-09T18:29:01.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.828 7f6ea3fff700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6e90018930 0x7f6e9001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:01.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.828 7f6ea3fff700 1 -- 172.21.15.120:0/3548432212 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f6e9c033140 con 0x7f6eac1971c0 2021-04-09T18:29:01.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.828 7f6eaaffd700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6e90018930 0x7f6e9001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:01.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.828 7f6eaaffd700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6e90018930 0x7f6e9001ae10 crc :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:01.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.851 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac182a20 con 0x7f6eac1971c0 2021-04-09T18:29:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:01.855 7f6ea3fff700 1 -- 172.21.15.120:0/3548432212 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6e9c00bdf0 con 0x7f6eac1971c0 2021-04-09T18:29:02.025 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.036 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6eac182a20 con 0x7f6eac1971c0 2021-04-09T18:29:02.026 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.036 7f6ea3fff700 1 -- 172.21.15.120:0/3548432212 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+1768 (secure 0 0 0) 0x7f6e9c001010 con 0x7f6eac1971c0 2021-04-09T18:29:02.026 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 41 2021-04-09T18:29:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:29:02.027 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:29:02.028 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.038 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6e90018930 msgr2=0x7f6e9001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.038 7f6eb1f23700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6e90018930 0x7f6e9001ae10 crc :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.038 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac1971c0 msgr2=0x7f6eac193ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:02.029 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.038 7f6eb1f23700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac1971c0 0x7f6eac193ca0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6e9c00b910 tx=0x7f6e9c00bcb0).stop 2021-04-09T18:29:02.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.039 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 shutdown_connections 2021-04-09T18:29:02.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.039 7f6eb1f23700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6e90018930 0x7f6e9001ae10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:02.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.039 7f6eb1f23700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6eac18bd70 0x7f6eac18c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:02.030 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.039 7f6eb1f23700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eac18ad80 0x7f6eac18b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.039 7f6eb1f23700 1 --2- 172.21.15.120:0/3548432212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac1971c0 0x7f6eac193ca0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.039 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 >> 172.21.15.120:0/3548432212 conn(0x7f6eac18dcd0 msgr2=0x7f6eac187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.039 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 shutdown_connections 2021-04-09T18:29:02.031 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:02.039 7f6eb1f23700 1 -- 172.21.15.120:0/3548432212 wait complete. 2021-04-09T18:29:02.038 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-04-09T18:29:04.039 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.236 7fc279fe7700 1 Processor -- start 2021-04-09T18:29:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.236 7fc279fe7700 1 -- start start 2021-04-09T18:29:04.250 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc279fe7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc2740d7160 0x7fc2740d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:04.250 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc279fe7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740d55a0 0x7fc2740d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:04.250 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc279fe7700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2740d6be0 con 0x7fc2740d5fc0 2021-04-09T18:29:04.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc279fe7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2740d80f0 con 0x7fc2740d7160 2021-04-09T18:29:04.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc279fe7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740d0f10 con 0x7fc2740d55a0 2021-04-09T18:29:04.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc272ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740d55a0 0x7fc2740d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc2737fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc2740d7160 0x7fc2740d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc272ffd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740d55a0 0x7fc2740d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:44896/0 (socket says 172.21.15.120:44896) 2021-04-09T18:29:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc2737fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc2740d7160 0x7fc2740d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:47066/0 (socket says 172.21.15.120:47066) 2021-04-09T18:29:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.237 7fc272ffd700 1 -- 172.21.15.120:0/2388558485 learned_addr learned my addr 172.21.15.120:0/2388558485 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:04.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc2737fe700 1 -- 172.21.15.120:0/2388558485 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740d55a0 msgr2=0x7fc2740d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:04.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc2737fe700 1 --2- 172.21.15.120:0/2388558485 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740d55a0 0x7fc2740d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc2737fe700 1 -- 172.21.15.120:0/2388558485 >> v1:172.21.15.134:6789/0 conn(0x7fc2740d5fc0 legacy=0x7fc2740d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:04.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc2737fe700 1 -- 172.21.15.120:0/2388558485 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2740d11f0 con 0x7fc2740d7160 2021-04-09T18:29:04.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc2727fc700 1 -- 172.21.15.120:0/2388558485 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028582460 0 0) 0x7fc26c000d30 con 0x7fc2740d5fc0 2021-04-09T18:29:04.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc272ffd700 1 --2- 172.21.15.120:0/2388558485 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740d55a0 0x7fc2740d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:04.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc2737fe700 1 --2- 172.21.15.120:0/2388558485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2740d7160 0x7fc2740d7560 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fc264006650 tx=0x7fc264009a80).ready entity=mon.1 client_cookie=3d4034708f65bdcb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:04.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc2727fc700 1 -- 172.21.15.120:0/2388558485 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2640009b0 con 0x7fc2740d7160 2021-04-09T18:29:04.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc2727fc700 1 -- 172.21.15.120:0/2388558485 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26400c0c0 con 0x7fc2740d7160 2021-04-09T18:29:04.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc2727fc700 1 -- 172.21.15.120:0/2388558485 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2640009b0 con 0x7fc2740d7160 2021-04-09T18:29:04.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc279fe7700 1 -- 172.21.15.120:0/2388558485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2740d7160 msgr2=0x7fc2740d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:04.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.238 7fc279fe7700 1 --2- 172.21.15.120:0/2388558485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2740d7160 0x7fc2740d7560 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fc264006650 tx=0x7fc264009a80).stop 2021-04-09T18:29:04.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.239 7fc279fe7700 1 -- 172.21.15.120:0/2388558485 shutdown_connections 2021-04-09T18:29:04.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.239 7fc279fe7700 1 --2- 172.21.15.120:0/2388558485 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740d55a0 0x7fc2740d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.239 7fc279fe7700 1 --2- 172.21.15.120:0/2388558485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2740d7160 0x7fc2740d7560 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.239 7fc279fe7700 1 -- 172.21.15.120:0/2388558485 >> 172.21.15.120:0/2388558485 conn(0x7fc2740d1590 msgr2=0x7fc2740d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.239 7fc279fe7700 1 -- 172.21.15.120:0/2388558485 shutdown_connections 2021-04-09T18:29:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.239 7fc279fe7700 1 -- 172.21.15.120:0/2388558485 wait complete. 2021-04-09T18:29:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.259 7fc279fe7700 1 Processor -- start 2021-04-09T18:29:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc279fe7700 1 -- start start 2021-04-09T18:29:04.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc279fe7700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc274187670 0x7fc2740a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:04.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc279fe7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2740a5050 0x7fc2740b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:04.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc279fe7700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740b5710 0x7fc2741838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:04.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc279fe7700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740b5b10 con 0x7fc274187670 2021-04-09T18:29:04.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc279fe7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740b5d30 con 0x7fc2740a5050 2021-04-09T18:29:04.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc279fe7700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740b5f50 con 0x7fc2740b5710 2021-04-09T18:29:04.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc2737fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc274187670 0x7fc2740a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:04.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc2737fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc274187670 0x7fc2740a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58236/0 (socket says 172.21.15.120:58236) 2021-04-09T18:29:04.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc2737fe700 1 -- 172.21.15.120:0/276799467 learned_addr learned my addr 172.21.15.120:0/276799467 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:04.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc273fff700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740b5710 0x7fc2741838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:04.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.260 7fc272ffd700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2740a5050 0x7fc2740b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:04.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc2737fe700 1 -- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740b5710 msgr2=0x7fc2741838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:04.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc2737fe700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740b5710 0x7fc2741838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc2737fe700 1 -- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2740a5050 msgr2=0x7fc2740b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:04.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc2737fe700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2740a5050 0x7fc2740b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc2737fe700 1 -- 172.21.15.120:0/276799467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274183ef0 con 0x7fc274187670 2021-04-09T18:29:04.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc2737fe700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc274187670 0x7fc2740a4a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fc264009650 tx=0x7fc26400b8e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:04.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc26bfff700 1 -- 172.21.15.120:0/276799467 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2640093a0 con 0x7fc274187670 2021-04-09T18:29:04.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc26bfff700 1 -- 172.21.15.120:0/276799467 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc264006070 con 0x7fc274187670 2021-04-09T18:29:04.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc279fe7700 1 -- 172.21.15.120:0/276799467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc274183ef0 con 0x7fc274187670 2021-04-09T18:29:04.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc26bfff700 1 -- 172.21.15.120:0/276799467 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2640052e0 con 0x7fc274187670 2021-04-09T18:29:04.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.261 7fc279fe7700 1 -- 172.21.15.120:0/276799467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc274183ef0 con 0x7fc274187670 2021-04-09T18:29:04.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.262 7fc26bfff700 1 -- 172.21.15.120:0/276799467 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc264009300 con 0x7fc274187670 2021-04-09T18:29:04.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.262 7fc26bfff700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc24c0188c0 0x7fc24c01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:04.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.262 7fc26bfff700 1 -- 172.21.15.120:0/276799467 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7fc264032af0 con 0x7fc274187670 2021-04-09T18:29:04.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.262 7fc272ffd700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc24c0188c0 0x7fc24c01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:04.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.263 7fc272ffd700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc24c0188c0 0x7fc24c01adc0 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:04.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.281 7fc279fe7700 1 -- 172.21.15.120:0/276799467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2741829e0 con 0x7fc274187670 2021-04-09T18:29:04.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.285 7fc26bfff700 1 -- 172.21.15.120:0/276799467 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc264000940 con 0x7fc274187670 2021-04-09T18:29:04.470 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.481 7fc279fe7700 1 -- 172.21.15.120:0/276799467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2741829e0 con 0x7fc274187670 2021-04-09T18:29:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.481 7fc26bfff700 1 -- 172.21.15.120:0/276799467 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fc264009300 con 0x7fc274187670 2021-04-09T18:29:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2021-04-09T18:29:04.472 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:29:04.472 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:29:04.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 -- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc24c0188c0 msgr2=0x7fc24c01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:04.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc24c0188c0 0x7fc24c01adc0 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 -- 172.21.15.120:0/276799467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc274187670 msgr2=0x7fc2740a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:04.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc274187670 0x7fc2740a4a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fc264009650 tx=0x7fc26400b8e0).stop 2021-04-09T18:29:04.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 -- 172.21.15.120:0/276799467 shutdown_connections 2021-04-09T18:29:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc24c0188c0 0x7fc24c01adc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2740b5710 0x7fc2741838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2740a5050 0x7fc2740b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 --2- 172.21.15.120:0/276799467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc274187670 0x7fc2740a4a30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:04.476 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 -- 172.21.15.120:0/276799467 >> 172.21.15.120:0/276799467 conn(0x7fc27418dc90 msgr2=0x7fc27408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:04.476 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 -- 172.21.15.120:0/276799467 shutdown_connections 2021-04-09T18:29:04.476 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:04.484 7fc279fe7700 1 -- 172.21.15.120:0/276799467 wait complete. 2021-04-09T18:29:04.483 INFO:tasks.mds_thrash.fs.[None]:mds.a reported in up:standby state 2021-04-09T18:29:04.483 INFO:tasks.mds_thrash.fs.[None]:waiting for 42 secs before thrashing 2021-04-09T18:29:06.052 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:06.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:36.168 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:36.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:29:46.484 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:46.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.674 7fafd829a700 1 Processor -- start 2021-04-09T18:29:46.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.674 7fafd829a700 1 -- start start 2021-04-09T18:29:46.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd829a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fafd00d7560 0x7fafd00d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd829a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00d63b0 0x7fafd01ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd829a700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd00d7960 con 0x7fafd00d7160 2021-04-09T18:29:46.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd829a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd00d80f0 con 0x7fafd00d7560 2021-04-09T18:29:46.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd829a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00d6be0 con 0x7fafd00d63b0 2021-04-09T18:29:46.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd60b6700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fafd00d7160 0x7fafd00d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53460/0 (socket says 172.21.15.120:53460) 2021-04-09T18:29:46.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd60b6700 1 -- 172.21.15.120:0/2590864117 learned_addr learned my addr 172.21.15.120:0/2590864117 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:29:46.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd68b7700 1 --2- 172.21.15.120:0/2590864117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00d63b0 0x7fafd01ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd58b5700 1 --2- 172.21.15.120:0/2590864117 >> v2:172.21.15.134:3300/0 conn(0x7fafd00d7560 0x7fafd00d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd50b4700 1 -- 172.21.15.120:0/2590864117 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138978610 0 0) 0x7fafcc000ce0 con 0x7fafd00d7160 2021-04-09T18:29:46.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd50b4700 1 -- 172.21.15.120:0/2590864117 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafbc002fe0 con 0x7fafd00d7160 2021-04-09T18:29:46.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd68b7700 1 -- 172.21.15.120:0/2590864117 >> v2:172.21.15.134:3300/0 conn(0x7fafd00d7560 msgr2=0x7fafd00d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:46.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd68b7700 1 --2- 172.21.15.120:0/2590864117 >> v2:172.21.15.134:3300/0 conn(0x7fafd00d7560 0x7fafd00d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd68b7700 1 -- 172.21.15.120:0/2590864117 >> v1:172.21.15.120:6789/0 conn(0x7fafd00d7160 legacy=0x7fafd00d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.675 7fafd68b7700 1 -- 172.21.15.120:0/2590864117 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd01a2ac0 con 0x7fafd00d63b0 2021-04-09T18:29:46.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.676 7fafd58b5700 1 --2- 172.21.15.120:0/2590864117 >> v2:172.21.15.134:3300/0 conn(0x7fafd00d7560 0x7fafd00d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:46.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.676 7fafd68b7700 1 --2- 172.21.15.120:0/2590864117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00d63b0 0x7fafd01ab1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fafc8006e50 tx=0x7fafc8009e70).ready entity=mon.2 client_cookie=1f5021ba8e6cd2d4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:46.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.676 7fafd50b4700 1 -- 172.21.15.120:0/2590864117 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafc8006a20 con 0x7fafd00d63b0 2021-04-09T18:29:46.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.676 7fafd50b4700 1 -- 172.21.15.120:0/2590864117 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc8006790 con 0x7fafd00d63b0 2021-04-09T18:29:46.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.676 7fafd50b4700 1 -- 172.21.15.120:0/2590864117 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafc800b700 con 0x7fafd00d63b0 2021-04-09T18:29:46.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.676 7fafd829a700 1 -- 172.21.15.120:0/2590864117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00d63b0 msgr2=0x7fafd01ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.676 7fafd829a700 1 --2- 172.21.15.120:0/2590864117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00d63b0 0x7fafd01ab1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fafc8006e50 tx=0x7fafc8009e70).stop 2021-04-09T18:29:46.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.677 7fafd829a700 1 -- 172.21.15.120:0/2590864117 shutdown_connections 2021-04-09T18:29:46.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.677 7fafd829a700 1 --2- 172.21.15.120:0/2590864117 >> v2:172.21.15.134:3300/0 conn(0x7fafd00d7560 0x7fafd00d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.677 7fafd829a700 1 --2- 172.21.15.120:0/2590864117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00d63b0 0x7fafd01ab1e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.677 7fafd829a700 1 -- 172.21.15.120:0/2590864117 >> 172.21.15.120:0/2590864117 conn(0x7fafd00d1590 msgr2=0x7fafd00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:46.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.677 7fafd829a700 1 -- 172.21.15.120:0/2590864117 shutdown_connections 2021-04-09T18:29:46.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.677 7fafd829a700 1 -- 172.21.15.120:0/2590864117 wait complete. 2021-04-09T18:29:46.691 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.695 7fafd829a700 1 Processor -- start 2021-04-09T18:29:46.691 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.695 7fafd829a700 1 -- start start 2021-04-09T18:29:46.694 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd829a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd008aa90 0x7fafd008ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.695 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd829a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd017aee0 0x7fafd017b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.695 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd829a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd017db00 0x7fafd017df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.695 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd829a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd0183680 con 0x7fafd008aa90 2021-04-09T18:29:46.696 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd829a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd017e520 con 0x7fafd017db00 2021-04-09T18:29:46.696 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd829a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd017e700 con 0x7fafd017aee0 2021-04-09T18:29:46.696 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd60b6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd008aa90 0x7fafd008ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.696 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd60b6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd008aa90 0x7fafd008ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58554/0 (socket says 172.21.15.120:58554) 2021-04-09T18:29:46.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd60b6700 1 -- 172.21.15.120:0/2959500099 learned_addr learned my addr 172.21.15.120:0/2959500099 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:46.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd58b5700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd017aee0 0x7fafd017b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd68b7700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd017db00 0x7fafd017df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd60b6700 1 -- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd017aee0 msgr2=0x7fafd017b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd60b6700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd017aee0 0x7fafd017b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd60b6700 1 -- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd017db00 msgr2=0x7fafd017df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd60b6700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd017db00 0x7fafd017df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd60b6700 1 -- 172.21.15.120:0/2959500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd017e920 con 0x7fafd008aa90 2021-04-09T18:29:46.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd60b6700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd008aa90 0x7fafd008ae90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fafcc00b530 tx=0x7fafcc00b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:46.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafc6ffd700 1 -- 172.21.15.120:0/2959500099 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafcc00bcc0 con 0x7fafd008aa90 2021-04-09T18:29:46.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafc6ffd700 1 -- 172.21.15.120:0/2959500099 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc006030 con 0x7fafd008aa90 2021-04-09T18:29:46.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafd829a700 1 -- 172.21.15.120:0/2959500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd017e920 con 0x7fafd008aa90 2021-04-09T18:29:46.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.696 7fafc6ffd700 1 -- 172.21.15.120:0/2959500099 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafcc004620 con 0x7fafd008aa90 2021-04-09T18:29:46.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.697 7fafd829a700 1 -- 172.21.15.120:0/2959500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd017e920 con 0x7fafd008aa90 2021-04-09T18:29:46.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.697 7fafc6ffd700 1 -- 172.21.15.120:0/2959500099 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fafcc0043a0 con 0x7fafd008aa90 2021-04-09T18:29:46.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.697 7fafc6ffd700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fafb8018930 0x7fafb801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:46.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.697 7fafc6ffd700 1 -- 172.21.15.120:0/2959500099 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7fafcc032e80 con 0x7fafd008aa90 2021-04-09T18:29:46.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.697 7fafd58b5700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fafb8018930 0x7fafb801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:46.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.698 7fafd58b5700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fafb8018930 0x7fafb801ae10 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:46.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.721 7fafd829a700 1 -- 172.21.15.120:0/2959500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd0179ce0 con 0x7fafd008aa90 2021-04-09T18:29:46.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.724 7fafc6ffd700 1 -- 172.21.15.120:0/2959500099 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fafcc006b90 con 0x7fafd008aa90 2021-04-09T18:29:46.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.903 7fafd829a700 1 -- 172.21.15.120:0/2959500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafd0179ce0 con 0x7fafd008aa90 2021-04-09T18:29:46.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.903 7fafc6ffd700 1 -- 172.21.15.120:0/2959500099 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fafcc0043a0 con 0x7fafd008aa90 2021-04-09T18:29:46.893 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2021-04-09T18:29:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:29:46.894 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:29:46.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 -- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fafb8018930 msgr2=0x7fafb801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fafb8018930 0x7fafb801ae10 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 -- 172.21.15.120:0/2959500099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd008aa90 msgr2=0x7fafd008ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:46.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd008aa90 0x7fafd008ae90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fafcc00b530 tx=0x7fafcc00b8d0).stop 2021-04-09T18:29:46.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 -- 172.21.15.120:0/2959500099 shutdown_connections 2021-04-09T18:29:46.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd017db00 0x7fafd017df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fafb8018930 0x7fafb801ae10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd017aee0 0x7fafd017b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 --2- 172.21.15.120:0/2959500099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd008aa90 0x7fafd008ae90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:46.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 -- 172.21.15.120:0/2959500099 >> 172.21.15.120:0/2959500099 conn(0x7fafd018c6e0 msgr2=0x7fafd019b680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:46.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 -- 172.21.15.120:0/2959500099 shutdown_connections 2021-04-09T18:29:46.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:46.906 7fafd829a700 1 -- 172.21.15.120:0/2959500099 wait complete. 2021-04-09T18:29:46.905 INFO:tasks.mds_thrash.fs.[None]:kill mds.b (rank=0) 2021-04-09T18:29:46.905 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:29:46.906 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:29:46.916 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:29:46.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.104 7f42bc30c700 1 Processor -- start 2021-04-09T18:29:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.104 7f42bc30c700 1 -- start start 2021-04-09T18:29:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42bc30c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f42b40d1b40 0x7f42b40d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42bc30c700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40d61e0 con 0x7f42b40eac40 2021-04-09T18:29:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42bc30c700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40dcab0 con 0x7f42b40dc6b0 2021-04-09T18:29:47.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42bc30c700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40eaa10 con 0x7f42b40d1b40 2021-04-09T18:29:47.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42ba128700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f42b40eac40 0x7f42b4088000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53476/0 (socket says 172.21.15.120:53476) 2021-04-09T18:29:47.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42ba128700 1 -- 172.21.15.120:0/1234243800 learned_addr learned my addr 172.21.15.120:0/1234243800 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:29:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42ba929700 1 --2- 172.21.15.120:0/1234243800 >> v2:172.21.15.134:3300/0 conn(0x7f42b40d1b40 0x7f42b40d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42b9126700 1 -- 172.21.15.120:0/1234243800 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986092877 0 0) 0x7f42a8000ce0 con 0x7f42b40eac40 2021-04-09T18:29:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42b9126700 1 -- 172.21.15.120:0/1234243800 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42a0002fe0 con 0x7f42b40eac40 2021-04-09T18:29:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42b9126700 1 -- 172.21.15.120:0/1234243800 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3721064989 0 0) 0x7f42a80010e0 con 0x7f42b40eac40 2021-04-09T18:29:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42ba929700 1 -- 172.21.15.120:0/1234243800 >> v1:172.21.15.134:6789/0 conn(0x7f42b40dc6b0 legacy=0x7f42b40d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.105 7f42ba929700 1 -- 172.21.15.120:0/1234243800 >> v1:172.21.15.120:6789/0 conn(0x7f42b40eac40 legacy=0x7f42b4088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.106 7f42ba929700 1 -- 172.21.15.120:0/1234243800 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40f3910 con 0x7f42b40d1b40 2021-04-09T18:29:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.106 7f42ba929700 1 --2- 172.21.15.120:0/1234243800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42b40d1b40 0x7f42b40d5590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f42ac006ad0 tx=0x7f42ac009a50).ready entity=mon.1 client_cookie=6ddb96349f58019b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.106 7f42b9126700 1 -- 172.21.15.120:0/1234243800 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42ac0066a0 con 0x7f42b40d1b40 2021-04-09T18:29:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.106 7f42b9126700 1 -- 172.21.15.120:0/1234243800 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac006410 con 0x7f42b40d1b40 2021-04-09T18:29:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.106 7f42b9126700 1 -- 172.21.15.120:0/1234243800 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42ac0024d0 con 0x7f42b40d1b40 2021-04-09T18:29:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.106 7f42bc30c700 1 -- 172.21.15.120:0/1234243800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42b40d1b40 msgr2=0x7f42b40d5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.106 7f42bc30c700 1 --2- 172.21.15.120:0/1234243800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42b40d1b40 0x7f42b40d5590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f42ac006ad0 tx=0x7f42ac009a50).stop 2021-04-09T18:29:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.107 7f42bc30c700 1 -- 172.21.15.120:0/1234243800 shutdown_connections 2021-04-09T18:29:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.107 7f42bc30c700 1 --2- 172.21.15.120:0/1234243800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42b40d1b40 0x7f42b40d5590 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.107 7f42bc30c700 1 -- 172.21.15.120:0/1234243800 >> 172.21.15.120:0/1234243800 conn(0x7f42b40e93c0 msgr2=0x7f42b4100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.107 7f42bc30c700 1 -- 172.21.15.120:0/1234243800 shutdown_connections 2021-04-09T18:29:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.107 7f42bc30c700 1 -- 172.21.15.120:0/1234243800 wait complete. 2021-04-09T18:29:47.122 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.125 7f42bc30c700 1 Processor -- start 2021-04-09T18:29:47.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.125 7f42bc30c700 1 -- start start 2021-04-09T18:29:47.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42bc30c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42b418bfc0 0x7f42b408c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42bc30c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42b4092a40 0x7f42b4092e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.123 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42bc30c700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42b4089410 0x7f42b4089810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42bc30c700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b408bb30 con 0x7f42b4092a40 2021-04-09T18:29:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42bc30c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b4092750 con 0x7f42b418bfc0 2021-04-09T18:29:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42bc30c700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b408c6d0 con 0x7f42b4089410 2021-04-09T18:29:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42b9927700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42b4092a40 0x7f42b4092e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42b9927700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42b4092a40 0x7f42b4092e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58574/0 (socket says 172.21.15.120:58574) 2021-04-09T18:29:47.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42b9927700 1 -- 172.21.15.120:0/1406626510 learned_addr learned my addr 172.21.15.120:0/1406626510 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:47.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42ba128700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42b418bfc0 0x7f42b408c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42ba929700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42b4089410 0x7f42b4089810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42b9927700 1 -- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42b4089410 msgr2=0x7f42b4089810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.125 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42b9927700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42b4089410 0x7f42b4089810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42b9927700 1 -- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42b418bfc0 msgr2=0x7f42b408c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42b9927700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42b418bfc0 0x7f42b408c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.126 7f42b9927700 1 -- 172.21.15.120:0/1406626510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b418c3c0 con 0x7f42b4092a40 2021-04-09T18:29:47.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.127 7f42b9927700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42b4092a40 0x7f42b4092e40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f42b000b8e0 tx=0x7f42b000bc80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:47.127 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.127 7f42a6ffd700 1 -- 172.21.15.120:0/1406626510 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42b000c2f0 con 0x7f42b4092a40 2021-04-09T18:29:47.127 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.127 7f42a6ffd700 1 -- 172.21.15.120:0/1406626510 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b000c570 con 0x7f42b4092a40 2021-04-09T18:29:47.127 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.127 7f42a6ffd700 1 -- 172.21.15.120:0/1406626510 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42b000c9d0 con 0x7f42b4092a40 2021-04-09T18:29:47.127 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.127 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b418c3c0 con 0x7f42b4092a40 2021-04-09T18:29:47.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.127 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b418c3c0 con 0x7f42b4092a40 2021-04-09T18:29:47.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.127 7f42a6ffd700 1 -- 172.21.15.120:0/1406626510 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f42b000a000 con 0x7f42b4092a40 2021-04-09T18:29:47.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.127 7f42a6ffd700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f429c018930 0x7f429c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:47.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.127 7f42a6ffd700 1 -- 172.21.15.120:0/1406626510 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f42b0033140 con 0x7f42b4092a40 2021-04-09T18:29:47.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.128 7f42ba128700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f429c018930 0x7f429c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:47.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.128 7f42ba128700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f429c018930 0x7f429c01ae10 crc :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.151 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b4092700 con 0x7f42b4092a40 2021-04-09T18:29:47.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.154 7f42a6ffd700 1 -- 172.21.15.120:0/1406626510 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f42b000bdc0 con 0x7f42b4092a40 2021-04-09T18:29:47.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.331 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42b4092700 con 0x7f42b4092a40 2021-04-09T18:29:47.320 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.332 7f42a6ffd700 1 -- 172.21.15.120:0/1406626510 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f42b000a000 con 0x7f42b4092a40 2021-04-09T18:29:47.320 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2021-04-09T18:29:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:29:47.321 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:29:47.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f429c018930 msgr2=0x7f429c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f429c018930 0x7f429c01ae10 crc :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42b4092a40 msgr2=0x7f42b4092e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:47.323 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42b4092a40 0x7f42b4092e40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f42b000b8e0 tx=0x7f42b000bc80).stop 2021-04-09T18:29:47.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 shutdown_connections 2021-04-09T18:29:47.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f429c018930 0x7f429c01ae10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42b4089410 0x7f42b4089810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42b4092a40 0x7f42b4092e40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.324 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 --2- 172.21.15.120:0/1406626510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42b418bfc0 0x7f42b408c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:47.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 >> 172.21.15.120:0/1406626510 conn(0x7f42b41ad050 msgr2=0x7f42b41a96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:47.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 shutdown_connections 2021-04-09T18:29:47.325 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:47.334 7f42bc30c700 1 -- 172.21.15.120:0/1406626510 wait complete. 2021-04-09T18:29:47.332 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:29:49.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:49.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.528 7f6bcf81a700 1 Processor -- start 2021-04-09T18:29:49.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcf81a700 1 -- start start 2021-04-09T18:29:49.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcf81a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6bc80d7160 0x7f6bc80d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.539 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcf81a700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6bc80d55a0 0x7f6bc80d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.539 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcf81a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80d6be0 con 0x7f6bc80d5fc0 2021-04-09T18:29:49.539 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcf81a700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80d80f0 con 0x7f6bc80d55a0 2021-04-09T18:29:49.539 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcf81a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc81a2ac0 con 0x7f6bc80d7160 2021-04-09T18:29:49.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcce35700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6bc80d55a0 0x7f6bc80d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcce35700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6bc80d55a0 0x7f6bc80d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58596/0 (socket says 172.21.15.120:58596) 2021-04-09T18:29:49.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcce35700 1 -- 172.21.15.120:0/1651224339 learned_addr learned my addr 172.21.15.120:0/1651224339 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:49.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.529 7f6bcd636700 1 --2- 172.21.15.120:0/1651224339 >> v2:172.21.15.134:3300/0 conn(0x7f6bc80d7160 0x7f6bc80d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bcce35700 1 -- 172.21.15.120:0/1651224339 >> v2:172.21.15.134:3300/0 conn(0x7f6bc80d7160 msgr2=0x7f6bc80d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:49.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bcce35700 1 --2- 172.21.15.120:0/1651224339 >> v2:172.21.15.134:3300/0 conn(0x7f6bc80d7160 0x7f6bc80d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bcce35700 1 -- 172.21.15.120:0/1651224339 >> v1:172.21.15.134:6789/0 conn(0x7f6bc80d5fc0 legacy=0x7f6bc80d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:49.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bcce35700 1 -- 172.21.15.120:0/1651224339 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc81ac1f0 con 0x7f6bc80d55a0 2021-04-09T18:29:49.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bcce35700 1 --2- 172.21.15.120:0/1651224339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc80d55a0 0x7f6bc80d59a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f6bb8006700 tx=0x7f6bb8009b00).ready entity=mon.0 client_cookie=d349669da2bdab3e server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bbffff700 1 -- 172.21.15.120:0/1651224339 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bb800c0c0 con 0x7f6bc80d55a0 2021-04-09T18:29:49.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bbffff700 1 -- 172.21.15.120:0/1651224339 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb800c400 con 0x7f6bc80d55a0 2021-04-09T18:29:49.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bbffff700 1 -- 172.21.15.120:0/1651224339 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bb800c8e0 con 0x7f6bc80d55a0 2021-04-09T18:29:49.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bcf81a700 1 -- 172.21.15.120:0/1651224339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc80d55a0 msgr2=0x7f6bc80d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.530 7f6bcf81a700 1 --2- 172.21.15.120:0/1651224339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc80d55a0 0x7f6bc80d59a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f6bb8006700 tx=0x7f6bb8009b00).stop 2021-04-09T18:29:49.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.531 7f6bcf81a700 1 -- 172.21.15.120:0/1651224339 shutdown_connections 2021-04-09T18:29:49.544 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.531 7f6bcf81a700 1 --2- 172.21.15.120:0/1651224339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc80d55a0 0x7f6bc80d59a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.544 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.531 7f6bcf81a700 1 --2- 172.21.15.120:0/1651224339 >> v2:172.21.15.134:3300/0 conn(0x7f6bc80d7160 0x7f6bc80d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.544 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.531 7f6bcf81a700 1 -- 172.21.15.120:0/1651224339 >> 172.21.15.120:0/1651224339 conn(0x7f6bc80d1590 msgr2=0x7f6bc80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:49.544 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.531 7f6bcf81a700 1 -- 172.21.15.120:0/1651224339 shutdown_connections 2021-04-09T18:29:49.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.531 7f6bcf81a700 1 -- 172.21.15.120:0/1651224339 wait complete. 2021-04-09T18:29:49.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcf81a700 1 Processor -- start 2021-04-09T18:29:49.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcf81a700 1 -- start start 2021-04-09T18:29:49.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcf81a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc817b4b0 0x7f6bc81a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcf81a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc817b8b0 0x7f6bc819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcf81a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bc81a1760 0x7f6bc819ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcf81a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc817be20 con 0x7f6bc817b8b0 2021-04-09T18:29:49.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcf81a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc81a0550 con 0x7f6bc817b4b0 2021-04-09T18:29:49.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcf81a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc81a0770 con 0x7f6bc81a1760 2021-04-09T18:29:49.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcce35700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc817b8b0 0x7f6bc819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcce35700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc817b8b0 0x7f6bc819f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58600/0 (socket says 172.21.15.120:58600) 2021-04-09T18:29:49.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.550 7f6bcce35700 1 -- 172.21.15.120:0/3525867623 learned_addr learned my addr 172.21.15.120:0/3525867623 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:49.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcd636700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc817b4b0 0x7f6bc81a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcde37700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bc81a1760 0x7f6bc819ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcce35700 1 -- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bc81a1760 msgr2=0x7f6bc819ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcce35700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bc81a1760 0x7f6bc819ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcce35700 1 -- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc817b4b0 msgr2=0x7f6bc81a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcce35700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc817b4b0 0x7f6bc81a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcce35700 1 -- 172.21.15.120:0/3525867623 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc81a0990 con 0x7f6bc817b8b0 2021-04-09T18:29:49.554 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcce35700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc817b8b0 0x7f6bc819f910 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f6bb8006f20 tx=0x7f6bb800b9e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.554 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bbdffb700 1 -- 172.21.15.120:0/3525867623 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bb800bdd0 con 0x7f6bc817b8b0 2021-04-09T18:29:49.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bbdffb700 1 -- 172.21.15.120:0/3525867623 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8006440 con 0x7f6bc817b8b0 2021-04-09T18:29:49.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc81a0990 con 0x7f6bc817b8b0 2021-04-09T18:29:49.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bbdffb700 1 -- 172.21.15.120:0/3525867623 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bb80052e0 con 0x7f6bc817b8b0 2021-04-09T18:29:49.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.551 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc81a0990 con 0x7f6bc817b8b0 2021-04-09T18:29:49.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.552 7f6bbdffb700 1 -- 172.21.15.120:0/3525867623 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6bb80052e0 con 0x7f6bc817b8b0 2021-04-09T18:29:49.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.552 7f6bbdffb700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6ba8018930 0x7f6ba801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:49.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.552 7f6bbdffb700 1 -- 172.21.15.120:0/3525867623 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f6bb8032d70 con 0x7f6bc817b8b0 2021-04-09T18:29:49.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.552 7f6bcd636700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6ba8018930 0x7f6ba801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:49.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.552 7f6bcd636700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6ba8018930 0x7f6ba801ae10 crc :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:49.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.575 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc817a2b0 con 0x7f6bc817b8b0 2021-04-09T18:29:49.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.579 7f6bbdffb700 1 -- 172.21.15.120:0/3525867623 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6bb8006440 con 0x7f6bc817b8b0 2021-04-09T18:29:49.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.756 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bc817a2b0 con 0x7f6bc817b8b0 2021-04-09T18:29:49.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.757 7f6bbdffb700 1 -- 172.21.15.120:0/3525867623 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f6bb800bdd0 con 0x7f6bc817b8b0 2021-04-09T18:29:49.746 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2021-04-09T18:29:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:29:49.747 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:29:49.748 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.759 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6ba8018930 msgr2=0x7f6ba801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.748 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.759 7f6bcf81a700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6ba8018930 0x7f6ba801ae10 crc :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.749 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.759 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc817b8b0 msgr2=0x7f6bc819f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:49.749 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.759 7f6bcf81a700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc817b8b0 0x7f6bc819f910 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f6bb8006f20 tx=0x7f6bb800b9e0).stop 2021-04-09T18:29:49.749 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.760 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 shutdown_connections 2021-04-09T18:29:49.750 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.760 7f6bcf81a700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6ba8018930 0x7f6ba801ae10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.750 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.760 7f6bcf81a700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bc81a1760 0x7f6bc819ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.750 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.760 7f6bcf81a700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bc817b8b0 0x7f6bc819f910 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.750 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.760 7f6bcf81a700 1 --2- 172.21.15.120:0/3525867623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bc817b4b0 0x7f6bc81a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:49.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.760 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 >> 172.21.15.120:0/3525867623 conn(0x7f6bc8185580 msgr2=0x7f6bc8188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:49.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.760 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 shutdown_connections 2021-04-09T18:29:49.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:49.760 7f6bcf81a700 1 -- 172.21.15.120:0/3525867623 wait complete. 2021-04-09T18:29:49.758 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:29:51.759 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:51.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.951 7fb0a7a63700 1 Processor -- start 2021-04-09T18:29:51.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.952 7fb0a7a63700 1 -- start start 2021-04-09T18:29:51.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.952 7fb0a7a63700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb0a00d6580 0x7fb0a01ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.952 7fb0a7a63700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a00d7960 con 0x7fb0a00d7560 2021-04-09T18:29:51.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.952 7fb0a7a63700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a00d6980 con 0x7fb0a00d7160 2021-04-09T18:29:51.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.952 7fb0a7a63700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a00d6be0 con 0x7fb0a00d6580 2021-04-09T18:29:51.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.952 7fb0a6080700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb0a00d6580 0x7fb0a01ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.952 7fb0a507e700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb0a00d7560 0x7fb0a00d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53524/0 (socket says 172.21.15.120:53524) 2021-04-09T18:29:51.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.952 7fb0a507e700 1 -- 172.21.15.120:0/3755666685 learned_addr learned my addr 172.21.15.120:0/3755666685 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:29:51.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a6080700 1 -- 172.21.15.120:0/3755666685 >> v1:172.21.15.134:6789/0 conn(0x7fb0a00d7160 legacy=0x7fb0a00d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a6080700 1 -- 172.21.15.120:0/3755666685 >> v1:172.21.15.120:6789/0 conn(0x7fb0a00d7560 legacy=0x7fb0a00d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a6080700 1 -- 172.21.15.120:0/3755666685 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a01a2ac0 con 0x7fb0a00d6580 2021-04-09T18:29:51.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a487d700 1 -- 172.21.15.120:0/3755666685 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547601650 0 0) 0x7fb0900009b0 con 0x7fb0a00d7560 2021-04-09T18:29:51.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a6080700 1 --2- 172.21.15.120:0/3755666685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a00d6580 0x7fb0a01ac1f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fb098006ab0 tx=0x7fb098009ac0).ready entity=mon.0 client_cookie=57c358b054db5524 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:51.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a487d700 1 -- 172.21.15.120:0/3755666685 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb0980066d0 con 0x7fb0a00d6580 2021-04-09T18:29:51.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a487d700 1 -- 172.21.15.120:0/3755666685 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb098000c10 con 0x7fb0a00d6580 2021-04-09T18:29:51.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a487d700 1 -- 172.21.15.120:0/3755666685 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb0980022e0 con 0x7fb0a00d6580 2021-04-09T18:29:51.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a7a63700 1 -- 172.21.15.120:0/3755666685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a00d6580 msgr2=0x7fb0a01ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.953 7fb0a7a63700 1 --2- 172.21.15.120:0/3755666685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a00d6580 0x7fb0a01ac1f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fb098006ab0 tx=0x7fb098009ac0).stop 2021-04-09T18:29:51.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.954 7fb0a7a63700 1 -- 172.21.15.120:0/3755666685 shutdown_connections 2021-04-09T18:29:51.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.954 7fb0a7a63700 1 --2- 172.21.15.120:0/3755666685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a00d6580 0x7fb0a01ac1f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.954 7fb0a7a63700 1 -- 172.21.15.120:0/3755666685 >> 172.21.15.120:0/3755666685 conn(0x7fb0a00d1590 msgr2=0x7fb0a00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:51.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.954 7fb0a7a63700 1 -- 172.21.15.120:0/3755666685 shutdown_connections 2021-04-09T18:29:51.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.954 7fb0a7a63700 1 -- 172.21.15.120:0/3755666685 wait complete. 2021-04-09T18:29:51.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.972 7fb0a7a63700 1 Processor -- start 2021-04-09T18:29:51.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a7a63700 1 -- start start 2021-04-09T18:29:51.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a7a63700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a008b3d0 0x7fb0a008aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a7a63700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0a019cfa0 0x7fb0a008b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a7a63700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a019d3a0 0x7fb0a008bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a7a63700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a019ca20 con 0x7fb0a019d3a0 2021-04-09T18:29:51.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a7a63700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a008c520 con 0x7fb0a008b3d0 2021-04-09T18:29:51.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a7a63700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a008c700 con 0x7fb0a019cfa0 2021-04-09T18:29:51.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a6080700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a019d3a0 0x7fb0a008bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a6080700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a019d3a0 0x7fb0a008bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58614/0 (socket says 172.21.15.120:58614) 2021-04-09T18:29:51.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a6080700 1 -- 172.21.15.120:0/2668243136 learned_addr learned my addr 172.21.15.120:0/2668243136 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:51.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a507e700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0a019cfa0 0x7fb0a008b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a587f700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a008b3d0 0x7fb0a008aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a6080700 1 -- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0a019cfa0 msgr2=0x7fb0a008b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a6080700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0a019cfa0 0x7fb0a008b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a6080700 1 -- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a008b3d0 msgr2=0x7fb0a008aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:51.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a6080700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a008b3d0 0x7fb0a008aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:51.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a6080700 1 -- 172.21.15.120:0/2668243136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a008c920 con 0x7fb0a019d3a0 2021-04-09T18:29:51.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a507e700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0a019cfa0 0x7fb0a008b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:51.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.973 7fb0a587f700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a008b3d0 0x7fb0a008aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:51.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.974 7fb0a6080700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a019d3a0 0x7fb0a008bf00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fb098006e50 tx=0x7fb098002820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:51.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.974 7fb0967fc700 1 -- 172.21.15.120:0/2668243136 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb09800d0d0 con 0x7fb0a019d3a0 2021-04-09T18:29:51.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.974 7fb0967fc700 1 -- 172.21.15.120:0/2668243136 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0980009b0 con 0x7fb0a019d3a0 2021-04-09T18:29:51.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.974 7fb0967fc700 1 -- 172.21.15.120:0/2668243136 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb09800d650 con 0x7fb0a019d3a0 2021-04-09T18:29:51.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.974 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a008c920 con 0x7fb0a019d3a0 2021-04-09T18:29:51.982 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.974 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a008c920 con 0x7fb0a019d3a0 2021-04-09T18:29:51.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.974 7fb0967fc700 1 -- 172.21.15.120:0/2668243136 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fb098002c10 con 0x7fb0a019d3a0 2021-04-09T18:29:51.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.974 7fb0967fc700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb088018930 0x7fb08801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:51.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.974 7fb0967fc700 1 -- 172.21.15.120:0/2668243136 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7fb098032dc0 con 0x7fb0a019d3a0 2021-04-09T18:29:51.983 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.975 7fb0a587f700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb088018930 0x7fb08801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:51.984 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.975 7fb0a587f700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb088018930 0x7fb08801adc0 crc :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:51.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:51.998 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a017f360 con 0x7fb0a019d3a0 2021-04-09T18:29:51.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.001 7fb0967fc700 1 -- 172.21.15.120:0/2668243136 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fb09801f790 con 0x7fb0a019d3a0 2021-04-09T18:29:52.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.180 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0a017f360 con 0x7fb0a019d3a0 2021-04-09T18:29:52.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.180 7fb0967fc700 1 -- 172.21.15.120:0/2668243136 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fb098002c10 con 0x7fb0a019d3a0 2021-04-09T18:29:52.169 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2021-04-09T18:29:52.170 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:29:52.170 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:29:52.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb088018930 msgr2=0x7fb08801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:52.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb088018930 0x7fb08801adc0 crc :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a019d3a0 msgr2=0x7fb0a008bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:52.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a019d3a0 0x7fb0a008bf00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fb098006e50 tx=0x7fb098002820).stop 2021-04-09T18:29:52.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 shutdown_connections 2021-04-09T18:29:52.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0a019d3a0 0x7fb0a008bf00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fb088018930 0x7fb08801adc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0a019cfa0 0x7fb0a008b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 --2- 172.21.15.120:0/2668243136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0a008b3d0 0x7fb0a008aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:52.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 >> 172.21.15.120:0/2668243136 conn(0x7fb0a00945f0 msgr2=0x7fb0a0097cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:52.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 shutdown_connections 2021-04-09T18:29:52.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:52.183 7fb0a7a63700 1 -- 172.21.15.120:0/2668243136 wait complete. 2021-04-09T18:29:52.181 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:29:54.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:54.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.375 7f02d3f0b700 1 Processor -- start 2021-04-09T18:29:54.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d3f0b700 1 -- start start 2021-04-09T18:29:54.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d3f0b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0d7560 0x7f02cc0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d3f0b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f02cc0d63b0 0x7f02cc1ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d3f0b700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc0d7960 con 0x7f02cc0d7160 2021-04-09T18:29:54.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d3f0b700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02cc0d80f0 con 0x7f02cc0d63b0 2021-04-09T18:29:54.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d3f0b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0d6be0 con 0x7f02cc0d7560 2021-04-09T18:29:54.389 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d2528700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f02cc0d63b0 0x7f02cc1ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d1d27700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f02cc0d7160 0x7f02cc0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53536/0 (socket says 172.21.15.120:53536) 2021-04-09T18:29:54.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d1d27700 1 -- 172.21.15.120:0/59478223 learned_addr learned my addr 172.21.15.120:0/59478223 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:29:54.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d1526700 1 --2- 172.21.15.120:0/59478223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0d7560 0x7f02cc0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.390 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.376 7f02d2528700 1 -- 172.21.15.120:0/59478223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0d7560 msgr2=0x7f02cc0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:54.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d2528700 1 --2- 172.21.15.120:0/59478223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0d7560 0x7f02cc0d5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d0d25700 1 -- 172.21.15.120:0/59478223 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381607010 0 0) 0x7f02bc000ce0 con 0x7f02cc0d7160 2021-04-09T18:29:54.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d2528700 1 -- 172.21.15.120:0/59478223 >> v1:172.21.15.120:6789/0 conn(0x7f02cc0d7160 legacy=0x7f02cc0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.391 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d2528700 1 -- 172.21.15.120:0/59478223 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc1a2ac0 con 0x7f02cc0d63b0 2021-04-09T18:29:54.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d2528700 1 --2- 172.21.15.120:0/59478223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc0d63b0 0x7f02cc1ab1e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f02c4006e30 tx=0x7f02c4009de0).ready entity=mon.0 client_cookie=fd556c42f11b6a5c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d0d25700 1 -- 172.21.15.120:0/59478223 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02c400b300 con 0x7f02cc0d63b0 2021-04-09T18:29:54.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d0d25700 1 -- 172.21.15.120:0/59478223 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c400b680 con 0x7f02cc0d63b0 2021-04-09T18:29:54.392 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d0d25700 1 -- 172.21.15.120:0/59478223 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02c400bb60 con 0x7f02cc0d63b0 2021-04-09T18:29:54.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d3f0b700 1 -- 172.21.15.120:0/59478223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc0d63b0 msgr2=0x7f02cc1ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.377 7f02d3f0b700 1 --2- 172.21.15.120:0/59478223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc0d63b0 0x7f02cc1ab1e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f02c4006e30 tx=0x7f02c4009de0).stop 2021-04-09T18:29:54.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.378 7f02d3f0b700 1 -- 172.21.15.120:0/59478223 shutdown_connections 2021-04-09T18:29:54.393 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.378 7f02d3f0b700 1 --2- 172.21.15.120:0/59478223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc0d63b0 0x7f02cc1ab1e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.378 7f02d3f0b700 1 --2- 172.21.15.120:0/59478223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0d7560 0x7f02cc0d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.378 7f02d3f0b700 1 -- 172.21.15.120:0/59478223 >> 172.21.15.120:0/59478223 conn(0x7f02cc0d1590 msgr2=0x7f02cc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:54.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.378 7f02d3f0b700 1 -- 172.21.15.120:0/59478223 shutdown_connections 2021-04-09T18:29:54.394 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.378 7f02d3f0b700 1 -- 172.21.15.120:0/59478223 wait complete. 2021-04-09T18:29:54.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.396 7f02d3f0b700 1 Processor -- start 2021-04-09T18:29:54.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.396 7f02d3f0b700 1 -- start start 2021-04-09T18:29:54.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d3f0b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc17f2e0 0x7f02cc17b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d3f0b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02cc17f6e0 0x7f02cc17b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d3f0b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0aea70 0x7f02cc0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d3f0b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc17fc60 con 0x7f02cc17f2e0 2021-04-09T18:29:54.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d3f0b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc097ca0 con 0x7f02cc17f6e0 2021-04-09T18:29:54.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d3f0b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0a65c0 con 0x7f02cc0aea70 2021-04-09T18:29:54.396 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1d27700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc17f2e0 0x7f02cc17b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1d27700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc17f2e0 0x7f02cc17b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58630/0 (socket says 172.21.15.120:58630) 2021-04-09T18:29:54.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1d27700 1 -- 172.21.15.120:0/210233749 learned_addr learned my addr 172.21.15.120:0/210233749 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:54.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1526700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02cc17f6e0 0x7f02cc17b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d2528700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0aea70 0x7f02cc0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1d27700 1 -- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0aea70 msgr2=0x7f02cc0b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1d27700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0aea70 0x7f02cc0b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1d27700 1 -- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02cc17f6e0 msgr2=0x7f02cc17b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1d27700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02cc17f6e0 0x7f02cc17b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1d27700 1 -- 172.21.15.120:0/210233749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc17ed90 con 0x7f02cc17f2e0 2021-04-09T18:29:54.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d1d27700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc17f2e0 0x7f02cc17b2a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f02bc00b530 tx=0x7f02bc00b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02ca7fc700 1 -- 172.21.15.120:0/210233749 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02bc006020 con 0x7f02cc17f2e0 2021-04-09T18:29:54.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02ca7fc700 1 -- 172.21.15.120:0/210233749 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc0063a0 con 0x7f02cc17f2e0 2021-04-09T18:29:54.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc17ed90 con 0x7f02cc17f2e0 2021-04-09T18:29:54.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.397 7f02ca7fc700 1 -- 172.21.15.120:0/210233749 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f02bc004590 con 0x7f02cc17f2e0 2021-04-09T18:29:54.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.398 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc17ed90 con 0x7f02cc17f2e0 2021-04-09T18:29:54.401 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.398 7f02ca7fc700 1 -- 172.21.15.120:0/210233749 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f02bc00a000 con 0x7f02cc17f2e0 2021-04-09T18:29:54.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.398 7f02ca7fc700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f02ac018930 0x7f02ac01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:54.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.398 7f02ca7fc700 1 -- 172.21.15.120:0/210233749 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f02bc032d40 con 0x7f02cc17f2e0 2021-04-09T18:29:54.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.398 7f02d1526700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f02ac018930 0x7f02ac01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:54.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.399 7f02d1526700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f02ac018930 0x7f02ac01ae10 crc :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:54.410 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.422 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc097ca0 con 0x7f02cc17f2e0 2021-04-09T18:29:54.413 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.425 7f02ca7fc700 1 -- 172.21.15.120:0/210233749 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f02bc006b90 con 0x7f02cc17f2e0 2021-04-09T18:29:54.591 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.603 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02cc097ca0 con 0x7f02cc17f2e0 2021-04-09T18:29:54.592 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.603 7f02ca7fc700 1 -- 172.21.15.120:0/210233749 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f02bc00a000 con 0x7f02cc17f2e0 2021-04-09T18:29:54.592 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2021-04-09T18:29:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:29:54.593 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:29:54.594 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f02ac018930 msgr2=0x7f02ac01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f02ac018930 0x7f02ac01ae10 crc :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc17f2e0 msgr2=0x7f02cc17b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:54.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc17f2e0 0x7f02cc17b2a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f02bc00b530 tx=0x7f02bc00b8d0).stop 2021-04-09T18:29:54.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 shutdown_connections 2021-04-09T18:29:54.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f02ac018930 0x7f02ac01ae10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f02cc0aea70 0x7f02cc0b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02cc17f6e0 0x7f02cc17b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.596 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 --2- 172.21.15.120:0/210233749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02cc17f2e0 0x7f02cc17b2a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:54.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 >> 172.21.15.120:0/210233749 conn(0x7f02cc1a1d70 msgr2=0x7f02cc19edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:54.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 shutdown_connections 2021-04-09T18:29:54.597 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:54.606 7f02d3f0b700 1 -- 172.21.15.120:0/210233749 wait complete. 2021-04-09T18:29:54.604 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:29:56.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:56.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.812 7fa9eae22700 1 Processor -- start 2021-04-09T18:29:56.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.812 7fa9eae22700 1 -- start start 2021-04-09T18:29:56.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9eae22700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa9e40d7160 0x7fa9e40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9eae22700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa9e40d6190 0x7fa9e40d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9eae22700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e40d6be0 con 0x7fa9e40d55a0 2021-04-09T18:29:56.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9eae22700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e40d80f0 con 0x7fa9e40d6190 2021-04-09T18:29:56.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9eae22700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e41a2ac0 con 0x7fa9e40d7160 2021-04-09T18:29:56.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e943f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa9e40d6190 0x7fa9e40d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e3fff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa9e40d55a0 0x7fa9e40d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53554/0 (socket says 172.21.15.120:53554) 2021-04-09T18:29:56.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e3fff700 1 -- 172.21.15.120:0/1766344832 learned_addr learned my addr 172.21.15.120:0/1766344832 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:29:56.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e8c3e700 1 --2- 172.21.15.120:0/1766344832 >> v2:172.21.15.134:3300/0 conn(0x7fa9e40d7160 0x7fa9e40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e37fe700 1 -- 172.21.15.120:0/1766344832 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990833203 0 0) 0x7fa9d4000ce0 con 0x7fa9e40d55a0 2021-04-09T18:29:56.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e37fe700 1 -- 172.21.15.120:0/1766344832 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d0002fe0 con 0x7fa9e40d55a0 2021-04-09T18:29:56.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e943f700 1 -- 172.21.15.120:0/1766344832 >> v2:172.21.15.134:3300/0 conn(0x7fa9e40d7160 msgr2=0x7fa9e40d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:56.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e943f700 1 --2- 172.21.15.120:0/1766344832 >> v2:172.21.15.134:3300/0 conn(0x7fa9e40d7160 0x7fa9e40d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e943f700 1 -- 172.21.15.120:0/1766344832 >> v1:172.21.15.120:6789/0 conn(0x7fa9e40d55a0 legacy=0x7fa9e40d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.813 7fa9e943f700 1 -- 172.21.15.120:0/1766344832 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e41ac1f0 con 0x7fa9e40d6190 2021-04-09T18:29:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9e943f700 1 --2- 172.21.15.120:0/1766344832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40d6190 0x7fa9e40d6590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa9dc006e30 tx=0x7fa9dc009e60).ready entity=mon.0 client_cookie=a43948b0c8c5d5c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9e37fe700 1 -- 172.21.15.120:0/1766344832 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9dc006a50 con 0x7fa9e40d6190 2021-04-09T18:29:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9e37fe700 1 -- 172.21.15.120:0/1766344832 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc00b300 con 0x7fa9e40d6190 2021-04-09T18:29:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9e37fe700 1 -- 172.21.15.120:0/1766344832 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9dc00b750 con 0x7fa9e40d6190 2021-04-09T18:29:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9eae22700 1 -- 172.21.15.120:0/1766344832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40d6190 msgr2=0x7fa9e40d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9eae22700 1 --2- 172.21.15.120:0/1766344832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40d6190 0x7fa9e40d6590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa9dc006e30 tx=0x7fa9dc009e60).stop 2021-04-09T18:29:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9eae22700 1 -- 172.21.15.120:0/1766344832 shutdown_connections 2021-04-09T18:29:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9eae22700 1 --2- 172.21.15.120:0/1766344832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40d6190 0x7fa9e40d6590 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9eae22700 1 --2- 172.21.15.120:0/1766344832 >> v2:172.21.15.134:3300/0 conn(0x7fa9e40d7160 0x7fa9e40d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9eae22700 1 -- 172.21.15.120:0/1766344832 >> 172.21.15.120:0/1766344832 conn(0x7fa9e40d1590 msgr2=0x7fa9e40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.814 7fa9eae22700 1 -- 172.21.15.120:0/1766344832 shutdown_connections 2021-04-09T18:29:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.815 7fa9eae22700 1 -- 172.21.15.120:0/1766344832 wait complete. 2021-04-09T18:29:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.833 7fa9eae22700 1 Processor -- start 2021-04-09T18:29:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.833 7fa9eae22700 1 -- start start 2021-04-09T18:29:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9eae22700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9e4187670 0x7fa9e40a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9eae22700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40a5050 0x7fa9e40b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9eae22700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e40b5710 0x7fa9e41838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9eae22700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40b5b10 con 0x7fa9e40a5050 2021-04-09T18:29:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9eae22700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40b5d30 con 0x7fa9e40b5710 2021-04-09T18:29:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9eae22700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40b5f50 con 0x7fa9e4187670 2021-04-09T18:29:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40a5050 0x7fa9e40b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e3fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40a5050 0x7fa9e40b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58646/0 (socket says 172.21.15.120:58646) 2021-04-09T18:29:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e3fff700 1 -- 172.21.15.120:0/2818394754 learned_addr learned my addr 172.21.15.120:0/2818394754 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e8c3e700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9e4187670 0x7fa9e40a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e943f700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e40b5710 0x7fa9e41838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e3fff700 1 -- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9e4187670 msgr2=0x7fa9e40a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e3fff700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9e4187670 0x7fa9e40a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e3fff700 1 -- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e40b5710 msgr2=0x7fa9e41838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e3fff700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e40b5710 0x7fa9e41838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e3fff700 1 -- 172.21.15.120:0/2818394754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e4183ef0 con 0x7fa9e40a5050 2021-04-09T18:29:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e943f700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e40b5710 0x7fa9e41838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e8c3e700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9e4187670 0x7fa9e40a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:29:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e3fff700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40a5050 0x7fa9e40b50f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fa9d400b590 tx=0x7fa9d400b930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e17fa700 1 -- 172.21.15.120:0/2818394754 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9d400bd20 con 0x7fa9e40a5050 2021-04-09T18:29:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e17fa700 1 -- 172.21.15.120:0/2818394754 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4006030 con 0x7fa9e40a5050 2021-04-09T18:29:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e4183ef0 con 0x7fa9e40a5050 2021-04-09T18:29:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9e17fa700 1 -- 172.21.15.120:0/2818394754 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9d40106d0 con 0x7fa9e40a5050 2021-04-09T18:29:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.834 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e4183ef0 con 0x7fa9e40a5050 2021-04-09T18:29:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.835 7fa9e17fa700 1 -- 172.21.15.120:0/2818394754 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa9d400bd20 con 0x7fa9e40a5050 2021-04-09T18:29:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.835 7fa9e17fa700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9c8018930 0x7fa9c801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.835 7fa9e17fa700 1 -- 172.21.15.120:0/2818394754 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7fa9d4037170 con 0x7fa9e40a5050 2021-04-09T18:29:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.835 7fa9e8c3e700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9c8018930 0x7fa9c801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.836 7fa9e8c3e700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9c8018930 0x7fa9c801ae10 crc :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.859 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e41829e0 con 0x7fa9e40a5050 2021-04-09T18:29:56.850 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:56.862 7fa9e17fa700 1 -- 172.21.15.120:0/2818394754 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa9d40009b0 con 0x7fa9e40a5050 2021-04-09T18:29:57.033 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.045 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9e41829e0 con 0x7fa9e40a5050 2021-04-09T18:29:57.034 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.045 7fa9e17fa700 1 -- 172.21.15.120:0/2818394754 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2107 (secure 0 0 0) 0x7fa9d4006030 con 0x7fa9e40a5050 2021-04-09T18:29:57.035 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2021-04-09T18:29:57.035 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:29:57.035 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:29:57.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9c8018930 msgr2=0x7fa9c801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9c8018930 0x7fa9c801ae10 crc :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40a5050 msgr2=0x7fa9e40b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:57.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40a5050 0x7fa9e40b50f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fa9d400b590 tx=0x7fa9d400b930).stop 2021-04-09T18:29:57.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 shutdown_connections 2021-04-09T18:29:57.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e40b5710 0x7fa9e41838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9e40a5050 0x7fa9e40b50f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa9c8018930 0x7fa9c801ae10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 --2- 172.21.15.120:0/2818394754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa9e4187670 0x7fa9e40a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:57.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 >> 172.21.15.120:0/2818394754 conn(0x7fa9e418dc90 msgr2=0x7fa9e408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:57.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 shutdown_connections 2021-04-09T18:29:57.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:57.048 7fa9eae22700 1 -- 172.21.15.120:0/2818394754 wait complete. 2021-04-09T18:29:57.046 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:29:59.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:29:59.249 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.240 7f936a948700 1 Processor -- start 2021-04-09T18:29:59.250 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.240 7f936a948700 1 -- start start 2021-04-09T18:29:59.250 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f936a948700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f93640d7160 0x7f93640e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:59.250 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f936a948700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f93640d7560 0x7f93640d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:59.250 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f936a948700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93640d6be0 con 0x7f93640d5bc0 2021-04-09T18:29:59.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f936a948700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640d80f0 con 0x7f93640d7560 2021-04-09T18:29:59.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f936a948700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93640e7f00 con 0x7f93640d7160 2021-04-09T18:29:59.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f935bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f93640d7560 0x7f93640d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:59.251 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f9363fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f93640d7160 0x7f93640e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:59.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f9363fff700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f93640d7160 0x7f93640e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:45324/0 (socket says 172.21.15.120:45324) 2021-04-09T18:29:59.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f935bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f93640d7560 0x7f93640d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:47496/0 (socket says 172.21.15.120:47496) 2021-04-09T18:29:59.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f9363fff700 1 -- 172.21.15.120:0/1147080367 learned_addr learned my addr 172.21.15.120:0/1147080367 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:59.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.241 7f9368f65700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f93640d5bc0 0x7f93640d5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:48390/0 (socket says 172.21.15.120:48390) 2021-04-09T18:29:59.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f9363fff700 1 -- 172.21.15.120:0/1147080367 >> v2:172.21.15.134:3300/0 conn(0x7f93640d7560 msgr2=0x7f93640d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:29:59.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f9363fff700 1 --2- 172.21.15.120:0/1147080367 >> v2:172.21.15.134:3300/0 conn(0x7f93640d7560 0x7f93640d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f9363fff700 1 -- 172.21.15.120:0/1147080367 >> v1:172.21.15.134:6789/0 conn(0x7f93640d5bc0 legacy=0x7f93640d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:59.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f9363fff700 1 -- 172.21.15.120:0/1147080367 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93641a2ac0 con 0x7f93640d7160 2021-04-09T18:29:59.253 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f93637fe700 1 -- 172.21.15.120:0/1147080367 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188123763 0 0) 0x7f935c001440 con 0x7f93640d5bc0 2021-04-09T18:29:59.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f935bfff700 1 --2- 172.21.15.120:0/1147080367 >> v2:172.21.15.134:3300/0 conn(0x7f93640d7560 0x7f93640d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:29:59.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f9363fff700 1 --2- 172.21.15.120:0/1147080367 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f93640d7160 0x7f93640e78e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9354006700 tx=0x7f9354009b80).ready entity=mon.2 client_cookie=a67bf9b1909eb9c5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:59.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f93637fe700 1 -- 172.21.15.120:0/1147080367 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f935400c0c0 con 0x7f93640d7160 2021-04-09T18:29:59.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f93637fe700 1 -- 172.21.15.120:0/1147080367 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935400c440 con 0x7f93640d7160 2021-04-09T18:29:59.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f93637fe700 1 -- 172.21.15.120:0/1147080367 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f935400c0c0 con 0x7f93640d7160 2021-04-09T18:29:59.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f936a948700 1 -- 172.21.15.120:0/1147080367 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f93640d7160 msgr2=0x7f93640e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:59.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.242 7f936a948700 1 --2- 172.21.15.120:0/1147080367 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f93640d7160 0x7f93640e78e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9354006700 tx=0x7f9354009b80).stop 2021-04-09T18:29:59.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.243 7f936a948700 1 -- 172.21.15.120:0/1147080367 shutdown_connections 2021-04-09T18:29:59.255 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.243 7f936a948700 1 --2- 172.21.15.120:0/1147080367 >> v2:172.21.15.134:3300/0 conn(0x7f93640d7560 0x7f93640d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.243 7f936a948700 1 --2- 172.21.15.120:0/1147080367 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f93640d7160 0x7f93640e78e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.243 7f936a948700 1 -- 172.21.15.120:0/1147080367 >> 172.21.15.120:0/1147080367 conn(0x7f93640d1590 msgr2=0x7f93640d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:59.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.243 7f936a948700 1 -- 172.21.15.120:0/1147080367 shutdown_connections 2021-04-09T18:29:59.256 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.243 7f936a948700 1 -- 172.21.15.120:0/1147080367 wait complete. 2021-04-09T18:29:59.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f936a948700 1 Processor -- start 2021-04-09T18:29:59.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f936a948700 1 -- start start 2021-04-09T18:29:59.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f936a948700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9364187380 0x7f936419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:59.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f936a948700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9364187780 0x7f936419af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:59.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f936a948700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f936419b5a0 0x7f93641838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:59.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f936a948700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936419c920 con 0x7f9364187780 2021-04-09T18:29:59.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f936a948700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936419b9a0 con 0x7f936419b5a0 2021-04-09T18:29:59.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f936a948700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9364183ef0 con 0x7f9364187380 2021-04-09T18:29:59.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f935bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9364187780 0x7f936419af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:59.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f935bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9364187780 0x7f936419af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58666/0 (socket says 172.21.15.120:58666) 2021-04-09T18:29:59.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f935bfff700 1 -- 172.21.15.120:0/1625645189 learned_addr learned my addr 172.21.15.120:0/1625645189 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:29:59.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f9368f65700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f936419b5a0 0x7f93641838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:59.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.262 7f9363fff700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9364187380 0x7f936419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:59.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.263 7f935bfff700 1 -- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9364187380 msgr2=0x7f936419c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:59.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.263 7f935bfff700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9364187380 0x7f936419c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.263 7f935bfff700 1 -- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f936419b5a0 msgr2=0x7f93641838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:59.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.263 7f935bfff700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f936419b5a0 0x7f93641838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.263 7f935bfff700 1 -- 172.21.15.120:0/1625645189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9364184110 con 0x7f9364187780 2021-04-09T18:29:59.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.263 7f935bfff700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9364187780 0x7f936419af80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f934c006f40 tx=0x7f934c00b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:59.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.263 7f93617fa700 1 -- 172.21.15.120:0/1625645189 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f934c00bd80 con 0x7f9364187780 2021-04-09T18:29:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.263 7f93617fa700 1 -- 172.21.15.120:0/1625645189 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c000c90 con 0x7f9364187780 2021-04-09T18:29:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.263 7f93617fa700 1 -- 172.21.15.120:0/1625645189 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f934c0009b0 con 0x7f9364187780 2021-04-09T18:29:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.264 7f936a948700 1 -- 172.21.15.120:0/1625645189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9364184110 con 0x7f9364187780 2021-04-09T18:29:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.264 7f936a948700 1 -- 172.21.15.120:0/1625645189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9364184110 con 0x7f9364187780 2021-04-09T18:29:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.264 7f93617fa700 1 -- 172.21.15.120:0/1625645189 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f934c00a000 con 0x7f9364187780 2021-04-09T18:29:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.264 7f93617fa700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f93480188c0 0x7f934801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:29:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.264 7f93617fa700 1 -- 172.21.15.120:0/1625645189 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f934c032b00 con 0x7f9364187780 2021-04-09T18:29:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.264 7f9363fff700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f93480188c0 0x7f934801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:29:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.265 7f9363fff700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f93480188c0 0x7f934801adc0 crc :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:29:59.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.287 7f936a948700 1 -- 172.21.15.120:0/1625645189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93641829e0 con 0x7f9364187780 2021-04-09T18:29:59.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.290 7f93617fa700 1 -- 172.21.15.120:0/1625645189 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f934c006b00 con 0x7f9364187780 2021-04-09T18:29:59.457 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.469 7f936a948700 1 -- 172.21.15.120:0/1625645189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93641829e0 con 0x7f9364187780 2021-04-09T18:29:59.458 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.470 7f93617fa700 1 -- 172.21.15.120:0/1625645189 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2107 (secure 0 0 0) 0x7f934c00bd80 con 0x7f9364187780 2021-04-09T18:29:59.458 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2021-04-09T18:29:59.459 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:29:59.459 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:28:57.955669","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4844},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4844":{"gid":4844,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6835/782463162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":782463162},{"type":"v1","addr":"172.21.15.134:6835","nonce":782463162}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:29:59.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 -- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f93480188c0 msgr2=0x7f934801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:59.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f93480188c0 0x7f934801adc0 crc :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 -- 172.21.15.120:0/1625645189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9364187780 msgr2=0x7f936419af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:29:59.461 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9364187780 0x7f936419af80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f934c006f40 tx=0x7f934c00b990).stop 2021-04-09T18:29:59.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 -- 172.21.15.120:0/1625645189 shutdown_connections 2021-04-09T18:29:59.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f936419b5a0 0x7f93641838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9364187780 0x7f936419af80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f93480188c0 0x7f934801adc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.462 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 --2- 172.21.15.120:0/1625645189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9364187380 0x7f936419c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:29:59.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 -- 172.21.15.120:0/1625645189 >> 172.21.15.120:0/1625645189 conn(0x7f936418dc90 msgr2=0x7f936408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:29:59.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 -- 172.21.15.120:0/1625645189 shutdown_connections 2021-04-09T18:29:59.463 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:29:59.472 7f936a948700 1 -- 172.21.15.120:0/1625645189 wait complete. 2021-04-09T18:29:59.470 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-04-09T18:30:01.472 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:01.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94cdebc700 1 Processor -- start 2021-04-09T18:30:01.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94cdebc700 1 -- start start 2021-04-09T18:30:01.674 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94cdebc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c80d7160 0x7f94c80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:01.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94cdebc700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f94c80d7560 0x7f94c80d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:01.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94cdebc700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80d6be0 con 0x7f94c80d5bc0 2021-04-09T18:30:01.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94cdebc700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c80d80f0 con 0x7f94c80d7560 2021-04-09T18:30:01.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94cdebc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80e7f00 con 0x7f94c80d7160 2021-04-09T18:30:01.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94c6ffd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f94c80d7560 0x7f94c80d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:01.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94c6ffd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f94c80d7560 0x7f94c80d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58694/0 (socket says 172.21.15.120:58694) 2021-04-09T18:30:01.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.665 7f94c6ffd700 1 -- 172.21.15.120:0/256568971 learned_addr learned my addr 172.21.15.120:0/256568971 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:01.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94c77fe700 1 --2- 172.21.15.120:0/256568971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c80d7160 0x7f94c80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:01.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94c6ffd700 1 -- 172.21.15.120:0/256568971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c80d7160 msgr2=0x7f94c80e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:01.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94c6ffd700 1 --2- 172.21.15.120:0/256568971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c80d7160 0x7f94c80e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94c6ffd700 1 -- 172.21.15.120:0/256568971 >> v1:172.21.15.134:6789/0 conn(0x7f94c80d5bc0 legacy=0x7f94c80d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:01.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94c6ffd700 1 -- 172.21.15.120:0/256568971 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c81a2ac0 con 0x7f94c80d7560 2021-04-09T18:30:01.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94c6ffd700 1 --2- 172.21.15.120:0/256568971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c80d7560 0x7f94c80d55a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f94b8006700 tx=0x7f94b8009b80).ready entity=mon.0 client_cookie=defef797ee69cf2a server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:01.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94c67fc700 1 -- 172.21.15.120:0/256568971 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94b800c0c0 con 0x7f94c80d7560 2021-04-09T18:30:01.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94c67fc700 1 -- 172.21.15.120:0/256568971 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b800c440 con 0x7f94c80d7560 2021-04-09T18:30:01.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94c67fc700 1 -- 172.21.15.120:0/256568971 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94b800c920 con 0x7f94c80d7560 2021-04-09T18:30:01.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94cdebc700 1 -- 172.21.15.120:0/256568971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c80d7560 msgr2=0x7f94c80d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:01.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.666 7f94cdebc700 1 --2- 172.21.15.120:0/256568971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c80d7560 0x7f94c80d55a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f94b8006700 tx=0x7f94b8009b80).stop 2021-04-09T18:30:01.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.667 7f94cdebc700 1 -- 172.21.15.120:0/256568971 shutdown_connections 2021-04-09T18:30:01.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.667 7f94cdebc700 1 --2- 172.21.15.120:0/256568971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c80d7560 0x7f94c80d55a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.667 7f94cdebc700 1 --2- 172.21.15.120:0/256568971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c80d7160 0x7f94c80e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.682 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.667 7f94cdebc700 1 -- 172.21.15.120:0/256568971 >> 172.21.15.120:0/256568971 conn(0x7f94c80d1590 msgr2=0x7f94c80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:01.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.667 7f94cdebc700 1 -- 172.21.15.120:0/256568971 shutdown_connections 2021-04-09T18:30:01.683 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.667 7f94cdebc700 1 -- 172.21.15.120:0/256568971 wait complete. 2021-04-09T18:30:01.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.686 7f94cdebc700 1 Processor -- start 2021-04-09T18:30:01.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.686 7f94cdebc700 1 -- start start 2021-04-09T18:30:01.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94cdebc700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8187380 0x7f94c819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:01.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94cdebc700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c8187780 0x7f94c819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:01.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94cdebc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c819b5a0 0x7f94c81838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:01.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94cdebc700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c819c920 con 0x7f94c8187380 2021-04-09T18:30:01.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94cdebc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c819b9a0 con 0x7f94c819b5a0 2021-04-09T18:30:01.691 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94cdebc700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8183ef0 con 0x7f94c8187780 2021-04-09T18:30:01.691 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c77fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8187380 0x7f94c819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:01.691 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c77fe700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8187380 0x7f94c819c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58698/0 (socket says 172.21.15.120:58698) 2021-04-09T18:30:01.692 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c77fe700 1 -- 172.21.15.120:0/1044734681 learned_addr learned my addr 172.21.15.120:0/1044734681 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:01.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c6ffd700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c8187780 0x7f94c819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:01.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c7fff700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c819b5a0 0x7f94c81838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:01.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c77fe700 1 -- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c8187780 msgr2=0x7f94c819af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:01.693 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c77fe700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c8187780 0x7f94c819af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.694 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c77fe700 1 -- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c819b5a0 msgr2=0x7f94c81838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:01.694 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c77fe700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c819b5a0 0x7f94c81838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.694 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.687 7f94c77fe700 1 -- 172.21.15.120:0/1044734681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8184110 con 0x7f94c8187380 2021-04-09T18:30:01.695 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.688 7f94c77fe700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8187380 0x7f94c819c300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f94c00099e0 tx=0x7f94c000bd40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:01.695 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.688 7f94bffff700 1 -- 172.21.15.120:0/1044734681 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94c000c2f0 con 0x7f94c8187380 2021-04-09T18:30:01.695 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.688 7f94bffff700 1 -- 172.21.15.120:0/1044734681 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000c5f0 con 0x7f94c8187380 2021-04-09T18:30:01.696 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.688 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c8184110 con 0x7f94c8187380 2021-04-09T18:30:01.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.688 7f94bffff700 1 -- 172.21.15.120:0/1044734681 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94c000cad0 con 0x7f94c8187380 2021-04-09T18:30:01.697 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.688 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c8184110 con 0x7f94c8187380 2021-04-09T18:30:01.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.688 7f94bffff700 1 -- 172.21.15.120:0/1044734681 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f94c000a020 con 0x7f94c8187380 2021-04-09T18:30:01.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.689 7f94bffff700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f94ac018930 0x7f94ac01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:01.698 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.689 7f94bffff700 1 -- 172.21.15.120:0/1044734681 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f94c00331a0 con 0x7f94c8187380 2021-04-09T18:30:01.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.689 7f94c6ffd700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f94ac018930 0x7f94ac01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:01.699 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.689 7f94c6ffd700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f94ac018930 0x7f94ac01ae10 crc :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:01.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.710 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c819c920 con 0x7f94c8187380 2021-04-09T18:30:01.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.714 7f94bffff700 1 -- 172.21.15.120:0/1044734681 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f94c001fb20 con 0x7f94c8187380 2021-04-09T18:30:01.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.901 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94c819c920 con 0x7f94c8187380 2021-04-09T18:30:01.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.902 7f94bffff700 1 -- 172.21.15.120:0/1044734681 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f94c0009fe0 con 0x7f94c8187380 2021-04-09T18:30:01.891 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2021-04-09T18:30:01.891 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:30:01.891 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:00.815358","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:30:01.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.905 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f94ac018930 msgr2=0x7f94ac01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:01.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.905 7f94cdebc700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f94ac018930 0x7f94ac01ae10 crc :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.905 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8187380 msgr2=0x7f94c819c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:01.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.905 7f94cdebc700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8187380 0x7f94c819c300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f94c00099e0 tx=0x7f94c000bd40).stop 2021-04-09T18:30:01.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.906 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 shutdown_connections 2021-04-09T18:30:01.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.906 7f94cdebc700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94c819b5a0 0x7f94c81838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.906 7f94cdebc700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f94ac018930 0x7f94ac01ae10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.906 7f94cdebc700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f94c8187780 0x7f94c819af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.906 7f94cdebc700 1 --2- 172.21.15.120:0/1044734681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8187380 0x7f94c819c300 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.906 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 >> 172.21.15.120:0/1044734681 conn(0x7f94c818dc90 msgr2=0x7f94c808fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.906 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 shutdown_connections 2021-04-09T18:30:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:01.906 7f94cdebc700 1 -- 172.21.15.120:0/1044734681 wait complete. 2021-04-09T18:30:01.904 INFO:tasks.mds_thrash.fs.[None]:mds.b down, removed from mdsmap 2021-04-09T18:30:01.904 INFO:tasks.mds_thrash.fs.[None]:waiting for mds cluster to stabilize... 2021-04-09T18:30:01.904 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:02.127 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.112 7f2b7e973700 1 Processor -- start 2021-04-09T18:30:02.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.112 7f2b7e973700 1 -- start start 2021-04-09T18:30:02.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7e973700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2b780dc6b0 0x7f2b780d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:02.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7e973700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b780d6760 0x7f2b780d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:02.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7e973700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b780d61e0 con 0x7f2b780eac40 2021-04-09T18:30:02.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7e973700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b78100d60 con 0x7f2b780dc6b0 2021-04-09T18:30:02.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7e973700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b780eaa10 con 0x7f2b780d6760 2021-04-09T18:30:02.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b6ffff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2b780dc6b0 0x7f2b780d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:02.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7cf90700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b780d6760 0x7f2b780d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:02.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b6ffff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2b780dc6b0 0x7f2b780d1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:47544/0 (socket says 172.21.15.120:47544) 2021-04-09T18:30:02.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7cf90700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b780d6760 0x7f2b780d6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:45374/0 (socket says 172.21.15.120:45374) 2021-04-09T18:30:02.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b6ffff700 1 -- 172.21.15.120:0/4266437037 learned_addr learned my addr 172.21.15.120:0/4266437037 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:02.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7cf90700 1 -- 172.21.15.120:0/4266437037 >> v2:172.21.15.134:3300/0 conn(0x7f2b780dc6b0 msgr2=0x7f2b780d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:02.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7cf90700 1 --2- 172.21.15.120:0/4266437037 >> v2:172.21.15.134:3300/0 conn(0x7f2b780dc6b0 0x7f2b780d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7cf90700 1 -- 172.21.15.120:0/4266437037 >> v1:172.21.15.134:6789/0 conn(0x7f2b780eac40 legacy=0x7f2b78088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:02.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b777fe700 1 -- 172.21.15.120:0/4266437037 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786370091 0 0) 0x7f2b68000c60 con 0x7f2b780eac40 2021-04-09T18:30:02.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b7cf90700 1 -- 172.21.15.120:0/4266437037 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b780dcab0 con 0x7f2b780d6760 2021-04-09T18:30:02.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.113 7f2b6ffff700 1 --2- 172.21.15.120:0/4266437037 >> v2:172.21.15.134:3300/0 conn(0x7f2b780dc6b0 0x7f2b780d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:30:02.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.114 7f2b7cf90700 1 --2- 172.21.15.120:0/4266437037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b780d6760 0x7f2b780d6b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2b70006e50 tx=0x7f2b70009e70).ready entity=mon.2 client_cookie=744acbdae3f1bdd6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:02.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.114 7f2b777fe700 1 -- 172.21.15.120:0/4266437037 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2b70006a20 con 0x7f2b780d6760 2021-04-09T18:30:02.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.114 7f2b777fe700 1 -- 172.21.15.120:0/4266437037 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b70006790 con 0x7f2b780d6760 2021-04-09T18:30:02.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.114 7f2b777fe700 1 -- 172.21.15.120:0/4266437037 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2b70006a20 con 0x7f2b780d6760 2021-04-09T18:30:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.114 7f2b7e973700 1 -- 172.21.15.120:0/4266437037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b780d6760 msgr2=0x7f2b780d6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.114 7f2b7e973700 1 --2- 172.21.15.120:0/4266437037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b780d6760 0x7f2b780d6b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2b70006e50 tx=0x7f2b70009e70).stop 2021-04-09T18:30:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.115 7f2b7e973700 1 -- 172.21.15.120:0/4266437037 shutdown_connections 2021-04-09T18:30:02.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.115 7f2b7e973700 1 --2- 172.21.15.120:0/4266437037 >> v2:172.21.15.134:3300/0 conn(0x7f2b780dc6b0 0x7f2b780d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.115 7f2b7e973700 1 --2- 172.21.15.120:0/4266437037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b780d6760 0x7f2b780d6b60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.115 7f2b7e973700 1 -- 172.21.15.120:0/4266437037 >> 172.21.15.120:0/4266437037 conn(0x7f2b780e93c0 msgr2=0x7f2b78100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:02.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.115 7f2b7e973700 1 -- 172.21.15.120:0/4266437037 shutdown_connections 2021-04-09T18:30:02.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.115 7f2b7e973700 1 -- 172.21.15.120:0/4266437037 wait complete. 2021-04-09T18:30:02.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b7e973700 1 Processor -- start 2021-04-09T18:30:02.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b7e973700 1 -- start start 2021-04-09T18:30:02.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b7e973700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b780c39c0 0x7f2b78095450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:02.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b7e973700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b78095a70 0x7f2b780941d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:02.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b7e973700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b780947f0 0x7f2b78191c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:02.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b7e973700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b780c3200 con 0x7f2b780c39c0 2021-04-09T18:30:02.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b7e973700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b780c3550 con 0x7f2b780947f0 2021-04-09T18:30:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b7e973700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b78192230 con 0x7f2b78095a70 2021-04-09T18:30:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b77fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b780c39c0 0x7f2b78095450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b77fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b780c39c0 0x7f2b78095450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58712/0 (socket says 172.21.15.120:58712) 2021-04-09T18:30:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.135 7f2b77fff700 1 -- 172.21.15.120:0/4176397452 learned_addr learned my addr 172.21.15.120:0/4176397452 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b6ffff700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b78095a70 0x7f2b780941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b7cf90700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b780947f0 0x7f2b78191c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b77fff700 1 -- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b78095a70 msgr2=0x7f2b780941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b77fff700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b78095a70 0x7f2b780941d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b77fff700 1 -- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b780947f0 msgr2=0x7f2b78191c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b77fff700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b780947f0 0x7f2b78191c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b77fff700 1 -- 172.21.15.120:0/4176397452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78192450 con 0x7f2b780c39c0 2021-04-09T18:30:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b77fff700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b780c39c0 0x7f2b78095450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f2b6800b580 tx=0x7f2b6800b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b757fa700 1 -- 172.21.15.120:0/4176397452 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2b6800bd10 con 0x7f2b780c39c0 2021-04-09T18:30:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b757fa700 1 -- 172.21.15.120:0/4176397452 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b68001080 con 0x7f2b780c39c0 2021-04-09T18:30:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b757fa700 1 -- 172.21.15.120:0/4176397452 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2b68001550 con 0x7f2b780c39c0 2021-04-09T18:30:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b78192450 con 0x7f2b780c39c0 2021-04-09T18:30:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.136 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b78192450 con 0x7f2b780c39c0 2021-04-09T18:30:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.137 7f2b757fa700 1 -- 172.21.15.120:0/4176397452 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f2b68001260 con 0x7f2b780c39c0 2021-04-09T18:30:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.137 7f2b757fa700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2b5c0188c0 0x7f2b5c01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.137 7f2b757fa700 1 -- 172.21.15.120:0/4176397452 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f2b68032e00 con 0x7f2b780c39c0 2021-04-09T18:30:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.137 7f2b6ffff700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2b5c0188c0 0x7f2b5c01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.138 7f2b6ffff700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2b5c0188c0 0x7f2b5c01adc0 crc :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:02.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.156 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b78094c80 con 0x7f2b780c39c0 2021-04-09T18:30:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.160 7f2b757fa700 1 -- 172.21.15.120:0/4176397452 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f2b68006bf0 con 0x7f2b780c39c0 2021-04-09T18:30:02.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.347 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b78094c80 con 0x7f2b780c39c0 2021-04-09T18:30:02.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.348 7f2b757fa700 1 -- 172.21.15.120:0/4176397452 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f2b68001080 con 0x7f2b780c39c0 2021-04-09T18:30:02.337 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2021-04-09T18:30:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:30:02.337 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:00.815358","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:30:02.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2b5c0188c0 msgr2=0x7f2b5c01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:02.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2b5c0188c0 0x7f2b5c01adc0 crc :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b780c39c0 msgr2=0x7f2b78095450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:02.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b780c39c0 0x7f2b78095450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f2b6800b580 tx=0x7f2b6800b920).stop 2021-04-09T18:30:02.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 shutdown_connections 2021-04-09T18:30:02.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b780947f0 0x7f2b78191c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2b5c0188c0 0x7f2b5c01adc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b78095a70 0x7f2b780941d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 --2- 172.21.15.120:0/4176397452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b780c39c0 0x7f2b78095450 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:02.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.350 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 >> 172.21.15.120:0/4176397452 conn(0x7f2b780ab640 msgr2=0x7f2b7809fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:02.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.351 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 shutdown_connections 2021-04-09T18:30:02.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:02.351 7f2b7e973700 1 -- 172.21.15.120:0/4176397452 wait complete. 2021-04-09T18:30:02.349 INFO:tasks.mds_thrash.fs.[None]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 43, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-04-09 18:19:55.049244", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 43, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5223": { "addr": "172.21.15.120:6833/3326321867", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 3326321867, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 3326321867, "type": "v1" } ] }, "export_targets": [], "features": 4611087854035861503, "flags": 0, "gid": 5223, "incarnation": 43, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "-1 (unspecified)", "modified": "2021-04-09 18:30:00.815358", "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5223 } } } ], "standbys": [] } 2021-04-09T18:30:04.350 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:04.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.551 7f57ecbf6700 1 Processor -- start 2021-04-09T18:30:04.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.551 7f57ecbf6700 1 -- start start 2021-04-09T18:30:04.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57ecbf6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e80d7160 0x7f57e80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:04.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57ecbf6700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f57e80d7560 0x7f57e80d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:04.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57ecbf6700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e80d6be0 con 0x7f57e80d5bc0 2021-04-09T18:30:04.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57ecbf6700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e80d80f0 con 0x7f57e80d7560 2021-04-09T18:30:04.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57ecbf6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80e7f00 con 0x7f57e80d7160 2021-04-09T18:30:04.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e705f700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f57e80d5bc0 0x7f57e80d5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53634/0 (socket says 172.21.15.120:53634) 2021-04-09T18:30:04.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e705f700 1 -- 172.21.15.120:0/3406160355 learned_addr learned my addr 172.21.15.120:0/3406160355 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:30:04.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e605d700 1 --2- 172.21.15.120:0/3406160355 >> v2:172.21.15.134:3300/0 conn(0x7f57e80d7560 0x7f57e80d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:04.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e685e700 1 --2- 172.21.15.120:0/3406160355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e80d7160 0x7f57e80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:04.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e585c700 1 -- 172.21.15.120:0/3406160355 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193572404 0 0) 0x7f57d80009b0 con 0x7f57e80d5bc0 2021-04-09T18:30:04.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e585c700 1 -- 172.21.15.120:0/3406160355 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57d4002fe0 con 0x7f57e80d5bc0 2021-04-09T18:30:04.564 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e685e700 1 -- 172.21.15.120:0/3406160355 >> v2:172.21.15.134:3300/0 conn(0x7f57e80d7560 msgr2=0x7f57e80d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:04.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e685e700 1 --2- 172.21.15.120:0/3406160355 >> v2:172.21.15.134:3300/0 conn(0x7f57e80d7560 0x7f57e80d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e585c700 1 -- 172.21.15.120:0/3406160355 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3518338453 0 0) 0x7f57d80010e0 con 0x7f57e80d5bc0 2021-04-09T18:30:04.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e685e700 1 -- 172.21.15.120:0/3406160355 >> v1:172.21.15.120:6789/0 conn(0x7f57e80d5bc0 legacy=0x7f57e80d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:04.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e685e700 1 -- 172.21.15.120:0/3406160355 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e81a2ac0 con 0x7f57e80d7160 2021-04-09T18:30:04.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.552 7f57e605d700 1 --2- 172.21.15.120:0/3406160355 >> v2:172.21.15.134:3300/0 conn(0x7f57e80d7560 0x7f57e80d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:30:04.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.553 7f57e685e700 1 --2- 172.21.15.120:0/3406160355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e80d7160 0x7f57e80e78e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f57e00069d0 tx=0x7f57e0009e40).ready entity=mon.2 client_cookie=6126e1957aae1ff7 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:04.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.553 7f57e585c700 1 -- 172.21.15.120:0/3406160355 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f57e000b510 con 0x7f57e80d7160 2021-04-09T18:30:04.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.553 7f57e585c700 1 -- 172.21.15.120:0/3406160355 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e000b890 con 0x7f57e80d7160 2021-04-09T18:30:04.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.553 7f57e585c700 1 -- 172.21.15.120:0/3406160355 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f57e000bd70 con 0x7f57e80d7160 2021-04-09T18:30:04.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.553 7f57ecbf6700 1 -- 172.21.15.120:0/3406160355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e80d7160 msgr2=0x7f57e80e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:04.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.553 7f57ecbf6700 1 --2- 172.21.15.120:0/3406160355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e80d7160 0x7f57e80e78e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f57e00069d0 tx=0x7f57e0009e40).stop 2021-04-09T18:30:04.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.554 7f57ecbf6700 1 -- 172.21.15.120:0/3406160355 shutdown_connections 2021-04-09T18:30:04.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.554 7f57ecbf6700 1 --2- 172.21.15.120:0/3406160355 >> v2:172.21.15.134:3300/0 conn(0x7f57e80d7560 0x7f57e80d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.554 7f57ecbf6700 1 --2- 172.21.15.120:0/3406160355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e80d7160 0x7f57e80e78e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.554 7f57ecbf6700 1 -- 172.21.15.120:0/3406160355 >> 172.21.15.120:0/3406160355 conn(0x7f57e80d1590 msgr2=0x7f57e80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:04.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.554 7f57ecbf6700 1 -- 172.21.15.120:0/3406160355 shutdown_connections 2021-04-09T18:30:04.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.554 7f57ecbf6700 1 -- 172.21.15.120:0/3406160355 wait complete. 2021-04-09T18:30:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.573 7f57ecbf6700 1 Processor -- start 2021-04-09T18:30:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.573 7f57ecbf6700 1 -- start start 2021-04-09T18:30:04.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57ecbf6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57e8187380 0x7f57e8189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:04.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57ecbf6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57e8187780 0x7f57e80987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:04.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57ecbf6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e8189c50 0x7f57e80b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:04.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57ecbf6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e818ce60 con 0x7f57e8187780 2021-04-09T18:30:04.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57ecbf6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8098e10 con 0x7f57e8187380 2021-04-09T18:30:04.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57ecbf6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8099030 con 0x7f57e8189c50 2021-04-09T18:30:04.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e605d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57e8187780 0x7f57e80987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e605d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57e8187780 0x7f57e80987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58726/0 (socket says 172.21.15.120:58726) 2021-04-09T18:30:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e605d700 1 -- 172.21.15.120:0/2573730177 learned_addr learned my addr 172.21.15.120:0/2573730177 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e705f700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e8189c50 0x7f57e80b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e685e700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57e8187380 0x7f57e8189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e605d700 1 -- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e8189c50 msgr2=0x7f57e80b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e605d700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e8189c50 0x7f57e80b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e605d700 1 -- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57e8187380 msgr2=0x7f57e8189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e605d700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57e8187380 0x7f57e8189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e605d700 1 -- 172.21.15.120:0/2573730177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80b8b30 con 0x7f57e8187780 2021-04-09T18:30:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e705f700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e8189c50 0x7f57e80b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:30:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57e605d700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57e8187780 0x7f57e80987f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f57d0006f40 tx=0x7f57d000dbc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57df7fe700 1 -- 172.21.15.120:0/2573730177 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f57d000b030 con 0x7f57e8187780 2021-04-09T18:30:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57df7fe700 1 -- 172.21.15.120:0/2573730177 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d0000c90 con 0x7f57e8187780 2021-04-09T18:30:04.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e80b8b30 con 0x7f57e8187780 2021-04-09T18:30:04.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57df7fe700 1 -- 172.21.15.120:0/2573730177 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f57d0002210 con 0x7f57e8187780 2021-04-09T18:30:04.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.574 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e80b8b30 con 0x7f57e8187780 2021-04-09T18:30:04.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.575 7f57df7fe700 1 -- 172.21.15.120:0/2573730177 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f57d0009250 con 0x7f57e8187780 2021-04-09T18:30:04.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.575 7f57df7fe700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f57cc018930 0x7f57cc01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:04.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.575 7f57df7fe700 1 -- 172.21.15.120:0/2573730177 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f57d0034fe0 con 0x7f57e8187780 2021-04-09T18:30:04.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.576 7f57e685e700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f57cc018930 0x7f57cc01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:04.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.576 7f57e685e700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f57cc018930 0x7f57cc01adc0 crc :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:04.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.597 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e8189100 con 0x7f57e8187780 2021-04-09T18:30:04.588 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.600 7f57df7fe700 1 -- 172.21.15.120:0/2573730177 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f57d0000c90 con 0x7f57e8187780 2021-04-09T18:30:04.771 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.783 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57e8189100 con 0x7f57e8187780 2021-04-09T18:30:04.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.784 7f57df7fe700 1 -- 172.21.15.120:0/2573730177 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f57d0006b00 con 0x7f57e8187780 2021-04-09T18:30:04.773 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2021-04-09T18:30:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:30:04.774 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:00.815358","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:30:04.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.786 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f57cc018930 msgr2=0x7f57cc01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:04.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.786 7f57ecbf6700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f57cc018930 0x7f57cc01adc0 crc :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.786 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57e8187780 msgr2=0x7f57e80987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:04.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.786 7f57ecbf6700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57e8187780 0x7f57e80987f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f57d0006f40 tx=0x7f57d000dbc0).stop 2021-04-09T18:30:04.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.787 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 shutdown_connections 2021-04-09T18:30:04.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.787 7f57ecbf6700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f57cc018930 0x7f57cc01adc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.787 7f57ecbf6700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f57e8189c50 0x7f57e80b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.787 7f57ecbf6700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57e8187780 0x7f57e80987f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.787 7f57ecbf6700 1 --2- 172.21.15.120:0/2573730177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57e8187380 0x7f57e8189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:04.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.787 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 >> 172.21.15.120:0/2573730177 conn(0x7f57e818dc90 msgr2=0x7f57e808fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:04.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.787 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 shutdown_connections 2021-04-09T18:30:04.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:04.787 7f57ecbf6700 1 -- 172.21.15.120:0/2573730177 wait complete. 2021-04-09T18:30:04.784 INFO:tasks.mds_thrash.fs.[None]:no change 2021-04-09T18:30:06.298 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:06.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:06.785 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:07.059 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.050 7fc27e865700 1 Processor -- start 2021-04-09T18:30:07.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.050 7fc27e865700 1 -- start start 2021-04-09T18:30:07.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc27e865700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780eac40 0x7fc2780dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:07.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc27e865700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2780d1b40 0x7fc278088000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:07.060 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc27e865700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2780d61e0 con 0x7fc278088620 2021-04-09T18:30:07.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc27e865700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2780eaa10 con 0x7fc2780d1b40 2021-04-09T18:30:07.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc27e865700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780f38e0 con 0x7fc2780eac40 2021-04-09T18:30:07.061 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc26ffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2780d1b40 0x7fc278088000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:07.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc26ffff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2780d1b40 0x7fc278088000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58750/0 (socket says 172.21.15.120:58750) 2021-04-09T18:30:07.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc26ffff700 1 -- 172.21.15.120:0/2426681568 learned_addr learned my addr 172.21.15.120:0/2426681568 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:07.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc277fff700 1 --2- 172.21.15.120:0/2426681568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780eac40 0x7fc2780dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:07.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc26ffff700 1 -- 172.21.15.120:0/2426681568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780eac40 msgr2=0x7fc2780dc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:07.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc26ffff700 1 --2- 172.21.15.120:0/2426681568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780eac40 0x7fc2780dc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc26ffff700 1 -- 172.21.15.120:0/2426681568 >> v1:172.21.15.134:6789/0 conn(0x7fc278088620 legacy=0x7fc2780d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:07.063 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc26ffff700 1 -- 172.21.15.120:0/2426681568 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780d6f50 con 0x7fc2780d1b40 2021-04-09T18:30:07.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc26ffff700 1 --2- 172.21.15.120:0/2426681568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780d1b40 0x7fc278088000 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fc260006700 tx=0x7fc260009b80).ready entity=mon.0 client_cookie=4749d8e765587924 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:07.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.051 7fc2777fe700 1 -- 172.21.15.120:0/2426681568 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc26000c0c0 con 0x7fc2780d1b40 2021-04-09T18:30:07.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc2777fe700 1 -- 172.21.15.120:0/2426681568 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000c440 con 0x7fc2780d1b40 2021-04-09T18:30:07.064 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc2777fe700 1 -- 172.21.15.120:0/2426681568 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc26000c920 con 0x7fc2780d1b40 2021-04-09T18:30:07.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc27e865700 1 -- 172.21.15.120:0/2426681568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780d1b40 msgr2=0x7fc278088000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:07.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc27e865700 1 --2- 172.21.15.120:0/2426681568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780d1b40 0x7fc278088000 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fc260006700 tx=0x7fc260009b80).stop 2021-04-09T18:30:07.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc27e865700 1 -- 172.21.15.120:0/2426681568 shutdown_connections 2021-04-09T18:30:07.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc27e865700 1 --2- 172.21.15.120:0/2426681568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780d1b40 0x7fc278088000 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc27e865700 1 --2- 172.21.15.120:0/2426681568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780eac40 0x7fc2780dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc27e865700 1 -- 172.21.15.120:0/2426681568 >> 172.21.15.120:0/2426681568 conn(0x7fc2780e93c0 msgr2=0x7fc278100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:07.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc27e865700 1 -- 172.21.15.120:0/2426681568 shutdown_connections 2021-04-09T18:30:07.066 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.052 7fc27e865700 1 -- 172.21.15.120:0/2426681568 wait complete. 2021-04-09T18:30:07.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.071 7fc27e865700 1 Processor -- start 2021-04-09T18:30:07.067 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.071 7fc27e865700 1 -- start start 2021-04-09T18:30:07.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc27e865700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780c39c0 0x7fc278095450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:07.070 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc27e865700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278095a70 0x7fc2780941d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:07.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc27e865700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780947f0 0x7fc278191c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:07.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc27e865700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780c3200 con 0x7fc2780c39c0 2021-04-09T18:30:07.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc27e865700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780c3550 con 0x7fc278095a70 2021-04-09T18:30:07.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc27e865700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc278192230 con 0x7fc2780947f0 2021-04-09T18:30:07.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc277fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780c39c0 0x7fc278095450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:07.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc277fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780c39c0 0x7fc278095450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58756/0 (socket says 172.21.15.120:58756) 2021-04-09T18:30:07.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc277fff700 1 -- 172.21.15.120:0/1544703471 learned_addr learned my addr 172.21.15.120:0/1544703471 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:07.072 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc26ffff700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278095a70 0x7fc2780941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:07.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc27ce82700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780947f0 0x7fc278191c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:07.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc277fff700 1 -- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780947f0 msgr2=0x7fc278191c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:07.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc277fff700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780947f0 0x7fc278191c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc277fff700 1 -- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278095a70 msgr2=0x7fc2780941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:07.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc277fff700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278095a70 0x7fc2780941d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc277fff700 1 -- 172.21.15.120:0/1544703471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278192450 con 0x7fc2780c39c0 2021-04-09T18:30:07.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc277fff700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780c39c0 0x7fc278095450 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fc268006be0 tx=0x7fc26800b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:07.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.072 7fc2757fa700 1 -- 172.21.15.120:0/1544703471 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2680064d0 con 0x7fc2780c39c0 2021-04-09T18:30:07.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.073 7fc2757fa700 1 -- 172.21.15.120:0/1544703471 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26800be10 con 0x7fc2780c39c0 2021-04-09T18:30:07.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.073 7fc27e865700 1 -- 172.21.15.120:0/1544703471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc278192450 con 0x7fc2780c39c0 2021-04-09T18:30:07.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.073 7fc2757fa700 1 -- 172.21.15.120:0/1544703471 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc268002030 con 0x7fc2780c39c0 2021-04-09T18:30:07.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.073 7fc27e865700 1 -- 172.21.15.120:0/1544703471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc278192450 con 0x7fc2780c39c0 2021-04-09T18:30:07.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.073 7fc2757fa700 1 -- 172.21.15.120:0/1544703471 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc268006c90 con 0x7fc2780c39c0 2021-04-09T18:30:07.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.073 7fc2757fa700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc25c018930 0x7fc25c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:07.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.073 7fc2757fa700 1 -- 172.21.15.120:0/1544703471 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7fc268032e00 con 0x7fc2780c39c0 2021-04-09T18:30:07.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.073 7fc26ffff700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc25c018930 0x7fc25c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:07.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.074 7fc26ffff700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc25c018930 0x7fc25c01ae10 crc :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:07.084 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.096 7fc27e865700 1 -- 172.21.15.120:0/1544703471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc278094c80 con 0x7fc2780c39c0 2021-04-09T18:30:07.087 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.099 7fc2757fa700 1 -- 172.21.15.120:0/1544703471 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc2680064d0 con 0x7fc2780c39c0 2021-04-09T18:30:07.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.277 7fc27e865700 1 -- 172.21.15.120:0/1544703471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc278094c80 con 0x7fc2780c39c0 2021-04-09T18:30:07.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.278 7fc2757fa700 1 -- 172.21.15.120:0/1544703471 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+1777 (secure 0 0 0) 0x7fc26800bd80 con 0x7fc2780c39c0 2021-04-09T18:30:07.267 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 46 2021-04-09T18:30:07.267 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:30:07.267 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:06.837230","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:clientreplay","state_seq":20,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:30:07.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 -- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc25c018930 msgr2=0x7fc25c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:07.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc25c018930 0x7fc25c01ae10 crc :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 -- 172.21.15.120:0/1544703471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780c39c0 msgr2=0x7fc278095450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:07.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780c39c0 0x7fc278095450 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fc268006be0 tx=0x7fc26800b990).stop 2021-04-09T18:30:07.269 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 -- 172.21.15.120:0/1544703471 shutdown_connections 2021-04-09T18:30:07.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc25c018930 0x7fc25c01ae10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2780947f0 0x7fc278191c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc278095a70 0x7fc2780941d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 --2- 172.21.15.120:0/1544703471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2780c39c0 0x7fc278095450 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:07.270 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 -- 172.21.15.120:0/1544703471 >> 172.21.15.120:0/1544703471 conn(0x7fc2780ab640 msgr2=0x7fc27809fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:07.271 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 -- 172.21.15.120:0/1544703471 shutdown_connections 2021-04-09T18:30:07.271 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:07.280 7fc27e865700 1 -- 172.21.15.120:0/1544703471 wait complete. 2021-04-09T18:30:07.279 INFO:tasks.mds_thrash.fs.[None]:no change 2021-04-09T18:30:09.279 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:09.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.493 7ff5081c5700 1 Processor -- start 2021-04-09T18:30:09.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.493 7ff5081c5700 1 -- start start 2021-04-09T18:30:09.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff5081c5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000eac40 0x7ff5000dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff5081c5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff5000d6760 0x7ff5000d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff5081c5700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000d61e0 con 0x7ff5000d1b40 2021-04-09T18:30:09.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff5081c5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000eaa10 con 0x7ff5000d6760 2021-04-09T18:30:09.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff5081c5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000f38e0 con 0x7ff5000eac40 2021-04-09T18:30:09.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff5057e0700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff5000d1b40 0x7ff500088000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53684/0 (socket says 172.21.15.120:53684) 2021-04-09T18:30:09.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff5057e0700 1 -- 172.21.15.120:0/1776323735 learned_addr learned my addr 172.21.15.120:0/1776323735 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:30:09.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff505fe1700 1 --2- 172.21.15.120:0/1776323735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000eac40 0x7ff5000dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff5067e2700 1 --2- 172.21.15.120:0/1776323735 >> v2:172.21.15.134:3300/0 conn(0x7ff5000d6760 0x7ff5000d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff504fdf700 1 -- 172.21.15.120:0/1776323735 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045851257 0 0) 0x7ff4f0000ce0 con 0x7ff5000d1b40 2021-04-09T18:30:09.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff504fdf700 1 -- 172.21.15.120:0/1776323735 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4ec002fe0 con 0x7ff5000d1b40 2021-04-09T18:30:09.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff505fe1700 1 -- 172.21.15.120:0/1776323735 >> v2:172.21.15.134:3300/0 conn(0x7ff5000d6760 msgr2=0x7ff5000d6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:09.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff505fe1700 1 --2- 172.21.15.120:0/1776323735 >> v2:172.21.15.134:3300/0 conn(0x7ff5000d6760 0x7ff5000d6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff505fe1700 1 -- 172.21.15.120:0/1776323735 >> v1:172.21.15.120:6789/0 conn(0x7ff5000d1b40 legacy=0x7ff500088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff505fe1700 1 -- 172.21.15.120:0/1776323735 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000887f0 con 0x7ff5000eac40 2021-04-09T18:30:09.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.494 7ff505fe1700 1 --2- 172.21.15.120:0/1776323735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000eac40 0x7ff5000dc6b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff4fc006650 tx=0x7ff4fc009a80).ready entity=mon.2 client_cookie=1dbeaf10acb4ae14 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:09.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.495 7ff504fdf700 1 -- 172.21.15.120:0/1776323735 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4fc0009b0 con 0x7ff5000eac40 2021-04-09T18:30:09.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.495 7ff504fdf700 1 -- 172.21.15.120:0/1776323735 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00c0c0 con 0x7ff5000eac40 2021-04-09T18:30:09.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.495 7ff504fdf700 1 -- 172.21.15.120:0/1776323735 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4fc0009b0 con 0x7ff5000eac40 2021-04-09T18:30:09.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.495 7ff5081c5700 1 -- 172.21.15.120:0/1776323735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000eac40 msgr2=0x7ff5000dc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.495 7ff5081c5700 1 --2- 172.21.15.120:0/1776323735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000eac40 0x7ff5000dc6b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff4fc006650 tx=0x7ff4fc009a80).stop 2021-04-09T18:30:09.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.496 7ff5081c5700 1 -- 172.21.15.120:0/1776323735 shutdown_connections 2021-04-09T18:30:09.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.496 7ff5081c5700 1 --2- 172.21.15.120:0/1776323735 >> v2:172.21.15.134:3300/0 conn(0x7ff5000d6760 0x7ff5000d6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.496 7ff5081c5700 1 --2- 172.21.15.120:0/1776323735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000eac40 0x7ff5000dc6b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.496 7ff5081c5700 1 -- 172.21.15.120:0/1776323735 >> 172.21.15.120:0/1776323735 conn(0x7ff5000e93c0 msgr2=0x7ff500100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:09.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.497 7ff5081c5700 1 -- 172.21.15.120:0/1776323735 shutdown_connections 2021-04-09T18:30:09.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.497 7ff5081c5700 1 -- 172.21.15.120:0/1776323735 wait complete. 2021-04-09T18:30:09.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5081c5700 1 Processor -- start 2021-04-09T18:30:09.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5081c5700 1 -- start start 2021-04-09T18:30:09.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5081c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5000bfbf0 0x7ff5000b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5081c5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000bfff0 0x7ff5000b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5081c5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000b1080 0x7ff5000b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5081c5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000bf670 con 0x7ff5000bfff0 2021-04-09T18:30:09.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5081c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50018f340 con 0x7ff5000bfbf0 2021-04-09T18:30:09.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5081c5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50018f520 con 0x7ff5000b1080 2021-04-09T18:30:09.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5057e0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000bfff0 0x7ff5000b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5057e0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000bfff0 0x7ff5000b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58780/0 (socket says 172.21.15.120:58780) 2021-04-09T18:30:09.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5057e0700 1 -- 172.21.15.120:0/1232071270 learned_addr learned my addr 172.21.15.120:0/1232071270 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:09.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff5067e2700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000b1080 0x7ff5000b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.517 7ff505fe1700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5000bfbf0 0x7ff5000b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff5057e0700 1 -- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000b1080 msgr2=0x7ff5000b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff5057e0700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000b1080 0x7ff5000b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff5057e0700 1 -- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5000bfbf0 msgr2=0x7ff5000b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff5057e0700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5000bfbf0 0x7ff5000b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff5057e0700 1 -- 172.21.15.120:0/1232071270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000b1aa0 con 0x7ff5000bfff0 2021-04-09T18:30:09.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff5057e0700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000bfff0 0x7ff5000b0a60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7ff4f0006f00 tx=0x7ff4f000b940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:09.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff4f67fc700 1 -- 172.21.15.120:0/1232071270 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4f000bd30 con 0x7ff5000bfff0 2021-04-09T18:30:09.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff4f67fc700 1 -- 172.21.15.120:0/1232071270 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f0006030 con 0x7ff5000bfff0 2021-04-09T18:30:09.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5000b1aa0 con 0x7ff5000bfff0 2021-04-09T18:30:09.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff4f67fc700 1 -- 172.21.15.120:0/1232071270 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4f0004590 con 0x7ff5000bfff0 2021-04-09T18:30:09.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.518 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5000b1aa0 con 0x7ff5000bfff0 2021-04-09T18:30:09.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.519 7ff4f67fc700 1 -- 172.21.15.120:0/1232071270 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7ff4f00043a0 con 0x7ff5000bfff0 2021-04-09T18:30:09.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.519 7ff4f67fc700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff4e8018930 0x7ff4e801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.519 7ff4f67fc700 1 -- 172.21.15.120:0/1232071270 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7ff4f0032d80 con 0x7ff5000bfff0 2021-04-09T18:30:09.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.519 7ff505fe1700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff4e8018930 0x7ff4e801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.520 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.520 7ff505fe1700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff4e8018930 0x7ff4e801ae10 crc :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:09.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.538 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5000b1d40 con 0x7ff5000bfff0 2021-04-09T18:30:09.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.541 7ff4f67fc700 1 -- 172.21.15.120:0/1232071270 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7ff4f00009b0 con 0x7ff5000bfff0 2021-04-09T18:30:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.719 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5000b1d40 con 0x7ff5000bfff0 2021-04-09T18:30:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.719 7ff4f67fc700 1 -- 172.21.15.120:0/1232071270 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1771 (secure 0 0 0) 0x7ff4f000bd30 con 0x7ff5000bfff0 2021-04-09T18:30:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2021-04-09T18:30:09.708 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:30:09.709 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:30:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff4e8018930 msgr2=0x7ff4e801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff4e8018930 0x7ff4e801ae10 crc :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000bfff0 msgr2=0x7ff5000b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000bfff0 0x7ff5000b0a60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7ff4f0006f00 tx=0x7ff4f000b940).stop 2021-04-09T18:30:09.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 shutdown_connections 2021-04-09T18:30:09.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7ff4e8018930 0x7ff4e801ae10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5000b1080 0x7ff5000b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000bfff0 0x7ff5000b0a60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 --2- 172.21.15.120:0/1232071270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5000bfbf0 0x7ff5000b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 >> 172.21.15.120:0/1232071270 conn(0x7ff5000c11f0 msgr2=0x7ff5000bb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 shutdown_connections 2021-04-09T18:30:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.722 7ff5081c5700 1 -- 172.21.15.120:0/1232071270 wait complete. 2021-04-09T18:30:09.720 INFO:tasks.mds_thrash.fs.[None]:mds.a has gained rank=0, replacing gid=4844 2021-04-09T18:30:09.720 INFO:tasks.mds_thrash.fs.[None]:waiting for 0 secs before reviving mds.b 2021-04-09T18:30:09.720 INFO:tasks.mds_thrash.fs.[None]:reviving mds.b 2021-04-09T18:30:09.720 INFO:tasks.ceph.mds.b:Restarting daemon 2021-04-09T18:30:09.721 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-04-09T18:30:09.724 INFO:tasks.ceph.mds.b:Started 2021-04-09T18:30:09.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:09.899 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2021-04-09T18:30:09.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe14a0b3700 1 Processor -- start 2021-04-09T18:30:09.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe14a0b3700 1 -- start start 2021-04-09T18:30:09.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe14a0b3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1440d7160 0x7fe1440e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe14a0b3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1440d7560 0x7fe1440d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe14a0b3700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440d6be0 con 0x7fe1440d5bc0 2021-04-09T18:30:09.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe14a0b3700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1440d80f0 con 0x7fe1440d7560 2021-04-09T18:30:09.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe14a0b3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440d0f10 con 0x7fe1440d7160 2021-04-09T18:30:09.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe13bfff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1440d7560 0x7fe1440d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe143fff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe1440d5bc0 0x7fe1440d5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53702/0 (socket says 172.21.15.120:53702) 2021-04-09T18:30:09.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe143fff700 1 -- 172.21.15.120:0/3083341126 learned_addr learned my addr 172.21.15.120:0/3083341126 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:30:09.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.914 7fe1437fe700 1 --2- 172.21.15.120:0/3083341126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1440d7160 0x7fe1440e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe13bfff700 1 -- 172.21.15.120:0/3083341126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1440d7160 msgr2=0x7fe1440e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:09.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe13bfff700 1 --2- 172.21.15.120:0/3083341126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1440d7160 0x7fe1440e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe13bfff700 1 -- 172.21.15.120:0/3083341126 >> v1:172.21.15.120:6789/0 conn(0x7fe1440d5bc0 legacy=0x7fe1440d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe13bfff700 1 -- 172.21.15.120:0/3083341126 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1440e7f00 con 0x7fe1440d7560 2021-04-09T18:30:09.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe142ffd700 1 -- 172.21.15.120:0/3083341126 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196493599 0 0) 0x7fe13c000d30 con 0x7fe1440d5bc0 2021-04-09T18:30:09.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe1437fe700 1 --2- 172.21.15.120:0/3083341126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1440d7160 0x7fe1440e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:30:09.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe13bfff700 1 --2- 172.21.15.120:0/3083341126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440d7560 0x7fe1440d55a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fe12c006650 tx=0x7fe12c009a80).ready entity=mon.0 client_cookie=780319cc471addf6 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:09.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe142ffd700 1 -- 172.21.15.120:0/3083341126 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe12c0009b0 con 0x7fe1440d7560 2021-04-09T18:30:09.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe142ffd700 1 -- 172.21.15.120:0/3083341126 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c00c0c0 con 0x7fe1440d7560 2021-04-09T18:30:09.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe142ffd700 1 -- 172.21.15.120:0/3083341126 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe12c00c510 con 0x7fe1440d7560 2021-04-09T18:30:09.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe14a0b3700 1 -- 172.21.15.120:0/3083341126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440d7560 msgr2=0x7fe1440d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.915 7fe14a0b3700 1 --2- 172.21.15.120:0/3083341126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440d7560 0x7fe1440d55a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fe12c006650 tx=0x7fe12c009a80).stop 2021-04-09T18:30:09.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.916 7fe14a0b3700 1 -- 172.21.15.120:0/3083341126 shutdown_connections 2021-04-09T18:30:09.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.916 7fe14a0b3700 1 --2- 172.21.15.120:0/3083341126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440d7560 0x7fe1440d55a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.916 7fe14a0b3700 1 --2- 172.21.15.120:0/3083341126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1440d7160 0x7fe1440e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.916 7fe14a0b3700 1 -- 172.21.15.120:0/3083341126 >> 172.21.15.120:0/3083341126 conn(0x7fe1440d1590 msgr2=0x7fe1440d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:09.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.916 7fe14a0b3700 1 -- 172.21.15.120:0/3083341126 shutdown_connections 2021-04-09T18:30:09.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.916 7fe14a0b3700 1 -- 172.21.15.120:0/3083341126 wait complete. 2021-04-09T18:30:09.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.934 7fe14a0b3700 1 Processor -- start 2021-04-09T18:30:09.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.934 7fe14a0b3700 1 -- start start 2021-04-09T18:30:09.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe14a0b3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe144187670 0x7fe1440a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe14a0b3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440a5050 0x7fe1440b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe14a0b3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1440b5710 0x7fe1441838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe14a0b3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440b5b10 con 0x7fe1440a5050 2021-04-09T18:30:09.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe14a0b3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440b5d30 con 0x7fe1440b5710 2021-04-09T18:30:09.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe14a0b3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440b5f50 con 0x7fe144187670 2021-04-09T18:30:09.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe13bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440a5050 0x7fe1440b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe13bfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440a5050 0x7fe1440b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58794/0 (socket says 172.21.15.120:58794) 2021-04-09T18:30:09.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe13bfff700 1 -- 172.21.15.120:0/1319299523 learned_addr learned my addr 172.21.15.120:0/1319299523 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:09.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe143fff700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1440b5710 0x7fe1441838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe1437fe700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe144187670 0x7fe1440a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe13bfff700 1 -- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe144187670 msgr2=0x7fe1440a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe13bfff700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe144187670 0x7fe1440a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe13bfff700 1 -- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1440b5710 msgr2=0x7fe1441838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:09.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe13bfff700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1440b5710 0x7fe1441838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:09.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe13bfff700 1 -- 172.21.15.120:0/1319299523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144183ef0 con 0x7fe1440a5050 2021-04-09T18:30:09.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe143fff700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1440b5710 0x7fe1441838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:30:09.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe1437fe700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe144187670 0x7fe1440a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:30:09.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.935 7fe13bfff700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440a5050 0x7fe1440b50f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fe12c009650 tx=0x7fe12c00b960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:09.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.936 7fe140ff9700 1 -- 172.21.15.120:0/1319299523 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe12c00bd50 con 0x7fe1440a5050 2021-04-09T18:30:09.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.936 7fe140ff9700 1 -- 172.21.15.120:0/1319299523 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c006030 con 0x7fe1440a5050 2021-04-09T18:30:09.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.936 7fe140ff9700 1 -- 172.21.15.120:0/1319299523 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe12c0054d0 con 0x7fe1440a5050 2021-04-09T18:30:09.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.936 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe144183ef0 con 0x7fe1440a5050 2021-04-09T18:30:09.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.936 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe144183ef0 con 0x7fe1440a5050 2021-04-09T18:30:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.936 7fe140ff9700 1 -- 172.21.15.120:0/1319299523 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fe12c0052e0 con 0x7fe1440a5050 2021-04-09T18:30:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.936 7fe140ff9700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe11c018930 0x7fe11c01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.936 7fe140ff9700 1 -- 172.21.15.120:0/1319299523 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7fe12c032d80 con 0x7fe1440a5050 2021-04-09T18:30:09.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.937 7fe1437fe700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe11c018930 0x7fe11c01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:09.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.937 7fe1437fe700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe11c018930 0x7fe11c01adc0 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:09.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.960 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1441829e0 con 0x7fe1440a5050 2021-04-09T18:30:09.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:09.963 7fe140ff9700 1 -- 172.21.15.120:0/1319299523 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fe12c000940 con 0x7fe1440a5050 2021-04-09T18:30:10.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.141 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1441829e0 con 0x7fe1440a5050 2021-04-09T18:30:10.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.141 7fe140ff9700 1 -- 172.21.15.120:0/1319299523 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1771 (secure 0 0 0) 0x7fe12c006030 con 0x7fe1440a5050 2021-04-09T18:30:10.130 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2021-04-09T18:30:10.130 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:30:10.131 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:30:10.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe11c018930 msgr2=0x7fe11c01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:10.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe11c018930 0x7fe11c01adc0 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:10.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440a5050 msgr2=0x7fe1440b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:10.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440a5050 0x7fe1440b50f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fe12c009650 tx=0x7fe12c00b960).stop 2021-04-09T18:30:10.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 shutdown_connections 2021-04-09T18:30:10.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1440b5710 0x7fe1441838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:10.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1440a5050 0x7fe1440b50f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:10.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fe11c018930 0x7fe11c01adc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:10.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 --2- 172.21.15.120:0/1319299523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe144187670 0x7fe1440a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:10.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 >> 172.21.15.120:0/1319299523 conn(0x7fe14418dc90 msgr2=0x7fe14408fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:10.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 shutdown_connections 2021-04-09T18:30:10.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:10.144 7fe14a0b3700 1 -- 172.21.15.120:0/1319299523 wait complete. 2021-04-09T18:30:10.142 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-04-09T18:30:12.143 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:12.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.340 7f8da2ca4700 1 Processor -- start 2021-04-09T18:30:12.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.340 7f8da2ca4700 1 -- start start 2021-04-09T18:30:12.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8da2ca4700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8d9c0d7560 0x7f8d9c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8da2ca4700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c0d7960 con 0x7f8d9c0d63b0 2021-04-09T18:30:12.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8da2ca4700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c0d6be0 con 0x7f8d9c0d7160 2021-04-09T18:30:12.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8da2ca4700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c0d80f0 con 0x7f8d9c0d7560 2021-04-09T18:30:12.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8d9bfff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8d9c0d7560 0x7f8d9c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8da12c1700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f8d9c0d63b0 0x7f8d9c1ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53736/0 (socket says 172.21.15.120:53736) 2021-04-09T18:30:12.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8da12c1700 1 -- 172.21.15.120:0/952850417 learned_addr learned my addr 172.21.15.120:0/952850417 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:30:12.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8d9b7fe700 1 -- 172.21.15.120:0/952850417 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508440041 0 0) 0x7f8d94000d30 con 0x7f8d9c0d63b0 2021-04-09T18:30:12.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8d9b7fe700 1 -- 172.21.15.120:0/952850417 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d88002fe0 con 0x7f8d9c0d63b0 2021-04-09T18:30:12.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8d9bfff700 1 -- 172.21.15.120:0/952850417 >> v1:172.21.15.134:6789/0 conn(0x7f8d9c0d7160 legacy=0x7f8d9c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8d9bfff700 1 -- 172.21.15.120:0/952850417 >> v1:172.21.15.120:6789/0 conn(0x7f8d9c0d63b0 legacy=0x7f8d9c1ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8d9bfff700 1 -- 172.21.15.120:0/952850417 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c1a2af0 con 0x7f8d9c0d7560 2021-04-09T18:30:12.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.341 7f8d9bfff700 1 --2- 172.21.15.120:0/952850417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c0d7560 0x7f8d9c0d5d90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f8d8c006650 tx=0x7f8d8c009a00).ready entity=mon.0 client_cookie=6062b0e05d0b6bdc server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:12.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.342 7f8d9b7fe700 1 -- 172.21.15.120:0/952850417 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d8c0009b0 con 0x7f8d9c0d7560 2021-04-09T18:30:12.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.342 7f8d9b7fe700 1 -- 172.21.15.120:0/952850417 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c00c0c0 con 0x7f8d9c0d7560 2021-04-09T18:30:12.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.342 7f8d9b7fe700 1 -- 172.21.15.120:0/952850417 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d8c0009b0 con 0x7f8d9c0d7560 2021-04-09T18:30:12.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.342 7f8da2ca4700 1 -- 172.21.15.120:0/952850417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c0d7560 msgr2=0x7f8d9c0d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.342 7f8da2ca4700 1 --2- 172.21.15.120:0/952850417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c0d7560 0x7f8d9c0d5d90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f8d8c006650 tx=0x7f8d8c009a00).stop 2021-04-09T18:30:12.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.343 7f8da2ca4700 1 -- 172.21.15.120:0/952850417 shutdown_connections 2021-04-09T18:30:12.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.343 7f8da2ca4700 1 --2- 172.21.15.120:0/952850417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c0d7560 0x7f8d9c0d5d90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.343 7f8da2ca4700 1 -- 172.21.15.120:0/952850417 >> 172.21.15.120:0/952850417 conn(0x7f8d9c0d1590 msgr2=0x7f8d9c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:12.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.343 7f8da2ca4700 1 -- 172.21.15.120:0/952850417 shutdown_connections 2021-04-09T18:30:12.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.343 7f8da2ca4700 1 -- 172.21.15.120:0/952850417 wait complete. 2021-04-09T18:30:12.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.362 7f8da2ca4700 1 Processor -- start 2021-04-09T18:30:12.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.362 7f8da2ca4700 1 -- start start 2021-04-09T18:30:12.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da2ca4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9c19f6d0 0x7f8d9c096f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da2ca4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d9c0902f0 0x7f8d9c095f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da2ca4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c096580 0x7f8d9c0b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da2ca4700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0975b0 con 0x7f8d9c096580 2021-04-09T18:30:12.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da2ca4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0906f0 con 0x7f8d9c19f6d0 2021-04-09T18:30:12.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da2ca4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c090910 con 0x7f8d9c0902f0 2021-04-09T18:30:12.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da12c1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c096580 0x7f8d9c0b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da12c1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c096580 0x7f8d9c0b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58830/0 (socket says 172.21.15.120:58830) 2021-04-09T18:30:12.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da12c1700 1 -- 172.21.15.120:0/1685567534 learned_addr learned my addr 172.21.15.120:0/1685567534 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:12.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8d9bfff700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d9c0902f0 0x7f8d9c095f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da0ac0700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9c19f6d0 0x7f8d9c096f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da12c1700 1 -- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d9c0902f0 msgr2=0x7f8d9c095f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.370 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da12c1700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d9c0902f0 0x7f8d9c095f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da12c1700 1 -- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9c19f6d0 msgr2=0x7f8d9c096f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da12c1700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9c19f6d0 0x7f8d9c096f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da12c1700 1 -- 172.21.15.120:0/1685567534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c0b41a0 con 0x7f8d9c096580 2021-04-09T18:30:12.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.363 7f8da12c1700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c096580 0x7f8d9c0b3b80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f8d9400a880 tx=0x7f8d9400ac20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:12.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.364 7f8d997fa700 1 -- 172.21.15.120:0/1685567534 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d94001270 con 0x7f8d9c096580 2021-04-09T18:30:12.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.364 7f8d997fa700 1 -- 172.21.15.120:0/1685567534 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d940070d0 con 0x7f8d9c096580 2021-04-09T18:30:12.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.364 7f8d997fa700 1 -- 172.21.15.120:0/1685567534 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d94004720 con 0x7f8d9c096580 2021-04-09T18:30:12.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.364 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c0b41a0 con 0x7f8d9c096580 2021-04-09T18:30:12.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.364 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c0b41a0 con 0x7f8d9c096580 2021-04-09T18:30:12.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.364 7f8d997fa700 1 -- 172.21.15.120:0/1685567534 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f8d940072b0 con 0x7f8d9c096580 2021-04-09T18:30:12.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.365 7f8d997fa700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8d80018930 0x7f8d8001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:12.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.365 7f8d997fa700 1 -- 172.21.15.120:0/1685567534 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f8d94033140 con 0x7f8d9c096580 2021-04-09T18:30:12.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.365 7f8da0ac0700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8d80018930 0x7f8d8001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:12.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.365 7f8da0ac0700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8d80018930 0x7f8d8001ae10 crc :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:12.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.385 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c17f6c0 con 0x7f8d9c096580 2021-04-09T18:30:12.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.389 7f8d997fa700 1 -- 172.21.15.120:0/1685567534 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f8d94007cb0 con 0x7f8d9c096580 2021-04-09T18:30:12.578 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.590 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d9c17f6c0 con 0x7f8d9c096580 2021-04-09T18:30:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.591 7f8d997fa700 1 -- 172.21.15.120:0/1685567534 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1771 (secure 0 0 0) 0x7f8d940070d0 con 0x7f8d9c096580 2021-04-09T18:30:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2021-04-09T18:30:12.580 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:30:12.580 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:30:12.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8d80018930 msgr2=0x7f8d8001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8d80018930 0x7f8d8001ae10 crc :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c096580 msgr2=0x7f8d9c0b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:12.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c096580 0x7f8d9c0b3b80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f8d9400a880 tx=0x7f8d9400ac20).stop 2021-04-09T18:30:12.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 shutdown_connections 2021-04-09T18:30:12.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d9c096580 0x7f8d9c0b3b80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f8d80018930 0x7f8d8001ae10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d9c0902f0 0x7f8d9c095f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 --2- 172.21.15.120:0/1685567534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d9c19f6d0 0x7f8d9c096f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:12.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 >> 172.21.15.120:0/1685567534 conn(0x7f8d9c18a9d0 msgr2=0x7f8d9c198100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:12.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 shutdown_connections 2021-04-09T18:30:12.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:12.593 7f8da2ca4700 1 -- 172.21.15.120:0/1685567534 wait complete. 2021-04-09T18:30:12.591 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-04-09T18:30:14.592 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:30:14.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.805 7f1cc4349700 1 Processor -- start 2021-04-09T18:30:14.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.805 7f1cc4349700 1 -- start start 2021-04-09T18:30:14.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.805 7f1cc4349700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1cbc0d7160 0x7f1cbc0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:14.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.805 7f1cc4349700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1cbc0d55a0 0x7f1cbc0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:14.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.805 7f1cc4349700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc0d6be0 con 0x7f1cbc0d5fc0 2021-04-09T18:30:14.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.805 7f1cc4349700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc0d80f0 con 0x7f1cbc0d7160 2021-04-09T18:30:14.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.805 7f1cc4349700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc1a2ac0 con 0x7f1cbc0d55a0 2021-04-09T18:30:14.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.805 7f1cc2165700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1cbc0d7160 0x7f1cbc0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:14.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.805 7f1cc2165700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1cbc0d7160 0x7f1cbc0d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58856/0 (socket says 172.21.15.120:58856) 2021-04-09T18:30:14.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc2165700 1 -- 172.21.15.120:0/123301784 learned_addr learned my addr 172.21.15.120:0/123301784 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:14.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc1964700 1 --2- 172.21.15.120:0/123301784 >> v2:172.21.15.134:3300/0 conn(0x7f1cbc0d55a0 0x7f1cbc0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:14.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc2165700 1 -- 172.21.15.120:0/123301784 >> v2:172.21.15.134:3300/0 conn(0x7f1cbc0d55a0 msgr2=0x7f1cbc0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:14.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc2165700 1 --2- 172.21.15.120:0/123301784 >> v2:172.21.15.134:3300/0 conn(0x7f1cbc0d55a0 0x7f1cbc0d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:14.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc2165700 1 -- 172.21.15.120:0/123301784 >> v1:172.21.15.134:6789/0 conn(0x7f1cbc0d5fc0 legacy=0x7f1cbc0d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:30:14.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc2165700 1 -- 172.21.15.120:0/123301784 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc1ac1f0 con 0x7f1cbc0d7160 2021-04-09T18:30:14.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc2165700 1 --2- 172.21.15.120:0/123301784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc0d7160 0x7f1cbc0d7560 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1cb4006a80 tx=0x7f1cb4009e80).ready entity=mon.0 client_cookie=552d57e65317ba19 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:14.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc1163700 1 -- 172.21.15.120:0/123301784 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1cb400b510 con 0x7f1cbc0d7160 2021-04-09T18:30:14.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc1163700 1 -- 172.21.15.120:0/123301784 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb400b7d0 con 0x7f1cbc0d7160 2021-04-09T18:30:14.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc1163700 1 -- 172.21.15.120:0/123301784 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1cb400bcb0 con 0x7f1cbc0d7160 2021-04-09T18:30:14.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc4349700 1 -- 172.21.15.120:0/123301784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc0d7160 msgr2=0x7f1cbc0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:14.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.806 7f1cc4349700 1 --2- 172.21.15.120:0/123301784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc0d7160 0x7f1cbc0d7560 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1cb4006a80 tx=0x7f1cb4009e80).stop 2021-04-09T18:30:14.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.807 7f1cc4349700 1 -- 172.21.15.120:0/123301784 shutdown_connections 2021-04-09T18:30:14.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.807 7f1cc4349700 1 --2- 172.21.15.120:0/123301784 >> v2:172.21.15.134:3300/0 conn(0x7f1cbc0d55a0 0x7f1cbc0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:14.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.807 7f1cc4349700 1 --2- 172.21.15.120:0/123301784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc0d7160 0x7f1cbc0d7560 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:14.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.807 7f1cc4349700 1 -- 172.21.15.120:0/123301784 >> 172.21.15.120:0/123301784 conn(0x7f1cbc0d1590 msgr2=0x7f1cbc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:14.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.807 7f1cc4349700 1 -- 172.21.15.120:0/123301784 shutdown_connections 2021-04-09T18:30:14.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.807 7f1cc4349700 1 -- 172.21.15.120:0/123301784 wait complete. 2021-04-09T18:30:14.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc4349700 1 Processor -- start 2021-04-09T18:30:14.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc4349700 1 -- start start 2021-04-09T18:30:14.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc4349700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cbc17b7d0 0x7f1cbc0a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:14.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc4349700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc19a6b0 0x7f1cbc19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:14.824 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc4349700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cbc199150 0x7f1cbc199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:14.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc4349700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc17be50 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc4349700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0a9e60 con 0x7f1cbc199150 2021-04-09T18:30:14.825 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc4349700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0aa080 con 0x7f1cbc17b7d0 2021-04-09T18:30:14.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc1964700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc19a6b0 0x7f1cbc19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:14.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc1964700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc19a6b0 0x7f1cbc19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58862/0 (socket says 172.21.15.120:58862) 2021-04-09T18:30:14.826 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.826 7f1cc1964700 1 -- 172.21.15.120:0/1011329659 learned_addr learned my addr 172.21.15.120:0/1011329659 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:30:14.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc2966700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cbc199150 0x7f1cbc199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:14.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc2165700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cbc17b7d0 0x7f1cbc0a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:14.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc1964700 1 -- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cbc17b7d0 msgr2=0x7f1cbc0a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:14.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc1964700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cbc17b7d0 0x7f1cbc0a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:14.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc1964700 1 -- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cbc199150 msgr2=0x7f1cbc199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:14.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc1964700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cbc199150 0x7f1cbc199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:14.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc1964700 1 -- 172.21.15.120:0/1011329659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc199b70 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc1964700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc19a6b0 0x7f1cbc19aab0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f1ca4006f00 tx=0x7f1ca400b940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:14.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cbaffd700 1 -- 172.21.15.120:0/1011329659 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ca400bd30 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cbaffd700 1 -- 172.21.15.120:0/1011329659 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4002030 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cbaffd700 1 -- 172.21.15.120:0/1011329659 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ca4002590 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc199b70 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.827 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc199b70 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.828 7f1cbaffd700 1 -- 172.21.15.120:0/1011329659 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1ca4000c90 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.828 7f1cbaffd700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ca00188d0 0x7f1ca001add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:30:14.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.828 7f1cbaffd700 1 -- 172.21.15.120:0/1011329659 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f1ca4032fb0 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.828 7f1cc2165700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ca00188d0 0x7f1ca001add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:30:14.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.828 7f1cc2165700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ca00188d0 0x7f1ca001add0 crc :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:30:14.839 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.851 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc19a180 con 0x7f1cbc19a6b0 2021-04-09T18:30:14.842 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:14.855 7f1cbaffd700 1 -- 172.21.15.120:0/1011329659 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1ca400bd30 con 0x7f1cbc19a6b0 2021-04-09T18:30:15.033 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.045 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cbc19a180 con 0x7f1cbc19a6b0 2021-04-09T18:30:15.034 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.046 7f1cbaffd700 1 -- 172.21.15.120:0/1011329659 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f1ca4000c90 con 0x7f1cbc19a6b0 2021-04-09T18:30:15.035 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2021-04-09T18:30:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:30:15.035 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:30:15.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ca00188d0 msgr2=0x7f1ca001add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:15.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ca00188d0 0x7f1ca001add0 crc :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:15.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc19a6b0 msgr2=0x7f1cbc19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:30:15.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc19a6b0 0x7f1cbc19aab0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f1ca4006f00 tx=0x7f1ca400b940).stop 2021-04-09T18:30:15.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 shutdown_connections 2021-04-09T18:30:15.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cbc199150 0x7f1cbc199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:15.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cbc19a6b0 0x7f1cbc19aab0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:15.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1ca00188d0 0x7f1ca001add0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:15.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 --2- 172.21.15.120:0/1011329659 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1cbc17b7d0 0x7f1cbc0a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:30:15.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 >> 172.21.15.120:0/1011329659 conn(0x7f1cbc185590 msgr2=0x7f1cbc19bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:30:15.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 shutdown_connections 2021-04-09T18:30:15.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:30:15.049 7f1cc4349700 1 -- 172.21.15.120:0/1011329659 wait complete. 2021-04-09T18:30:15.046 INFO:tasks.mds_thrash.fs.[None]:mds.b reported in up:standby state 2021-04-09T18:30:15.047 INFO:tasks.mds_thrash.fs.[None]:waiting for 75 secs before thrashing 2021-04-09T18:30:38.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:30:38.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:11.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:11.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:30.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:30.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.250 7efc0c9c4700 1 Processor -- start 2021-04-09T18:31:30.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.251 7efc0c9c4700 1 -- start start 2021-04-09T18:31:30.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.251 7efc0c9c4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc080d6580 0x7efc081ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.251 7efc0c9c4700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc080d7960 con 0x7efc080d7160 2021-04-09T18:31:30.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.251 7efc0c9c4700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc080d6980 con 0x7efc080d7560 2021-04-09T18:31:30.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.251 7efc0c9c4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc080d11f0 con 0x7efc080d6580 2021-04-09T18:31:30.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.251 7efc0661c700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7efc080d7160 0x7efc080d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54372/0 (socket says 172.21.15.120:54372) 2021-04-09T18:31:30.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.251 7efc0661c700 1 -- 172.21.15.120:0/789563795 learned_addr learned my addr 172.21.15.120:0/789563795 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:31:30.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.251 7efc06e1d700 1 --2- 172.21.15.120:0/789563795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc080d6580 0x7efc081ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc0561a700 1 -- 172.21.15.120:0/789563795 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993396067 0 0) 0x7efc00000ce0 con 0x7efc080d7160 2021-04-09T18:31:30.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc0561a700 1 -- 172.21.15.120:0/789563795 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe8002fe0 con 0x7efc080d7160 2021-04-09T18:31:30.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc06e1d700 1 -- 172.21.15.120:0/789563795 >> v1:172.21.15.134:6789/0 conn(0x7efc080d7560 legacy=0x7efc080d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc06e1d700 1 -- 172.21.15.120:0/789563795 >> v1:172.21.15.120:6789/0 conn(0x7efc080d7160 legacy=0x7efc080d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc06e1d700 1 -- 172.21.15.120:0/789563795 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc080d6be0 con 0x7efc080d6580 2021-04-09T18:31:30.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc06e1d700 1 --2- 172.21.15.120:0/789563795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc080d6580 0x7efc081ac1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efbf8006e50 tx=0x7efbf8009e70).ready entity=mon.2 client_cookie=2a1cab35d7e6ce1b server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:30.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc0561a700 1 -- 172.21.15.120:0/789563795 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efbf8006a20 con 0x7efc080d6580 2021-04-09T18:31:30.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc0561a700 1 -- 172.21.15.120:0/789563795 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf8006790 con 0x7efc080d6580 2021-04-09T18:31:30.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc0561a700 1 -- 172.21.15.120:0/789563795 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efbf800b700 con 0x7efc080d6580 2021-04-09T18:31:30.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc0c9c4700 1 -- 172.21.15.120:0/789563795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc080d6580 msgr2=0x7efc081ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.252 7efc0c9c4700 1 --2- 172.21.15.120:0/789563795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc080d6580 0x7efc081ac1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efbf8006e50 tx=0x7efbf8009e70).stop 2021-04-09T18:31:30.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.253 7efc0c9c4700 1 -- 172.21.15.120:0/789563795 shutdown_connections 2021-04-09T18:31:30.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.253 7efc0c9c4700 1 --2- 172.21.15.120:0/789563795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc080d6580 0x7efc081ac1f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.253 7efc0c9c4700 1 -- 172.21.15.120:0/789563795 >> 172.21.15.120:0/789563795 conn(0x7efc080d1590 msgr2=0x7efc080d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:30.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.253 7efc0c9c4700 1 -- 172.21.15.120:0/789563795 shutdown_connections 2021-04-09T18:31:30.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.253 7efc0c9c4700 1 -- 172.21.15.120:0/789563795 wait complete. 2021-04-09T18:31:30.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.272 7efc0c9c4700 1 Processor -- start 2021-04-09T18:31:30.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.272 7efc0c9c4700 1 -- start start 2021-04-09T18:31:30.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc0c9c4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc08195c90 0x7efc081950c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc0c9c4700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc08196090 0x7efc08090200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc0c9c4700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc08090820 0x7efc080b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc0c9c4700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08195710 con 0x7efc08090820 2021-04-09T18:31:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc0c9c4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0808fd10 con 0x7efc08195c90 2021-04-09T18:31:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc0c9c4700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0808fef0 con 0x7efc08196090 2021-04-09T18:31:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc06e1d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc08090820 0x7efc080b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc06e1d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc08090820 0x7efc080b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59470/0 (socket says 172.21.15.120:59470) 2021-04-09T18:31:30.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc06e1d700 1 -- 172.21.15.120:0/388428764 learned_addr learned my addr 172.21.15.120:0/388428764 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:30.279 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc0661c700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc08195c90 0x7efc081950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc05e1b700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc08196090 0x7efc08090200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.280 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc06e1d700 1 -- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc08196090 msgr2=0x7efc08090200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc06e1d700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc08196090 0x7efc08090200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc06e1d700 1 -- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc08195c90 msgr2=0x7efc081950c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc06e1d700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc08195c90 0x7efc081950c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc06e1d700 1 -- 172.21.15.120:0/388428764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc080b0ea0 con 0x7efc08090820 2021-04-09T18:31:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc0661c700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc08195c90 0x7efc081950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:31:30.283 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.273 7efc06e1d700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc08090820 0x7efc080b0880 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7efbf80099f0 tx=0x7efbf800bc90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:30.283 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.274 7efbfeffd700 1 -- 172.21.15.120:0/388428764 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efbf80090c0 con 0x7efc08090820 2021-04-09T18:31:30.283 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.274 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc080b0ea0 con 0x7efc08090820 2021-04-09T18:31:30.284 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.274 7efbfeffd700 1 -- 172.21.15.120:0/388428764 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800bdd0 con 0x7efc08090820 2021-04-09T18:31:30.284 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.274 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc080b0ea0 con 0x7efc08090820 2021-04-09T18:31:30.284 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.274 7efbfeffd700 1 -- 172.21.15.120:0/388428764 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efbf8009020 con 0x7efc08090820 2021-04-09T18:31:30.284 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.274 7efbfeffd700 1 -- 172.21.15.120:0/388428764 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7efbf8000df0 con 0x7efc08090820 2021-04-09T18:31:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.274 7efbfeffd700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbe0018930 0x7efbe001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.274 7efbfeffd700 1 -- 172.21.15.120:0/388428764 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7efbf8033140 con 0x7efc08090820 2021-04-09T18:31:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.275 7efc0661c700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbe0018930 0x7efbe001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.275 7efc0661c700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbe0018930 0x7efbe001ae10 crc :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.294 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0808fd10 con 0x7efc08090820 2021-04-09T18:31:30.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.297 7efbfeffd700 1 -- 172.21.15.120:0/388428764 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7efbf8000df0 con 0x7efc08090820 2021-04-09T18:31:30.471 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.484 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc0808fd10 con 0x7efc08090820 2021-04-09T18:31:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.484 7efbfeffd700 1 -- 172.21.15.120:0/388428764 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2110 (secure 0 0 0) 0x7efbf800bdd0 con 0x7efc08090820 2021-04-09T18:31:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2021-04-09T18:31:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:30.473 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:30.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbe0018930 msgr2=0x7efbe001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbe0018930 0x7efbe001ae10 crc :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc08090820 msgr2=0x7efc080b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc08090820 0x7efc080b0880 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7efbf80099f0 tx=0x7efbf800bc90).stop 2021-04-09T18:31:30.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 shutdown_connections 2021-04-09T18:31:30.476 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc08090820 0x7efc080b0880 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.476 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7efbe0018930 0x7efbe001ae10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.476 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc08196090 0x7efc08090200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.476 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 --2- 172.21.15.120:0/388428764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc08195c90 0x7efc081950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.477 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 >> 172.21.15.120:0/388428764 conn(0x7efc0818a9d0 msgr2=0x7efc08198100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:30.477 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 shutdown_connections 2021-04-09T18:31:30.477 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.487 7efc0c9c4700 1 -- 172.21.15.120:0/388428764 wait complete. 2021-04-09T18:31:30.484 INFO:tasks.mds_thrash.fs.[None]:kill mds.a (rank=0) 2021-04-09T18:31:30.485 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:31:30.485 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:31:30.495 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:31:30.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:30.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.716 7f30bb295700 1 Processor -- start 2021-04-09T18:31:30.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.716 7f30bb295700 1 -- start start 2021-04-09T18:31:30.726 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.716 7f30bb295700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f30b40d7160 0x7f30b40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.716 7f30bb295700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40d55a0 0x7f30b40d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.716 7f30bb295700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b40d6be0 con 0x7f30b40d5fc0 2021-04-09T18:31:30.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.716 7f30bb295700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b40d80f0 con 0x7f30b40d7160 2021-04-09T18:31:30.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.716 7f30bb295700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b41a2ac0 con 0x7f30b40d55a0 2021-04-09T18:31:30.727 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b90b1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f30b40d7160 0x7f30b40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b88b0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40d55a0 0x7f30b40d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b90b1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f30b40d7160 0x7f30b40d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:48314/0 (socket says 172.21.15.120:48314) 2021-04-09T18:31:30.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b90b1700 1 -- 172.21.15.120:0/1115461935 learned_addr learned my addr 172.21.15.120:0/1115461935 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:30.728 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b98b2700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f30b40d5fc0 0x7f30b40d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.120:49208/0 (socket says 172.21.15.120:49208) 2021-04-09T18:31:30.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b90b1700 1 -- 172.21.15.120:0/1115461935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40d55a0 msgr2=0x7f30b40d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:30.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b90b1700 1 --2- 172.21.15.120:0/1115461935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40d55a0 0x7f30b40d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b90b1700 1 -- 172.21.15.120:0/1115461935 >> v1:172.21.15.134:6789/0 conn(0x7f30b40d5fc0 legacy=0x7f30b40d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.729 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b90b1700 1 -- 172.21.15.120:0/1115461935 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b41a2cb0 con 0x7f30b40d7160 2021-04-09T18:31:30.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b88b0700 1 --2- 172.21.15.120:0/1115461935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40d55a0 0x7f30b40d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:30.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b90b1700 1 --2- 172.21.15.120:0/1115461935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40d7160 0x7f30b40d7560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f30a4006700 tx=0x7f30a4009b80).ready entity=mon.1 client_cookie=30d439e336f89a00 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:30.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b3fff700 1 -- 172.21.15.120:0/1115461935 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30a400c0c0 con 0x7f30b40d7160 2021-04-09T18:31:30.730 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b3fff700 1 -- 172.21.15.120:0/1115461935 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a400c440 con 0x7f30b40d7160 2021-04-09T18:31:30.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30b3fff700 1 -- 172.21.15.120:0/1115461935 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30a400c920 con 0x7f30b40d7160 2021-04-09T18:31:30.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30bb295700 1 -- 172.21.15.120:0/1115461935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40d7160 msgr2=0x7f30b40d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.717 7f30bb295700 1 --2- 172.21.15.120:0/1115461935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40d7160 0x7f30b40d7560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f30a4006700 tx=0x7f30a4009b80).stop 2021-04-09T18:31:30.731 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.718 7f30bb295700 1 -- 172.21.15.120:0/1115461935 shutdown_connections 2021-04-09T18:31:30.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.718 7f30bb295700 1 --2- 172.21.15.120:0/1115461935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40d55a0 0x7f30b40d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.718 7f30bb295700 1 --2- 172.21.15.120:0/1115461935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b40d7160 0x7f30b40d7560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.718 7f30bb295700 1 -- 172.21.15.120:0/1115461935 >> 172.21.15.120:0/1115461935 conn(0x7f30b40d1590 msgr2=0x7f30b40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:30.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.718 7f30bb295700 1 -- 172.21.15.120:0/1115461935 shutdown_connections 2021-04-09T18:31:30.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.718 7f30bb295700 1 -- 172.21.15.120:0/1115461935 wait complete. 2021-04-09T18:31:30.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.738 7f30bb295700 1 Processor -- start 2021-04-09T18:31:30.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.738 7f30bb295700 1 -- start start 2021-04-09T18:31:30.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30bb295700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b41830d0 0x7f30b40915f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.736 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30bb295700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b41837a0 0x7f30b4183ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30bb295700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40ab8d0 0x7f30b40abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30bb295700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4091070 con 0x7f30b41830d0 2021-04-09T18:31:30.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30bb295700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4090d30 con 0x7f30b41837a0 2021-04-09T18:31:30.737 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30bb295700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4091c10 con 0x7f30b40ab8d0 2021-04-09T18:31:30.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30b90b1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b41830d0 0x7f30b40915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30b90b1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b41830d0 0x7f30b40915f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59484/0 (socket says 172.21.15.120:59484) 2021-04-09T18:31:30.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30b90b1700 1 -- 172.21.15.120:0/1127760166 learned_addr learned my addr 172.21.15.120:0/1127760166 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:30.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30b98b2700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40ab8d0 0x7f30b40abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.739 7f30b88b0700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b41837a0 0x7f30b4183ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30b90b1700 1 -- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40ab8d0 msgr2=0x7f30b40abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30b90b1700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40ab8d0 0x7f30b40abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30b90b1700 1 -- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b41837a0 msgr2=0x7f30b4183ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30b90b1700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b41837a0 0x7f30b4183ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30b90b1700 1 -- 172.21.15.120:0/1127760166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b41841c0 con 0x7f30b41830d0 2021-04-09T18:31:30.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30b90b1700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b41830d0 0x7f30b40915f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f30a400b5e0 tx=0x7f30a400b980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:30.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30b1ffb700 1 -- 172.21.15.120:0/1127760166 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30a400bd70 con 0x7f30b41830d0 2021-04-09T18:31:30.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30b1ffb700 1 -- 172.21.15.120:0/1127760166 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a4002030 con 0x7f30b41830d0 2021-04-09T18:31:30.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30bb295700 1 -- 172.21.15.120:0/1127760166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b41841c0 con 0x7f30b41830d0 2021-04-09T18:31:30.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30b1ffb700 1 -- 172.21.15.120:0/1127760166 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f30a4002550 con 0x7f30b41830d0 2021-04-09T18:31:30.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.740 7f30bb295700 1 -- 172.21.15.120:0/1127760166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b41841c0 con 0x7f30b41830d0 2021-04-09T18:31:30.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.741 7f30b1ffb700 1 -- 172.21.15.120:0/1127760166 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f30a4000c90 con 0x7f30b41830d0 2021-04-09T18:31:30.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.741 7f30b1ffb700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3094018930 0x7f309401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:30.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.741 7f30b1ffb700 1 -- 172.21.15.120:0/1127760166 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f30a4032e20 con 0x7f30b41830d0 2021-04-09T18:31:30.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.741 7f30b88b0700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3094018930 0x7f309401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:30.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.741 7f30b88b0700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3094018930 0x7f309401ae10 crc :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:30.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.762 7f30bb295700 1 -- 172.21.15.120:0/1127760166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b417a2b0 con 0x7f30b41830d0 2021-04-09T18:31:30.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.766 7f30b1ffb700 1 -- 172.21.15.120:0/1127760166 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f30a401f7a0 con 0x7f30b41830d0 2021-04-09T18:31:30.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.945 7f30bb295700 1 -- 172.21.15.120:0/1127760166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30b417a2b0 con 0x7f30b41830d0 2021-04-09T18:31:30.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.945 7f30b1ffb700 1 -- 172.21.15.120:0/1127760166 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f30a401f7a0 con 0x7f30b41830d0 2021-04-09T18:31:30.933 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2021-04-09T18:31:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:30.934 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:30.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.947 7f30bb295700 1 -- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3094018930 msgr2=0x7f309401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.947 7f30bb295700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3094018930 0x7f309401ae10 crc :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.947 7f30bb295700 1 -- 172.21.15.120:0/1127760166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b41830d0 msgr2=0x7f30b40915f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:30.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.947 7f30bb295700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b41830d0 0x7f30b40915f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f30a400b5e0 tx=0x7f30a400b980).stop 2021-04-09T18:31:30.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.948 7f30bb295700 1 -- 172.21.15.120:0/1127760166 shutdown_connections 2021-04-09T18:31:30.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.948 7f30bb295700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3094018930 0x7f309401ae10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.948 7f30bb295700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f30b40ab8d0 0x7f30b40abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.948 7f30bb295700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30b41837a0 0x7f30b4183ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.948 7f30bb295700 1 --2- 172.21.15.120:0/1127760166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b41830d0 0x7f30b40915f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.948 7f30bb295700 1 -- 172.21.15.120:0/1127760166 >> 172.21.15.120:0/1127760166 conn(0x7f30b4185580 msgr2=0x7f30b4188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.948 7f30bb295700 1 -- 172.21.15.120:0/1127760166 shutdown_connections 2021-04-09T18:31:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:30.948 7f30bb295700 1 -- 172.21.15.120:0/1127760166 wait complete. 2021-04-09T18:31:30.945 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:31:32.946 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.133 7f11bec0f700 1 Processor -- start 2021-04-09T18:31:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.133 7f11bec0f700 1 -- start start 2021-04-09T18:31:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bec0f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b80d7160 0x7f11b80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bec0f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f11b80d7560 0x7f11b80d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bec0f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f11b80d5bc0 0x7f11b80d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bec0f700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b80d80f0 con 0x7f11b80d7560 2021-04-09T18:31:33.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bec0f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b80d6be0 con 0x7f11b80d5bc0 2021-04-09T18:31:33.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bec0f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80e7f00 con 0x7f11b80d7160 2021-04-09T18:31:33.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b7fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f11b80d7560 0x7f11b80d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b7fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f11b80d7560 0x7f11b80d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59496/0 (socket says 172.21.15.120:59496) 2021-04-09T18:31:33.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b7fff700 1 -- 172.21.15.120:0/1338214212 learned_addr learned my addr 172.21.15.120:0/1338214212 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:33.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bd22c700 1 --2- 172.21.15.120:0/1338214212 >> v2:172.21.15.134:3300/0 conn(0x7f11b80d5bc0 0x7f11b80d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bca2b700 1 --2- 172.21.15.120:0/1338214212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b80d7160 0x7f11b80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b7fff700 1 -- 172.21.15.120:0/1338214212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b80d7160 msgr2=0x7f11b80e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:33.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b7fff700 1 --2- 172.21.15.120:0/1338214212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b80d7160 0x7f11b80e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b7fff700 1 -- 172.21.15.120:0/1338214212 >> v2:172.21.15.134:3300/0 conn(0x7f11b80d5bc0 msgr2=0x7f11b80d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:33.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b7fff700 1 --2- 172.21.15.120:0/1338214212 >> v2:172.21.15.134:3300/0 conn(0x7f11b80d5bc0 0x7f11b80d5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b7fff700 1 -- 172.21.15.120:0/1338214212 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b81a2ac0 con 0x7f11b80d7560 2021-04-09T18:31:33.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bd22c700 1 --2- 172.21.15.120:0/1338214212 >> v2:172.21.15.134:3300/0 conn(0x7f11b80d5bc0 0x7f11b80d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:31:33.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b7fff700 1 --2- 172.21.15.120:0/1338214212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b80d7560 0x7f11b80d55a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f11a8006700 tx=0x7f11a8009b80).ready entity=mon.0 client_cookie=893d9b11b22b1fe0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b77fe700 1 -- 172.21.15.120:0/1338214212 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11a800c0c0 con 0x7f11b80d7560 2021-04-09T18:31:33.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b77fe700 1 -- 172.21.15.120:0/1338214212 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a800c440 con 0x7f11b80d7560 2021-04-09T18:31:33.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11b77fe700 1 -- 172.21.15.120:0/1338214212 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11a800c920 con 0x7f11b80d7560 2021-04-09T18:31:33.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bec0f700 1 -- 172.21.15.120:0/1338214212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b80d7560 msgr2=0x7f11b80d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.134 7f11bec0f700 1 --2- 172.21.15.120:0/1338214212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b80d7560 0x7f11b80d55a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f11a8006700 tx=0x7f11a8009b80).stop 2021-04-09T18:31:33.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.135 7f11bec0f700 1 -- 172.21.15.120:0/1338214212 shutdown_connections 2021-04-09T18:31:33.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.135 7f11bec0f700 1 --2- 172.21.15.120:0/1338214212 >> v2:172.21.15.134:3300/0 conn(0x7f11b80d5bc0 0x7f11b80d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.135 7f11bec0f700 1 --2- 172.21.15.120:0/1338214212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b80d7560 0x7f11b80d55a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.135 7f11bec0f700 1 --2- 172.21.15.120:0/1338214212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b80d7160 0x7f11b80e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.135 7f11bec0f700 1 -- 172.21.15.120:0/1338214212 >> 172.21.15.120:0/1338214212 conn(0x7f11b80d1590 msgr2=0x7f11b80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:33.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.135 7f11bec0f700 1 -- 172.21.15.120:0/1338214212 shutdown_connections 2021-04-09T18:31:33.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.135 7f11bec0f700 1 -- 172.21.15.120:0/1338214212 wait complete. 2021-04-09T18:31:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bec0f700 1 Processor -- start 2021-04-09T18:31:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bec0f700 1 -- start start 2021-04-09T18:31:33.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bec0f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b8187380 0x7f11b8189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bec0f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b8187780 0x7f11b80987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.157 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bec0f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11b8189c50 0x7f11b80b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bec0f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b818ce60 con 0x7f11b8187380 2021-04-09T18:31:33.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bec0f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8098e10 con 0x7f11b8189c50 2021-04-09T18:31:33.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bec0f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8099030 con 0x7f11b8187780 2021-04-09T18:31:33.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bca2b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b8187380 0x7f11b8189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bca2b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b8187380 0x7f11b8189630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59502/0 (socket says 172.21.15.120:59502) 2021-04-09T18:31:33.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.154 7f11bca2b700 1 -- 172.21.15.120:0/672209331 learned_addr learned my addr 172.21.15.120:0/672209331 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:33.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11b7fff700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b8187780 0x7f11b80987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bd22c700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11b8189c50 0x7f11b80b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bca2b700 1 -- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b8187780 msgr2=0x7f11b80987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bca2b700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b8187780 0x7f11b80987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bca2b700 1 -- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11b8189c50 msgr2=0x7f11b80b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bca2b700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11b8189c50 0x7f11b80b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bca2b700 1 -- 172.21.15.120:0/672209331 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b80b8b30 con 0x7f11b8187380 2021-04-09T18:31:33.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bd22c700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11b8189c50 0x7f11b80b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:33.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bca2b700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b8187380 0x7f11b8189630 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f11a000b580 tx=0x7f11a000b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11b57fa700 1 -- 172.21.15.120:0/672209331 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11a000bd10 con 0x7f11b8187380 2021-04-09T18:31:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11b57fa700 1 -- 172.21.15.120:0/672209331 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a0002030 con 0x7f11b8187380 2021-04-09T18:31:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11b57fa700 1 -- 172.21.15.120:0/672209331 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11a0002480 con 0x7f11b8187380 2021-04-09T18:31:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bec0f700 1 -- 172.21.15.120:0/672209331 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b80b8b30 con 0x7f11b8187380 2021-04-09T18:31:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.155 7f11bec0f700 1 -- 172.21.15.120:0/672209331 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b80b8b30 con 0x7f11b8187380 2021-04-09T18:31:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.156 7f11b57fa700 1 -- 172.21.15.120:0/672209331 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f11a0002210 con 0x7f11b8187380 2021-04-09T18:31:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.156 7f11b57fa700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f119c018930 0x7f119c01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.156 7f11b57fa700 1 -- 172.21.15.120:0/672209331 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f11a0032dc0 con 0x7f11b8187380 2021-04-09T18:31:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.156 7f11b7fff700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f119c018930 0x7f119c01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.156 7f11b7fff700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f119c018930 0x7f119c01adc0 crc :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.179 7f11bec0f700 1 -- 172.21.15.120:0/672209331 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b8189100 con 0x7f11b8187380 2021-04-09T18:31:33.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.183 7f11b57fa700 1 -- 172.21.15.120:0/672209331 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f11a0006320 con 0x7f11b8187380 2021-04-09T18:31:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.361 7f11bec0f700 1 -- 172.21.15.120:0/672209331 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11b8189100 con 0x7f11b8187380 2021-04-09T18:31:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.362 7f11b57fa700 1 -- 172.21.15.120:0/672209331 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f11a0002030 con 0x7f11b8187380 2021-04-09T18:31:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2021-04-09T18:31:33.351 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:33.351 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:33.354 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 -- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f119c018930 msgr2=0x7f119c01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f119c018930 0x7f119c01adc0 crc :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 -- 172.21.15.120:0/672209331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b8187380 msgr2=0x7f11b8189630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:33.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b8187380 0x7f11b8189630 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f11a000b580 tx=0x7f11a000b920).stop 2021-04-09T18:31:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 -- 172.21.15.120:0/672209331 shutdown_connections 2021-04-09T18:31:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11b8189c50 0x7f11b80b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f119c018930 0x7f119c01adc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f11b8187780 0x7f11b80987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 --2- 172.21.15.120:0/672209331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11b8187380 0x7f11b8189630 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:33.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.364 7f11bec0f700 1 -- 172.21.15.120:0/672209331 >> 172.21.15.120:0/672209331 conn(0x7f11b818dc90 msgr2=0x7f11b808fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:33.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.365 7f11bec0f700 1 -- 172.21.15.120:0/672209331 shutdown_connections 2021-04-09T18:31:33.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:33.365 7f11bec0f700 1 -- 172.21.15.120:0/672209331 wait complete. 2021-04-09T18:31:33.363 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:31:35.365 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:35.547 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.539 7f0865f19700 1 Processor -- start 2021-04-09T18:31:35.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.539 7f0865f19700 1 -- start start 2021-04-09T18:31:35.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.540 7f0865f19700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08600d7560 0x7f08600d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.540 7f0865f19700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f08600d63b0 0x7f08601ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.548 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.540 7f0865f19700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08600d7960 con 0x7f08600d7160 2021-04-09T18:31:35.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.540 7f0865f19700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08600d80f0 con 0x7f08600d63b0 2021-04-09T18:31:35.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.540 7f0865f19700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08600d6be0 con 0x7f08600d7560 2021-04-09T18:31:35.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.540 7f085ffff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f08600d63b0 0x7f08601ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.540 7f085effd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08600d7560 0x7f08600d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.540 7f085ffff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f08600d63b0 0x7f08601ab1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:48348/0 (socket says 172.21.15.120:48348) 2021-04-09T18:31:35.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.540 7f085ffff700 1 -- 172.21.15.120:0/497413653 learned_addr learned my addr 172.21.15.120:0/497413653 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:35.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f085effd700 1 -- 172.21.15.120:0/497413653 >> v2:172.21.15.134:3300/0 conn(0x7f08600d63b0 msgr2=0x7f08601ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:35.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f085effd700 1 --2- 172.21.15.120:0/497413653 >> v2:172.21.15.134:3300/0 conn(0x7f08600d63b0 0x7f08601ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f085effd700 1 -- 172.21.15.120:0/497413653 >> v1:172.21.15.134:6789/0 conn(0x7f08600d7160 legacy=0x7f08600d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f085effd700 1 -- 172.21.15.120:0/497413653 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08601a2ac0 con 0x7f08600d7560 2021-04-09T18:31:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f085ffff700 1 --2- 172.21.15.120:0/497413653 >> v2:172.21.15.134:3300/0 conn(0x7f08600d63b0 0x7f08601ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f085effd700 1 --2- 172.21.15.120:0/497413653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08600d7560 0x7f08600d5d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0854006650 tx=0x7f0854009a80).ready entity=mon.2 client_cookie=b67ce75caa824043 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f085e7fc700 1 -- 172.21.15.120:0/497413653 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08540009b0 con 0x7f08600d7560 2021-04-09T18:31:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f085e7fc700 1 -- 172.21.15.120:0/497413653 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085400c0c0 con 0x7f08600d7560 2021-04-09T18:31:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f085e7fc700 1 -- 172.21.15.120:0/497413653 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f085400c510 con 0x7f08600d7560 2021-04-09T18:31:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f0865f19700 1 -- 172.21.15.120:0/497413653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08600d7560 msgr2=0x7f08600d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.541 7f0865f19700 1 --2- 172.21.15.120:0/497413653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08600d7560 0x7f08600d5d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0854006650 tx=0x7f0854009a80).stop 2021-04-09T18:31:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.542 7f0865f19700 1 -- 172.21.15.120:0/497413653 shutdown_connections 2021-04-09T18:31:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.542 7f0865f19700 1 --2- 172.21.15.120:0/497413653 >> v2:172.21.15.134:3300/0 conn(0x7f08600d63b0 0x7f08601ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.542 7f0865f19700 1 --2- 172.21.15.120:0/497413653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08600d7560 0x7f08600d5d90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.542 7f0865f19700 1 -- 172.21.15.120:0/497413653 >> 172.21.15.120:0/497413653 conn(0x7f08600d1590 msgr2=0x7f08600d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.542 7f0865f19700 1 -- 172.21.15.120:0/497413653 shutdown_connections 2021-04-09T18:31:35.554 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.542 7f0865f19700 1 -- 172.21.15.120:0/497413653 wait complete. 2021-04-09T18:31:35.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f0865f19700 1 Processor -- start 2021-04-09T18:31:35.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f0865f19700 1 -- start start 2021-04-09T18:31:35.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f0865f19700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0860187670 0x7f08600a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f0865f19700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08600a5050 0x7f08600b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f0865f19700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08600b5710 0x7f08601838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f0865f19700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600b5b10 con 0x7f08600a5050 2021-04-09T18:31:35.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f0865f19700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600b5d30 con 0x7f08600b5710 2021-04-09T18:31:35.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f0865f19700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08600b5f50 con 0x7f0860187670 2021-04-09T18:31:35.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f085effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08600a5050 0x7f08600b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.559 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f085effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08600a5050 0x7f08600b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59516/0 (socket says 172.21.15.120:59516) 2021-04-09T18:31:35.559 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.561 7f085effd700 1 -- 172.21.15.120:0/60264434 learned_addr learned my addr 172.21.15.120:0/60264434 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:35.559 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f085ffff700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08600b5710 0x7f08601838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f085f7fe700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0860187670 0x7f08600a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f085effd700 1 -- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0860187670 msgr2=0x7f08600a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f085effd700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0860187670 0x7f08600a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f085effd700 1 -- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08600b5710 msgr2=0x7f08601838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f085effd700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08600b5710 0x7f08601838d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f085effd700 1 -- 172.21.15.120:0/60264434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860183ef0 con 0x7f08600a5050 2021-04-09T18:31:35.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f085effd700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08600a5050 0x7f08600b50f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f0854009650 tx=0x7f085400b8e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f0847fff700 1 -- 172.21.15.120:0/60264434 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08540093a0 con 0x7f08600a5050 2021-04-09T18:31:35.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f0847fff700 1 -- 172.21.15.120:0/60264434 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0854006070 con 0x7f08600a5050 2021-04-09T18:31:35.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f0865f19700 1 -- 172.21.15.120:0/60264434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0860183ef0 con 0x7f08600a5050 2021-04-09T18:31:35.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f0847fff700 1 -- 172.21.15.120:0/60264434 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08540052e0 con 0x7f08600a5050 2021-04-09T18:31:35.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.562 7f0865f19700 1 -- 172.21.15.120:0/60264434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0860183ef0 con 0x7f08600a5050 2021-04-09T18:31:35.562 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.563 7f0847fff700 1 -- 172.21.15.120:0/60264434 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0854009300 con 0x7f08600a5050 2021-04-09T18:31:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.563 7f0847fff700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0840018930 0x7f084001adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.563 7f0847fff700 1 -- 172.21.15.120:0/60264434 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f0854032dd0 con 0x7f08600a5050 2021-04-09T18:31:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.563 7f085f7fe700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0840018930 0x7f084001adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.563 7f085f7fe700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0840018930 0x7f084001adc0 crc :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:35.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.586 7f0865f19700 1 -- 172.21.15.120:0/60264434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08601829e0 con 0x7f08600a5050 2021-04-09T18:31:35.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.589 7f0847fff700 1 -- 172.21.15.120:0/60264434 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0854006030 con 0x7f08600a5050 2021-04-09T18:31:35.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.766 7f0865f19700 1 -- 172.21.15.120:0/60264434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08601829e0 con 0x7f08600a5050 2021-04-09T18:31:35.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.766 7f0847fff700 1 -- 172.21.15.120:0/60264434 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f0854000940 con 0x7f08600a5050 2021-04-09T18:31:35.754 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2021-04-09T18:31:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:35.755 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:35.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 -- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0840018930 msgr2=0x7f084001adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0840018930 0x7f084001adc0 crc :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 -- 172.21.15.120:0/60264434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08600a5050 msgr2=0x7f08600b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:35.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08600a5050 0x7f08600b50f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f0854009650 tx=0x7f085400b8e0).stop 2021-04-09T18:31:35.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 -- 172.21.15.120:0/60264434 shutdown_connections 2021-04-09T18:31:35.758 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08600b5710 0x7f08601838d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.758 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08600a5050 0x7f08600b50f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.758 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0840018930 0x7f084001adc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.758 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 --2- 172.21.15.120:0/60264434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0860187670 0x7f08600a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:35.759 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 -- 172.21.15.120:0/60264434 >> 172.21.15.120:0/60264434 conn(0x7f086018dc90 msgr2=0x7f086008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:35.759 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 -- 172.21.15.120:0/60264434 shutdown_connections 2021-04-09T18:31:35.759 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:35.769 7f0865f19700 1 -- 172.21.15.120:0/60264434 wait complete. 2021-04-09T18:31:35.766 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:31:37.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:37.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.930 7f09d8409700 1 Processor -- start 2021-04-09T18:31:37.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.930 7f09d8409700 1 -- start start 2021-04-09T18:31:37.939 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.930 7f09d8409700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f09d00d7160 0x7f09d00d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:37.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.930 7f09d8409700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d00d55a0 0x7f09d00d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:37.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.930 7f09d8409700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f09d00d5fc0 0x7f09d00d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:37.940 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.930 7f09d8409700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00e80a0 con 0x7f09d00d5fc0 2021-04-09T18:31:37.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.930 7f09d8409700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00d80f0 con 0x7f09d00d7160 2021-04-09T18:31:37.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.930 7f09d8409700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d00d6be0 con 0x7f09d00d55a0 2021-04-09T18:31:37.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6a26700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f09d00d5fc0 0x7f09d00d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:37.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6a26700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f09d00d5fc0 0x7f09d00d63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59528/0 (socket says 172.21.15.120:59528) 2021-04-09T18:31:37.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6a26700 1 -- 172.21.15.120:0/2800722947 learned_addr learned my addr 172.21.15.120:0/2800722947 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:37.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d5a24700 1 --2- 172.21.15.120:0/2800722947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d00d55a0 0x7f09d00d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:37.942 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6225700 1 --2- 172.21.15.120:0/2800722947 >> v2:172.21.15.134:3300/0 conn(0x7f09d00d7160 0x7f09d00d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:37.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6a26700 1 -- 172.21.15.120:0/2800722947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d00d55a0 msgr2=0x7f09d00d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:37.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6a26700 1 --2- 172.21.15.120:0/2800722947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d00d55a0 0x7f09d00d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:37.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6a26700 1 -- 172.21.15.120:0/2800722947 >> v2:172.21.15.134:3300/0 conn(0x7f09d00d7160 msgr2=0x7f09d00d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:37.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6a26700 1 --2- 172.21.15.120:0/2800722947 >> v2:172.21.15.134:3300/0 conn(0x7f09d00d7160 0x7f09d00d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:37.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6a26700 1 -- 172.21.15.120:0/2800722947 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d01a2ac0 con 0x7f09d00d5fc0 2021-04-09T18:31:37.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d6a26700 1 --2- 172.21.15.120:0/2800722947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d00d5fc0 0x7f09d00d63c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f09c8006b80 tx=0x7f09c8009b10).ready entity=mon.0 client_cookie=df0e8084e5fbbe9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:37.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d5223700 1 -- 172.21.15.120:0/2800722947 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09c80022e0 con 0x7f09d00d5fc0 2021-04-09T18:31:37.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d5223700 1 -- 172.21.15.120:0/2800722947 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8002620 con 0x7f09d00d5fc0 2021-04-09T18:31:37.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d5223700 1 -- 172.21.15.120:0/2800722947 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09c8002b00 con 0x7f09d00d5fc0 2021-04-09T18:31:37.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d8409700 1 -- 172.21.15.120:0/2800722947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d00d5fc0 msgr2=0x7f09d00d63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:37.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.931 7f09d8409700 1 --2- 172.21.15.120:0/2800722947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d00d5fc0 0x7f09d00d63c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f09c8006b80 tx=0x7f09c8009b10).stop 2021-04-09T18:31:37.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.932 7f09d8409700 1 -- 172.21.15.120:0/2800722947 shutdown_connections 2021-04-09T18:31:37.945 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.932 7f09d8409700 1 --2- 172.21.15.120:0/2800722947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d00d5fc0 0x7f09d00d63c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:37.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.932 7f09d8409700 1 --2- 172.21.15.120:0/2800722947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d00d55a0 0x7f09d00d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:37.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.932 7f09d8409700 1 --2- 172.21.15.120:0/2800722947 >> v2:172.21.15.134:3300/0 conn(0x7f09d00d7160 0x7f09d00d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:37.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.932 7f09d8409700 1 -- 172.21.15.120:0/2800722947 >> 172.21.15.120:0/2800722947 conn(0x7f09d00d1590 msgr2=0x7f09d00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:37.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.932 7f09d8409700 1 -- 172.21.15.120:0/2800722947 shutdown_connections 2021-04-09T18:31:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.932 7f09d8409700 1 -- 172.21.15.120:0/2800722947 wait complete. 2021-04-09T18:31:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.951 7f09d8409700 1 Processor -- start 2021-04-09T18:31:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.951 7f09d8409700 1 -- start start 2021-04-09T18:31:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.951 7f09d8409700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d0183b60 0x7f09d01841d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.951 7f09d8409700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d008d000 0x7f09d008de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.951 7f09d8409700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d008d400 0x7f09d00bb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.951 7f09d8409700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d008e790 con 0x7f09d0183b60 2021-04-09T18:31:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.951 7f09d8409700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d008d890 con 0x7f09d008d400 2021-04-09T18:31:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.951 7f09d8409700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d018ccb0 con 0x7f09d008d000 2021-04-09T18:31:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.951 7f09d6225700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d0183b60 0x7f09d01841d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d6225700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d0183b60 0x7f09d01841d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59532/0 (socket says 172.21.15.120:59532) 2021-04-09T18:31:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d6225700 1 -- 172.21.15.120:0/1515658387 learned_addr learned my addr 172.21.15.120:0/1515658387 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d6a26700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d008d400 0x7f09d00bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d5a24700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d008d000 0x7f09d008de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d6225700 1 -- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d008d000 msgr2=0x7f09d008de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d6225700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d008d000 0x7f09d008de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d6225700 1 -- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d008d400 msgr2=0x7f09d00bb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d6225700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d008d400 0x7f09d00bb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d6225700 1 -- 172.21.15.120:0/1515658387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d008e430 con 0x7f09d0183b60 2021-04-09T18:31:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d6225700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d0183b60 0x7f09d01841d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f09cc00b930 tx=0x7f09cc00bcd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09c6ffd700 1 -- 172.21.15.120:0/1515658387 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09cc00c2f0 con 0x7f09d0183b60 2021-04-09T18:31:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09c6ffd700 1 -- 172.21.15.120:0/1515658387 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc00c5f0 con 0x7f09d0183b60 2021-04-09T18:31:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d8409700 1 -- 172.21.15.120:0/1515658387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d008e430 con 0x7f09d0183b60 2021-04-09T18:31:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09c6ffd700 1 -- 172.21.15.120:0/1515658387 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09cc00ca40 con 0x7f09d0183b60 2021-04-09T18:31:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.952 7f09d8409700 1 -- 172.21.15.120:0/1515658387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d008e430 con 0x7f09d0183b60 2021-04-09T18:31:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.953 7f09c6ffd700 1 -- 172.21.15.120:0/1515658387 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f09cc001010 con 0x7f09d0183b60 2021-04-09T18:31:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.953 7f09c6ffd700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f09b80188c0 0x7f09b801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.953 7f09c6ffd700 1 -- 172.21.15.120:0/1515658387 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f09cc0331b0 con 0x7f09d0183b60 2021-04-09T18:31:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.953 7f09d5a24700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f09b80188c0 0x7f09b801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.953 7f09d5a24700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f09b80188c0 0x7f09b801adc0 crc :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:37.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.976 7f09d8409700 1 -- 172.21.15.120:0/1515658387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d0182960 con 0x7f09d0183b60 2021-04-09T18:31:37.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:37.979 7f09c6ffd700 1 -- 172.21.15.120:0/1515658387 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f09cc00c4f0 con 0x7f09d0183b60 2021-04-09T18:31:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.157 7f09d8409700 1 -- 172.21.15.120:0/1515658387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09d00d6be0 con 0x7f09d0183b60 2021-04-09T18:31:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.158 7f09c6ffd700 1 -- 172.21.15.120:0/1515658387 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f09cc001010 con 0x7f09d0183b60 2021-04-09T18:31:38.146 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2021-04-09T18:31:38.147 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:38.148 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:38.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 -- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f09b80188c0 msgr2=0x7f09b801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:38.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f09b80188c0 0x7f09b801adc0 crc :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:38.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 -- 172.21.15.120:0/1515658387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d0183b60 msgr2=0x7f09d01841d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:38.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d0183b60 0x7f09d01841d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f09cc00b930 tx=0x7f09cc00bcd0).stop 2021-04-09T18:31:38.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 -- 172.21.15.120:0/1515658387 shutdown_connections 2021-04-09T18:31:38.152 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d008d400 0x7f09d00bb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:38.152 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f09b80188c0 0x7f09b801adc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:38.152 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09d008d000 0x7f09d008de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:38.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 --2- 172.21.15.120:0/1515658387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09d0183b60 0x7f09d01841d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:38.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 -- 172.21.15.120:0/1515658387 >> 172.21.15.120:0/1515658387 conn(0x7f09d019a7e0 msgr2=0x7f09d009b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:38.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 -- 172.21.15.120:0/1515658387 shutdown_connections 2021-04-09T18:31:38.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:38.160 7f09d8409700 1 -- 172.21.15.120:0/1515658387 wait complete. 2021-04-09T18:31:38.158 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:31:40.160 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:40.330 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.322 7f05c8bd3700 1 Processor -- start 2021-04-09T18:31:40.330 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.322 7f05c8bd3700 1 -- start start 2021-04-09T18:31:40.331 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c8bd3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c40d7160 0x7f05c40e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:40.331 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c8bd3700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f05c40d7560 0x7f05c40d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:40.331 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c8bd3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f05c40d5bc0 0x7f05c40d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:40.331 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c8bd3700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c40d80f0 con 0x7f05c40d7560 2021-04-09T18:31:40.332 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c8bd3700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c40d6be0 con 0x7f05c40d5bc0 2021-04-09T18:31:40.332 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c8bd3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40e7f00 con 0x7f05c40d7160 2021-04-09T18:31:40.332 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c205d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f05c40d7560 0x7f05c40d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:40.332 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c205d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f05c40d7560 0x7f05c40d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59544/0 (socket says 172.21.15.120:59544) 2021-04-09T18:31:40.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c205d700 1 -- 172.21.15.120:0/62064158 learned_addr learned my addr 172.21.15.120:0/62064158 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:40.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c285e700 1 --2- 172.21.15.120:0/62064158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c40d7160 0x7f05c40e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:40.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c305f700 1 --2- 172.21.15.120:0/62064158 >> v2:172.21.15.134:3300/0 conn(0x7f05c40d5bc0 0x7f05c40d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:40.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c205d700 1 -- 172.21.15.120:0/62064158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c40d7160 msgr2=0x7f05c40e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:40.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c205d700 1 --2- 172.21.15.120:0/62064158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c40d7160 0x7f05c40e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c205d700 1 -- 172.21.15.120:0/62064158 >> v2:172.21.15.134:3300/0 conn(0x7f05c40d5bc0 msgr2=0x7f05c40d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:40.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c205d700 1 --2- 172.21.15.120:0/62064158 >> v2:172.21.15.134:3300/0 conn(0x7f05c40d5bc0 0x7f05c40d5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c205d700 1 -- 172.21.15.120:0/62064158 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c41a2ac0 con 0x7f05c40d7560 2021-04-09T18:31:40.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c305f700 1 --2- 172.21.15.120:0/62064158 >> v2:172.21.15.134:3300/0 conn(0x7f05c40d5bc0 0x7f05c40d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:40.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c205d700 1 --2- 172.21.15.120:0/62064158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c40d7560 0x7f05c40d55a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f05b8006700 tx=0x7f05b8009b80).ready entity=mon.0 client_cookie=64932edee3891739 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:40.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c185c700 1 -- 172.21.15.120:0/62064158 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05b800c0c0 con 0x7f05c40d7560 2021-04-09T18:31:40.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c185c700 1 -- 172.21.15.120:0/62064158 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b800c440 con 0x7f05c40d7560 2021-04-09T18:31:40.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.323 7f05c185c700 1 -- 172.21.15.120:0/62064158 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05b800c920 con 0x7f05c40d7560 2021-04-09T18:31:40.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.324 7f05c8bd3700 1 -- 172.21.15.120:0/62064158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c40d7560 msgr2=0x7f05c40d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:40.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.324 7f05c8bd3700 1 --2- 172.21.15.120:0/62064158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c40d7560 0x7f05c40d55a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f05b8006700 tx=0x7f05b8009b80).stop 2021-04-09T18:31:40.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.324 7f05c8bd3700 1 -- 172.21.15.120:0/62064158 shutdown_connections 2021-04-09T18:31:40.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.324 7f05c8bd3700 1 --2- 172.21.15.120:0/62064158 >> v2:172.21.15.134:3300/0 conn(0x7f05c40d5bc0 0x7f05c40d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.324 7f05c8bd3700 1 --2- 172.21.15.120:0/62064158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c40d7560 0x7f05c40d55a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.324 7f05c8bd3700 1 --2- 172.21.15.120:0/62064158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c40d7160 0x7f05c40e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.324 7f05c8bd3700 1 -- 172.21.15.120:0/62064158 >> 172.21.15.120:0/62064158 conn(0x7f05c40d1590 msgr2=0x7f05c40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.324 7f05c8bd3700 1 -- 172.21.15.120:0/62064158 shutdown_connections 2021-04-09T18:31:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.324 7f05c8bd3700 1 -- 172.21.15.120:0/62064158 wait complete. 2021-04-09T18:31:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.343 7f05c8bd3700 1 Processor -- start 2021-04-09T18:31:40.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.343 7f05c8bd3700 1 -- start start 2021-04-09T18:31:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c8bd3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c408aca0 0x7f05c417ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c8bd3700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c408b0a0 0x7f05c4095890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c8bd3700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c417f0b0 0x7f05c40aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c8bd3700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c408b690 con 0x7f05c408b0a0 2021-04-09T18:31:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c8bd3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c408b910 con 0x7f05c408aca0 2021-04-09T18:31:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c8bd3700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4095eb0 con 0x7f05c417f0b0 2021-04-09T18:31:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c205d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c408b0a0 0x7f05c4095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c205d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c408b0a0 0x7f05c4095890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59548/0 (socket says 172.21.15.120:59548) 2021-04-09T18:31:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c205d700 1 -- 172.21.15.120:0/1221320162 learned_addr learned my addr 172.21.15.120:0/1221320162 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c285e700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c408aca0 0x7f05c417ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c305f700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c417f0b0 0x7f05c40aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c205d700 1 -- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c417f0b0 msgr2=0x7f05c40aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c205d700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c417f0b0 0x7f05c40aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c205d700 1 -- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c408aca0 msgr2=0x7f05c417ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c205d700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c408aca0 0x7f05c417ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c205d700 1 -- 172.21.15.120:0/1221320162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40960d0 con 0x7f05c408b0a0 2021-04-09T18:31:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c205d700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c408b0a0 0x7f05c4095890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f05b800b580 tx=0x7f05b800b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05b37fe700 1 -- 172.21.15.120:0/1221320162 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05b800bd10 con 0x7f05c408b0a0 2021-04-09T18:31:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05b37fe700 1 -- 172.21.15.120:0/1221320162 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8002030 con 0x7f05c408b0a0 2021-04-09T18:31:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05b37fe700 1 -- 172.21.15.120:0/1221320162 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05b8002550 con 0x7f05c408b0a0 2021-04-09T18:31:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c40960d0 con 0x7f05c408b0a0 2021-04-09T18:31:40.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.344 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c40960d0 con 0x7f05c408b0a0 2021-04-09T18:31:40.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.345 7f05b37fe700 1 -- 172.21.15.120:0/1221320162 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f05b8002210 con 0x7f05c408b0a0 2021-04-09T18:31:40.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.345 7f05b37fe700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a8018930 0x7f05a801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:40.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.345 7f05b37fe700 1 -- 172.21.15.120:0/1221320162 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f05b8032df0 con 0x7f05c408b0a0 2021-04-09T18:31:40.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.345 7f05c285e700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a8018930 0x7f05a801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:40.347 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.346 7f05c285e700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a8018930 0x7f05a801adc0 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:40.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.368 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c40e48e0 con 0x7f05c408b0a0 2021-04-09T18:31:40.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.372 7f05b37fe700 1 -- 172.21.15.120:0/1221320162 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f05b8002240 con 0x7f05c408b0a0 2021-04-09T18:31:40.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.549 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05c40e48e0 con 0x7f05c408b0a0 2021-04-09T18:31:40.537 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.550 7f05b37fe700 1 -- 172.21.15.120:0/1221320162 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f05b8002030 con 0x7f05c408b0a0 2021-04-09T18:31:40.537 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2021-04-09T18:31:40.538 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:40.538 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:40.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a8018930 msgr2=0x7f05a801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:40.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a8018930 0x7f05a801adc0 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c408b0a0 msgr2=0x7f05c4095890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:40.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c408b0a0 0x7f05c4095890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f05b800b580 tx=0x7f05b800b920).stop 2021-04-09T18:31:40.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 shutdown_connections 2021-04-09T18:31:40.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f05a8018930 0x7f05a801adc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05c417f0b0 0x7f05c40aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05c408b0a0 0x7f05c4095890 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 --2- 172.21.15.120:0/1221320162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c408aca0 0x7f05c417ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:40.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 >> 172.21.15.120:0/1221320162 conn(0x7f05c41993c0 msgr2=0x7f05c4199820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:40.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 shutdown_connections 2021-04-09T18:31:40.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:40.552 7f05c8bd3700 1 -- 172.21.15.120:0/1221320162 wait complete. 2021-04-09T18:31:40.549 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:31:41.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:41.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:31:42.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:42.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.705 7f56fc8f8700 1 Processor -- start 2021-04-09T18:31:42.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.705 7f56fc8f8700 1 -- start start 2021-04-09T18:31:42.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.706 7f56fc8f8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f56f80d7160 0x7f56f80d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:42.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.706 7f56fc8f8700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f80d6be0 con 0x7f56f80d6190 2021-04-09T18:31:42.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.706 7f56fc8f8700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f81a2ac0 con 0x7f56f80d55a0 2021-04-09T18:31:42.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.706 7f56fc8f8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f81a2ce0 con 0x7f56f80d7160 2021-04-09T18:31:42.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.706 7f56f6e1d700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f56f80d6190 0x7f56f81ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54468/0 (socket says 172.21.15.120:54468) 2021-04-09T18:31:42.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.706 7f56f6e1d700 1 -- 172.21.15.120:0/304227463 learned_addr learned my addr 172.21.15.120:0/304227463 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:31:42.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.706 7f56f661c700 1 --2- 172.21.15.120:0/304227463 >> v2:172.21.15.134:3300/0 conn(0x7f56f80d7160 0x7f56f80d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:42.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.706 7f56f561a700 1 -- 172.21.15.120:0/304227463 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902666363 0 0) 0x7f56f00009b0 con 0x7f56f80d6190 2021-04-09T18:31:42.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.706 7f56f561a700 1 -- 172.21.15.120:0/304227463 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e0002fe0 con 0x7f56f80d6190 2021-04-09T18:31:42.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1156790031 0 0) 0x7f56f0000ef0 con 0x7f56f80d6190 2021-04-09T18:31:42.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 >> v2:172.21.15.134:3300/0 conn(0x7f56f80d7160 msgr2=0x7f56f80d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:42.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 --2- 172.21.15.120:0/304227463 >> v2:172.21.15.134:3300/0 conn(0x7f56f80d7160 0x7f56f80d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 >> v1:172.21.15.134:6789/0 conn(0x7f56f80d55a0 legacy=0x7f56f80d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:42.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80d6590 con 0x7f56f80d6190 2021-04-09T18:31:42.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f56f0001600 con 0x7f56f80d6190 2021-04-09T18:31:42.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 >> v1:172.21.15.120:6789/0 conn(0x7f56f80d6190 legacy=0x7f56f81ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:42.747 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e0003a60 0x7f56e0005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:42.747 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56e0006790 0x7f56e0008c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:42.747 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56e0009590 0x7f56e000bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:42.748 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e000c300 con 0x7f56e0003a60 2021-04-09T18:31:42.748 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e000c520 con 0x7f56e0009590 2021-04-09T18:31:42.748 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0050750 con 0x7f56e0006790 2021-04-09T18:31:42.749 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f661c700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e0003a60 0x7f56e0005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:42.749 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f5e1b700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56e0006790 0x7f56e0008c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:42.749 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f6e1d700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56e0009590 0x7f56e000bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:42.749 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f661c700 1 -- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56e0006790 msgr2=0x7f56e0008c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:42.750 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f661c700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56e0006790 0x7f56e0008c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.750 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f661c700 1 -- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56e0009590 msgr2=0x7f56e000bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:42.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f661c700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56e0009590 0x7f56e000bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f661c700 1 -- 172.21.15.120:0/304227463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e00509b0 con 0x7f56e0003a60 2021-04-09T18:31:42.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f6e1d700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56e0009590 0x7f56e000bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:42.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f5e1b700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56e0006790 0x7f56e0008c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:42.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f6e1d700 1 -- 172.21.15.120:0/304227463 reap_dead start 2021-04-09T18:31:42.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f661c700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e0003a60 0x7f56e0005ef0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f56e8006fc0 tx=0x7f56e800c0c0).ready entity=mon.0 client_cookie=a91307189c245133 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:42.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f56e800c4b0 con 0x7f56e0003a60 2021-04-09T18:31:42.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e8009a70 con 0x7f56e0003a60 2021-04-09T18:31:42.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56f561a700 1 -- 172.21.15.120:0/304227463 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f56e800c830 con 0x7f56e0003a60 2021-04-09T18:31:42.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56fc8f8700 1 -- 172.21.15.120:0/304227463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e0003a60 msgr2=0x7f56e0005ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:42.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.707 7f56fc8f8700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e0003a60 0x7f56e0005ef0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f56e8006fc0 tx=0x7f56e800c0c0).stop 2021-04-09T18:31:42.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.708 7f56fc8f8700 1 -- 172.21.15.120:0/304227463 shutdown_connections 2021-04-09T18:31:42.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.708 7f56fc8f8700 1 --2- 172.21.15.120:0/304227463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56e0003a60 0x7f56e0005ef0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.708 7f56fc8f8700 1 -- 172.21.15.120:0/304227463 >> 172.21.15.120:0/304227463 conn(0x7f56f80d1590 msgr2=0x7f56f80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:42.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.708 7f56fc8f8700 1 -- 172.21.15.120:0/304227463 shutdown_connections 2021-04-09T18:31:42.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.708 7f56fc8f8700 1 -- 172.21.15.120:0/304227463 wait complete. 2021-04-09T18:31:42.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56fc8f8700 1 Processor -- start 2021-04-09T18:31:42.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56fc8f8700 1 -- start start 2021-04-09T18:31:42.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56fc8f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56f8187380 0x7f56f819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:42.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56fc8f8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56f8187780 0x7f56f819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:42.757 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56fc8f8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f819b5a0 0x7f56f81838d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:42.758 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56fc8f8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f819c920 con 0x7f56f819b5a0 2021-04-09T18:31:42.758 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56fc8f8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f819b9a0 con 0x7f56f8187380 2021-04-09T18:31:42.759 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56fc8f8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8183ef0 con 0x7f56f8187780 2021-04-09T18:31:42.760 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56f6e1d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f819b5a0 0x7f56f81838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:42.760 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56f6e1d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f819b5a0 0x7f56f81838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59570/0 (socket says 172.21.15.120:59570) 2021-04-09T18:31:42.760 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56f6e1d700 1 -- 172.21.15.120:0/3579985425 learned_addr learned my addr 172.21.15.120:0/3579985425 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:42.761 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56f661c700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56f8187380 0x7f56f819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:42.761 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.727 7f56f5e1b700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56f8187780 0x7f56f819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:42.761 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56f6e1d700 1 -- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56f8187780 msgr2=0x7f56f819af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:42.762 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56f6e1d700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56f8187780 0x7f56f819af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.762 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56f6e1d700 1 -- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56f8187380 msgr2=0x7f56f819c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:42.762 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56f6e1d700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56f8187380 0x7f56f819c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.763 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56f6e1d700 1 -- 172.21.15.120:0/3579985425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f8184110 con 0x7f56f819b5a0 2021-04-09T18:31:42.763 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56f6e1d700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f819b5a0 0x7f56f81838d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f56f0001e90 tx=0x7f56f000a8f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:42.763 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56e6ffd700 1 -- 172.21.15.120:0/3579985425 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f56f000ace0 con 0x7f56f819b5a0 2021-04-09T18:31:42.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56e6ffd700 1 -- 172.21.15.120:0/3579985425 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f0007030 con 0x7f56f819b5a0 2021-04-09T18:31:42.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f8184110 con 0x7f56f819b5a0 2021-04-09T18:31:42.764 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56e6ffd700 1 -- 172.21.15.120:0/3579985425 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f56f0004590 con 0x7f56f819b5a0 2021-04-09T18:31:42.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.728 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f8184110 con 0x7f56f819b5a0 2021-04-09T18:31:42.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.729 7f56e6ffd700 1 -- 172.21.15.120:0/3579985425 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f56f00043a0 con 0x7f56f819b5a0 2021-04-09T18:31:42.765 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.729 7f56e6ffd700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f56dc0188c0 0x7f56dc01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:42.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.729 7f56e6ffd700 1 -- 172.21.15.120:0/3579985425 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7f56f0032b40 con 0x7f56f819b5a0 2021-04-09T18:31:42.767 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.729 7f56f661c700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f56dc0188c0 0x7f56dc01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:42.767 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.729 7f56f661c700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f56dc0188c0 0x7f56dc01adc0 crc :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:42.768 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.752 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f819c920 con 0x7f56f819b5a0 2021-04-09T18:31:42.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.755 7f56e6ffd700 1 -- 172.21.15.120:0/3579985425 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f56f00011a0 con 0x7f56f819b5a0 2021-04-09T18:31:42.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.934 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56f819c920 con 0x7f56f819b5a0 2021-04-09T18:31:42.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.935 7f56e6ffd700 1 -- 172.21.15.120:0/3579985425 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f56f00043a0 con 0x7f56f819b5a0 2021-04-09T18:31:42.922 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2021-04-09T18:31:42.923 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:42.923 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:42.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f56dc0188c0 msgr2=0x7f56dc01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:42.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f56dc0188c0 0x7f56dc01adc0 crc :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f819b5a0 msgr2=0x7f56f81838d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:42.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f819b5a0 0x7f56f81838d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f56f0001e90 tx=0x7f56f000a8f0).stop 2021-04-09T18:31:42.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 shutdown_connections 2021-04-09T18:31:42.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f819b5a0 0x7f56f81838d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f56dc0188c0 0x7f56dc01adc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56f8187780 0x7f56f819af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 --2- 172.21.15.120:0/3579985425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56f8187380 0x7f56f819c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:42.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 >> 172.21.15.120:0/3579985425 conn(0x7f56f818dc90 msgr2=0x7f56f808fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:42.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 shutdown_connections 2021-04-09T18:31:42.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:42.937 7f56fc8f8700 1 -- 172.21.15.120:0/3579985425 wait complete. 2021-04-09T18:31:42.934 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:31:44.936 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:45.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.095 7fa61ea65700 1 Processor -- start 2021-04-09T18:31:45.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.095 7fa61ea65700 1 -- start start 2021-04-09T18:31:45.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa61ea65700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6180d7160 0x7fa6180d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:45.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa61ea65700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa6180d55a0 0x7fa6180d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:45.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa61ea65700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6180d6be0 con 0x7fa6180d5fc0 2021-04-09T18:31:45.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa61ea65700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6180d80f0 con 0x7fa6180d55a0 2021-04-09T18:31:45.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa61ea65700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6181a2ac0 con 0x7fa6180d7160 2021-04-09T18:31:45.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa617fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa6180d55a0 0x7fa6180d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:45.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa61d082700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa6180d5fc0 0x7fa6180d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54488/0 (socket says 172.21.15.120:54488) 2021-04-09T18:31:45.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa61d082700 1 -- 172.21.15.120:0/1636480263 learned_addr learned my addr 172.21.15.120:0/1636480263 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:31:45.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa61c881700 1 --2- 172.21.15.120:0/1636480263 >> v2:172.21.15.134:3300/0 conn(0x7fa6180d7160 0x7fa6180d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:45.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa617fff700 1 -- 172.21.15.120:0/1636480263 >> v2:172.21.15.134:3300/0 conn(0x7fa6180d7160 msgr2=0x7fa6180d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:45.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa617fff700 1 --2- 172.21.15.120:0/1636480263 >> v2:172.21.15.134:3300/0 conn(0x7fa6180d7160 0x7fa6180d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa6177fe700 1 -- 172.21.15.120:0/1636480263 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360707855 0 0) 0x7fa6100009b0 con 0x7fa6180d5fc0 2021-04-09T18:31:45.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa617fff700 1 -- 172.21.15.120:0/1636480263 >> v1:172.21.15.120:6789/0 conn(0x7fa6180d5fc0 legacy=0x7fa6180d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:45.106 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa617fff700 1 -- 172.21.15.120:0/1636480263 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6181ac1f0 con 0x7fa6180d55a0 2021-04-09T18:31:45.107 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.096 7fa617fff700 1 --2- 172.21.15.120:0/1636480263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6180d55a0 0x7fa6180d59a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fa6080069d0 tx=0x7fa608009e40).ready entity=mon.0 client_cookie=82aac4b12805bfbd server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:45.107 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa6177fe700 1 -- 172.21.15.120:0/1636480263 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa60800b510 con 0x7fa6180d55a0 2021-04-09T18:31:45.107 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa6177fe700 1 -- 172.21.15.120:0/1636480263 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60800b890 con 0x7fa6180d55a0 2021-04-09T18:31:45.107 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa6177fe700 1 -- 172.21.15.120:0/1636480263 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa60800bd70 con 0x7fa6180d55a0 2021-04-09T18:31:45.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa61ea65700 1 -- 172.21.15.120:0/1636480263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6180d55a0 msgr2=0x7fa6180d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:45.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa61ea65700 1 --2- 172.21.15.120:0/1636480263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6180d55a0 0x7fa6180d59a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fa6080069d0 tx=0x7fa608009e40).stop 2021-04-09T18:31:45.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa61ea65700 1 -- 172.21.15.120:0/1636480263 shutdown_connections 2021-04-09T18:31:45.108 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa61ea65700 1 --2- 172.21.15.120:0/1636480263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6180d55a0 0x7fa6180d59a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa61ea65700 1 --2- 172.21.15.120:0/1636480263 >> v2:172.21.15.134:3300/0 conn(0x7fa6180d7160 0x7fa6180d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa61ea65700 1 -- 172.21.15.120:0/1636480263 >> 172.21.15.120:0/1636480263 conn(0x7fa6180d1590 msgr2=0x7fa6180d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:45.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa61ea65700 1 -- 172.21.15.120:0/1636480263 shutdown_connections 2021-04-09T18:31:45.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.097 7fa61ea65700 1 -- 172.21.15.120:0/1636480263 wait complete. 2021-04-09T18:31:45.109 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.116 7fa61ea65700 1 Processor -- start 2021-04-09T18:31:45.110 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.116 7fa61ea65700 1 -- start start 2021-04-09T18:31:45.112 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61ea65700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa61817b4b0 0x7fa6181a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:45.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61ea65700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa61817b8b0 0x7fa61819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:45.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61ea65700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6181a1760 0x7fa61819ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:45.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61ea65700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61817be20 con 0x7fa6181a1760 2021-04-09T18:31:45.113 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61ea65700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6181a0550 con 0x7fa61817b4b0 2021-04-09T18:31:45.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61ea65700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6181a0770 con 0x7fa61817b8b0 2021-04-09T18:31:45.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61d082700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6181a1760 0x7fa61819ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:45.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61d082700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6181a1760 0x7fa61819ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59582/0 (socket says 172.21.15.120:59582) 2021-04-09T18:31:45.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61d082700 1 -- 172.21.15.120:0/2267416071 learned_addr learned my addr 172.21.15.120:0/2267416071 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:45.114 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61c881700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa61817b4b0 0x7fa6181a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:45.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa617fff700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa61817b8b0 0x7fa61819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:45.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61d082700 1 -- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa61817b8b0 msgr2=0x7fa61819f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:45.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61d082700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa61817b8b0 0x7fa61819f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.115 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61d082700 1 -- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa61817b4b0 msgr2=0x7fa6181a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:45.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61d082700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa61817b4b0 0x7fa6181a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61d082700 1 -- 172.21.15.120:0/2267416071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6181a0990 con 0x7fa6181a1760 2021-04-09T18:31:45.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61d082700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6181a1760 0x7fa61819ff30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fa6100014d0 tx=0x7fa61000a8a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:45.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa6157fa700 1 -- 172.21.15.120:0/2267416071 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa61000ac90 con 0x7fa6181a1760 2021-04-09T18:31:45.116 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa6157fa700 1 -- 172.21.15.120:0/2267416071 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6100043a0 con 0x7fa6181a1760 2021-04-09T18:31:45.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6181a0990 con 0x7fa6181a1760 2021-04-09T18:31:45.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.117 7fa6157fa700 1 -- 172.21.15.120:0/2267416071 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa610004880 con 0x7fa6181a1760 2021-04-09T18:31:45.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.118 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6181a0990 con 0x7fa6181a1760 2021-04-09T18:31:45.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.118 7fa6157fa700 1 -- 172.21.15.120:0/2267416071 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa610008000 con 0x7fa6181a1760 2021-04-09T18:31:45.117 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.118 7fa6157fa700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa5fc018930 0x7fa5fc01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:45.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.118 7fa6157fa700 1 -- 172.21.15.120:0/2267416071 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6537+0+0 (secure 0 0 0) 0x7fa610032d80 con 0x7fa6181a1760 2021-04-09T18:31:45.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.118 7fa61c881700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa5fc018930 0x7fa5fc01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:45.118 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.119 7fa61c881700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa5fc018930 0x7fa5fc01ae10 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:45.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.141 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61817a2b0 con 0x7fa6181a1760 2021-04-09T18:31:45.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.145 7fa6157fa700 1 -- 172.21.15.120:0/2267416071 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa610007070 con 0x7fa6181a1760 2021-04-09T18:31:45.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.322 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa61817a2b0 con 0x7fa6181a1760 2021-04-09T18:31:45.310 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.322 7fa6157fa700 1 -- 172.21.15.120:0/2267416071 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2110 (secure 0 0 0) 0x7fa6100043a0 con 0x7fa6181a1760 2021-04-09T18:31:45.310 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2021-04-09T18:31:45.310 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:45.311 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:30:07.841460","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5223":{"gid":5223,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":21,"addr":"172.21.15.120:6833/3326321867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3326321867},{"type":"v1","addr":"172.21.15.120:6833","nonce":3326321867}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:45.312 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.324 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa5fc018930 msgr2=0x7fa5fc01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:45.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa5fc018930 0x7fa5fc01ae10 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6181a1760 msgr2=0x7fa61819ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:45.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6181a1760 0x7fa61819ff30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fa6100014d0 tx=0x7fa61000a8a0).stop 2021-04-09T18:31:45.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 shutdown_connections 2021-04-09T18:31:45.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6181a1760 0x7fa61819ff30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa5fc018930 0x7fa5fc01ae10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa61817b8b0 0x7fa61819f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 --2- 172.21.15.120:0/2267416071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa61817b4b0 0x7fa6181a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:45.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 >> 172.21.15.120:0/2267416071 conn(0x7fa618185580 msgr2=0x7fa618188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:45.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 shutdown_connections 2021-04-09T18:31:45.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:45.325 7fa61ea65700 1 -- 172.21.15.120:0/2267416071 wait complete. 2021-04-09T18:31:45.322 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-04-09T18:31:45.831 INFO:tasks.ceph.osd.7.smithi134.stderr:2021-04-09 18:31:45.846 7f24776bd700 -1 bdev(0x556e68d5e700 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2021-04-09T18:31:47.323 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:47.493 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.485 7f719d7f0700 1 Processor -- start 2021-04-09T18:31:47.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.485 7f719d7f0700 1 -- start start 2021-04-09T18:31:47.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.485 7f719d7f0700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f71980d7160 0x7f71980d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.494 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.485 7f719d7f0700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71980d6be0 con 0x7f71980d6190 2021-04-09T18:31:47.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.485 7f719d7f0700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71981a2ac0 con 0x7f71980d55a0 2021-04-09T18:31:47.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.485 7f719d7f0700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71981a2ce0 con 0x7f71980d7160 2021-04-09T18:31:47.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.485 7f7197d75700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f71980d6190 0x7f71981ab1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54500/0 (socket says 172.21.15.120:54500) 2021-04-09T18:31:47.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.485 7f7197d75700 1 -- 172.21.15.120:0/3892947045 learned_addr learned my addr 172.21.15.120:0/3892947045 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:31:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197574700 1 --2- 172.21.15.120:0/3892947045 >> v2:172.21.15.134:3300/0 conn(0x7f71980d7160 0x7f71980d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990333612 0 0) 0x7f7190000d30 con 0x7f71980d6190 2021-04-09T18:31:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7180002fe0 con 0x7f71980d6190 2021-04-09T18:31:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2404350677 0 0) 0x7f7190001270 con 0x7f71980d6190 2021-04-09T18:31:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 >> v2:172.21.15.134:3300/0 conn(0x7f71980d7160 msgr2=0x7f71980d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 --2- 172.21.15.120:0/3892947045 >> v2:172.21.15.134:3300/0 conn(0x7f71980d7160 0x7f71980d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 >> v1:172.21.15.134:6789/0 conn(0x7f71980d55a0 legacy=0x7f71980d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980d6590 con 0x7f71980d6190 2021-04-09T18:31:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f7190001980 con 0x7f71980d6190 2021-04-09T18:31:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 >> v1:172.21.15.120:6789/0 conn(0x7f71980d6190 legacy=0x7f71981ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7180003a60 0x7f7180005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7180006790 0x7f7180008c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7180009590 0x7f718000bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718000c300 con 0x7f7180003a60 2021-04-09T18:31:47.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718000c520 con 0x7f7180006790 2021-04-09T18:31:47.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197574700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7180003a60 0x7f7180005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196572700 1 -- 172.21.15.120:0/3892947045 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7180050750 con 0x7f7180009590 2021-04-09T18:31:47.499 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196d73700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7180006790 0x7f7180008c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197d75700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7180009590 0x7f718000bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197574700 1 -- 172.21.15.120:0/3892947045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7180009590 msgr2=0x7f718000bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:47.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197574700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7180009590 0x7f718000bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197574700 1 -- 172.21.15.120:0/3892947045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7180006790 msgr2=0x7f7180008c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:47.500 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197574700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7180006790 0x7f7180008c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197d75700 1 -- 172.21.15.120:0/3892947045 reap_dead start 2021-04-09T18:31:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197574700 1 -- 172.21.15.120:0/3892947045 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800509b0 con 0x7f7180003a60 2021-04-09T18:31:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7196d73700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7180006790 0x7f7180008c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:31:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.486 7f7197574700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7180003a60 0x7f7180005ef0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f718800c470 tx=0x7f7188006c20).ready entity=mon.0 client_cookie=e05c1c937d4333c3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f7196572700 1 -- 172.21.15.120:0/3892947045 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71880090d0 con 0x7f7180003a60 2021-04-09T18:31:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f7196572700 1 -- 172.21.15.120:0/3892947045 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188009450 con 0x7f7180003a60 2021-04-09T18:31:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f7196572700 1 -- 172.21.15.120:0/3892947045 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7188009930 con 0x7f7180003a60 2021-04-09T18:31:47.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f719d7f0700 1 -- 172.21.15.120:0/3892947045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7180003a60 msgr2=0x7f7180005ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f719d7f0700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7180003a60 0x7f7180005ef0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f718800c470 tx=0x7f7188006c20).stop 2021-04-09T18:31:47.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f719d7f0700 1 -- 172.21.15.120:0/3892947045 shutdown_connections 2021-04-09T18:31:47.503 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f719d7f0700 1 --2- 172.21.15.120:0/3892947045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7180003a60 0x7f7180005ef0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f719d7f0700 1 -- 172.21.15.120:0/3892947045 >> 172.21.15.120:0/3892947045 conn(0x7f71980d1590 msgr2=0x7f71980d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:47.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f719d7f0700 1 -- 172.21.15.120:0/3892947045 shutdown_connections 2021-04-09T18:31:47.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.487 7f719d7f0700 1 -- 172.21.15.120:0/3892947045 wait complete. 2021-04-09T18:31:47.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.506 7f719d7f0700 1 Processor -- start 2021-04-09T18:31:47.504 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.506 7f719d7f0700 1 -- start start 2021-04-09T18:31:47.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f719d7f0700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71981a1510 0x7f71980b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f719d7f0700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7198191bf0 0x7f71980b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f719d7f0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71980b7c80 0x7f7198192540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f719d7f0700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7198192270 con 0x7f7198191bf0 2021-04-09T18:31:47.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f719d7f0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719809d2e0 con 0x7f71980b7c80 2021-04-09T18:31:47.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f719d7f0700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719809d500 con 0x7f71981a1510 2021-04-09T18:31:47.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7196d73700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7198191bf0 0x7f71980b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7196d73700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7198191bf0 0x7f71980b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59598/0 (socket says 172.21.15.120:59598) 2021-04-09T18:31:47.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7196d73700 1 -- 172.21.15.120:0/4157936935 learned_addr learned my addr 172.21.15.120:0/4157936935 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:47.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7197d75700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71980b7c80 0x7f7198192540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7197574700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71981a1510 0x7f71980b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.509 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7196d73700 1 -- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71981a1510 msgr2=0x7f71980b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7196d73700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71981a1510 0x7f71980b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7196d73700 1 -- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71980b7c80 msgr2=0x7f7198192540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7196d73700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71980b7c80 0x7f7198192540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7196d73700 1 -- 172.21.15.120:0/4157936935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198192b60 con 0x7f7198191bf0 2021-04-09T18:31:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f7196d73700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7198191bf0 0x7f71980b7660 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f718c006f10 tx=0x7f718c00b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f717ffff700 1 -- 172.21.15.120:0/4157936935 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f718c00bd80 con 0x7f7198191bf0 2021-04-09T18:31:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f717ffff700 1 -- 172.21.15.120:0/4157936935 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c006030 con 0x7f7198191bf0 2021-04-09T18:31:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f717ffff700 1 -- 172.21.15.120:0/4157936935 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f718c0052e0 con 0x7f7198191bf0 2021-04-09T18:31:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.507 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7198192b60 con 0x7f7198191bf0 2021-04-09T18:31:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.508 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7198192b60 con 0x7f7198191bf0 2021-04-09T18:31:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.508 7f717ffff700 1 -- 172.21.15.120:0/4157936935 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f718c0052e0 con 0x7f7198191bf0 2021-04-09T18:31:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.508 7f717ffff700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7178018930 0x7f717801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.508 7f717ffff700 1 -- 172.21.15.120:0/4157936935 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f718c032e20 con 0x7f7198191bf0 2021-04-09T18:31:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.508 7f7197574700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7178018930 0x7f717801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.509 7f7197574700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7178018930 0x7f717801ae10 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:47.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.531 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7198192220 con 0x7f7198191bf0 2021-04-09T18:31:47.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.535 7f717ffff700 1 -- 172.21.15.120:0/4157936935 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f718c006ba0 con 0x7f7198191bf0 2021-04-09T18:31:47.702 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.715 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7198192220 con 0x7f7198191bf0 2021-04-09T18:31:47.703 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.715 7f717ffff700 1 -- 172.21.15.120:0/4157936935 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f718c006030 con 0x7f7198191bf0 2021-04-09T18:31:47.703 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 49 2021-04-09T18:31:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:47.704 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:31:45.824445","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4997":{"gid":4997,"name":"b","rank":0,"incarnation":49,"state":"up:replay","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:47.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7178018930 msgr2=0x7f717801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7178018930 0x7f717801ae10 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7198191bf0 msgr2=0x7f71980b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7198191bf0 0x7f71980b7660 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f718c006f10 tx=0x7f718c00b990).stop 2021-04-09T18:31:47.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 shutdown_connections 2021-04-09T18:31:47.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71980b7c80 0x7f7198192540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7198191bf0 0x7f71980b7660 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7178018930 0x7f717801ae10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 --2- 172.21.15.120:0/4157936935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71981a1510 0x7f71980b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 >> 172.21.15.120:0/4157936935 conn(0x7f719808f950 msgr2=0x7f719808eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:47.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 shutdown_connections 2021-04-09T18:31:47.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.718 7f719d7f0700 1 -- 172.21.15.120:0/4157936935 wait complete. 2021-04-09T18:31:47.715 INFO:tasks.mds_thrash.fs.[None]:mds.a down, removed from mdsmap 2021-04-09T18:31:47.715 INFO:tasks.mds_thrash.fs.[None]:waiting for mds cluster to stabilize... 2021-04-09T18:31:47.716 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:47.878 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.870 7f9127e9e700 1 Processor -- start 2021-04-09T18:31:47.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.870 7f9127e9e700 1 -- start start 2021-04-09T18:31:47.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.870 7f9127e9e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f91200dc6b0 0x7f91200d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.879 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.870 7f9127e9e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91200d6760 0x7f91200d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.870 7f9127e9e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91200d61e0 con 0x7f91200eac40 2021-04-09T18:31:47.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.870 7f9127e9e700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9120100d60 con 0x7f91200d6760 2021-04-09T18:31:47.880 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.870 7f9127e9e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91200eaa10 con 0x7f91200dc6b0 2021-04-09T18:31:47.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f91264bb700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91200d6760 0x7f91200d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f91264bb700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91200d6760 0x7f91200d6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59608/0 (socket says 172.21.15.120:59608) 2021-04-09T18:31:47.881 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f91264bb700 1 -- 172.21.15.120:0/19085859 learned_addr learned my addr 172.21.15.120:0/19085859 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:47.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f91254b9700 1 --2- 172.21.15.120:0/19085859 >> v2:172.21.15.134:3300/0 conn(0x7f91200dc6b0 0x7f91200d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f91264bb700 1 -- 172.21.15.120:0/19085859 >> v2:172.21.15.134:3300/0 conn(0x7f91200dc6b0 msgr2=0x7f91200d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:47.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f91264bb700 1 --2- 172.21.15.120:0/19085859 >> v2:172.21.15.134:3300/0 conn(0x7f91200dc6b0 0x7f91200d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.885 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f91264bb700 1 -- 172.21.15.120:0/19085859 >> v1:172.21.15.134:6789/0 conn(0x7f91200eac40 legacy=0x7f9120088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f91264bb700 1 -- 172.21.15.120:0/19085859 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200dcab0 con 0x7f91200d6760 2021-04-09T18:31:47.886 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f91264bb700 1 --2- 172.21.15.120:0/19085859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200d6760 0x7f91200d6b60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f9118006f00 tx=0x7f9118009e90).ready entity=mon.0 client_cookie=47f3447fc8605bc1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:47.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f9124cb8700 1 -- 172.21.15.120:0/19085859 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f911800b300 con 0x7f91200d6760 2021-04-09T18:31:47.887 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f9124cb8700 1 -- 172.21.15.120:0/19085859 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911800b640 con 0x7f91200d6760 2021-04-09T18:31:47.888 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f9124cb8700 1 -- 172.21.15.120:0/19085859 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f911800bb20 con 0x7f91200d6760 2021-04-09T18:31:47.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f9127e9e700 1 -- 172.21.15.120:0/19085859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200d6760 msgr2=0x7f91200d6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.871 7f9127e9e700 1 --2- 172.21.15.120:0/19085859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200d6760 0x7f91200d6b60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f9118006f00 tx=0x7f9118009e90).stop 2021-04-09T18:31:47.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.872 7f9127e9e700 1 -- 172.21.15.120:0/19085859 shutdown_connections 2021-04-09T18:31:47.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.872 7f9127e9e700 1 --2- 172.21.15.120:0/19085859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200d6760 0x7f91200d6b60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.872 7f9127e9e700 1 --2- 172.21.15.120:0/19085859 >> v2:172.21.15.134:3300/0 conn(0x7f91200dc6b0 0x7f91200d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.872 7f9127e9e700 1 -- 172.21.15.120:0/19085859 >> 172.21.15.120:0/19085859 conn(0x7f91200e93c0 msgr2=0x7f9120100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:47.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.872 7f9127e9e700 1 -- 172.21.15.120:0/19085859 shutdown_connections 2021-04-09T18:31:47.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.872 7f9127e9e700 1 -- 172.21.15.120:0/19085859 wait complete. 2021-04-09T18:31:47.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f9127e9e700 1 Processor -- start 2021-04-09T18:31:47.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f9127e9e700 1 -- start start 2021-04-09T18:31:47.901 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f9127e9e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9120089700 0x7f91200a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f9127e9e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9120089b00 0x7f91200a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f9127e9e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200a3500 0x7f91200a2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f9127e9e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912008a070 con 0x7f91200a3500 2021-04-09T18:31:47.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f9127e9e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200a2690 con 0x7f9120089b00 2021-04-09T18:31:47.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f9127e9e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9120090ac0 con 0x7f9120089700 2021-04-09T18:31:47.906 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f91264bb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200a3500 0x7f91200a2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f91264bb700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200a3500 0x7f91200a2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59616/0 (socket says 172.21.15.120:59616) 2021-04-09T18:31:47.910 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f91264bb700 1 -- 172.21.15.120:0/274562938 learned_addr learned my addr 172.21.15.120:0/274562938 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:47.911 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f9125cba700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9120089700 0x7f91200a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.913 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.891 7f91254b9700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9120089b00 0x7f91200a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.913 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f91264bb700 1 -- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9120089700 msgr2=0x7f91200a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.914 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f91264bb700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9120089700 0x7f91200a2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.915 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f91264bb700 1 -- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9120089b00 msgr2=0x7f91200a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:47.916 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f91264bb700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9120089b00 0x7f91200a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:47.916 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f91264bb700 1 -- 172.21.15.120:0/274562938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9120090ce0 con 0x7f91200a3500 2021-04-09T18:31:47.917 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f91264bb700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200a3500 0x7f91200a2070 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f91180099f0 tx=0x7f911800bc60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:47.918 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f91167fc700 1 -- 172.21.15.120:0/274562938 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9118003030 con 0x7f91200a3500 2021-04-09T18:31:47.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f91167fc700 1 -- 172.21.15.120:0/274562938 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911800bda0 con 0x7f91200a3500 2021-04-09T18:31:47.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f9127e9e700 1 -- 172.21.15.120:0/274562938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9120090ce0 con 0x7f91200a3500 2021-04-09T18:31:47.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f91167fc700 1 -- 172.21.15.120:0/274562938 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9118001460 con 0x7f91200a3500 2021-04-09T18:31:47.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.892 7f9127e9e700 1 -- 172.21.15.120:0/274562938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9120090ce0 con 0x7f91200a3500 2021-04-09T18:31:47.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.893 7f91167fc700 1 -- 172.21.15.120:0/274562938 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9118005820 con 0x7f91200a3500 2021-04-09T18:31:47.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.893 7f91167fc700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9108018930 0x7f910801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:47.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.893 7f91167fc700 1 -- 172.21.15.120:0/274562938 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f91180331b0 con 0x7f91200a3500 2021-04-09T18:31:47.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.893 7f9125cba700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9108018930 0x7f910801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:47.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.893 7f9125cba700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9108018930 0x7f910801ae10 crc :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:47.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.916 7f9127e9e700 1 -- 172.21.15.120:0/274562938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9120088500 con 0x7f91200a3500 2021-04-09T18:31:47.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:47.920 7f91167fc700 1 -- 172.21.15.120:0/274562938 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f9118000cc0 con 0x7f91200a3500 2021-04-09T18:31:48.085 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.098 7f9127e9e700 1 -- 172.21.15.120:0/274562938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91200ccba0 con 0x7f91200a3500 2021-04-09T18:31:48.086 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.098 7f91167fc700 1 -- 172.21.15.120:0/274562938 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+1770 (secure 0 0 0) 0x7f911801fae0 con 0x7f91200a3500 2021-04-09T18:31:48.086 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 49 2021-04-09T18:31:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:48.087 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:31:45.824445","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4997":{"gid":4997,"name":"b","rank":0,"incarnation":49,"state":"up:replay","state_seq":2,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:48.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 -- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9108018930 msgr2=0x7f910801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:48.089 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9108018930 0x7f910801ae10 crc :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:48.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 -- 172.21.15.120:0/274562938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200a3500 msgr2=0x7f91200a2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:48.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200a3500 0x7f91200a2070 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f91180099f0 tx=0x7f911800bc60).stop 2021-04-09T18:31:48.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 -- 172.21.15.120:0/274562938 shutdown_connections 2021-04-09T18:31:48.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91200a3500 0x7f91200a2070 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:48.090 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9120089b00 0x7f91200a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:48.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9108018930 0x7f910801ae10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:48.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 --2- 172.21.15.120:0/274562938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9120089700 0x7f91200a2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:48.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 -- 172.21.15.120:0/274562938 >> 172.21.15.120:0/274562938 conn(0x7f91200ab640 msgr2=0x7f912009fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:48.091 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 -- 172.21.15.120:0/274562938 shutdown_connections 2021-04-09T18:31:48.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:48.101 7f9127e9e700 1 -- 172.21.15.120:0/274562938 wait complete. 2021-04-09T18:31:48.098 INFO:tasks.mds_thrash.fs.[None]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 49, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-04-09 18:19:55.049244", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 49, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4997": { "addr": "172.21.15.134:6835/2928390315", "addrs": { "addrvec": [ { "addr": "172.21.15.134:6834", "nonce": 2928390315, "type": "v2" }, { "addr": "172.21.15.134:6835", "nonce": 2928390315, "type": "v1" } ] }, "export_targets": [], "features": 4611087854035861503, "flags": 0, "gid": 4997, "incarnation": 49, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "-1 (unspecified)", "modified": "2021-04-09 18:31:45.824445", "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4997 } } } ], "standbys": [] } 2021-04-09T18:31:50.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:50.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.253 7f88bbc59700 1 Processor -- start 2021-04-09T18:31:50.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88bbc59700 1 -- start start 2021-04-09T18:31:50.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88bbc59700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f88b40d7160 0x7f88b40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:50.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88bbc59700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88b40d55a0 0x7f88b40d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:50.262 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88bbc59700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b40d6be0 con 0x7f88b40d5fc0 2021-04-09T18:31:50.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88bbc59700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b40d80f0 con 0x7f88b40d7160 2021-04-09T18:31:50.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88bbc59700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b41a2ac0 con 0x7f88b40d55a0 2021-04-09T18:31:50.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88b9a75700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f88b40d7160 0x7f88b40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:50.263 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88ba276700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f88b40d5fc0 0x7f88b40d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54540/0 (socket says 172.21.15.120:54540) 2021-04-09T18:31:50.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88ba276700 1 -- 172.21.15.120:0/3536704853 learned_addr learned my addr 172.21.15.120:0/3536704853 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:31:50.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.254 7f88b9274700 1 --2- 172.21.15.120:0/3536704853 >> v2:172.21.15.134:3300/0 conn(0x7f88b40d55a0 0x7f88b40d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:50.264 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88b8a73700 1 -- 172.21.15.120:0/3536704853 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953130407 0 0) 0x7f88ac0009b0 con 0x7f88b40d5fc0 2021-04-09T18:31:50.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88b9a75700 1 -- 172.21.15.120:0/3536704853 >> v2:172.21.15.134:3300/0 conn(0x7f88b40d55a0 msgr2=0x7f88b40d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:50.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88b9a75700 1 --2- 172.21.15.120:0/3536704853 >> v2:172.21.15.134:3300/0 conn(0x7f88b40d55a0 0x7f88b40d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88b9a75700 1 -- 172.21.15.120:0/3536704853 >> v1:172.21.15.120:6789/0 conn(0x7f88b40d5fc0 legacy=0x7f88b40d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:50.265 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88b9a75700 1 -- 172.21.15.120:0/3536704853 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b41ac1f0 con 0x7f88b40d7160 2021-04-09T18:31:50.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88b9a75700 1 --2- 172.21.15.120:0/3536704853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40d7160 0x7f88b40d7560 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f88b00069d0 tx=0x7f88b0009e40).ready entity=mon.0 client_cookie=eebb814e75625335 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:50.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88b8a73700 1 -- 172.21.15.120:0/3536704853 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88b000b510 con 0x7f88b40d7160 2021-04-09T18:31:50.266 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88b8a73700 1 -- 172.21.15.120:0/3536704853 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b000b890 con 0x7f88b40d7160 2021-04-09T18:31:50.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88b8a73700 1 -- 172.21.15.120:0/3536704853 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88b000bd70 con 0x7f88b40d7160 2021-04-09T18:31:50.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88bbc59700 1 -- 172.21.15.120:0/3536704853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40d7160 msgr2=0x7f88b40d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:50.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.255 7f88bbc59700 1 --2- 172.21.15.120:0/3536704853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40d7160 0x7f88b40d7560 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f88b00069d0 tx=0x7f88b0009e40).stop 2021-04-09T18:31:50.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.256 7f88bbc59700 1 -- 172.21.15.120:0/3536704853 shutdown_connections 2021-04-09T18:31:50.267 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.256 7f88bbc59700 1 --2- 172.21.15.120:0/3536704853 >> v2:172.21.15.134:3300/0 conn(0x7f88b40d55a0 0x7f88b40d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.256 7f88bbc59700 1 --2- 172.21.15.120:0/3536704853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40d7160 0x7f88b40d7560 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.256 7f88bbc59700 1 -- 172.21.15.120:0/3536704853 >> 172.21.15.120:0/3536704853 conn(0x7f88b40d1590 msgr2=0x7f88b40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:50.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.256 7f88bbc59700 1 -- 172.21.15.120:0/3536704853 shutdown_connections 2021-04-09T18:31:50.268 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.256 7f88bbc59700 1 -- 172.21.15.120:0/3536704853 wait complete. 2021-04-09T18:31:50.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.275 7f88bbc59700 1 Processor -- start 2021-04-09T18:31:50.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.275 7f88bbc59700 1 -- start start 2021-04-09T18:31:50.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.275 7f88bbc59700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b41830d0 0x7f88b40915f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:50.272 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.275 7f88bbc59700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b41837a0 0x7f88b4183ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:50.273 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.275 7f88bbc59700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40ab8d0 0x7f88b40abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:50.273 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.275 7f88bbc59700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4091070 con 0x7f88b40ab8d0 2021-04-09T18:31:50.273 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.275 7f88bbc59700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4090d30 con 0x7f88b41837a0 2021-04-09T18:31:50.273 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.275 7f88bbc59700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4091c10 con 0x7f88b41830d0 2021-04-09T18:31:50.273 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88ba276700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40ab8d0 0x7f88b40abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:50.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88b9274700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b41837a0 0x7f88b4183ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:50.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88ba276700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40ab8d0 0x7f88b40abcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59636/0 (socket says 172.21.15.120:59636) 2021-04-09T18:31:50.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88ba276700 1 -- 172.21.15.120:0/713311872 learned_addr learned my addr 172.21.15.120:0/713311872 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:50.274 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88b9a75700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b41830d0 0x7f88b40915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:50.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88ba276700 1 -- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b41830d0 msgr2=0x7f88b40915f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:50.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88ba276700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b41830d0 0x7f88b40915f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88ba276700 1 -- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b41837a0 msgr2=0x7f88b4183ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:50.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88ba276700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b41837a0 0x7f88b4183ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.275 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88ba276700 1 -- 172.21.15.120:0/713311872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b41841c0 con 0x7f88b40ab8d0 2021-04-09T18:31:50.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88b9274700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b41837a0 0x7f88b4183ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:31:50.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88ba276700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40ab8d0 0x7f88b40abcd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f88ac0014d0 tx=0x7f88ac00a8a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:50.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88aa7fc700 1 -- 172.21.15.120:0/713311872 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88ac00ac90 con 0x7f88b40ab8d0 2021-04-09T18:31:50.276 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88aa7fc700 1 -- 172.21.15.120:0/713311872 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac0043a0 con 0x7f88b40ab8d0 2021-04-09T18:31:50.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88bbc59700 1 -- 172.21.15.120:0/713311872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b41841c0 con 0x7f88b40ab8d0 2021-04-09T18:31:50.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88aa7fc700 1 -- 172.21.15.120:0/713311872 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88ac004880 con 0x7f88b40ab8d0 2021-04-09T18:31:50.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.276 7f88bbc59700 1 -- 172.21.15.120:0/713311872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b41841c0 con 0x7f88b40ab8d0 2021-04-09T18:31:50.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.277 7f88aa7fc700 1 -- 172.21.15.120:0/713311872 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f88ac004580 con 0x7f88b40ab8d0 2021-04-09T18:31:50.277 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.277 7f88aa7fc700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f889c018930 0x7f889c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:50.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.277 7f88aa7fc700 1 -- 172.21.15.120:0/713311872 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f88ac032e20 con 0x7f88b40ab8d0 2021-04-09T18:31:50.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.277 7f88b9a75700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f889c018930 0x7f889c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:50.278 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.277 7f88b9a75700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f889c018930 0x7f889c01ae10 crc :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:50.287 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.300 7f88bbc59700 1 -- 172.21.15.120:0/713311872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b417a2b0 con 0x7f88b40ab8d0 2021-04-09T18:31:50.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.304 7f88aa7fc700 1 -- 172.21.15.120:0/713311872 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f88ac007070 con 0x7f88b40ab8d0 2021-04-09T18:31:50.474 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.487 7f88bbc59700 1 -- 172.21.15.120:0/713311872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88b417a2b0 con 0x7f88b40ab8d0 2021-04-09T18:31:50.475 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.488 7f88aa7fc700 1 -- 172.21.15.120:0/713311872 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+1774 (secure 0 0 0) 0x7f88ac0043a0 con 0x7f88b40ab8d0 2021-04-09T18:31:50.475 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 50 2021-04-09T18:31:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:50.476 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:31:50.419567","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4997":{"gid":4997,"name":"b","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":27,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:50.478 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.490 7f88bbc59700 1 -- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f889c018930 msgr2=0x7f889c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:50.478 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.490 7f88bbc59700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f889c018930 0x7f889c01ae10 crc :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.478 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.490 7f88bbc59700 1 -- 172.21.15.120:0/713311872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40ab8d0 msgr2=0x7f88b40abcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:50.479 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.491 7f88bbc59700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40ab8d0 0x7f88b40abcd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f88ac0014d0 tx=0x7f88ac00a8a0).stop 2021-04-09T18:31:50.479 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.491 7f88bbc59700 1 -- 172.21.15.120:0/713311872 shutdown_connections 2021-04-09T18:31:50.479 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.491 7f88bbc59700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88b40ab8d0 0x7f88b40abcd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.480 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.491 7f88bbc59700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b41837a0 0x7f88b4183ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.480 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.491 7f88bbc59700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f889c018930 0x7f889c01ae10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.480 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.491 7f88bbc59700 1 --2- 172.21.15.120:0/713311872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b41830d0 0x7f88b40915f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:50.480 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.491 7f88bbc59700 1 -- 172.21.15.120:0/713311872 >> 172.21.15.120:0/713311872 conn(0x7f88b4185580 msgr2=0x7f88b4188f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:50.481 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.491 7f88bbc59700 1 -- 172.21.15.120:0/713311872 shutdown_connections 2021-04-09T18:31:50.481 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:50.491 7f88bbc59700 1 -- 172.21.15.120:0/713311872 wait complete. 2021-04-09T18:31:50.488 INFO:tasks.mds_thrash.fs.[None]:no change 2021-04-09T18:31:52.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:52.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.692 7f24a8441700 1 Processor -- start 2021-04-09T18:31:52.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.692 7f24a8441700 1 -- start start 2021-04-09T18:31:52.705 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.692 7f24a8441700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f24a00d7160 0x7f24a00d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.692 7f24a8441700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f24a00d55a0 0x7f24a00d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.692 7f24a8441700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a00d6be0 con 0x7f24a00d5fc0 2021-04-09T18:31:52.706 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.692 7f24a8441700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a00d80f0 con 0x7f24a00d7160 2021-04-09T18:31:52.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.692 7f24a8441700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a01a2ac0 con 0x7f24a00d55a0 2021-04-09T18:31:52.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.692 7f24a625d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f24a00d7160 0x7f24a00d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.692 7f24a6a5e700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f24a00d5fc0 0x7f24a00d63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54568/0 (socket says 172.21.15.120:54568) 2021-04-09T18:31:52.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.693 7f24a625d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f24a00d7160 0x7f24a00d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59652/0 (socket says 172.21.15.120:59652) 2021-04-09T18:31:52.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.693 7f24a6a5e700 1 -- 172.21.15.120:0/1372945850 learned_addr learned my addr 172.21.15.120:0/1372945850 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:31:52.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.693 7f24a5a5c700 1 --2- 172.21.15.120:0/1372945850 >> v2:172.21.15.134:3300/0 conn(0x7f24a00d55a0 0x7f24a00d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.693 7f24a625d700 1 -- 172.21.15.120:0/1372945850 >> v2:172.21.15.134:3300/0 conn(0x7f24a00d55a0 msgr2=0x7f24a00d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:52.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.693 7f24a625d700 1 --2- 172.21.15.120:0/1372945850 >> v2:172.21.15.134:3300/0 conn(0x7f24a00d55a0 0x7f24a00d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.693 7f24a625d700 1 -- 172.21.15.120:0/1372945850 >> v1:172.21.15.120:6789/0 conn(0x7f24a00d5fc0 legacy=0x7f24a00d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.693 7f24a625d700 1 -- 172.21.15.120:0/1372945850 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a01ac1f0 con 0x7f24a00d7160 2021-04-09T18:31:52.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.693 7f24a625d700 1 --2- 172.21.15.120:0/1372945850 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a00d7160 0x7f24a00d7560 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f249c0069d0 tx=0x7f249c009e40).ready entity=mon.0 client_cookie=48d45abbb7d17e00 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.694 7f24a525b700 1 -- 172.21.15.120:0/1372945850 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f249c00b510 con 0x7f24a00d7160 2021-04-09T18:31:52.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.694 7f24a525b700 1 -- 172.21.15.120:0/1372945850 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c00b790 con 0x7f24a00d7160 2021-04-09T18:31:52.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.694 7f24a525b700 1 -- 172.21.15.120:0/1372945850 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f249c00bcb0 con 0x7f24a00d7160 2021-04-09T18:31:52.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.695 7f24a8441700 1 -- 172.21.15.120:0/1372945850 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a00d7160 msgr2=0x7f24a00d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.695 7f24a8441700 1 --2- 172.21.15.120:0/1372945850 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a00d7160 0x7f24a00d7560 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f249c0069d0 tx=0x7f249c009e40).stop 2021-04-09T18:31:52.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.695 7f24a8441700 1 -- 172.21.15.120:0/1372945850 shutdown_connections 2021-04-09T18:31:52.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.695 7f24a8441700 1 --2- 172.21.15.120:0/1372945850 >> v2:172.21.15.134:3300/0 conn(0x7f24a00d55a0 0x7f24a00d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.695 7f24a8441700 1 --2- 172.21.15.120:0/1372945850 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a00d7160 0x7f24a00d7560 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.695 7f24a8441700 1 -- 172.21.15.120:0/1372945850 >> 172.21.15.120:0/1372945850 conn(0x7f24a00d1590 msgr2=0x7f24a00d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:52.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.695 7f24a8441700 1 -- 172.21.15.120:0/1372945850 shutdown_connections 2021-04-09T18:31:52.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.695 7f24a8441700 1 -- 172.21.15.120:0/1372945850 wait complete. 2021-04-09T18:31:52.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.718 7f24a8441700 1 Processor -- start 2021-04-09T18:31:52.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.718 7f24a8441700 1 -- start start 2021-04-09T18:31:52.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a8441700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a0188b20 0x7f24a019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.714 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a8441700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a0188540 0x7f24a0182ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a8441700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a017b5c0 0x7f24a017b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a8441700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a0183860 con 0x7f24a017b5c0 2021-04-09T18:31:52.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a8441700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01a2140 con 0x7f24a0188540 2021-04-09T18:31:52.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a8441700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a0182960 con 0x7f24a0188b20 2021-04-09T18:31:52.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a6a5e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a017b5c0 0x7f24a017b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a6a5e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a017b5c0 0x7f24a017b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59662/0 (socket says 172.21.15.120:59662) 2021-04-09T18:31:52.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a6a5e700 1 -- 172.21.15.120:0/1774030526 learned_addr learned my addr 172.21.15.120:0/1774030526 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:52.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a625d700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a0188b20 0x7f24a019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a5a5c700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a0188540 0x7f24a0182ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a6a5e700 1 -- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a0188b20 msgr2=0x7f24a019c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a6a5e700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a0188b20 0x7f24a019c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a6a5e700 1 -- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a0188540 msgr2=0x7f24a0182ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a6a5e700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a0188540 0x7f24a0182ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.719 7f24a6a5e700 1 -- 172.21.15.120:0/1774030526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0183500 con 0x7f24a017b5c0 2021-04-09T18:31:52.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.720 7f24a6a5e700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a017b5c0 0x7f24a017b9c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f2498001400 tx=0x7f249800a900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.720 7f2496ffd700 1 -- 172.21.15.120:0/1774030526 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f249800acf0 con 0x7f24a017b5c0 2021-04-09T18:31:52.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.720 7f2496ffd700 1 -- 172.21.15.120:0/1774030526 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2498000c10 con 0x7f24a017b5c0 2021-04-09T18:31:52.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.720 7f24a8441700 1 -- 172.21.15.120:0/1774030526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a0183500 con 0x7f24a017b5c0 2021-04-09T18:31:52.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.720 7f2496ffd700 1 -- 172.21.15.120:0/1774030526 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2498004590 con 0x7f24a017b5c0 2021-04-09T18:31:52.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.720 7f24a8441700 1 -- 172.21.15.120:0/1774030526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a0183500 con 0x7f24a017b5c0 2021-04-09T18:31:52.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.721 7f2496ffd700 1 -- 172.21.15.120:0/1774030526 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f24980045b0 con 0x7f24a017b5c0 2021-04-09T18:31:52.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.721 7f2496ffd700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2488018930 0x7f248801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:52.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.721 7f2496ffd700 1 -- 172.21.15.120:0/1774030526 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f2498032e80 con 0x7f24a017b5c0 2021-04-09T18:31:52.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.721 7f24a625d700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2488018930 0x7f248801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:52.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.721 7f24a625d700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2488018930 0x7f248801ae10 crc :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:52.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.733 7f24a8441700 1 -- 172.21.15.120:0/1774030526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a017a6b0 con 0x7f24a017b5c0 2021-04-09T18:31:52.724 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.737 7f2496ffd700 1 -- 172.21.15.120:0/1774030526 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f24980043a0 con 0x7f24a017b5c0 2021-04-09T18:31:52.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.945 7f24a8441700 1 -- 172.21.15.120:0/1774030526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24a017a6b0 con 0x7f24a017b5c0 2021-04-09T18:31:52.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.945 7f2496ffd700 1 -- 172.21.15.120:0/1774030526 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+1771 (secure 0 0 0) 0x7f24980045b0 con 0x7f24a017b5c0 2021-04-09T18:31:52.933 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 52 2021-04-09T18:31:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:52.934 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:31:52.424898","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4997":{"gid":4997,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":29,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 -- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2488018930 msgr2=0x7f248801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2488018930 0x7f248801ae10 crc :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 -- 172.21.15.120:0/1774030526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a017b5c0 msgr2=0x7f24a017b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a017b5c0 0x7f24a017b9c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f2498001400 tx=0x7f249800a900).stop 2021-04-09T18:31:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 -- 172.21.15.120:0/1774030526 shutdown_connections 2021-04-09T18:31:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a017b5c0 0x7f24a017b9c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24a0188540 0x7f24a0182ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.937 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f2488018930 0x7f248801ae10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 --2- 172.21.15.120:0/1774030526 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24a0188b20 0x7f24a019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:52.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 -- 172.21.15.120:0/1774030526 >> 172.21.15.120:0/1774030526 conn(0x7f24a019cd60 msgr2=0x7f24a019ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:52.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.948 7f24a8441700 1 -- 172.21.15.120:0/1774030526 shutdown_connections 2021-04-09T18:31:52.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:52.949 7f24a8441700 1 -- 172.21.15.120:0/1774030526 wait complete. 2021-04-09T18:31:52.945 INFO:tasks.mds_thrash.fs.[None]:mds.b has gained rank=0, replacing gid=5223 2021-04-09T18:31:52.946 INFO:tasks.mds_thrash.fs.[None]:waiting for 5 secs before reviving mds.a 2021-04-09T18:31:57.947 INFO:tasks.mds_thrash.fs.[None]:reviving mds.a 2021-04-09T18:31:57.947 INFO:tasks.ceph.mds.a:Restarting daemon 2021-04-09T18:31:57.947 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-04-09T18:31:57.951 INFO:tasks.ceph.mds.a:Started 2021-04-09T18:31:57.951 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:31:58.112 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2021-04-09T18:31:58.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.125 7fa04127b700 1 Processor -- start 2021-04-09T18:31:58.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.125 7fa04127b700 1 -- start start 2021-04-09T18:31:58.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa04127b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa03c0d7160 0x7fa03c0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:58.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa04127b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c0d55a0 0x7fa03c0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:58.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa04127b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa03c0d5fc0 0x7fa03c0d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:58.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa04127b700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c0e80a0 con 0x7fa03c0d7160 2021-04-09T18:31:58.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa04127b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c0d80f0 con 0x7fa03c0d5fc0 2021-04-09T18:31:58.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa04127b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0d6be0 con 0x7fa03c0d55a0 2021-04-09T18:31:58.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa03b07d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa03c0d7160 0x7fa03c0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:58.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa03b07d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa03c0d7160 0x7fa03c0d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59728/0 (socket says 172.21.15.120:59728) 2021-04-09T18:31:58.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa03b07d700 1 -- 172.21.15.120:0/3511826677 learned_addr learned my addr 172.21.15.120:0/3511826677 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:58.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa03b87e700 1 --2- 172.21.15.120:0/3511826677 >> v2:172.21.15.134:3300/0 conn(0x7fa03c0d5fc0 0x7fa03c0d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:58.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa033fff700 1 --2- 172.21.15.120:0/3511826677 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c0d55a0 0x7fa03c0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:58.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa03b07d700 1 -- 172.21.15.120:0/3511826677 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c0d55a0 msgr2=0x7fa03c0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:58.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa03b07d700 1 --2- 172.21.15.120:0/3511826677 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c0d55a0 0x7fa03c0d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa03b07d700 1 -- 172.21.15.120:0/3511826677 >> v2:172.21.15.134:3300/0 conn(0x7fa03c0d5fc0 msgr2=0x7fa03c0d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:31:58.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa03b07d700 1 --2- 172.21.15.120:0/3511826677 >> v2:172.21.15.134:3300/0 conn(0x7fa03c0d5fc0 0x7fa03c0d63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.126 7fa03b07d700 1 -- 172.21.15.120:0/3511826677 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c1a2ac0 con 0x7fa03c0d7160 2021-04-09T18:31:58.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.127 7fa03b07d700 1 --2- 172.21.15.120:0/3511826677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0d7160 0x7fa03c0d7560 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fa02c006700 tx=0x7fa02c009b80).ready entity=mon.0 client_cookie=148905a40d7ee41f server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:58.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.127 7fa03a87c700 1 -- 172.21.15.120:0/3511826677 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa02c006340 con 0x7fa03c0d7160 2021-04-09T18:31:58.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.127 7fa03a87c700 1 -- 172.21.15.120:0/3511826677 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c00c0c0 con 0x7fa03c0d7160 2021-04-09T18:31:58.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.127 7fa03a87c700 1 -- 172.21.15.120:0/3511826677 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa02c00c5a0 con 0x7fa03c0d7160 2021-04-09T18:31:58.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.128 7fa04127b700 1 -- 172.21.15.120:0/3511826677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0d7160 msgr2=0x7fa03c0d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:58.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.128 7fa04127b700 1 --2- 172.21.15.120:0/3511826677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0d7160 0x7fa03c0d7560 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fa02c006700 tx=0x7fa02c009b80).stop 2021-04-09T18:31:58.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.129 7fa04127b700 1 -- 172.21.15.120:0/3511826677 shutdown_connections 2021-04-09T18:31:58.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.129 7fa04127b700 1 --2- 172.21.15.120:0/3511826677 >> v2:172.21.15.134:3300/0 conn(0x7fa03c0d5fc0 0x7fa03c0d63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.129 7fa04127b700 1 --2- 172.21.15.120:0/3511826677 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c0d55a0 0x7fa03c0d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.129 7fa04127b700 1 --2- 172.21.15.120:0/3511826677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0d7160 0x7fa03c0d7560 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.129 7fa04127b700 1 -- 172.21.15.120:0/3511826677 >> 172.21.15.120:0/3511826677 conn(0x7fa03c0d1590 msgr2=0x7fa03c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:58.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.129 7fa04127b700 1 -- 172.21.15.120:0/3511826677 shutdown_connections 2021-04-09T18:31:58.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.129 7fa04127b700 1 -- 172.21.15.120:0/3511826677 wait complete. 2021-04-09T18:31:58.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa04127b700 1 Processor -- start 2021-04-09T18:31:58.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa04127b700 1 -- start start 2021-04-09T18:31:58.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa04127b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c191390 0x7fa03c08ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:58.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa04127b700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0b1f70 0x7fa03c0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:58.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa04127b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa03c1838d0 0x7fa03c183cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:58.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa04127b700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c08b330 con 0x7fa03c0b1f70 2021-04-09T18:31:58.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa04127b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c1842f0 con 0x7fa03c1838d0 2021-04-09T18:31:58.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa04127b700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c184510 con 0x7fa03c191390 2021-04-09T18:31:58.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa033fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0b1f70 0x7fa03c0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:58.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa033fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0b1f70 0x7fa03c0b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59744/0 (socket says 172.21.15.120:59744) 2021-04-09T18:31:58.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa033fff700 1 -- 172.21.15.120:0/1128695694 learned_addr learned my addr 172.21.15.120:0/1128695694 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:31:58.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa03b07d700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c191390 0x7fa03c08ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:58.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.151 7fa03b87e700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa03c1838d0 0x7fa03c183cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:58.151 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa033fff700 1 -- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c191390 msgr2=0x7fa03c08ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:58.152 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa033fff700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c191390 0x7fa03c08ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.152 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa033fff700 1 -- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa03c1838d0 msgr2=0x7fa03c183cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:58.152 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa033fff700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa03c1838d0 0x7fa03c183cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.152 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa033fff700 1 -- 172.21.15.120:0/1128695694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0b9ca0 con 0x7fa03c0b1f70 2021-04-09T18:31:58.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa033fff700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0b1f70 0x7fa03c0b2370 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa02400b560 tx=0x7fa02400b900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:58.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa038878700 1 -- 172.21.15.120:0/1128695694 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa02400bcf0 con 0x7fa03c0b1f70 2021-04-09T18:31:58.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa038878700 1 -- 172.21.15.120:0/1128695694 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa024000c90 con 0x7fa03c0b1f70 2021-04-09T18:31:58.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa038878700 1 -- 172.21.15.120:0/1128695694 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa024002220 con 0x7fa03c0b1f70 2021-04-09T18:31:58.153 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa04127b700 1 -- 172.21.15.120:0/1128695694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c0b9ca0 con 0x7fa03c0b1f70 2021-04-09T18:31:58.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.152 7fa04127b700 1 -- 172.21.15.120:0/1128695694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c0b9ca0 con 0x7fa03c0b1f70 2021-04-09T18:31:58.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.153 7fa038878700 1 -- 172.21.15.120:0/1128695694 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa0240052e0 con 0x7fa03c0b1f70 2021-04-09T18:31:58.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.153 7fa038878700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa014018930 0x7fa01401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:31:58.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.153 7fa038878700 1 -- 172.21.15.120:0/1128695694 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fa024032e30 con 0x7fa03c0b1f70 2021-04-09T18:31:58.154 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.153 7fa03b07d700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa014018930 0x7fa01401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:31:58.155 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.153 7fa03b07d700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa014018930 0x7fa01401ae10 crc :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:31:58.155 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.162 7fa04127b700 1 -- 172.21.15.120:0/1128695694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c18cc10 con 0x7fa03c0b1f70 2021-04-09T18:31:58.155 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.165 7fa038878700 1 -- 172.21.15.120:0/1128695694 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fa024000c90 con 0x7fa03c0b1f70 2021-04-09T18:31:58.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.346 7fa04127b700 1 -- 172.21.15.120:0/1128695694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa03c18cc10 con 0x7fa03c0b1f70 2021-04-09T18:31:58.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.347 7fa038878700 1 -- 172.21.15.120:0/1128695694 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+1771 (secure 0 0 0) 0x7fa024006b00 con 0x7fa03c0b1f70 2021-04-09T18:31:58.334 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 52 2021-04-09T18:31:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:31:58.335 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:31:52.424898","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4997":{"gid":4997,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":29,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:31:58.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 -- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa014018930 msgr2=0x7fa01401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:58.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa014018930 0x7fa01401ae10 crc :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 -- 172.21.15.120:0/1128695694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0b1f70 msgr2=0x7fa03c0b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:31:58.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0b1f70 0x7fa03c0b2370 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa02400b560 tx=0x7fa02400b900).stop 2021-04-09T18:31:58.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 -- 172.21.15.120:0/1128695694 shutdown_connections 2021-04-09T18:31:58.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa03c1838d0 0x7fa03c183cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa03c0b1f70 0x7fa03c0b2370 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa014018930 0x7fa01401ae10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.338 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 --2- 172.21.15.120:0/1128695694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa03c191390 0x7fa03c08ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:31:58.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 -- 172.21.15.120:0/1128695694 >> 172.21.15.120:0/1128695694 conn(0x7fa03c19a7e0 msgr2=0x7fa03c093af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:31:58.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 -- 172.21.15.120:0/1128695694 shutdown_connections 2021-04-09T18:31:58.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:31:58.349 7fa04127b700 1 -- 172.21.15.120:0/1128695694 wait complete. 2021-04-09T18:31:58.346 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-04-09T18:32:00.347 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:00.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.503 7fab8cd46700 1 Processor -- start 2021-04-09T18:32:00.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.503 7fab8cd46700 1 -- start start 2021-04-09T18:32:00.510 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.503 7fab8cd46700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fab880d6580 0x7fab881ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:00.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.503 7fab8cd46700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab880d7960 con 0x7fab880d7560 2021-04-09T18:32:00.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.503 7fab8cd46700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab880d6980 con 0x7fab880d7160 2021-04-09T18:32:00.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.503 7fab8cd46700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab880d6be0 con 0x7fab880d6580 2021-04-09T18:32:00.511 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.503 7fab87314700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fab880d6580 0x7fab881ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:00.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab86312700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fab880d7560 0x7fab880d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54680/0 (socket says 172.21.15.120:54680) 2021-04-09T18:32:00.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab86312700 1 -- 172.21.15.120:0/1837153706 learned_addr learned my addr 172.21.15.120:0/1837153706 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:32:00.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab87314700 1 -- 172.21.15.120:0/1837153706 >> v1:172.21.15.134:6789/0 conn(0x7fab880d7160 legacy=0x7fab880d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:00.512 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab87314700 1 -- 172.21.15.120:0/1837153706 >> v1:172.21.15.120:6789/0 conn(0x7fab880d7560 legacy=0x7fab880d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:00.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab87314700 1 -- 172.21.15.120:0/1837153706 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab881a2ac0 con 0x7fab880d6580 2021-04-09T18:32:00.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab87314700 1 --2- 172.21.15.120:0/1837153706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab880d6580 0x7fab881ac1f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fab78006ab0 tx=0x7fab78009b40).ready entity=mon.0 client_cookie=e940775969b90dc4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:00.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab85b11700 1 -- 172.21.15.120:0/1837153706 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fab780022e0 con 0x7fab880d6580 2021-04-09T18:32:00.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab85b11700 1 -- 172.21.15.120:0/1837153706 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78002660 con 0x7fab880d6580 2021-04-09T18:32:00.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab85b11700 1 -- 172.21.15.120:0/1837153706 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fab78002b40 con 0x7fab880d6580 2021-04-09T18:32:00.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab8cd46700 1 -- 172.21.15.120:0/1837153706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab880d6580 msgr2=0x7fab881ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:00.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.504 7fab8cd46700 1 --2- 172.21.15.120:0/1837153706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab880d6580 0x7fab881ac1f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fab78006ab0 tx=0x7fab78009b40).stop 2021-04-09T18:32:00.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.505 7fab8cd46700 1 -- 172.21.15.120:0/1837153706 shutdown_connections 2021-04-09T18:32:00.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.505 7fab8cd46700 1 --2- 172.21.15.120:0/1837153706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab880d6580 0x7fab881ac1f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:00.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.505 7fab8cd46700 1 -- 172.21.15.120:0/1837153706 >> 172.21.15.120:0/1837153706 conn(0x7fab880d1590 msgr2=0x7fab880d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:00.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.505 7fab8cd46700 1 -- 172.21.15.120:0/1837153706 shutdown_connections 2021-04-09T18:32:00.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.505 7fab8cd46700 1 -- 172.21.15.120:0/1837153706 wait complete. 2021-04-09T18:32:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab8cd46700 1 Processor -- start 2021-04-09T18:32:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab8cd46700 1 -- start start 2021-04-09T18:32:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab8cd46700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab8808edd0 0x7fab880be610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab8cd46700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8808e770 0x7fab881b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab8cd46700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab881b76a0 0x7fab880a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab8cd46700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab880bec30 con 0x7fab881b76a0 2021-04-09T18:32:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab8cd46700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab881b7aa0 con 0x7fab8808e770 2021-04-09T18:32:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab8cd46700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab881b7cc0 con 0x7fab8808edd0 2021-04-09T18:32:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab87314700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab881b76a0 0x7fab880a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab87314700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab881b76a0 0x7fab880a52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59774/0 (socket says 172.21.15.120:59774) 2021-04-09T18:32:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.524 7fab87314700 1 -- 172.21.15.120:0/1249006684 learned_addr learned my addr 172.21.15.120:0/1249006684 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:32:00.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab86312700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8808e770 0x7fab881b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:00.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab86b13700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab8808edd0 0x7fab880be610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:00.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab87314700 1 -- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab8808edd0 msgr2=0x7fab880be610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:00.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab87314700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab8808edd0 0x7fab880be610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:00.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab87314700 1 -- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8808e770 msgr2=0x7fab881b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:00.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab87314700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8808e770 0x7fab881b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:00.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab87314700 1 -- 172.21.15.120:0/1249006684 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab880a58d0 con 0x7fab881b76a0 2021-04-09T18:32:00.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab86312700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8808e770 0x7fab881b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:32:00.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab86b13700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab8808edd0 0x7fab880be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:32:00.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab87314700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab881b76a0 0x7fab880a52b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fab7800b5f0 tx=0x7fab7800b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:00.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab777fe700 1 -- 172.21.15.120:0/1249006684 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fab7800bd80 con 0x7fab881b76a0 2021-04-09T18:32:00.528 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab777fe700 1 -- 172.21.15.120:0/1249006684 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78006020 con 0x7fab881b76a0 2021-04-09T18:32:00.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab880a58d0 con 0x7fab881b76a0 2021-04-09T18:32:00.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab777fe700 1 -- 172.21.15.120:0/1249006684 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fab780054a0 con 0x7fab881b76a0 2021-04-09T18:32:00.529 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.525 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab880a58d0 con 0x7fab881b76a0 2021-04-09T18:32:00.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.526 7fab777fe700 1 -- 172.21.15.120:0/1249006684 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fab780054a0 con 0x7fab881b76a0 2021-04-09T18:32:00.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.526 7fab777fe700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fab6c0188c0 0x7fab6c01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:00.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.526 7fab777fe700 1 -- 172.21.15.120:0/1249006684 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fab78032e20 con 0x7fab881b76a0 2021-04-09T18:32:00.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.526 7fab86b13700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fab6c0188c0 0x7fab6c01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:00.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.526 7fab86b13700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fab6c0188c0 0x7fab6c01adc0 crc :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:00.536 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.549 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8808d280 con 0x7fab881b76a0 2021-04-09T18:32:00.539 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.553 7fab777fe700 1 -- 172.21.15.120:0/1249006684 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fab7801f750 con 0x7fab881b76a0 2021-04-09T18:32:00.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.748 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab880ce5c0 con 0x7fab881b76a0 2021-04-09T18:32:00.735 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.748 7fab777fe700 1 -- 172.21.15.120:0/1249006684 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+1771 (secure 0 0 0) 0x7fab780054a0 con 0x7fab881b76a0 2021-04-09T18:32:00.736 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 52 2021-04-09T18:32:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:32:00.737 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:31:52.424898","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4997":{"gid":4997,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":29,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:32:00.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fab6c0188c0 msgr2=0x7fab6c01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:00.738 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fab6c0188c0 0x7fab6c01adc0 crc :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:00.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab881b76a0 msgr2=0x7fab880a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:00.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab881b76a0 0x7fab880a52b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fab7800b5f0 tx=0x7fab7800b990).stop 2021-04-09T18:32:00.739 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 shutdown_connections 2021-04-09T18:32:00.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab881b76a0 0x7fab880a52b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:00.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8808e770 0x7fab881b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:00.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fab6c0188c0 0x7fab6c01adc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:00.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 --2- 172.21.15.120:0/1249006684 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab8808edd0 0x7fab880be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:00.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 >> 172.21.15.120:0/1249006684 conn(0x7fab880a4930 msgr2=0x7fab88097c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:00.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 shutdown_connections 2021-04-09T18:32:00.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:00.751 7fab8cd46700 1 -- 172.21.15.120:0/1249006684 wait complete. 2021-04-09T18:32:00.748 INFO:tasks.mds_thrash.fs.[None]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-04-09T18:32:02.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-04-09T18:32:02.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.906 7f48dda33700 1 Processor -- start 2021-04-09T18:32:02.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.906 7f48dda33700 1 -- start start 2021-04-09T18:32:02.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48dda33700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d80d7160 0x7f48d80e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48dda33700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f48d80d7560 0x7f48d80d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48dda33700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f48d80d5bc0 0x7f48d80d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48dda33700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d80d80f0 con 0x7f48d80d7560 2021-04-09T18:32:02.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48dda33700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d80d6be0 con 0x7f48d80d5bc0 2021-04-09T18:32:02.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48dda33700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d80e7f00 con 0x7f48d80d7160 2021-04-09T18:32:02.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d6ffd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f48d80d7560 0x7f48d80d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d6ffd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f48d80d7560 0x7f48d80d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59790/0 (socket says 172.21.15.120:59790) 2021-04-09T18:32:02.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d6ffd700 1 -- 172.21.15.120:0/784324176 learned_addr learned my addr 172.21.15.120:0/784324176 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:32:02.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d77fe700 1 --2- 172.21.15.120:0/784324176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d80d7160 0x7f48d80e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d7fff700 1 --2- 172.21.15.120:0/784324176 >> v2:172.21.15.134:3300/0 conn(0x7f48d80d5bc0 0x7f48d80d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d6ffd700 1 -- 172.21.15.120:0/784324176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d80d7160 msgr2=0x7f48d80e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:02.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d6ffd700 1 --2- 172.21.15.120:0/784324176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d80d7160 0x7f48d80e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d6ffd700 1 -- 172.21.15.120:0/784324176 >> v2:172.21.15.134:3300/0 conn(0x7f48d80d5bc0 msgr2=0x7f48d80d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:02.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d6ffd700 1 --2- 172.21.15.120:0/784324176 >> v2:172.21.15.134:3300/0 conn(0x7f48d80d5bc0 0x7f48d80d5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d6ffd700 1 -- 172.21.15.120:0/784324176 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d81a2ac0 con 0x7f48d80d7560 2021-04-09T18:32:02.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.907 7f48d6ffd700 1 --2- 172.21.15.120:0/784324176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d80d7560 0x7f48d80d55a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f48cc006700 tx=0x7f48cc009b00).ready entity=mon.0 client_cookie=f8f19b3898489952 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:02.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.908 7f48d67fc700 1 -- 172.21.15.120:0/784324176 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48cc00c0c0 con 0x7f48d80d7560 2021-04-09T18:32:02.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.908 7f48d67fc700 1 -- 172.21.15.120:0/784324176 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc00c400 con 0x7f48d80d7560 2021-04-09T18:32:02.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.908 7f48d67fc700 1 -- 172.21.15.120:0/784324176 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48cc00c8e0 con 0x7f48d80d7560 2021-04-09T18:32:02.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.908 7f48dda33700 1 -- 172.21.15.120:0/784324176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d80d7560 msgr2=0x7f48d80d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.908 7f48dda33700 1 --2- 172.21.15.120:0/784324176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d80d7560 0x7f48d80d55a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f48cc006700 tx=0x7f48cc009b00).stop 2021-04-09T18:32:02.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.909 7f48dda33700 1 -- 172.21.15.120:0/784324176 shutdown_connections 2021-04-09T18:32:02.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.909 7f48dda33700 1 --2- 172.21.15.120:0/784324176 >> v2:172.21.15.134:3300/0 conn(0x7f48d80d5bc0 0x7f48d80d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.909 7f48dda33700 1 --2- 172.21.15.120:0/784324176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d80d7560 0x7f48d80d55a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.909 7f48dda33700 1 --2- 172.21.15.120:0/784324176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d80d7160 0x7f48d80e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.909 7f48dda33700 1 -- 172.21.15.120:0/784324176 >> 172.21.15.120:0/784324176 conn(0x7f48d80d1590 msgr2=0x7f48d80d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:02.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.909 7f48dda33700 1 -- 172.21.15.120:0/784324176 shutdown_connections 2021-04-09T18:32:02.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.909 7f48dda33700 1 -- 172.21.15.120:0/784324176 wait complete. 2021-04-09T18:32:02.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.929 7f48dda33700 1 Processor -- start 2021-04-09T18:32:02.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.929 7f48dda33700 1 -- start start 2021-04-09T18:32:02.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48dda33700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d81971b0 0x7f48d81963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48dda33700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d808fe00 0x7f48d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48dda33700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d8090200 0x7f48d80b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.927 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48dda33700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d81969f0 con 0x7f48d8090200 2021-04-09T18:32:02.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48dda33700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d8196c30 con 0x7f48d81971b0 2021-04-09T18:32:02.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48dda33700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d81975b0 con 0x7f48d808fe00 2021-04-09T18:32:02.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d7fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d8090200 0x7f48d80b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.928 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d7fff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d8090200 0x7f48d80b77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59800/0 (socket says 172.21.15.120:59800) 2021-04-09T18:32:02.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d81971b0 0x7f48d81963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d7fff700 1 -- 172.21.15.120:0/2530169566 learned_addr learned my addr 172.21.15.120:0/2530169566 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:32:02.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d6ffd700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d808fe00 0x7f48d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d7fff700 1 -- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d808fe00 msgr2=0x7f48d80b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d7fff700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d808fe00 0x7f48d80b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d7fff700 1 -- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d81971b0 msgr2=0x7f48d81963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:02.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d7fff700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d81971b0 0x7f48d81963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:02.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d7fff700 1 -- 172.21.15.120:0/2530169566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d8090800 con 0x7f48d8090200 2021-04-09T18:32:02.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d77fe700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d81971b0 0x7f48d81963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:02.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d6ffd700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d808fe00 0x7f48d80b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:32:02.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48d7fff700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d8090200 0x7f48d80b77d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f48d000a940 tx=0x7f48d000ace0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:02.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48bffff700 1 -- 172.21.15.120:0/2530169566 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48d000c300 con 0x7f48d8090200 2021-04-09T18:32:02.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48bffff700 1 -- 172.21.15.120:0/2530169566 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d000ae20 con 0x7f48d8090200 2021-04-09T18:32:02.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48bffff700 1 -- 172.21.15.120:0/2530169566 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48d000c770 con 0x7f48d8090200 2021-04-09T18:32:02.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48dda33700 1 -- 172.21.15.120:0/2530169566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d8090800 con 0x7f48d8090200 2021-04-09T18:32:02.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.930 7f48dda33700 1 -- 172.21.15.120:0/2530169566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d8090800 con 0x7f48d8090200 2021-04-09T18:32:02.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.931 7f48bffff700 1 -- 172.21.15.120:0/2530169566 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f48d000b030 con 0x7f48d8090200 2021-04-09T18:32:02.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.931 7f48bffff700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f48b8018930 0x7f48b801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:02.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.931 7f48bffff700 1 -- 172.21.15.120:0/2530169566 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f48d00331a0 con 0x7f48d8090200 2021-04-09T18:32:02.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.931 7f48d77fe700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f48b8018930 0x7f48b801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:02.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.932 7f48d77fe700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f48b8018930 0x7f48b801ae10 crc :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:02.938 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.951 7f48dda33700 1 -- 172.21.15.120:0/2530169566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d81969f0 con 0x7f48d8090200 2021-04-09T18:32:02.941 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:02.954 7f48bffff700 1 -- 172.21.15.120:0/2530169566 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f48d00066f0 con 0x7f48d8090200 2021-04-09T18:32:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.151 7f48dda33700 1 -- 172.21.15.120:0/2530169566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48d81969f0 con 0x7f48d8090200 2021-04-09T18:32:03.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.151 7f48bffff700 1 -- 172.21.15.120:0/2530169566 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2110 (secure 0 0 0) 0x7f48d000b030 con 0x7f48d8090200 2021-04-09T18:32:03.140 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 53 2021-04-09T18:32:03.140 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:32:03.141 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6833/3987333429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3987333429},{"type":"v1","addr":"172.21.15.120:6833","nonce":3987333429}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":53}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-04-09 18:19:55.049244","modified":"2021-04-09 18:31:52.424898","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4997":{"gid":4997,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":29,"addr":"172.21.15.134:6835/2928390315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2928390315},{"type":"v1","addr":"172.21.15.134:6835","nonce":2928390315}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-04-09T18:32:03.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 -- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f48b8018930 msgr2=0x7f48b801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f48b8018930 0x7f48b801ae10 crc :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 -- 172.21.15.120:0/2530169566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d8090200 msgr2=0x7f48d80b77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:03.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d8090200 0x7f48d80b77d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f48d000a940 tx=0x7f48d000ace0).stop 2021-04-09T18:32:03.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 -- 172.21.15.120:0/2530169566 shutdown_connections 2021-04-09T18:32:03.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d8090200 0x7f48d80b77d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f48b8018930 0x7f48b801ae10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f48d808fe00 0x7f48d80b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 --2- 172.21.15.120:0/2530169566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d81971b0 0x7f48d81963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 -- 172.21.15.120:0/2530169566 >> 172.21.15.120:0/2530169566 conn(0x7f48d818dc90 msgr2=0x7f48d81a13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 -- 172.21.15.120:0/2530169566 shutdown_connections 2021-04-09T18:32:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:03.154 7f48dda33700 1 -- 172.21.15.120:0/2530169566 wait complete. 2021-04-09T18:32:03.151 INFO:tasks.mds_thrash.fs.[None]:mds.a reported in up:standby state 2021-04-09T18:32:03.151 INFO:tasks.mds_thrash.fs.[None]:waiting for 97 secs before thrashing 2021-04-09T18:32:11.852 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:11.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:42.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:42.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:32:50.701 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2021-04-09T18:32:50.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2021-04-09T18:32:50.925 DEBUG:teuthology.parallel:result is None 2021-04-09T18:32:50.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2021-04-09T18:32:51.004 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2021-04-09T18:32:51.004 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-04-09T18:32:51.014 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-04-09T18:32:51.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:51.015 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:51.015 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:51.059 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2021-04-09T18:32:51.059 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:32:51.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:51.060 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:51.060 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:51.142 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2021-04-09T18:32:51.142 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-04-09T18:32:51.143 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2021-04-09T18:32:51.143 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-04-09T18:32:51.143 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:51.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:ceph-fuse[29622]: fuse finished with error 0 and tester_r 0 2021-04-09T18:32:51.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-04-09T18:32:51.256 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-04-09T18:32:51.257 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:51.301 INFO:teuthology.orchestra.run.smithi120.stdout:ext2/ext3 2021-04-09T18:32:51.301 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-04-09T18:32:51.302 INFO:teuthology.orchestra.run:waiting for 900 2021-04-09T18:32:57.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-04-09T18:32:57.405 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-04-09T18:32:57.459 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2021-04-09T18:32:57.472 INFO:tasks.mds_thrash:joining mds_thrashers 2021-04-09T18:32:57.472 INFO:tasks.mds_thrash.fs.[None]:stat['max_mds'] = 0 2021-04-09T18:32:57.473 INFO:tasks.mds_thrash.fs.[None]:stat['deactivate'] = 0 2021-04-09T18:32:57.473 INFO:tasks.mds_thrash.fs.[None]:stat['kill'] = 8 2021-04-09T18:32:57.473 INFO:tasks.mds_thrash:done joining 2021-04-09T18:32:58.849 INFO:tasks.mds_thrash.daemon_watchdog:watchdog finished 2021-04-09T18:32:58.850 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-04-09T18:32:58.862 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-04-09T18:32:58.863 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:32:59.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.030 7fef06b18700 1 Processor -- start 2021-04-09T18:32:59.037 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.030 7fef06b18700 1 -- start start 2021-04-09T18:32:59.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.030 7fef06b18700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fef000d7160 0x7fef000d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7fef06b18700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef000d6be0 con 0x7fef000d55a0 2021-04-09T18:32:59.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7fef06b18700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef001a2ac0 con 0x7fef000d6190 2021-04-09T18:32:59.038 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7fef06b18700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef001a2ce0 con 0x7fef000d7160 2021-04-09T18:32:59.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feefffff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fef000d55a0 0x7fef000d59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55038/0 (socket says 172.21.15.120:55038) 2021-04-09T18:32:59.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feefffff700 1 -- 172.21.15.120:0/831013436 learned_addr learned my addr 172.21.15.120:0/831013436 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:32:59.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599348180 0 0) 0x7feef0000ce0 con 0x7fef000d55a0 2021-04-09T18:32:59.039 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec002fe0 con 0x7fef000d55a0 2021-04-09T18:32:59.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7fef04934700 1 --2- 172.21.15.120:0/831013436 >> v2:172.21.15.134:3300/0 conn(0x7fef000d7160 0x7fef000d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 981313128 0 0) 0x7feef00010e0 con 0x7fef000d55a0 2021-04-09T18:32:59.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 >> v2:172.21.15.134:3300/0 conn(0x7fef000d7160 msgr2=0x7fef000d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:59.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 --2- 172.21.15.120:0/831013436 >> v2:172.21.15.134:3300/0 conn(0x7fef000d7160 0x7fef000d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.040 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 >> v1:172.21.15.134:6789/0 conn(0x7fef000d6190 legacy=0x7fef001ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000d6590 con 0x7fef000d55a0 2021-04-09T18:32:59.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7feef0001600 con 0x7fef000d55a0 2021-04-09T18:32:59.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 >> v1:172.21.15.120:6789/0 conn(0x7fef000d55a0 legacy=0x7fef000d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.041 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeec003a60 0x7feeec005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeec006790 0x7feeec008c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feeec009590 0x7feeec00bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec00c300 con 0x7feeec009590 2021-04-09T18:32:59.042 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec00c520 con 0x7feeec006790 2021-04-09T18:32:59.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feeff7fe700 1 -- 172.21.15.120:0/831013436 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec050750 con 0x7feeec003a60 2021-04-09T18:32:59.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7fef05135700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feeec009590 0x7feeec00bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7fef04934700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeec003a60 0x7feeec005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.043 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.031 7feefffff700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeec006790 0x7feeec008c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7fef05135700 1 -- 172.21.15.120:0/831013436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeec003a60 msgr2=0x7feeec005ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:59.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7fef05135700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeec003a60 0x7feeec005ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7fef05135700 1 -- 172.21.15.120:0/831013436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeec006790 msgr2=0x7feeec008c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:59.044 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7fef05135700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeec006790 0x7feeec008c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7fef05135700 1 -- 172.21.15.120:0/831013436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0509b0 con 0x7feeec009590 2021-04-09T18:32:59.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7fef05135700 1 -- 172.21.15.120:0/831013436 reap_dead start 2021-04-09T18:32:59.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7fef05135700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feeec009590 0x7feeec00bab0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7feef80069e0 tx=0x7feef8009d90).ready entity=mon.0 client_cookie=c8aa070102bee79c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:59.045 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7feeff7fe700 1 -- 172.21.15.120:0/831013436 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feef800b510 con 0x7feeec009590 2021-04-09T18:32:59.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7feeff7fe700 1 -- 172.21.15.120:0/831013436 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800b890 con 0x7feeec009590 2021-04-09T18:32:59.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7feeff7fe700 1 -- 172.21.15.120:0/831013436 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feef800bd70 con 0x7feeec009590 2021-04-09T18:32:59.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7fef06b18700 1 -- 172.21.15.120:0/831013436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feeec009590 msgr2=0x7feeec00bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.032 7fef06b18700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feeec009590 0x7feeec00bab0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7feef80069e0 tx=0x7feef8009d90).stop 2021-04-09T18:32:59.046 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.033 7fef06b18700 1 -- 172.21.15.120:0/831013436 shutdown_connections 2021-04-09T18:32:59.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.033 7fef06b18700 1 --2- 172.21.15.120:0/831013436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feeec009590 0x7feeec00bab0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.033 7fef06b18700 1 -- 172.21.15.120:0/831013436 >> 172.21.15.120:0/831013436 conn(0x7fef000d1590 msgr2=0x7fef000d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:59.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.033 7fef06b18700 1 -- 172.21.15.120:0/831013436 shutdown_connections 2021-04-09T18:32:59.047 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.033 7fef06b18700 1 -- 172.21.15.120:0/831013436 wait complete. 2021-04-09T18:32:59.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.051 7fef06b18700 1 Processor -- start 2021-04-09T18:32:59.048 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.051 7fef06b18700 1 -- start start 2021-04-09T18:32:59.050 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef06b18700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef00187380 0x7fef00189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef06b18700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef00187780 0x7fef000987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef06b18700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef00189c50 0x7fef000b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef06b18700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0018ce60 con 0x7fef00189c50 2021-04-09T18:32:59.051 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef06b18700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00098e10 con 0x7fef00187380 2021-04-09T18:32:59.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef06b18700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef00099030 con 0x7fef00187780 2021-04-09T18:32:59.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef05135700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef00189c50 0x7fef000b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef05135700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef00189c50 0x7fef000b8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60142/0 (socket says 172.21.15.120:60142) 2021-04-09T18:32:59.052 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef05135700 1 -- 172.21.15.120:0/1621799744 learned_addr learned my addr 172.21.15.120:0/1621799744 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:32:59.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7fef04934700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef00187380 0x7fef00189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.052 7feefffff700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef00187780 0x7fef000987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7fef05135700 1 -- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef00187780 msgr2=0x7fef000987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7fef05135700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef00187780 0x7fef000987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.053 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7fef05135700 1 -- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef00187380 msgr2=0x7fef00189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7fef05135700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef00187380 0x7fef00189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7fef05135700 1 -- 172.21.15.120:0/1621799744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000b8b30 con 0x7fef00189c50 2021-04-09T18:32:59.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7fef05135700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef00189c50 0x7fef000b8510 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7feef80099f0 tx=0x7feef800bce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:59.054 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7feefd7fa700 1 -- 172.21.15.120:0/1621799744 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feef8009020 con 0x7fef00189c50 2021-04-09T18:32:59.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7feefd7fa700 1 -- 172.21.15.120:0/1621799744 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef8003080 con 0x7fef00189c50 2021-04-09T18:32:59.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7fef06b18700 1 -- 172.21.15.120:0/1621799744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef000b8b30 con 0x7fef00189c50 2021-04-09T18:32:59.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7feefd7fa700 1 -- 172.21.15.120:0/1621799744 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feef800c570 con 0x7fef00189c50 2021-04-09T18:32:59.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7fef06b18700 1 -- 172.21.15.120:0/1621799744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef000b8b30 con 0x7fef00189c50 2021-04-09T18:32:59.055 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.053 7feefd7fa700 1 -- 172.21.15.120:0/1621799744 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7feef8009380 con 0x7fef00189c50 2021-04-09T18:32:59.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.054 7feefd7fa700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feee4018930 0x7feee401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.054 7feefd7fa700 1 -- 172.21.15.120:0/1621799744 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7feef8033180 con 0x7fef00189c50 2021-04-09T18:32:59.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.054 7fef04934700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feee4018930 0x7feee401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.056 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.054 7fef04934700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feee4018930 0x7feee401ae10 crc :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:59.062 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.076 7fef06b18700 1 -- 172.21.15.120:0/1621799744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef00189100 con 0x7fef00189c50 2021-04-09T18:32:59.065 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.080 7feefd7fa700 1 -- 172.21.15.120:0/1621799744 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7feef800be20 con 0x7fef00189c50 2021-04-09T18:32:59.241 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.256 7fef06b18700 1 -- 172.21.15.120:0/1621799744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef00189100 con 0x7fef00189c50 2021-04-09T18:32:59.243 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.257 7feefd7fa700 1 -- 172.21.15.120:0/1621799744 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15321 (secure 0 0 0) 0x7feef8009380 con 0x7fef00189c50 2021-04-09T18:32:59.243 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:32:59.243 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:31:45.823957","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.134:6835/782463162":"2021-04-10 18:30:00.814744","172.21.15.134:6834/782463162":"2021-04-10 18:30:00.814744","172.21.15.120:6833/4282122355":"2021-04-10 18:28:50.808587","172.21.15.120:6832/3326321867":"2021-04-10 18:31:45.823892","172.21.15.120:6833/3967329066":"2021-04-10 18:26:05.791416","172.21.15.120:6832/4282122355":"2021-04-10 18:28:50.808587","172.21.15.120:6832/3967329066":"2021-04-10 18:26:05.791416","172.21.15.134:6834/497894564":"2021-04-10 18:28:00.800425","172.21.15.134:6835/1933604370":"2021-04-10 18:20:55.766995","172.21.15.134:6834/1933604370":"2021-04-10 18:20:55.766995","172.21.15.120:6832/2249625664":"2021-04-10 18:23:05.777038","172.21.15.134:6835/497894564":"2021-04-10 18:28:00.800425","172.21.15.134:6835/3982642658":"2021-04-10 18:25:05.786493","172.21.15.120:6833/3326321867":"2021-04-10 18:31:45.823892","172.21.15.120:6833/2249625664":"2021-04-10 18:23:05.777038","172.21.15.134:6834/3982642658":"2021-04-10 18:25:05.786493"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:32:59.245 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 -- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feee4018930 msgr2=0x7feee401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.245 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feee4018930 0x7feee401ae10 crc :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.245 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 -- 172.21.15.120:0/1621799744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef00189c50 msgr2=0x7fef000b8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.246 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef00189c50 0x7fef000b8510 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7feef80099f0 tx=0x7feef800bce0).stop 2021-04-09T18:32:59.246 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 -- 172.21.15.120:0/1621799744 shutdown_connections 2021-04-09T18:32:59.246 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef00189c50 0x7fef000b8510 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.246 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7feee4018930 0x7feee401ae10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.246 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef00187780 0x7fef000987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 --2- 172.21.15.120:0/1621799744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef00187380 0x7fef00189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 -- 172.21.15.120:0/1621799744 >> 172.21.15.120:0/1621799744 conn(0x7fef0018dc90 msgr2=0x7fef0008fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:59.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 -- 172.21.15.120:0/1621799744 shutdown_connections 2021-04-09T18:32:59.247 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.259 7fef06b18700 1 -- 172.21.15.120:0/1621799744 wait complete. 2021-04-09T18:32:59.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:32:59.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.408 7f3745f88700 1 Processor -- start 2021-04-09T18:32:59.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.408 7f3745f88700 1 -- start start 2021-04-09T18:32:59.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f3745f88700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f37400eac40 0x7f37400dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f3745f88700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37400d1b40 0x7f3740088000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f3745f88700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37400d61e0 con 0x7f3740088620 2021-04-09T18:32:59.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f3745f88700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400eaa10 con 0x7f37400eac40 2021-04-09T18:32:59.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f3745f88700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37400f38e0 con 0x7f37400d1b40 2021-04-09T18:32:59.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f373f7fe700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f37400eac40 0x7f37400dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f373ffff700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3740088620 0x7f37400d6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55060/0 (socket says 172.21.15.120:55060) 2021-04-09T18:32:59.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f373ffff700 1 -- 172.21.15.120:0/124876876 learned_addr learned my addr 172.21.15.120:0/124876876 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:32:59.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f373effd700 1 --2- 172.21.15.120:0/124876876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37400d1b40 0x7f3740088000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f373f7fe700 1 -- 172.21.15.120:0/124876876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37400d1b40 msgr2=0x7f3740088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:59.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f373f7fe700 1 --2- 172.21.15.120:0/124876876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37400d1b40 0x7f3740088000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f373f7fe700 1 -- 172.21.15.120:0/124876876 >> v1:172.21.15.120:6789/0 conn(0x7f3740088620 legacy=0x7f37400d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f373e7fc700 1 -- 172.21.15.120:0/124876876 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024863331 0 0) 0x7f3738000d30 con 0x7f3740088620 2021-04-09T18:32:59.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.409 7f373f7fe700 1 -- 172.21.15.120:0/124876876 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400d6f50 con 0x7f37400eac40 2021-04-09T18:32:59.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.410 7f373f7fe700 1 --2- 172.21.15.120:0/124876876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37400eac40 0x7f37400dc6b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f3730006650 tx=0x7f3730009a00).ready entity=mon.0 client_cookie=9d221e3de15c3a2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:59.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.410 7f373e7fc700 1 -- 172.21.15.120:0/124876876 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3730009df0 con 0x7f37400eac40 2021-04-09T18:32:59.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.410 7f373e7fc700 1 -- 172.21.15.120:0/124876876 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37300009b0 con 0x7f37400eac40 2021-04-09T18:32:59.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.410 7f373e7fc700 1 -- 172.21.15.120:0/124876876 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f373000c2b0 con 0x7f37400eac40 2021-04-09T18:32:59.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.410 7f3745f88700 1 -- 172.21.15.120:0/124876876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37400eac40 msgr2=0x7f37400dc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.410 7f3745f88700 1 --2- 172.21.15.120:0/124876876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37400eac40 0x7f37400dc6b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f3730006650 tx=0x7f3730009a00).stop 2021-04-09T18:32:59.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.410 7f3745f88700 1 -- 172.21.15.120:0/124876876 shutdown_connections 2021-04-09T18:32:59.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.411 7f3745f88700 1 --2- 172.21.15.120:0/124876876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f37400d1b40 0x7f3740088000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.411 7f3745f88700 1 --2- 172.21.15.120:0/124876876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37400eac40 0x7f37400dc6b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.411 7f3745f88700 1 -- 172.21.15.120:0/124876876 >> 172.21.15.120:0/124876876 conn(0x7f37400e93c0 msgr2=0x7f3740100570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:59.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.411 7f3745f88700 1 -- 172.21.15.120:0/124876876 shutdown_connections 2021-04-09T18:32:59.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.411 7f3745f88700 1 -- 172.21.15.120:0/124876876 wait complete. 2021-04-09T18:32:59.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.429 7f3745f88700 1 Processor -- start 2021-04-09T18:32:59.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f3745f88700 1 -- start start 2021-04-09T18:32:59.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f3745f88700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3740089700 0x7f37400a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f3745f88700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3740089b00 0x7f37400a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f3745f88700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37400a3500 0x7f37400a2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f3745f88700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374008a070 con 0x7f3740089b00 2021-04-09T18:32:59.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f3745f88700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400a2690 con 0x7f37400a3500 2021-04-09T18:32:59.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f3745f88700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3740090ac0 con 0x7f3740089700 2021-04-09T18:32:59.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3740089b00 0x7f37400a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373effd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3740089b00 0x7f37400a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60152/0 (socket says 172.21.15.120:60152) 2021-04-09T18:32:59.426 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373effd700 1 -- 172.21.15.120:0/792601619 learned_addr learned my addr 172.21.15.120:0/792601619 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:32:59.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373f7fe700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3740089700 0x7f37400a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373ffff700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37400a3500 0x7f37400a2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.427 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373effd700 1 -- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3740089700 msgr2=0x7f37400a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373effd700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3740089700 0x7f37400a2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373effd700 1 -- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37400a3500 msgr2=0x7f37400a2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373effd700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37400a3500 0x7f37400a2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.430 7f373effd700 1 -- 172.21.15.120:0/792601619 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740090ce0 con 0x7f3740089b00 2021-04-09T18:32:59.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.431 7f373effd700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3740089b00 0x7f37400a1a50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f37340067e0 tx=0x7f373400b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:59.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.431 7f3727fff700 1 -- 172.21.15.120:0/792601619 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3734006900 con 0x7f3740089b00 2021-04-09T18:32:59.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.431 7f3727fff700 1 -- 172.21.15.120:0/792601619 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373400bd80 con 0x7f3740089b00 2021-04-09T18:32:59.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.431 7f3727fff700 1 -- 172.21.15.120:0/792601619 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3734002030 con 0x7f3740089b00 2021-04-09T18:32:59.429 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.431 7f3745f88700 1 -- 172.21.15.120:0/792601619 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3740090ce0 con 0x7f3740089b00 2021-04-09T18:32:59.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.431 7f3745f88700 1 -- 172.21.15.120:0/792601619 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3740090ce0 con 0x7f3740089b00 2021-04-09T18:32:59.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.431 7f3727fff700 1 -- 172.21.15.120:0/792601619 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f37340068b0 con 0x7f3740089b00 2021-04-09T18:32:59.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.431 7f3727fff700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3720018930 0x7f372001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.432 7f3727fff700 1 -- 172.21.15.120:0/792601619 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3734032e20 con 0x7f3740089b00 2021-04-09T18:32:59.430 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.432 7f373f7fe700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3720018930 0x7f372001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.432 7f373f7fe700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3720018930 0x7f372001ae10 crc :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:59.440 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.455 7f3745f88700 1 -- 172.21.15.120:0/792601619 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37400a2690 con 0x7f3740089b00 2021-04-09T18:32:59.444 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.458 7f3727fff700 1 -- 172.21.15.120:0/792601619 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3734000940 con 0x7f3740089b00 2021-04-09T18:32:59.621 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.635 7f3745f88700 1 -- 172.21.15.120:0/792601619 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f37400a2690 con 0x7f3720018930 2021-04-09T18:32:59.624 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.640 7f3727fff700 1 -- 172.21.15.120:0/792601619 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+101348 (crc 0 0 0) 0x7f3730006740 con 0x7f3720018930 2021-04-09T18:32:59.628 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2021-04-09T18:32:59.628 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:32:59.631 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 -- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3720018930 msgr2=0x7f372001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3720018930 0x7f372001ae10 crc :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 -- 172.21.15.120:0/792601619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3740089b00 msgr2=0x7f37400a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3740089b00 0x7f37400a1a50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f37340067e0 tx=0x7f373400b990).stop 2021-04-09T18:32:59.632 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 -- 172.21.15.120:0/792601619 shutdown_connections 2021-04-09T18:32:59.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37400a3500 0x7f37400a2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3740089b00 0x7f37400a1a50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3720018930 0x7f372001ae10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.633 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 --2- 172.21.15.120:0/792601619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3740089700 0x7f37400a2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 -- 172.21.15.120:0/792601619 >> 172.21.15.120:0/792601619 conn(0x7f37400ab640 msgr2=0x7f374009fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:59.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 -- 172.21.15.120:0/792601619 shutdown_connections 2021-04-09T18:32:59.634 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.645 7f3745f88700 1 -- 172.21.15.120:0/792601619 wait complete. 2021-04-09T18:32:59.641 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2021-04-09 18:32:58.906414","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":155716345,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":14381,"num_read_kb":2102932,"num_write":36489,"num_write_kb":4615424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38039,"ondisk_log_size":38039,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8584880,"kb_used_data":196208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746389840,"statfs":{"total":773094113280,"available":764303196160,"internally_reserved":8589934592,"allocated":200916992,"data_stored":312515434,"data_compressed":50837928,"data_compressed_allocated":113205248,"data_compressed_original":226410368,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3624590,"num_objects":-492,"num_object_clones":0,"num_object_copies":-1958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-492,"num_whiteouts":0,"num_read":19,"num_read_kb":69,"num_write":595,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002845"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.820189","last_change":"2021-04-09 18:19:48.659214","last_active":"2021-04-09 18:30:00.820189","last_peered":"2021-04-09 18:30:00.820189","last_clean":"2021-04-09 18:30:00.820189","last_became_active":"2021-04-09 18:19:48.658812","last_became_peered":"2021-04-09 18:19:48.658812","last_unstale":"2021-04-09 18:30:00.820189","last_undegraded":"2021-04-09 18:30:00.820189","last_fullsized":"2021-04-09 18:30:00.820189","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"30'1617","reported_seq":"1688","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:49.968902","last_change":"2021-04-09 18:19:51.674918","last_active":"2021-04-09 18:32:49.968902","last_peered":"2021-04-09 18:32:49.968902","last_clean":"2021-04-09 18:32:49.968902","last_became_active":"2021-04-09 18:19:51.674416","last_became_peered":"2021-04-09 18:19:51.674416","last_unstale":"2021-04-09 18:32:49.968902","last_undegraded":"2021-04-09 18:32:49.968902","last_fullsized":"2021-04-09 18:32:49.968902","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1617,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16777850,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":83,"num_read_kb":62902,"num_write":1388,"num_write_kb":17176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'3134","reported_seq":"4729","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.531320","last_change":"2021-04-09 18:19:54.682596","last_active":"2021-04-09 18:32:50.531320","last_peered":"2021-04-09 18:32:50.531320","last_clean":"2021-04-09 18:32:50.531320","last_became_active":"2021-04-09 18:19:54.682305","last_became_peered":"2021-04-09 18:19:54.682305","last_unstale":"2021-04-09 18:32:50.531320","last_undegraded":"2021-04-09 18:32:50.531320","last_fullsized":"2021-04-09 18:32:50.531320","mapping_epoch":20,"log_start":"23'100","ondisk_log_start":"23'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3034,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1576,"num_read_kb":167745,"num_write":2984,"num_write_kb":612887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.820142","last_change":"2021-04-09 18:19:48.659288","last_active":"2021-04-09 18:30:00.820142","last_peered":"2021-04-09 18:30:00.820142","last_clean":"2021-04-09 18:30:00.820142","last_became_active":"2021-04-09 18:19:48.658917","last_became_peered":"2021-04-09 18:19:48.658917","last_unstale":"2021-04-09 18:30:00.820142","last_undegraded":"2021-04-09 18:30:00.820142","last_fullsized":"2021-04-09 18:30:00.820142","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'2463","reported_seq":"2545","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:51.961712","last_change":"2021-04-09 18:19:51.675020","last_active":"2021-04-09 18:32:51.961712","last_peered":"2021-04-09 18:32:51.961712","last_clean":"2021-04-09 18:32:51.961712","last_became_active":"2021-04-09 18:19:51.674681","last_became_peered":"2021-04-09 18:19:51.674681","last_unstale":"2021-04-09 18:32:51.961712","last_undegraded":"2021-04-09 18:32:51.961712","last_fullsized":"2021-04-09 18:32:51.961712","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":2463,"ondisk_log_size":2463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165984,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":94,"num_read_kb":122944,"num_write":2221,"num_write_kb":25929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'3105","reported_seq":"4746","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.971120","last_change":"2021-04-09 18:19:54.681265","last_active":"2021-04-09 18:32:50.971120","last_peered":"2021-04-09 18:32:50.971120","last_clean":"2021-04-09 18:32:50.971120","last_became_active":"2021-04-09 18:19:54.680726","last_became_peered":"2021-04-09 18:19:54.680726","last_unstale":"2021-04-09 18:32:50.971120","last_undegraded":"2021-04-09 18:32:50.971120","last_fullsized":"2021-04-09 18:32:50.971120","mapping_epoch":20,"log_start":"23'100","ondisk_log_start":"23'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3005,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1622,"num_read_kb":187246,"num_write":2949,"num_write_kb":537587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"30'3074","reported_seq":"4785","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.972594","last_change":"2021-04-09 18:19:54.680273","last_active":"2021-04-09 18:32:50.972594","last_peered":"2021-04-09 18:32:50.972594","last_clean":"2021-04-09 18:32:50.972594","last_became_active":"2021-04-09 18:19:54.679793","last_became_peered":"2021-04-09 18:19:54.679793","last_unstale":"2021-04-09 18:32:50.972594","last_undegraded":"2021-04-09 18:32:50.972594","last_fullsized":"2021-04-09 18:32:50.972594","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3074,"ondisk_log_size":3074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1692,"num_read_kb":232958,"num_write":2932,"num_write_kb":526773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.948322","last_change":"2021-04-09 18:19:48.670446","last_active":"2021-04-09 18:30:00.948322","last_peered":"2021-04-09 18:30:00.948322","last_clean":"2021-04-09 18:30:00.948322","last_became_active":"2021-04-09 18:19:48.670077","last_became_peered":"2021-04-09 18:19:48.670077","last_unstale":"2021-04-09 18:30:00.948322","last_undegraded":"2021-04-09 18:30:00.948322","last_fullsized":"2021-04-09 18:30:00.948322","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'1659","reported_seq":"1708","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:49.927230","last_change":"2021-04-09 18:19:51.668684","last_active":"2021-04-09 18:32:49.927230","last_peered":"2021-04-09 18:32:49.927230","last_clean":"2021-04-09 18:32:49.927230","last_became_active":"2021-04-09 18:19:51.668425","last_became_peered":"2021-04-09 18:19:51.668425","last_unstale":"2021-04-09 18:32:49.927230","last_undegraded":"2021-04-09 18:32:49.927230","last_fullsized":"2021-04-09 18:32:49.927230","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1659,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":54038,"num_write":1625,"num_write_kb":14281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"30'3405","reported_seq":"5209","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.973677","last_change":"2021-04-09 18:19:54.678757","last_active":"2021-04-09 18:32:50.973677","last_peered":"2021-04-09 18:32:50.973677","last_clean":"2021-04-09 18:32:50.973677","last_became_active":"2021-04-09 18:19:54.678420","last_became_peered":"2021-04-09 18:19:54.678420","last_unstale":"2021-04-09 18:32:50.973677","last_undegraded":"2021-04-09 18:32:50.973677","last_fullsized":"2021-04-09 18:32:50.973677","mapping_epoch":20,"log_start":"23'400","ondisk_log_start":"23'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3005,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1785,"num_read_kb":229797,"num_write":3237,"num_write_kb":745712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.820358","last_change":"2021-04-09 18:19:48.660463","last_active":"2021-04-09 18:30:00.820358","last_peered":"2021-04-09 18:30:00.820358","last_clean":"2021-04-09 18:30:00.820358","last_became_active":"2021-04-09 18:19:48.660038","last_became_peered":"2021-04-09 18:19:48.660038","last_unstale":"2021-04-09 18:30:00.820358","last_undegraded":"2021-04-09 18:30:00.820358","last_fullsized":"2021-04-09 18:30:00.820358","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"30'1237","reported_seq":"1302","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:44.507912","last_change":"2021-04-09 18:19:51.670965","last_active":"2021-04-09 18:32:44.507912","last_peered":"2021-04-09 18:32:44.507912","last_clean":"2021-04-09 18:32:44.507912","last_became_active":"2021-04-09 18:19:51.670767","last_became_peered":"2021-04-09 18:19:51.670767","last_unstale":"2021-04-09 18:32:44.507912","last_undegraded":"2021-04-09 18:32:44.507912","last_fullsized":"2021-04-09 18:32:44.507912","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1237,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12583478,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":77,"num_read_kb":49216,"num_write":1015,"num_write_kb":12937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.829416","last_change":"2021-04-09 18:19:48.668518","last_active":"2021-04-09 18:30:00.829416","last_peered":"2021-04-09 18:30:00.829416","last_clean":"2021-04-09 18:30:00.829416","last_became_active":"2021-04-09 18:19:48.668225","last_became_peered":"2021-04-09 18:19:48.668225","last_unstale":"2021-04-09 18:30:00.829416","last_undegraded":"2021-04-09 18:30:00.829416","last_fullsized":"2021-04-09 18:30:00.829416","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"30'817","reported_seq":"895","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.475536","last_change":"2021-04-09 18:19:51.675432","last_active":"2021-04-09 18:32:50.475536","last_peered":"2021-04-09 18:32:50.475536","last_clean":"2021-04-09 18:32:50.475536","last_became_active":"2021-04-09 18:19:51.675161","last_became_peered":"2021-04-09 18:19:51.675161","last_unstale":"2021-04-09 18:32:50.475536","last_undegraded":"2021-04-09 18:32:50.475536","last_fullsized":"2021-04-09 18:32:50.475536","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":817,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":82,"num_read_kb":135240,"num_write":591,"num_write_kb":20834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'3228","reported_seq":"4840","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:51.289759","last_change":"2021-04-09 18:19:54.680136","last_active":"2021-04-09 18:32:51.289759","last_peered":"2021-04-09 18:32:51.289759","last_clean":"2021-04-09 18:32:51.289759","last_became_active":"2021-04-09 18:19:54.679654","last_became_peered":"2021-04-09 18:19:54.679654","last_unstale":"2021-04-09 18:32:51.289759","last_undegraded":"2021-04-09 18:32:51.289759","last_fullsized":"2021-04-09 18:32:51.289759","mapping_epoch":20,"log_start":"23'200","ondisk_log_start":"23'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3028,"ondisk_log_size":3028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1593,"num_read_kb":140394,"num_write":3081,"num_write_kb":627737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.820426","last_change":"2021-04-09 18:19:48.659172","last_active":"2021-04-09 18:30:00.820426","last_peered":"2021-04-09 18:30:00.820426","last_clean":"2021-04-09 18:30:00.820426","last_became_active":"2021-04-09 18:19:48.658788","last_became_peered":"2021-04-09 18:19:48.658788","last_unstale":"2021-04-09 18:30:00.820426","last_undegraded":"2021-04-09 18:30:00.820426","last_fullsized":"2021-04-09 18:30:00.820426","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"30'1932","reported_seq":"1987","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:51.002990","last_change":"2021-04-09 18:19:51.675238","last_active":"2021-04-09 18:32:51.002990","last_peered":"2021-04-09 18:32:51.002990","last_clean":"2021-04-09 18:32:51.002990","last_became_active":"2021-04-09 18:19:51.674810","last_became_peered":"2021-04-09 18:19:51.674810","last_unstale":"2021-04-09 18:32:51.002990","last_undegraded":"2021-04-09 18:32:51.002990","last_fullsized":"2021-04-09 18:32:51.002990","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1932,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":133210,"num_write":1688,"num_write_kb":25534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"30'3187","reported_seq":"4797","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.522190","last_change":"2021-04-09 18:19:54.680226","last_active":"2021-04-09 18:32:50.522190","last_peered":"2021-04-09 18:32:50.522190","last_clean":"2021-04-09 18:32:50.522190","last_became_active":"2021-04-09 18:19:54.679836","last_became_peered":"2021-04-09 18:19:54.679836","last_unstale":"2021-04-09 18:32:50.522190","last_undegraded":"2021-04-09 18:32:50.522190","last_fullsized":"2021-04-09 18:32:50.522190","mapping_epoch":20,"log_start":"23'100","ondisk_log_start":"23'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3087,"ondisk_log_size":3087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1591,"num_read_kb":159111,"num_write":3021,"num_write_kb":405224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"30'1642","reported_seq":"2316","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:51.956394","last_change":"2021-04-09 18:19:51.679961","last_active":"2021-04-09 18:32:51.956394","last_peered":"2021-04-09 18:32:51.956394","last_clean":"2021-04-09 18:32:51.956394","last_became_active":"2021-04-09 18:19:51.679689","last_became_peered":"2021-04-09 18:19:51.679689","last_unstale":"2021-04-09 18:32:51.956394","last_undegraded":"2021-04-09 18:32:51.956394","last_fullsized":"2021-04-09 18:32:51.956394","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1642,"ondisk_log_size":1642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9816456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":654,"num_read_kb":13580,"num_write":1392,"num_write_kb":10592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.829391","last_change":"2021-04-09 18:19:48.668812","last_active":"2021-04-09 18:30:00.829391","last_peered":"2021-04-09 18:30:00.829391","last_clean":"2021-04-09 18:30:00.829391","last_became_active":"2021-04-09 18:19:48.668474","last_became_peered":"2021-04-09 18:19:48.668474","last_unstale":"2021-04-09 18:30:00.829391","last_undegraded":"2021-04-09 18:30:00.829391","last_fullsized":"2021-04-09 18:30:00.829391","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"30'3348","reported_seq":"5061","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.997501","last_change":"2021-04-09 18:19:54.681340","last_active":"2021-04-09 18:32:50.997501","last_peered":"2021-04-09 18:32:50.997501","last_clean":"2021-04-09 18:32:50.997501","last_became_active":"2021-04-09 18:19:54.680877","last_became_peered":"2021-04-09 18:19:54.680877","last_unstale":"2021-04-09 18:32:50.997501","last_undegraded":"2021-04-09 18:32:50.997501","last_fullsized":"2021-04-09 18:32:50.997501","mapping_epoch":20,"log_start":"23'300","ondisk_log_start":"23'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3048,"ondisk_log_size":3048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1694,"num_read_kb":164019,"num_write":3172,"num_write_kb":529088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"30'2362","reported_seq":"2450","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:54.931046","last_change":"2021-04-09 18:19:51.675129","last_active":"2021-04-09 18:32:54.931046","last_peered":"2021-04-09 18:32:54.931046","last_clean":"2021-04-09 18:32:54.931046","last_became_active":"2021-04-09 18:19:51.674771","last_became_peered":"2021-04-09 18:19:51.674771","last_unstale":"2021-04-09 18:32:54.931046","last_undegraded":"2021-04-09 18:32:54.931046","last_fullsized":"2021-04-09 18:32:54.931046","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":2362,"ondisk_log_size":2362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32652287,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":132,"num_read_kb":131070,"num_write":2126,"num_write_kb":33047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.828985","last_change":"2021-04-09 18:19:48.660437","last_active":"2021-04-09 18:30:00.828985","last_peered":"2021-04-09 18:30:00.828985","last_clean":"2021-04-09 18:30:00.828985","last_became_active":"2021-04-09 18:19:48.660180","last_became_peered":"2021-04-09 18:19:48.660180","last_unstale":"2021-04-09 18:30:00.828985","last_undegraded":"2021-04-09 18:30:00.828985","last_fullsized":"2021-04-09 18:30:00.828985","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"30'3229","reported_seq":"4866","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.971782","last_change":"2021-04-09 18:19:54.679817","last_active":"2021-04-09 18:32:50.971782","last_peered":"2021-04-09 18:32:50.971782","last_clean":"2021-04-09 18:32:50.971782","last_became_active":"2021-04-09 18:19:54.679420","last_became_peered":"2021-04-09 18:19:54.679420","last_unstale":"2021-04-09 18:32:50.971782","last_undegraded":"2021-04-09 18:32:50.971782","last_fullsized":"2021-04-09 18:32:50.971782","mapping_epoch":20,"log_start":"23'200","ondisk_log_start":"23'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3029,"ondisk_log_size":3029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1618,"num_read_kb":119462,"num_write":3067,"num_write_kb":470086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13171,"num_read_kb":1400732,"num_write":24443,"num_write_kb":4455094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24310,"ondisk_log_size":24310,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":155716345,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1210,"num_read_kb":702200,"num_write":12046,"num_write_kb":160330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":198295552,"data_stored":311432690,"data_compressed":50837928,"data_compressed_allocated":113205248,"data_compressed_original":226410368,"omap_allocated":0,"internal_metadata":0},"log_size":13729,"ondisk_log_size":13729,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575012,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1093440,"kb_used_data":44856,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93278400,"statfs":{"total":96636764160,"available":95517081600,"internally_reserved":1073741824,"allocated":45932544,"data_stored":70537092,"data_compressed":11033403,"data_compressed_allocated":24817664,"data_compressed_original":49635264,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:00 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42399999999999999,"15min":6.758},"min":{"1min":0.23499999999999999,"5min":0.189,"15min":0.189},"max":{"1min":0.56100000000000005,"5min":1.4079999999999999,"15min":552.03099999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":26.881,"5min":5.7460000000000004,"15min":5.2149999999999999},"min":{"1min":0.29599999999999999,"5min":0.23000000000000001,"15min":0.19500000000000001},"max":{"1min":582.798,"5min":582.798,"15min":582.798},"last":0.5}]},{"osd":1,"last update":"Fri Apr 9 18:32:00 2021","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":1.484,"15min":4.548},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.19600000000000001},"max":{"1min":0.54000000000000004,"5min":107.545,"15min":243.08699999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":29.744,"5min":17.109999999999999,"15min":9.0990000000000002},"min":{"1min":0.23400000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":646.31700000000001,"5min":974.39400000000001,"15min":974.39400000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Apr 9 18:32:00 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":13.378,"15min":6.5579999999999998},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.246},"max":{"1min":0.56999999999999995,"5min":603.80899999999997,"15min":603.80899999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.44500000000000001,"15min":2.4710000000000001},"min":{"1min":0.32700000000000001,"5min":0.28100000000000003,"15min":0.224},"max":{"1min":0.58199999999999996,"5min":1.135,"15min":635.03700000000003},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Apr 9 18:32:00 2021","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":15.922000000000001,"15min":10.887},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.255},"max":{"1min":0.56000000000000005,"5min":959.947,"15min":959.947},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.436,"5min":5.7290000000000001,"15min":4.4889999999999999},"min":{"1min":0.312,"5min":0.29099999999999998,"15min":0.23699999999999999},"max":{"1min":0.57499999999999996,"5min":501.96600000000001,"15min":545.40899999999999},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Apr 9 18:32:00 2021","interfaces":[{"interface":"back","average":{"1min":20.838999999999999,"5min":4.4550000000000001,"15min":1.742},"min":{"1min":0.186,"5min":0.183,"15min":0.183},"max":{"1min":451.887,"5min":451.887,"15min":451.887},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.38400000000000001,"15min":3.4929999999999999},"min":{"1min":0.219,"5min":0.182,"15min":0.182},"max":{"1min":0.58799999999999997,"5min":1.984,"15min":676.46900000000005},"last":0.32700000000000001}]},{"osd":5,"last update":"Fri Apr 9 18:32:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":0.56200000000000006,"5min":2.2189999999999999,"15min":2.871},"last":0.377},{"interface":"front","average":{"1min":0.374,"5min":4.8010000000000002,"15min":4.4900000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.23200000000000001},"max":{"1min":0.56699999999999995,"5min":350.24599999999998,"15min":741.22199999999998},"last":0.38900000000000001}]},{"osd":6,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":6.4770000000000003,"15min":6.2530000000000001},"min":{"1min":0.23999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":610.43899999999996,"15min":766.49300000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40300000000000002,"15min":0.432},"min":{"1min":0.245,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.53500000000000003,"5min":1.361,"15min":5.4050000000000002},"last":0.42699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1065240,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93306600,"statfs":{"total":96636764160,"available":95545958400,"internally_reserved":1073741824,"allocated":17055744,"data_stored":25301733,"data_compressed":3840529,"data_compressed_allocated":8450048,"data_compressed_original":16900032,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":18.530999999999999,"5min":4.0039999999999996,"15min":4.3209999999999997},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.17999999999999999},"max":{"1min":363.27499999999998,"5min":363.27499999999998,"15min":592.09900000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":10.096,"15min":4.2039999999999997},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.19700000000000001},"max":{"1min":0.59799999999999998,"5min":728.14300000000003,"15min":728.14300000000003},"last":0.70799999999999996}]},{"osd":1,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.371,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.47799999999999998,"5min":0.63500000000000001,"15min":2.3140000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":2.8479999999999999},"min":{"1min":0.32400000000000001,"5min":0.22800000000000001,"15min":0.217},"max":{"1min":0.54600000000000004,"5min":1.1499999999999999,"15min":692.18100000000004},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":3.637,"15min":3.5409999999999999},"min":{"1min":0.24199999999999999,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.58499999999999996,"5min":212.816,"15min":416.06900000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.433},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.23400000000000001},"max":{"1min":0.56899999999999995,"5min":0.66500000000000004,"15min":1.665},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Apr 9 18:32:06 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":5.7329999999999997,"15min":5.2409999999999997},"min":{"1min":0.29999999999999999,"5min":0.26200000000000001,"15min":0.23100000000000001},"max":{"1min":0.59399999999999997,"5min":532.06899999999996,"15min":860.98099999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":3.8940000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.61399999999999999,"5min":0.86399999999999999,"15min":675.61300000000006},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":8.2240000000000002,"15min":6.048},"min":{"1min":0.248,"5min":0.191,"15min":0.17299999999999999},"max":{"1min":0.496,"5min":670.02200000000005,"15min":670.02200000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":50.018000000000001,"5min":28.960999999999999,"15min":14.472},"min":{"1min":0.23799999999999999,"5min":0.23200000000000001,"15min":0.19900000000000001},"max":{"1min":993.46400000000006,"5min":993.46400000000006,"15min":993.46400000000006},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":17.515999999999998,"15min":6.8250000000000002},"min":{"1min":0.245,"5min":0.215,"15min":0.21299999999999999},"max":{"1min":0.53800000000000003,"5min":865.55600000000004,"15min":865.55600000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":3.073},"min":{"1min":0.26300000000000001,"5min":0.249,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.57899999999999996,"15min":924.65300000000002},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Apr 9 18:32:06 2021","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":13.430999999999999,"15min":5.1719999999999997},"min":{"1min":0.25600000000000001,"5min":0.23200000000000001,"15min":0.19400000000000001},"max":{"1min":0.55400000000000005,"5min":597.70600000000002,"15min":597.70600000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.35399999999999998,"5min":2.5379999999999998,"15min":1.3859999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60899999999999999,"5min":195.625,"15min":195.625},"last":0.61199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575013,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1075676,"kb_used_data":27092,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93296164,"statfs":{"total":96636764160,"available":95535271936,"internally_reserved":1073741824,"allocated":27742208,"data_stored":46272721,"data_compressed":8418247,"data_compressed_allocated":18726912,"data_compressed_original":37453824,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.41599999999999998,"15min":0.505},"min":{"1min":0.27300000000000002,"5min":0.19,"15min":0.19},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":21.654},"last":0.59099999999999997},{"interface":"front","average":{"1min":6.6749999999999998,"5min":3.149,"15min":3.9169999999999998},"min":{"1min":0.27000000000000002,"5min":0.248,"15min":0.218},"max":{"1min":137.06999999999999,"5min":176.75200000000001,"15min":519.08100000000002},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.39500000000000002,"15min":0.41299999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20399999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.3839999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":35.027999999999999,"5min":7.3700000000000001,"15min":3.4039999999999999},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.19900000000000001},"max":{"1min":761.06899999999996,"5min":761.06899999999996,"15min":761.06899999999996},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":3.6280000000000001,"15min":4.3029999999999999},"min":{"1min":0.23699999999999999,"5min":0.22900000000000001,"15min":0.214},"max":{"1min":1.282,"5min":384.24000000000001,"15min":786.34900000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":15.673,"5min":3.5089999999999999,"15min":1.5049999999999999},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":335.99200000000002,"5min":335.99200000000002,"15min":335.99200000000002},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":14.919,"15min":5.274},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.4279999999999999,"5min":785.99199999999996,"15min":785.99199999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.45300000000000001,"15min":16.681999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.65000000000000002,"5min":2.323,"15min":643.62},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":7.6420000000000003,"15min":2.899},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19},"max":{"1min":1.9910000000000001,"5min":500.91800000000001,"15min":500.91800000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":5.468,"15min":5.4400000000000004},"min":{"1min":0.23000000000000001,"5min":0.22700000000000001,"15min":0.192},"max":{"1min":0.56599999999999995,"5min":405.11700000000002,"15min":437.25599999999997},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":3.7959999999999998,"15min":13.470000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19600000000000001},"max":{"1min":1.222,"5min":209.929,"15min":840.71699999999998},"last":0.379},{"interface":"front","average":{"1min":0.41699999999999998,"5min":5.6159999999999997,"15min":10.382},"min":{"1min":0.26700000000000002,"5min":0.23000000000000001,"15min":0.185},"max":{"1min":1.3500000000000001,"5min":575.17200000000003,"15min":681.07500000000005},"last":0.41399999999999998}]},{"osd":7,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":33.874000000000002,"5min":7.0890000000000004,"15min":8.9809999999999999},"min":{"1min":0.23699999999999999,"5min":0.22500000000000001,"15min":0.19800000000000001},"max":{"1min":703.91499999999996,"5min":703.91499999999996,"15min":703.91499999999996},"last":0.505},{"interface":"front","average":{"1min":30.684999999999999,"5min":8.9280000000000008,"15min":7.3630000000000004},"min":{"1min":0.248,"5min":0.23599999999999999,"15min":0.224},"max":{"1min":635.601,"5min":635.601,"15min":635.601},"last":0.52500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048904,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322936,"statfs":{"total":96636764160,"available":95562686464,"internally_reserved":1073741824,"allocated":327680,"data_stored":135343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":1.3220000000000001,"15min":9.3670000000000009},"min":{"1min":0.26300000000000001,"5min":0.23200000000000001,"15min":0.184},"max":{"1min":0.64500000000000002,"5min":83.387,"15min":1084.748},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.40100000000000002,"15min":1.137},"min":{"1min":0.28499999999999998,"5min":0.24199999999999999,"15min":0.23400000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":112.58199999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":5.9969999999999999,"15min":2.2669999999999999},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.54000000000000004,"5min":558.18799999999999,"15min":558.18799999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.438,"15min":5.2729999999999997},"min":{"1min":0.26200000000000001,"5min":0.23499999999999999,"15min":0.21299999999999999},"max":{"1min":0.54200000000000004,"5min":2.141,"15min":720.49000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40200000000000002,"15min":6.3819999999999997},"min":{"1min":0.26200000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.655,"5min":1.655,"15min":1100.546},"last":0.443},{"interface":"front","average":{"1min":0.45600000000000002,"5min":1.262,"15min":6.9050000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22600000000000001},"max":{"1min":1.506,"5min":74.540999999999997,"15min":1100.5699999999999},"last":0.433}]},{"osd":3,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.432,"15min":3.4489999999999998},"min":{"1min":0.28399999999999997,"5min":0.26800000000000002,"15min":0.246},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":955.88499999999999},"last":0.496},{"interface":"front","average":{"1min":0.49199999999999999,"5min":1.619,"15min":0.82799999999999996},"min":{"1min":0.33800000000000002,"5min":0.28899999999999998,"15min":0.23899999999999999},"max":{"1min":1.5629999999999999,"5min":107.729,"15min":107.729},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":10.08,"15min":3.7450000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":0.82799999999999996,"5min":500.57999999999998,"15min":500.57999999999998},"last":0.375},{"interface":"front","average":{"1min":0.378,"5min":20.699000000000002,"15min":9.5909999999999993},"min":{"1min":0.23499999999999999,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":1.623,"5min":904.89400000000001,"15min":904.89400000000001},"last":0.38700000000000001}]},{"osd":6,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.39700000000000002,"15min":1.206},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.21099999999999999},"max":{"1min":0.52400000000000002,"5min":2.177,"15min":235.71000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":24.959,"5min":5.2949999999999999,"15min":2.0099999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20899999999999999},"max":{"1min":492.97000000000003,"5min":492.97000000000003,"15min":492.97000000000003},"last":0.41599999999999998}]},{"osd":7,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.41499999999999998,"15min":3.3940000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.20899999999999999},"max":{"1min":0.51100000000000001,"5min":2.1869999999999998,"15min":993.75300000000004},"last":0.504},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.48199999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.21199999999999999},"max":{"1min":1.641,"5min":1.641,"15min":32.991},"last":0.40999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1075556,"kb_used_data":26972,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93296284,"statfs":{"total":96636764160,"available":95535394816,"internally_reserved":1073741824,"allocated":27619328,"data_stored":42079177,"data_compressed":6498995,"data_compressed_allocated":14667776,"data_compressed_original":29335552,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.28199999999999997,"15min":2.9049999999999998},"min":{"1min":0.183,"5min":0.151,"15min":0.14199999999999999},"max":{"1min":0.45800000000000002,"5min":1.8859999999999999,"15min":370.23200000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.29299999999999998,"5min":20.943999999999999,"15min":9.7560000000000002},"min":{"1min":0.17399999999999999,"5min":0.17000000000000001,"15min":0.152},"max":{"1min":0.58999999999999997,"5min":949.67999999999995,"15min":980.14200000000005},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":11.308999999999999,"15min":7.7949999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.159},"max":{"1min":1.1080000000000001,"5min":935.36599999999999,"15min":935.36599999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":9.1820000000000004,"15min":6.8250000000000002},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.16600000000000001},"max":{"1min":2.258,"5min":707.76800000000003,"15min":763.25900000000001},"last":723.14300000000003}]},{"osd":3,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":4.7329999999999997,"15min":2.2250000000000001},"min":{"1min":0.23499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.54300000000000004,"5min":374.58499999999998,"15min":374.58499999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":8.6400000000000006,"15min":6.2320000000000002},"min":{"1min":0.253,"5min":0.17999999999999999,"15min":0.159},"max":{"1min":0.51200000000000001,"5min":706.14999999999998,"15min":706.14999999999998},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":4.8710000000000004,"15min":5.7249999999999996},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23000000000000001},"max":{"1min":0.67300000000000004,"5min":356.02300000000002,"15min":797.23199999999997},"last":0.376},{"interface":"front","average":{"1min":19.209,"5min":20.712,"15min":9.8949999999999996},"min":{"1min":0.25600000000000001,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":339.25700000000001,"5min":926.05899999999997,"15min":926.05899999999997},"last":0.40300000000000002}]},{"osd":5,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":50.677999999999997,"5min":11.989000000000001,"15min":5.3789999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":855.36000000000001,"5min":855.36000000000001,"15min":855.36000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":10.542999999999999,"15min":4.0590000000000002},"min":{"1min":0.33000000000000002,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":0.86599999999999999,"5min":858.15300000000002,"15min":858.15300000000002},"last":0.37}]},{"osd":6,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":43.277000000000001,"5min":16.277000000000001,"15min":6.3890000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.252},"max":{"1min":771.98699999999997,"5min":798.38699999999994,"15min":798.38699999999994},"last":0.42199999999999999},{"interface":"front","average":{"1min":42.238,"5min":18.111000000000001,"15min":7.1749999999999998},"min":{"1min":0.308,"5min":0.29799999999999999,"15min":0.27200000000000002},"max":{"1min":753.20699999999999,"5min":753.20699999999999,"15min":753.20699999999999},"last":0.39800000000000002}]},{"osd":7,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":5.1139999999999999},"min":{"1min":0.317,"5min":0.245,"15min":0.245},"max":{"1min":1.0920000000000001,"5min":1.5840000000000001,"15min":983.08600000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":14.292999999999999,"15min":5.085},"min":{"1min":0.313,"5min":0.312,"15min":0.27600000000000002},"max":{"1min":0.78700000000000003,"5min":825.28099999999995,"15min":825.28099999999995},"last":0.434}]}]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1102804,"kb_used_data":54220,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93269036,"statfs":{"total":96636764160,"available":95507492864,"internally_reserved":1073741824,"allocated":55521280,"data_stored":87314216,"data_compressed":14545655,"data_compressed_allocated":31993856,"data_compressed_original":63987712,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.28100000000000003,"15min":0.39700000000000002},"min":{"1min":0.159,"5min":0.159,"15min":0.14499999999999999},"max":{"1min":0.501,"5min":1.748,"15min":26.109000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.316,"15min":2.1259999999999999},"min":{"1min":0.17999999999999999,"5min":0.151,"15min":0.14899999999999999},"max":{"1min":0.41599999999999998,"5min":1.347,"15min":537.42399999999998},"last":0.22900000000000001}]},{"osd":2,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":8.3469999999999995,"15min":10.035},"min":{"1min":0.16800000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.47499999999999998,"5min":843.40599999999995,"15min":984.54499999999996},"last":0.218},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.63700000000000001,"15min":22.808},"min":{"1min":0.20499999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.52000000000000002,"5min":35.290999999999997,"15min":803.20399999999995},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":17.965,"5min":5.9640000000000004,"15min":5.1520000000000001},"min":{"1min":0.20200000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":335.904,"5min":335.904,"15min":335.904},"last":0.372},{"interface":"front","average":{"1min":43.740000000000002,"5min":24.318000000000001,"15min":12.151},"min":{"1min":0.245,"5min":0.19500000000000001,"15min":0.16},"max":{"1min":825.78300000000002,"5min":868.67700000000002,"15min":868.67700000000002},"last":0.28999999999999998}]},{"osd":4,"last update":"Fri Apr 9 18:32:04 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42999999999999999,"15min":2.9670000000000001},"min":{"1min":0.29699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.65500000000000003,"5min":0.85099999999999998,"15min":208.495},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.45100000000000001,"15min":6.4050000000000002},"min":{"1min":0.27800000000000002,"5min":0.26300000000000001,"15min":0.245},"max":{"1min":0.64800000000000002,"5min":1.488,"15min":707.65899999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":14.994,"15min":16.943000000000001},"min":{"1min":0.28199999999999997,"5min":0.247,"15min":0.247},"max":{"1min":0.51500000000000001,"5min":588.13699999999994,"15min":997.548},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.49299999999999999,"15min":10.696},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.63400000000000001,"5min":3.5310000000000001,"15min":933.71600000000001},"last":0.48699999999999999}]},{"osd":6,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":18.605,"5min":12.630000000000001,"15min":6.1289999999999996},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":327.71100000000001,"5min":639.91200000000003,"15min":639.91200000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":18.478000000000002,"15min":12.032},"min":{"1min":0.28799999999999998,"5min":0.28199999999999997,"15min":0.27700000000000002},"max":{"1min":0.65600000000000003,"5min":957.94899999999996,"15min":957.94899999999996},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":5.71,"15min":5.7649999999999997},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.253},"max":{"1min":0.71599999999999997,"5min":500.83999999999997,"15min":500.83999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.438,"5min":4.6269999999999998,"15min":3.9249999999999998},"min":{"1min":0.32000000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.627,"5min":500.82999999999998,"15min":500.82999999999998},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1067332,"kb_used_data":18748,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93304508,"statfs":{"total":96636764160,"available":95543816192,"internally_reserved":1073741824,"allocated":19197952,"data_stored":30923353,"data_compressed":5307282,"data_compressed_allocated":11923456,"data_compressed_original":23846912,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.27300000000000002,"15min":2.2810000000000001},"min":{"1min":0.19700000000000001,"5min":0.14499999999999999,"15min":0.13800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":568.56600000000003},"last":0.33100000000000002},{"interface":"front","average":{"1min":7.7709999999999999,"5min":7.9050000000000002,"15min":7.3879999999999999},"min":{"1min":0.183,"5min":0.17999999999999999,"15min":0.16200000000000001},"max":{"1min":119.66500000000001,"5min":311.89699999999999,"15min":400.709},"last":0.248}]},{"osd":1,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.314,"15min":13.382},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.41499999999999998,"5min":1.292,"15min":981.71000000000004},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.317,"15min":0.34000000000000002},"min":{"1min":0.188,"5min":0.17599999999999999,"15min":0.17499999999999999},"max":{"1min":0.58899999999999997,"5min":0.97499999999999998,"15min":2.6509999999999998},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":6.8710000000000004,"15min":2.516},"min":{"1min":0.224,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":0.56599999999999995,"5min":438.19499999999999,"15min":438.19499999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.317,"15min":1.3009999999999999},"min":{"1min":0.20599999999999999,"5min":0.192,"15min":0.16500000000000001},"max":{"1min":0.59599999999999997,"5min":0.626,"15min":256.45299999999997},"last":0.28399999999999997}]},{"osd":4,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.69799999999999995},"min":{"1min":0.27500000000000002,"5min":0.249,"15min":0.22900000000000001},"max":{"1min":0.67900000000000005,"5min":0.79000000000000004,"15min":64.497},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":18.603000000000002,"15min":10.135999999999999},"min":{"1min":0.29999999999999999,"5min":0.27400000000000002,"15min":0.24299999999999999},"max":{"1min":0.71799999999999997,"5min":672.15800000000002,"15min":672.15800000000002},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Apr 9 18:32:18 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":16.571000000000002,"15min":14.084},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.25},"max":{"1min":0.65400000000000003,"5min":944.35000000000002,"15min":944.35000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":11.064},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70499999999999996,"5min":1.4630000000000001,"15min":500.64699999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Apr 9 18:32:18 2021","interfaces":[{"interface":"back","average":{"1min":62.701999999999998,"5min":12.898,"15min":4.6219999999999999},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.26000000000000001},"max":{"1min":996.5,"5min":996.5,"15min":996.5},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.35999999999999999,"5min":0.28199999999999997,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":1.4750000000000001,"15min":3.6080000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":3.399,"15min":5.5099999999999998},"min":{"1min":0.30199999999999999,"5min":0.27800000000000002,"15min":0.26700000000000002},"max":{"1min":0.64900000000000002,"5min":235.40700000000001,"15min":847.73000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.73099999999999998},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.28399999999999997},"max":{"1min":0.746,"5min":1.486,"15min":63.689999999999998},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1055928,"kb_used_data":7344,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315912,"statfs":{"total":96636764160,"available":95555493888,"internally_reserved":1073741824,"allocated":7520256,"data_stored":9951799,"data_compressed":1193817,"data_compressed_allocated":2625536,"data_compressed_original":5251072,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.29999999999999999,"15min":10.824},"min":{"1min":0.17899999999999999,"5min":0.16400000000000001,"15min":0.13900000000000001},"max":{"1min":0.48399999999999999,"5min":1.875,"15min":790.36000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":54.048999999999999,"5min":12.827999999999999,"15min":6.7439999999999998},"min":{"1min":0.17699999999999999,"5min":0.154,"15min":0.14699999999999999},"max":{"1min":914.44100000000003,"5min":914.44100000000003,"15min":914.44100000000003},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.29999999999999999,"15min":3.7850000000000001},"min":{"1min":0.21199999999999999,"5min":0.16,"15min":0.158},"max":{"1min":0.59299999999999997,"5min":0.78400000000000003,"15min":565.56600000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":5.2050000000000001},"min":{"1min":0.20000000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.92400000000000004,"5min":2.2200000000000002,"15min":500.68299999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":30.271999999999998,"5min":6.3390000000000004,"15min":9.8849999999999998},"min":{"1min":0.23999999999999999,"5min":0.20699999999999999,"15min":0.19800000000000001},"max":{"1min":509.69499999999999,"5min":509.69499999999999,"15min":742.48699999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.36199999999999999,"15min":4.8029999999999999},"min":{"1min":0.221,"5min":0.19,"15min":0.19},"max":{"1min":0.89700000000000002,"5min":2.2519999999999998,"15min":500.53899999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":2.3490000000000002,"15min":14.544},"min":{"1min":0.28499999999999998,"5min":0.252,"15min":0.23400000000000001},"max":{"1min":0.56999999999999995,"5min":113.149,"15min":959.31799999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.3460000000000001,"5min":11.412000000000001,"15min":5.1050000000000004},"min":{"1min":0.29999999999999999,"5min":0.246,"15min":0.22700000000000001},"max":{"1min":15.391,"5min":973.16399999999999,"15min":973.16399999999999},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":5.4649999999999999,"15min":4.3570000000000002},"min":{"1min":0.31900000000000001,"5min":0.26700000000000002,"15min":0.22800000000000001},"max":{"1min":0.88300000000000001,"5min":500.66699999999997,"15min":728.46199999999999},"last":0.504},{"interface":"front","average":{"1min":0.442,"5min":15.743,"15min":11.685},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.752,"5min":884.28700000000003,"15min":884.28700000000003},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":25.808,"5min":7.75,"15min":3.673},"min":{"1min":0.33400000000000002,"5min":0.251,"15min":0.251},"max":{"1min":430.43400000000003,"5min":430.43400000000003,"15min":430.43400000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.5,"5min":15.512,"15min":17.364000000000001},"min":{"1min":0.33500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72999999999999998,"5min":975.39700000000005,"15min":975.39700000000005},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50900000000000001,"15min":6.6219999999999999},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.27300000000000002},"max":{"1min":0.93000000000000005,"5min":2.371,"15min":830.30999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.27800000000000002},"max":{"1min":0.90400000000000003,"5min":1.218,"15min":3.5550000000000002},"last":0.58999999999999997}]}]}]}} 2021-04-09T18:32:59.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-04-09T18:32:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.797 7fc643c42700 1 Processor -- start 2021-04-09T18:32:59.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.797 7fc643c42700 1 -- start start 2021-04-09T18:32:59.806 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc643c42700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c0d7160 0x7fc63c0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc643c42700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc63c0e70a0 0x7fc63c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.807 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc643c42700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c0d6be0 con 0x7fc63c0d7560 2021-04-09T18:32:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc643c42700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0d80f0 con 0x7fc63c0e70a0 2021-04-09T18:32:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc643c42700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0e7f00 con 0x7fc63c0d7160 2021-04-09T18:32:59.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc64225f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc63c0e70a0 0x7fc63c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.809 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc64125d700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc63c0d7560 0x7fc63c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55076/0 (socket says 172.21.15.120:55076) 2021-04-09T18:32:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc64125d700 1 -- 172.21.15.120:0/105154587 learned_addr learned my addr 172.21.15.120:0/105154587 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:32:59.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc641a5e700 1 --2- 172.21.15.120:0/105154587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c0d7160 0x7fc63c0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.811 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc64225f700 1 -- 172.21.15.120:0/105154587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c0d7160 msgr2=0x7fc63c0e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:32:59.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc64225f700 1 --2- 172.21.15.120:0/105154587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c0d7160 0x7fc63c0e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc64225f700 1 -- 172.21.15.120:0/105154587 >> v1:172.21.15.120:6789/0 conn(0x7fc63c0d7560 legacy=0x7fc63c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc640a5c700 1 -- 172.21.15.120:0/105154587 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234845044 0 0) 0x7fc62c0009b0 con 0x7fc63c0d7560 2021-04-09T18:32:59.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc64225f700 1 -- 172.21.15.120:0/105154587 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c1a2ac0 con 0x7fc63c0e70a0 2021-04-09T18:32:59.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.798 7fc64225f700 1 --2- 172.21.15.120:0/105154587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c0e70a0 0x7fc63c0d5d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc634006ab0 tx=0x7fc634009ac0).ready entity=mon.0 client_cookie=1d7e93144bda6155 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:59.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.799 7fc640a5c700 1 -- 172.21.15.120:0/105154587 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6340066d0 con 0x7fc63c0e70a0 2021-04-09T18:32:59.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.799 7fc640a5c700 1 -- 172.21.15.120:0/105154587 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6340022e0 con 0x7fc63c0e70a0 2021-04-09T18:32:59.815 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.799 7fc640a5c700 1 -- 172.21.15.120:0/105154587 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6340027c0 con 0x7fc63c0e70a0 2021-04-09T18:32:59.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.799 7fc643c42700 1 -- 172.21.15.120:0/105154587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c0e70a0 msgr2=0x7fc63c0d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.816 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.799 7fc643c42700 1 --2- 172.21.15.120:0/105154587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c0e70a0 0x7fc63c0d5d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc634006ab0 tx=0x7fc634009ac0).stop 2021-04-09T18:32:59.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.799 7fc643c42700 1 -- 172.21.15.120:0/105154587 shutdown_connections 2021-04-09T18:32:59.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.799 7fc643c42700 1 --2- 172.21.15.120:0/105154587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c0e70a0 0x7fc63c0d5d90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.817 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.799 7fc643c42700 1 --2- 172.21.15.120:0/105154587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c0d7160 0x7fc63c0e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.799 7fc643c42700 1 -- 172.21.15.120:0/105154587 >> 172.21.15.120:0/105154587 conn(0x7fc63c0d1590 msgr2=0x7fc63c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:32:59.818 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.800 7fc643c42700 1 -- 172.21.15.120:0/105154587 shutdown_connections 2021-04-09T18:32:59.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.800 7fc643c42700 1 -- 172.21.15.120:0/105154587 wait complete. 2021-04-09T18:32:59.819 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.818 7fc643c42700 1 Processor -- start 2021-04-09T18:32:59.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.818 7fc643c42700 1 -- start start 2021-04-09T18:32:59.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc643c42700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c187380 0x7fc63c189630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.820 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc643c42700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c187780 0x7fc63c0987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc643c42700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc63c189c50 0x7fc63c0b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.821 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc643c42700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c18ce60 con 0x7fc63c187780 2021-04-09T18:32:59.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc643c42700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c098e10 con 0x7fc63c189c50 2021-04-09T18:32:59.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc643c42700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c099030 con 0x7fc63c187380 2021-04-09T18:32:59.822 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64125d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c187780 0x7fc63c0987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64125d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c187780 0x7fc63c0987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60168/0 (socket says 172.21.15.120:60168) 2021-04-09T18:32:59.823 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64125d700 1 -- 172.21.15.120:0/170102199 learned_addr learned my addr 172.21.15.120:0/170102199 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:32:59.827 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc641a5e700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c187380 0x7fc63c189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64225f700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc63c189c50 0x7fc63c0b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.828 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64125d700 1 -- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c187380 msgr2=0x7fc63c189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64125d700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c187380 0x7fc63c189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64125d700 1 -- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc63c189c50 msgr2=0x7fc63c0b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:32:59.829 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64125d700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc63c189c50 0x7fc63c0b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:32:59.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64125d700 1 -- 172.21.15.120:0/170102199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c18d080 con 0x7fc63c187780 2021-04-09T18:32:59.830 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.819 7fc64125d700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c187780 0x7fc63c0987f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fc62c00a4c0 tx=0x7fc62c00a860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:59.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.820 7fc6327fc700 1 -- 172.21.15.120:0/170102199 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc62c00ac50 con 0x7fc63c187780 2021-04-09T18:32:59.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.820 7fc6327fc700 1 -- 172.21.15.120:0/170102199 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c004140 con 0x7fc63c187780 2021-04-09T18:32:59.831 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.820 7fc643c42700 1 -- 172.21.15.120:0/170102199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c18d080 con 0x7fc63c187780 2021-04-09T18:32:59.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.820 7fc6327fc700 1 -- 172.21.15.120:0/170102199 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc62c004620 con 0x7fc63c187780 2021-04-09T18:32:59.832 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.820 7fc643c42700 1 -- 172.21.15.120:0/170102199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c18d080 con 0x7fc63c187780 2021-04-09T18:32:59.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.820 7fc6327fc700 1 -- 172.21.15.120:0/170102199 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc62c004320 con 0x7fc63c187780 2021-04-09T18:32:59.833 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.820 7fc6327fc700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc624018930 0x7fc62401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:32:59.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.820 7fc6327fc700 1 -- 172.21.15.120:0/170102199 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fc62c032de0 con 0x7fc63c187780 2021-04-09T18:32:59.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.821 7fc641a5e700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc624018930 0x7fc62401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:32:59.834 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.821 7fc641a5e700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc624018930 0x7fc62401ae10 crc :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:32:59.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.844 7fc643c42700 1 -- 172.21.15.120:0/170102199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c189100 con 0x7fc63c187780 2021-04-09T18:32:59.836 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:32:59.847 7fc6327fc700 1 -- 172.21.15.120:0/170102199 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc62c0009b0 con 0x7fc63c187780 2021-04-09T18:33:00.008 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.023 7fc643c42700 1 -- 172.21.15.120:0/170102199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc63c189100 con 0x7fc63c187780 2021-04-09T18:33:00.009 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.024 7fc6327fc700 1 -- 172.21.15.120:0/170102199 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15321 (secure 0 0 0) 0x7fc62c004140 con 0x7fc63c187780 2021-04-09T18:33:00.010 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:33:00.010 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"fsid":"dcbe2161-e5ca-44be-8661-d46578834d60","created":"2021-04-09 18:19:30.982707","modified":"2021-04-09 18:31:45.823957","last_up_change":"2021-04-09 18:19:42.766712","last_in_change":"2021-04-09 18:19:42.766712","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-04-09 18:19:47.013532","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2021-04-09 18:19:50.254363","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2021-04-09 18:19:52.685224","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99df735f-537d-4d75-a10d-c026975a00a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":24540},{"type":"v1","addr":"172.21.15.120:6801","nonce":24540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":24540},{"type":"v1","addr":"172.21.15.120:6803","nonce":24540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":24540},{"type":"v1","addr":"172.21.15.120:6807","nonce":24540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":24540},{"type":"v1","addr":"172.21.15.120:6805","nonce":24540}]},"public_addr":"172.21.15.120:6801/24540","cluster_addr":"172.21.15.120:6803/24540","heartbeat_back_addr":"172.21.15.120:6807/24540","heartbeat_front_addr":"172.21.15.120:6805/24540","state":["exists","up"]},{"osd":1,"uuid":"c48018d0-ff09-4a42-834e-5bbb908978d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":24588},{"type":"v1","addr":"172.21.15.120:6809","nonce":24588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":24588},{"type":"v1","addr":"172.21.15.120:6811","nonce":24588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":24588},{"type":"v1","addr":"172.21.15.120:6815","nonce":24588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":24588},{"type":"v1","addr":"172.21.15.120:6813","nonce":24588}]},"public_addr":"172.21.15.120:6809/24588","cluster_addr":"172.21.15.120:6811/24588","heartbeat_back_addr":"172.21.15.120:6815/24588","heartbeat_front_addr":"172.21.15.120:6813/24588","state":["exists","up"]},{"osd":2,"uuid":"3612c205-5cef-4483-b2f7-af04854d9004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":24603},{"type":"v1","addr":"172.21.15.120:6817","nonce":24603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":24603},{"type":"v1","addr":"172.21.15.120:6819","nonce":24603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":24603},{"type":"v1","addr":"172.21.15.120:6823","nonce":24603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":24603},{"type":"v1","addr":"172.21.15.120:6821","nonce":24603}]},"public_addr":"172.21.15.120:6817/24603","cluster_addr":"172.21.15.120:6819/24603","heartbeat_back_addr":"172.21.15.120:6823/24603","heartbeat_front_addr":"172.21.15.120:6821/24603","state":["exists","up"]},{"osd":3,"uuid":"45c829c9-94c2-4106-abd4-1823a81a19d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":24612},{"type":"v1","addr":"172.21.15.120:6825","nonce":24612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":24612},{"type":"v1","addr":"172.21.15.120:6827","nonce":24612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":24612},{"type":"v1","addr":"172.21.15.120:6831","nonce":24612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":24612},{"type":"v1","addr":"172.21.15.120:6829","nonce":24612}]},"public_addr":"172.21.15.120:6825/24612","cluster_addr":"172.21.15.120:6827/24612","heartbeat_back_addr":"172.21.15.120:6831/24612","heartbeat_front_addr":"172.21.15.120:6829/24612","state":["exists","up"]},{"osd":4,"uuid":"c57cf86c-b87c-4772-8dec-62047661f3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":24855},{"type":"v1","addr":"172.21.15.134:6803","nonce":24855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":24855},{"type":"v1","addr":"172.21.15.134:6805","nonce":24855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":24855},{"type":"v1","addr":"172.21.15.134:6809","nonce":24855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":24855},{"type":"v1","addr":"172.21.15.134:6807","nonce":24855}]},"public_addr":"172.21.15.134:6803/24855","cluster_addr":"172.21.15.134:6805/24855","heartbeat_back_addr":"172.21.15.134:6809/24855","heartbeat_front_addr":"172.21.15.134:6807/24855","state":["exists","up"]},{"osd":5,"uuid":"486e506e-c976-44c7-b7cd-99c4b45b65e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":24879},{"type":"v1","addr":"172.21.15.134:6811","nonce":24879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":24879},{"type":"v1","addr":"172.21.15.134:6813","nonce":24879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":24879},{"type":"v1","addr":"172.21.15.134:6817","nonce":24879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":24879},{"type":"v1","addr":"172.21.15.134:6815","nonce":24879}]},"public_addr":"172.21.15.134:6811/24879","cluster_addr":"172.21.15.134:6813/24879","heartbeat_back_addr":"172.21.15.134:6817/24879","heartbeat_front_addr":"172.21.15.134:6815/24879","state":["exists","up"]},{"osd":6,"uuid":"43649114-88d7-4924-a650-24cdb8307d8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":24918},{"type":"v1","addr":"172.21.15.134:6819","nonce":24918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":24918},{"type":"v1","addr":"172.21.15.134:6821","nonce":24918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":24918},{"type":"v1","addr":"172.21.15.134:6825","nonce":24918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":24918},{"type":"v1","addr":"172.21.15.134:6823","nonce":24918}]},"public_addr":"172.21.15.134:6819/24918","cluster_addr":"172.21.15.134:6821/24918","heartbeat_back_addr":"172.21.15.134:6825/24918","heartbeat_front_addr":"172.21.15.134:6823/24918","state":["exists","up"]},{"osd":7,"uuid":"39042b46-2011-4e62-81af-2a30eb565457","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":24925},{"type":"v1","addr":"172.21.15.134:6827","nonce":24925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":24925},{"type":"v1","addr":"172.21.15.134:6829","nonce":24925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":24925},{"type":"v1","addr":"172.21.15.134:6833","nonce":24925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":24925},{"type":"v1","addr":"172.21.15.134:6831","nonce":24925}]},"public_addr":"172.21.15.134:6827/24925","cluster_addr":"172.21.15.134:6829/24925","heartbeat_back_addr":"172.21.15.134:6833/24925","heartbeat_front_addr":"172.21.15.134:6831/24925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.134:6835/782463162":"2021-04-10 18:30:00.814744","172.21.15.134:6834/782463162":"2021-04-10 18:30:00.814744","172.21.15.120:6833/4282122355":"2021-04-10 18:28:50.808587","172.21.15.120:6832/3326321867":"2021-04-10 18:31:45.823892","172.21.15.120:6833/3967329066":"2021-04-10 18:26:05.791416","172.21.15.120:6832/4282122355":"2021-04-10 18:28:50.808587","172.21.15.120:6832/3967329066":"2021-04-10 18:26:05.791416","172.21.15.134:6834/497894564":"2021-04-10 18:28:00.800425","172.21.15.134:6835/1933604370":"2021-04-10 18:20:55.766995","172.21.15.134:6834/1933604370":"2021-04-10 18:20:55.766995","172.21.15.120:6832/2249625664":"2021-04-10 18:23:05.777038","172.21.15.134:6835/497894564":"2021-04-10 18:28:00.800425","172.21.15.134:6835/3982642658":"2021-04-10 18:25:05.786493","172.21.15.120:6833/3326321867":"2021-04-10 18:31:45.823892","172.21.15.120:6833/2249625664":"2021-04-10 18:23:05.777038","172.21.15.134:6834/3982642658":"2021-04-10 18:25:05.786493"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-04-09T18:33:00.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 -- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc624018930 msgr2=0x7fc62401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:00.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc624018930 0x7fc62401ae10 crc :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:00.012 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 -- 172.21.15.120:0/170102199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c187780 msgr2=0x7fc63c0987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:00.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c187780 0x7fc63c0987f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fc62c00a4c0 tx=0x7fc62c00a860).stop 2021-04-09T18:33:00.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 -- 172.21.15.120:0/170102199 shutdown_connections 2021-04-09T18:33:00.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc63c189c50 0x7fc63c0b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:00.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c187780 0x7fc63c0987f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:00.013 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc624018930 0x7fc62401ae10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:00.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 --2- 172.21.15.120:0/170102199 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc63c187380 0x7fc63c189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:00.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 -- 172.21.15.120:0/170102199 >> 172.21.15.120:0/170102199 conn(0x7fc63c18dc90 msgr2=0x7fc63c08fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:00.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 -- 172.21.15.120:0/170102199 shutdown_connections 2021-04-09T18:33:00.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:00.026 7fc643c42700 1 -- 172.21.15.120:0/170102199 wait complete. 2021-04-09T18:33:01.023 INFO:tasks.ceph:Scrubbing osd.0 2021-04-09T18:33:01.024 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:33:01.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.188 7fa974c51700 1 Processor -- start 2021-04-09T18:33:01.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.188 7fa974c51700 1 -- start start 2021-04-09T18:33:01.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.188 7fa974c51700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa9700d8870 0x7fa9700d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.198 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.188 7fa974c51700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9700ff1c0 con 0x7fa9700d75e0 2021-04-09T18:33:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.188 7fa974c51700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9700fff30 con 0x7fa9701a8da0 2021-04-09T18:33:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.188 7fa974c51700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9700d80f0 con 0x7fa9700d8870 2021-04-09T18:33:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96e05d700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa9700d75e0 0x7fa9700ff740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55094/0 (socket says 172.21.15.120:55094) 2021-04-09T18:33:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96e05d700 1 -- 172.21.15.120:0/662807839 learned_addr learned my addr 172.21.15.120:0/662807839 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96e85e700 1 --2- 172.21.15.120:0/662807839 >> v2:172.21.15.134:3300/0 conn(0x7fa9700d8870 0x7fa9700d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660128536 0 0) 0x7fa9580009b0 con 0x7fa9700d75e0 2021-04-09T18:33:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa95c002fe0 con 0x7fa9700d75e0 2021-04-09T18:33:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3100744885 0 0) 0x7fa958001010 con 0x7fa9700d75e0 2021-04-09T18:33:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 >> v2:172.21.15.134:3300/0 conn(0x7fa9700d8870 msgr2=0x7fa9700d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:01.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 --2- 172.21.15.120:0/662807839 >> v2:172.21.15.134:3300/0 conn(0x7fa9700d8870 0x7fa9700d8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 >> v1:172.21.15.134:6789/0 conn(0x7fa9701a8da0 legacy=0x7fa9701ab1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97019f900 con 0x7fa9700d75e0 2021-04-09T18:33:01.201 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7fa958001530 con 0x7fa9700d75e0 2021-04-09T18:33:01.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 >> v1:172.21.15.120:6789/0 conn(0x7fa9700d75e0 legacy=0x7fa9700ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa95c003a70 0x7fa95c005f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.202 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa95c0067a0 0x7fa95c008ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c0095a0 0x7fa95c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c00c310 con 0x7fa95c0067a0 2021-04-09T18:33:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c00c530 con 0x7fa95c0095a0 2021-04-09T18:33:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96d85c700 1 -- 172.21.15.120:0/662807839 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c050760 con 0x7fa95c003a70 2021-04-09T18:33:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96e05d700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa95c0067a0 0x7fa95c008ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96e85e700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa95c003a70 0x7fa95c005f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96f05f700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c0095a0 0x7fa95c00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96e05d700 1 -- 172.21.15.120:0/662807839 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa95c003a70 msgr2=0x7fa95c005f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96e05d700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa95c003a70 0x7fa95c005f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96e05d700 1 -- 172.21.15.120:0/662807839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c0095a0 msgr2=0x7fa95c00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.189 7fa96e05d700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c0095a0 0x7fa95c00bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.190 7fa96e05d700 1 -- 172.21.15.120:0/662807839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c0509c0 con 0x7fa95c0067a0 2021-04-09T18:33:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.190 7fa96f05f700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa95c0095a0 0x7fa95c00bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.190 7fa96f05f700 1 -- 172.21.15.120:0/662807839 reap_dead start 2021-04-09T18:33:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.190 7fa96e05d700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa95c0067a0 0x7fa95c008ca0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fa9580017e0 tx=0x7fa958007ce0).ready entity=mon.0 client_cookie=f96b54958552c5b1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.207 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.190 7fa96d85c700 1 -- 172.21.15.120:0/662807839 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa95800a310 con 0x7fa95c0067a0 2021-04-09T18:33:01.207 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.190 7fa96d85c700 1 -- 172.21.15.120:0/662807839 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95800a650 con 0x7fa95c0067a0 2021-04-09T18:33:01.207 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.190 7fa96d85c700 1 -- 172.21.15.120:0/662807839 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa95800ab30 con 0x7fa95c0067a0 2021-04-09T18:33:01.207 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.190 7fa974c51700 1 -- 172.21.15.120:0/662807839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa95c0067a0 msgr2=0x7fa95c008ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.208 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.190 7fa974c51700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa95c0067a0 0x7fa95c008ca0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fa9580017e0 tx=0x7fa958007ce0).stop 2021-04-09T18:33:01.208 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.191 7fa974c51700 1 -- 172.21.15.120:0/662807839 shutdown_connections 2021-04-09T18:33:01.208 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.191 7fa974c51700 1 --2- 172.21.15.120:0/662807839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa95c0067a0 0x7fa95c008ca0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.191 7fa974c51700 1 -- 172.21.15.120:0/662807839 >> 172.21.15.120:0/662807839 conn(0x7fa9700d1580 msgr2=0x7fa9700d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:01.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.191 7fa974c51700 1 -- 172.21.15.120:0/662807839 shutdown_connections 2021-04-09T18:33:01.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.191 7fa974c51700 1 -- 172.21.15.120:0/662807839 wait complete. 2021-04-09T18:33:01.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.209 7fa974c51700 1 Processor -- start 2021-04-09T18:33:01.209 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.209 7fa974c51700 1 -- start start 2021-04-09T18:33:01.210 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa974c51700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa970095160 0x7fa97018eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.210 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa974c51700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa970095560 0x7fa97018f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.210 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa974c51700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa97018f9e0 0x7fa97018fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.210 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa974c51700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa970095ae0 con 0x7fa970095160 2021-04-09T18:33:01.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa974c51700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97019f3b0 con 0x7fa97018f9e0 2021-04-09T18:33:01.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa974c51700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9700bb750 con 0x7fa970095560 2021-04-09T18:33:01.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa970095160 0x7fa97018eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e85e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa970095160 0x7fa97018eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60190/0 (socket says 172.21.15.120:60190) 2021-04-09T18:33:01.211 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e85e700 1 -- 172.21.15.120:0/970128870 learned_addr learned my addr 172.21.15.120:0/970128870 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:01.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e05d700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa970095560 0x7fa97018f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96f05f700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa97018f9e0 0x7fa97018fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e85e700 1 -- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa970095560 msgr2=0x7fa97018f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.212 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e85e700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa970095560 0x7fa97018f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e85e700 1 -- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa97018f9e0 msgr2=0x7fa97018fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e85e700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa97018f9e0 0x7fa97018fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e85e700 1 -- 172.21.15.120:0/970128870 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9700bb930 con 0x7fa970095160 2021-04-09T18:33:01.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.210 7fa96e85e700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa970095160 0x7fa97018eda0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fa9680099e0 tx=0x7fa96800bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.213 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.211 7fa9677fe700 1 -- 172.21.15.120:0/970128870 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa96800c2f0 con 0x7fa970095160 2021-04-09T18:33:01.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.211 7fa9677fe700 1 -- 172.21.15.120:0/970128870 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96800c630 con 0x7fa970095160 2021-04-09T18:33:01.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.211 7fa974c51700 1 -- 172.21.15.120:0/970128870 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9700bb930 con 0x7fa970095160 2021-04-09T18:33:01.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.211 7fa9677fe700 1 -- 172.21.15.120:0/970128870 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa96800cb10 con 0x7fa970095160 2021-04-09T18:33:01.214 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.211 7fa974c51700 1 -- 172.21.15.120:0/970128870 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9700bb930 con 0x7fa970095160 2021-04-09T18:33:01.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.211 7fa9677fe700 1 -- 172.21.15.120:0/970128870 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fa968001010 con 0x7fa970095160 2021-04-09T18:33:01.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.211 7fa9677fe700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa954018930 0x7fa95401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.211 7fa9677fe700 1 -- 172.21.15.120:0/970128870 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fa9680331b0 con 0x7fa970095160 2021-04-09T18:33:01.215 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.212 7fa96e05d700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa954018930 0x7fa95401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.216 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.212 7fa96e05d700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa954018930 0x7fa95401ae10 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.219 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.234 7fa974c51700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7fa970062f80 0x7fa970063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.234 7fa974c51700 1 -- 172.21.15.120:0/970128870 --> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9701831f0 con 0x7fa970062f80 2021-04-09T18:33:01.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.234 7fa96f05f700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7fa970062f80 0x7fa970063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.234 7fa96f05f700 1 -- 172.21.15.120:0/970128870 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7fa970062f80 msgr2=0x7fa970063380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:33:01.220 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.234 7fa96f05f700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7fa970062f80 0x7fa970063380 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.221 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.234 7fa9677fe700 1 -- 172.21.15.120:0/970128870 <== osd.0 v2:172.21.15.120:6800/24540 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7fa960006a50 con 0x7fa970062f80 2021-04-09T18:33:01.227 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.242 7fa974c51700 1 -- 172.21.15.120:0/970128870 --> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7fa9701831f0 con 0x7fa970062f80 2021-04-09T18:33:01.228 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.242 7fa9677fe700 1 -- 172.21.15.120:0/970128870 <== osd.0 v2:172.21.15.120:6800/24540 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7fa960000ac0 con 0x7fa970062f80 2021-04-09T18:33:01.228 INFO:teuthology.orchestra.run.smithi120.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:33:01.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 -- 172.21.15.120:0/970128870 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7fa970062f80 msgr2=0x7fa970063380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.230 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.120:6800/24540,v1:172.21.15.120:6801/24540] conn(0x7fa970062f80 0x7fa970063380 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 -- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa954018930 msgr2=0x7fa95401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.231 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fa954018930 0x7fa95401ae10 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.232 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 -- 172.21.15.120:0/970128870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa970095160 msgr2=0x7fa97018eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.232 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 --2- 172.21.15.120:0/970128870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa970095160 0x7fa97018eda0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fa9680099e0 tx=0x7fa96800bcf0).stop 2021-04-09T18:33:01.233 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa96f05f700 1 -- 172.21.15.120:0/970128870 reap_dead start 2021-04-09T18:33:01.233 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 -- 172.21.15.120:0/970128870 shutdown_connections 2021-04-09T18:33:01.233 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 -- 172.21.15.120:0/970128870 >> 172.21.15.120:0/970128870 conn(0x7fa97018e440 msgr2=0x7fa97018a500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:01.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 -- 172.21.15.120:0/970128870 shutdown_connections 2021-04-09T18:33:01.234 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.244 7fa974c51700 1 -- 172.21.15.120:0/970128870 wait complete. 2021-04-09T18:33:01.239 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-04-09T18:33:01.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.395 7f07e3f6d700 1 Processor -- start 2021-04-09T18:33:01.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.396 7f07e3f6d700 1 -- start start 2021-04-09T18:33:01.402 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.396 7f07e3f6d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc0d7160 0x7f07dc0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.396 7f07e3f6d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07dc0d7560 0x7f07dc0d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.396 7f07e3f6d700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc0d6be0 con 0x7f07dc0d5bc0 2021-04-09T18:33:01.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.396 7f07e3f6d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc0d80f0 con 0x7f07dc0d7560 2021-04-09T18:33:01.403 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.396 7f07e3f6d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc0e7f00 con 0x7f07dc0d7160 2021-04-09T18:33:01.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.396 7f07e258a700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f07dc0d5bc0 0x7f07dc0d5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55114/0 (socket says 172.21.15.120:55114) 2021-04-09T18:33:01.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.396 7f07e258a700 1 -- 172.21.15.120:0/1985370010 learned_addr learned my addr 172.21.15.120:0/1985370010 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:01.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e1588700 1 --2- 172.21.15.120:0/1985370010 >> v2:172.21.15.134:3300/0 conn(0x7f07dc0d7560 0x7f07dc0d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e1d89700 1 --2- 172.21.15.120:0/1985370010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc0d7160 0x7f07dc0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.404 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e0d87700 1 -- 172.21.15.120:0/1985370010 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113557393 0 0) 0x7f07d40009b0 con 0x7f07dc0d5bc0 2021-04-09T18:33:01.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e0d87700 1 -- 172.21.15.120:0/1985370010 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c8002fe0 con 0x7f07dc0d5bc0 2021-04-09T18:33:01.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e0d87700 1 -- 172.21.15.120:0/1985370010 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1314888523 0 0) 0x7f07d40010e0 con 0x7f07dc0d5bc0 2021-04-09T18:33:01.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e1588700 1 -- 172.21.15.120:0/1985370010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc0d7160 msgr2=0x7f07dc0e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:01.405 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e1588700 1 --2- 172.21.15.120:0/1985370010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc0d7160 0x7f07dc0e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e1588700 1 -- 172.21.15.120:0/1985370010 >> v1:172.21.15.120:6789/0 conn(0x7f07dc0d5bc0 legacy=0x7f07dc0d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e1588700 1 -- 172.21.15.120:0/1985370010 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc1a2ac0 con 0x7f07dc0d7560 2021-04-09T18:33:01.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e1d89700 1 --2- 172.21.15.120:0/1985370010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc0d7160 0x7f07dc0e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:01.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e1588700 1 --2- 172.21.15.120:0/1985370010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0d7560 0x7f07dc0d55a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f07d00069d0 tx=0x7f07d0009e40).ready entity=mon.1 client_cookie=f284257fb9686a3 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.406 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e0d87700 1 -- 172.21.15.120:0/1985370010 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07d000b510 con 0x7f07dc0d7560 2021-04-09T18:33:01.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e0d87700 1 -- 172.21.15.120:0/1985370010 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d000b890 con 0x7f07dc0d7560 2021-04-09T18:33:01.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e0d87700 1 -- 172.21.15.120:0/1985370010 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07d000bd70 con 0x7f07dc0d7560 2021-04-09T18:33:01.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e3f6d700 1 -- 172.21.15.120:0/1985370010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0d7560 msgr2=0x7f07dc0d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.407 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.397 7f07e3f6d700 1 --2- 172.21.15.120:0/1985370010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0d7560 0x7f07dc0d55a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f07d00069d0 tx=0x7f07d0009e40).stop 2021-04-09T18:33:01.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.398 7f07e3f6d700 1 -- 172.21.15.120:0/1985370010 shutdown_connections 2021-04-09T18:33:01.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.398 7f07e3f6d700 1 --2- 172.21.15.120:0/1985370010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0d7560 0x7f07dc0d55a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.398 7f07e3f6d700 1 --2- 172.21.15.120:0/1985370010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc0d7160 0x7f07dc0e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.398 7f07e3f6d700 1 -- 172.21.15.120:0/1985370010 >> 172.21.15.120:0/1985370010 conn(0x7f07dc0d1590 msgr2=0x7f07dc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:01.408 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.398 7f07e3f6d700 1 -- 172.21.15.120:0/1985370010 shutdown_connections 2021-04-09T18:33:01.409 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.398 7f07e3f6d700 1 -- 172.21.15.120:0/1985370010 wait complete. 2021-04-09T18:33:01.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e3f6d700 1 Processor -- start 2021-04-09T18:33:01.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e3f6d700 1 -- start start 2021-04-09T18:33:01.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e3f6d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc184c40 0x7f07dc0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e3f6d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 0x7f07dc0b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.414 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e3f6d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0b5b80 0x7f07dc0e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e3f6d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1846c0 con 0x7f07dc185040 2021-04-09T18:33:01.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e3f6d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1a1470 con 0x7f07dc0b5b80 2021-04-09T18:33:01.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e3f6d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc17fa90 con 0x7f07dc184c40 2021-04-09T18:33:01.415 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e1588700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 0x7f07dc0b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e1588700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 0x7f07dc0b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60208/0 (socket says 172.21.15.120:60208) 2021-04-09T18:33:01.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.417 7f07e1588700 1 -- 172.21.15.120:0/1082185369 learned_addr learned my addr 172.21.15.120:0/1082185369 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:01.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1d89700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc184c40 0x7f07dc0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.416 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e258a700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0b5b80 0x7f07dc0e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 -- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc184c40 msgr2=0x7f07dc0b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc184c40 0x7f07dc0b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 -- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0b5b80 msgr2=0x7f07dc0e34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.417 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0b5b80 0x7f07dc0e34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 -- 172.21.15.120:0/1082185369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc0e3af0 con 0x7f07dc185040 2021-04-09T18:33:01.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 0x7f07dc0b5560 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f07d00099e0 tx=0x7f07d000bd20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07d0006240 con 0x7f07dc185040 2021-04-09T18:33:01.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d000be60 con 0x7f07dc185040 2021-04-09T18:33:01.418 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc0e3af0 con 0x7f07dc185040 2021-04-09T18:33:01.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07d0005660 con 0x7f07dc185040 2021-04-09T18:33:01.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc0e3af0 con 0x7f07dc185040 2021-04-09T18:33:01.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 -- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 msgr2=0x7f07dc0b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-04-09T18:33:01.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 -- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 msgr2=0x7f07dc0b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-04-09T18:33:01.419 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 0x7f07dc0b5560 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f07d00099e0 tx=0x7f07d000bd20).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-04-09T18:33:01.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e1588700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 0x7f07dc0b5560 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f07d00099e0 tx=0x7f07d000bd20).stop 2021-04-09T18:33:01.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 msgr2=0x7f07dc0b5560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-04-09T18:33:01.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07dc185040 0x7f07dc0b5560 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.420 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4003940 0x7f07c4005d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40063f0 0x7f07c4008910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c4009200 0x7f07c400b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c400bf10 con 0x7f07c4009200 2021-04-09T18:33:01.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c400c130 con 0x7f07c4003940 2021-04-09T18:33:01.421 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c400c350 con 0x7f07c40063f0 2021-04-09T18:33:01.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.418 7f07e258a700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c4009200 0x7f07c400b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07e1588700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40063f0 0x7f07c4008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07e1d89700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4003940 0x7f07c4005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.422 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07e258a700 1 -- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40063f0 msgr2=0x7f07c4008910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07e258a700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40063f0 0x7f07c4008910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07e258a700 1 -- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4003940 msgr2=0x7f07c4005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07e258a700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4003940 0x7f07c4005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07e258a700 1 -- 172.21.15.120:0/1082185369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) v3 -- 0x7f07c400c670 con 0x7f07c4009200 2021-04-09T18:33:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07e1d89700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4003940 0x7f07c4005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07e258a700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c4009200 0x7f07c400b6c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f07d4006e90 tx=0x7f07d400b810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07d40043a0 con 0x7f07c4009200 2021-04-09T18:33:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.419 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d40046e0 con 0x7f07c4009200 2021-04-09T18:33:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.420 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f07d4000ef0 con 0x7f07c4009200 2021-04-09T18:33:01.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.420 7f07ce7fc700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07c4021070 0x7f07c4023480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.420 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 <== mon.0 v2:172.21.15.120:3300/0 4 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f07d4032d00 con 0x7f07c4009200 2021-04-09T18:33:01.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.420 7f07e1d89700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07c4021070 0x7f07c4023480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.425 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.420 7f07e1d89700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07c4021070 0x7f07c4023480 crc :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.428 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.442 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc0e25e0 con 0x7f07c4009200 2021-04-09T18:33:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.446 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 <== mon.0 v2:172.21.15.120:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f07d4000bf0 con 0x7f07c4009200 2021-04-09T18:33:01.600 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.615 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mgr", ""]}) v1 -- 0x7f07dc1854c0 con 0x7f07c4021070 2021-04-09T18:33:01.601 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.615 7f07ce7fc700 1 -- 172.21.15.120:0/1082185369 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f07d80009b0 con 0x7f07c4021070 2021-04-09T18:33:01.602 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 0 to deep-scrub 2021-04-09T18:33:01.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07c4021070 msgr2=0x7f07c4023480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.604 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07c4021070 0x7f07c4023480 crc :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c4009200 msgr2=0x7f07c400b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c4009200 0x7f07c400b6c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f07d4006e90 tx=0x7f07d400b810).stop 2021-04-09T18:33:01.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 shutdown_connections 2021-04-09T18:33:01.605 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07c4009200 0x7f07c400b6c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f07c4021070 0x7f07c4023480 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07c40063f0 0x7f07c4008910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 --2- 172.21.15.120:0/1082185369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07c4003940 0x7f07c4005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 >> 172.21.15.120:0/1082185369 conn(0x7f07dc182270 msgr2=0x7f07dc0e2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:01.606 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 shutdown_connections 2021-04-09T18:33:01.607 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.618 7f07e3f6d700 1 -- 172.21.15.120:0/1082185369 wait complete. 2021-04-09T18:33:01.614 INFO:tasks.ceph:Scrubbing osd.1 2021-04-09T18:33:01.614 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:33:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.770 7f9f77bdd700 1 Processor -- start 2021-04-09T18:33:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.770 7f9f77bdd700 1 -- start start 2021-04-09T18:33:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.770 7f9f77bdd700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9f7007e700 0x7f9f70100210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.770 7f9f77bdd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f701a9160 0x7f9f701ab570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.770 7f9f77bdd700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700ffc90 con 0x7f9f70100830 2021-04-09T18:33:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.770 7f9f77bdd700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700d80e0 con 0x7f9f7007e700 2021-04-09T18:33:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.770 7f9f77bdd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700d2040 con 0x7f9f701a9160 2021-04-09T18:33:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f759f9700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9f7007e700 0x7f9f70100210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f751f8700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9f70100830 0x7f9f700ff080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55136/0 (socket says 172.21.15.120:55136) 2021-04-09T18:33:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f751f8700 1 -- 172.21.15.120:0/2767402740 learned_addr learned my addr 172.21.15.120:0/2767402740 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f761fa700 1 --2- 172.21.15.120:0/2767402740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f701a9160 0x7f9f701ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f759f9700 1 -- 172.21.15.120:0/2767402740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f701a9160 msgr2=0x7f9f701ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f759f9700 1 --2- 172.21.15.120:0/2767402740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f701a9160 0x7f9f701ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f759f9700 1 -- 172.21.15.120:0/2767402740 >> v1:172.21.15.120:6789/0 conn(0x7f9f70100830 legacy=0x7f9f700ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f759f9700 1 -- 172.21.15.120:0/2767402740 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7007eb00 con 0x7f9f7007e700 2021-04-09T18:33:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f749f7700 1 -- 172.21.15.120:0/2767402740 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847191455 0 0) 0x7f9f640009b0 con 0x7f9f70100830 2021-04-09T18:33:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f761fa700 1 --2- 172.21.15.120:0/2767402740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f701a9160 0x7f9f701ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f759f9700 1 --2- 172.21.15.120:0/2767402740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f7007e700 0x7f9f70100210 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9f600069d0 tx=0x7f9f60009e40).ready entity=mon.0 client_cookie=96bac2d2a3b06e80 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f749f7700 1 -- 172.21.15.120:0/2767402740 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9f6000b510 con 0x7f9f7007e700 2021-04-09T18:33:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f749f7700 1 -- 172.21.15.120:0/2767402740 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6000b890 con 0x7f9f7007e700 2021-04-09T18:33:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f749f7700 1 -- 172.21.15.120:0/2767402740 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9f6000bd70 con 0x7f9f7007e700 2021-04-09T18:33:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f77bdd700 1 -- 172.21.15.120:0/2767402740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f7007e700 msgr2=0x7f9f70100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.771 7f9f77bdd700 1 --2- 172.21.15.120:0/2767402740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f7007e700 0x7f9f70100210 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9f600069d0 tx=0x7f9f60009e40).stop 2021-04-09T18:33:01.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.772 7f9f77bdd700 1 -- 172.21.15.120:0/2767402740 shutdown_connections 2021-04-09T18:33:01.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.772 7f9f77bdd700 1 --2- 172.21.15.120:0/2767402740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f701a9160 0x7f9f701ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.772 7f9f77bdd700 1 --2- 172.21.15.120:0/2767402740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f7007e700 0x7f9f70100210 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.772 7f9f77bdd700 1 -- 172.21.15.120:0/2767402740 >> 172.21.15.120:0/2767402740 conn(0x7f9f700f0050 msgr2=0x7f9f700d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:01.782 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.772 7f9f77bdd700 1 -- 172.21.15.120:0/2767402740 shutdown_connections 2021-04-09T18:33:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.772 7f9f77bdd700 1 -- 172.21.15.120:0/2767402740 wait complete. 2021-04-09T18:33:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.791 7f9f77bdd700 1 Processor -- start 2021-04-09T18:33:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.791 7f9f77bdd700 1 -- start start 2021-04-09T18:33:01.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.791 7f9f77bdd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f70193a00 0x7f9f701926e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.791 7f9f77bdd700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f70193e00 0x7f9f70192d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.786 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.791 7f9f77bdd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f700b3e80 0x7f9f700b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.791 7f9f77bdd700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700a1e40 con 0x7f9f700b3e80 2021-04-09T18:33:01.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.791 7f9f77bdd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700b48a0 con 0x7f9f70193a00 2021-04-09T18:33:01.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.791 7f9f77bdd700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700b4ac0 con 0x7f9f70193e00 2021-04-09T18:33:01.787 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.791 7f9f761fa700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f700b3e80 0x7f9f700b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f761fa700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f700b3e80 0x7f9f700b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60228/0 (socket says 172.21.15.120:60228) 2021-04-09T18:33:01.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f761fa700 1 -- 172.21.15.120:0/2053585347 learned_addr learned my addr 172.21.15.120:0/2053585347 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:01.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f751f8700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f70193e00 0x7f9f70192d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.788 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f759f9700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f70193a00 0x7f9f701926e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f761fa700 1 -- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f70193e00 msgr2=0x7f9f70192d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f761fa700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f70193e00 0x7f9f70192d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f761fa700 1 -- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f70193a00 msgr2=0x7f9f701926e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f761fa700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f70193a00 0x7f9f701926e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.789 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f761fa700 1 -- 172.21.15.120:0/2053585347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700b4ce0 con 0x7f9f700b3e80 2021-04-09T18:33:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f759f9700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f70193a00 0x7f9f701926e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f761fa700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f700b3e80 0x7f9f700b4280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f9f6800b580 tx=0x7f9f6800b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f6e7fc700 1 -- 172.21.15.120:0/2053585347 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9f6800bd10 con 0x7f9f700b3e80 2021-04-09T18:33:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f6e7fc700 1 -- 172.21.15.120:0/2053585347 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f68006410 con 0x7f9f700b3e80 2021-04-09T18:33:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f700b4ce0 con 0x7f9f700b3e80 2021-04-09T18:33:01.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f6e7fc700 1 -- 172.21.15.120:0/2053585347 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9f68002220 con 0x7f9f700b3e80 2021-04-09T18:33:01.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.792 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f700b4ce0 con 0x7f9f700b3e80 2021-04-09T18:33:01.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.793 7f9f6e7fc700 1 -- 172.21.15.120:0/2053585347 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f9f6800a030 con 0x7f9f700b3e80 2021-04-09T18:33:01.791 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.793 7f9f6e7fc700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9f50018930 0x7f9f5001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.793 7f9f6e7fc700 1 -- 172.21.15.120:0/2053585347 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f9f68032df0 con 0x7f9f700b3e80 2021-04-09T18:33:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.793 7f9f759f9700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9f50018930 0x7f9f5001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.793 7f9f759f9700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9f50018930 0x7f9f5001ae10 crc :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.816 7f9f77bdd700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f9f7008c780 0x7f9f70062a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.816 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 --> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f700b48a0 con 0x7f9f7008c780 2021-04-09T18:33:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.816 7f9f751f8700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f9f7008c780 0x7f9f70062a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.816 7f9f751f8700 1 -- 172.21.15.120:0/2053585347 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f9f7008c780 msgr2=0x7f9f70062a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:33:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.816 7f9f751f8700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f9f7008c780 0x7f9f70062a70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.817 7f9f6e7fc700 1 -- 172.21.15.120:0/2053585347 <== osd.1 v2:172.21.15.120:6808/24588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f9f640015b0 con 0x7f9f7008c780 2021-04-09T18:33:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.824 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 --> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f9f70182ae0 con 0x7f9f7008c780 2021-04-09T18:33:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.824 7f9f6e7fc700 1 -- 172.21.15.120:0/2053585347 <== osd.1 v2:172.21.15.120:6808/24588 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7f9f64001420 con 0x7f9f7008c780 2021-04-09T18:33:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:33:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.825 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f9f7008c780 msgr2=0x7f9f70062a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.825 7f9f77bdd700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.120:6808/24588,v1:172.21.15.120:6809/24588] conn(0x7f9f7008c780 0x7f9f70062a70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.826 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9f50018930 msgr2=0x7f9f5001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.826 7f9f77bdd700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f9f50018930 0x7f9f5001ae10 crc :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.826 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f700b3e80 msgr2=0x7f9f700b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.826 7f9f77bdd700 1 --2- 172.21.15.120:0/2053585347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f700b3e80 0x7f9f700b4280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f9f6800b580 tx=0x7f9f6800b920).stop 2021-04-09T18:33:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.826 7f9f761fa700 1 -- 172.21.15.120:0/2053585347 reap_dead start 2021-04-09T18:33:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.826 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 shutdown_connections 2021-04-09T18:33:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.826 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 >> 172.21.15.120:0/2053585347 conn(0x7f9f7018dd30 msgr2=0x7f9f70182d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.826 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 shutdown_connections 2021-04-09T18:33:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.826 7f9f77bdd700 1 -- 172.21.15.120:0/2053585347 wait complete. 2021-04-09T18:33:01.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-04-09T18:33:01.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.978 7f0e447b6700 1 Processor -- start 2021-04-09T18:33:01.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.978 7f0e447b6700 1 -- start start 2021-04-09T18:33:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.979 7f0e447b6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c0d7160 0x7f0e3c0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.979 7f0e447b6700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0d6be0 con 0x7f0e3c0d7560 2021-04-09T18:33:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.979 7f0e447b6700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0e7f00 con 0x7f0e3c0e70a0 2021-04-09T18:33:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.979 7f0e447b6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0d80f0 con 0x7f0e3c0d7160 2021-04-09T18:33:01.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.979 7f0e41dd1700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0e3c0d7560 0x7f0e3c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55152/0 (socket says 172.21.15.120:55152) 2021-04-09T18:33:01.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.979 7f0e41dd1700 1 -- 172.21.15.120:0/2094540856 learned_addr learned my addr 172.21.15.120:0/2094540856 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:01.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.979 7f0e425d2700 1 --2- 172.21.15.120:0/2094540856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c0d7160 0x7f0e3c0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e415d0700 1 -- 172.21.15.120:0/2094540856 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346352513 0 0) 0x7f0e300009b0 con 0x7f0e3c0d7560 2021-04-09T18:33:01.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e415d0700 1 -- 172.21.15.120:0/2094540856 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e24002fe0 con 0x7f0e3c0d7560 2021-04-09T18:33:01.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e415d0700 1 -- 172.21.15.120:0/2094540856 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717634702 0 0) 0x7f0e34001400 con 0x7f0e3c0e70a0 2021-04-09T18:33:01.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e415d0700 1 -- 172.21.15.120:0/2094540856 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e24003210 con 0x7f0e3c0e70a0 2021-04-09T18:33:01.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e415d0700 1 -- 172.21.15.120:0/2094540856 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1964404198 0 0) 0x7f0e30001010 con 0x7f0e3c0d7560 2021-04-09T18:33:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e425d2700 1 -- 172.21.15.120:0/2094540856 >> v1:172.21.15.134:6789/0 conn(0x7f0e3c0e70a0 legacy=0x7f0e3c0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e425d2700 1 -- 172.21.15.120:0/2094540856 >> v1:172.21.15.120:6789/0 conn(0x7f0e3c0d7560 legacy=0x7f0e3c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e425d2700 1 -- 172.21.15.120:0/2094540856 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c1a2ac0 con 0x7f0e3c0d7160 2021-04-09T18:33:01.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e425d2700 1 --2- 172.21.15.120:0/2094540856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c0d7160 0x7f0e3c0e78e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0e2c006650 tx=0x7f0e2c009a80).ready entity=mon.2 client_cookie=96a68b26455b52b4 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e415d0700 1 -- 172.21.15.120:0/2094540856 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e2c0009b0 con 0x7f0e3c0d7160 2021-04-09T18:33:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e415d0700 1 -- 172.21.15.120:0/2094540856 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c00c0c0 con 0x7f0e3c0d7160 2021-04-09T18:33:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e415d0700 1 -- 172.21.15.120:0/2094540856 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e2c0009b0 con 0x7f0e3c0d7160 2021-04-09T18:33:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e447b6700 1 -- 172.21.15.120:0/2094540856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c0d7160 msgr2=0x7f0e3c0e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.980 7f0e447b6700 1 --2- 172.21.15.120:0/2094540856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c0d7160 0x7f0e3c0e78e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0e2c006650 tx=0x7f0e2c009a80).stop 2021-04-09T18:33:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.981 7f0e447b6700 1 -- 172.21.15.120:0/2094540856 shutdown_connections 2021-04-09T18:33:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.981 7f0e447b6700 1 --2- 172.21.15.120:0/2094540856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c0d7160 0x7f0e3c0e78e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.981 7f0e447b6700 1 -- 172.21.15.120:0/2094540856 >> 172.21.15.120:0/2094540856 conn(0x7f0e3c0d1590 msgr2=0x7f0e3c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:01.991 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.981 7f0e447b6700 1 -- 172.21.15.120:0/2094540856 shutdown_connections 2021-04-09T18:33:01.992 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:01.981 7f0e447b6700 1 -- 172.21.15.120:0/2094540856 wait complete. 2021-04-09T18:33:01.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e447b6700 1 Processor -- start 2021-04-09T18:33:01.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e447b6700 1 -- start start 2021-04-09T18:33:01.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e447b6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e3c19f0f0 0x7f0e3c18c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.995 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e447b6700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3c18ca10 0x7f0e3c18a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e447b6700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c19f4f0 0x7f0e3c18af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:01.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e447b6700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c18be70 con 0x7f0e3c18ca10 2021-04-09T18:33:01.996 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e447b6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c18b570 con 0x7f0e3c19f0f0 2021-04-09T18:33:01.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e447b6700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c18b750 con 0x7f0e3c19f4f0 2021-04-09T18:33:01.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e41dd1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3c18ca10 0x7f0e3c18a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e41dd1700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3c18ca10 0x7f0e3c18a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60244/0 (socket says 172.21.15.120:60244) 2021-04-09T18:33:01.997 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e41dd1700 1 -- 172.21.15.120:0/1653704540 learned_addr learned my addr 172.21.15.120:0/1653704540 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:01.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.000 7f0e42dd3700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c19f4f0 0x7f0e3c18af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.998 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e425d2700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e3c19f0f0 0x7f0e3c18c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:01.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e41dd1700 1 -- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c19f4f0 msgr2=0x7f0e3c18af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:01.999 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e41dd1700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c19f4f0 0x7f0e3c18af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e41dd1700 1 -- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e3c19f0f0 msgr2=0x7f0e3c18c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e41dd1700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e3c19f0f0 0x7f0e3c18c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.000 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e41dd1700 1 -- 172.21.15.120:0/1653704540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c18b970 con 0x7f0e3c18ca10 2021-04-09T18:33:02.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e41dd1700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3c18ca10 0x7f0e3c18a930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f0e30001c60 tx=0x7f0e3000a8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e3affd700 1 -- 172.21.15.120:0/1653704540 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e3000acc0 con 0x7f0e3c18ca10 2021-04-09T18:33:02.001 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e3affd700 1 -- 172.21.15.120:0/1653704540 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30004140 con 0x7f0e3c18ca10 2021-04-09T18:33:02.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c18b970 con 0x7f0e3c18ca10 2021-04-09T18:33:02.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e3affd700 1 -- 172.21.15.120:0/1653704540 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e30004620 con 0x7f0e3c18ca10 2021-04-09T18:33:02.002 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.001 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c18b970 con 0x7f0e3c18ca10 2021-04-09T18:33:02.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.002 7f0e3affd700 1 -- 172.21.15.120:0/1653704540 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0e30004320 con 0x7f0e3c18ca10 2021-04-09T18:33:02.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.002 7f0e3affd700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e1c018930 0x7f0e1c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.002 7f0e3affd700 1 -- 172.21.15.120:0/1653704540 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f0e30032f40 con 0x7f0e3c18ca10 2021-04-09T18:33:02.003 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.002 7f0e425d2700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e1c018930 0x7f0e1c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.004 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.002 7f0e425d2700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e1c018930 0x7f0e1c01ae10 crc :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.010 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.025 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c18bc10 con 0x7f0e3c18ca10 2021-04-09T18:33:02.014 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.028 7f0e3affd700 1 -- 172.21.15.120:0/1653704540 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f0e30000e20 con 0x7f0e3c18ca10 2021-04-09T18:33:02.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.200 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mgr", ""]}) v1 -- 0x7f0e3c095d00 con 0x7f0e1c018930 2021-04-09T18:33:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.200 7f0e3affd700 1 -- 172.21.15.120:0/1653704540 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f0e2c009180 con 0x7f0e1c018930 2021-04-09T18:33:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 1 to deep-scrub 2021-04-09T18:33:02.189 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e1c018930 msgr2=0x7f0e1c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.189 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e1c018930 0x7f0e1c01ae10 crc :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.189 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3c18ca10 msgr2=0x7f0e3c18a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.190 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3c18ca10 0x7f0e3c18a930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f0e30001c60 tx=0x7f0e3000a8d0).stop 2021-04-09T18:33:02.190 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 shutdown_connections 2021-04-09T18:33:02.190 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0e1c018930 0x7f0e1c01ae10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.190 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e3c19f4f0 0x7f0e3c18af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3c18ca10 0x7f0e3c18a930 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 --2- 172.21.15.120:0/1653704540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e3c19f0f0 0x7f0e3c18c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 >> 172.21.15.120:0/1653704540 conn(0x7f0e3c0e2340 msgr2=0x7f0e3c0e3830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 shutdown_connections 2021-04-09T18:33:02.192 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.203 7f0e447b6700 1 -- 172.21.15.120:0/1653704540 wait complete. 2021-04-09T18:33:02.199 INFO:tasks.ceph:Scrubbing osd.2 2021-04-09T18:33:02.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:33:02.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.355 7f00e8bca700 1 Processor -- start 2021-04-09T18:33:02.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.355 7f00e8bca700 1 -- start start 2021-04-09T18:33:02.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e8bca700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e40d75e0 0x7f00e40ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.362 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e8bca700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f00e40ffd60 0x7f00e41aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e8bca700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e40ff1c0 con 0x7f00e40d8870 2021-04-09T18:33:02.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e8bca700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e40d9580 con 0x7f00e40ffd60 2021-04-09T18:33:02.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e8bca700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40d80f0 con 0x7f00e40d75e0 2021-04-09T18:33:02.363 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e285e700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f00e40d8870 0x7f00e40d8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55162/0 (socket says 172.21.15.120:55162) 2021-04-09T18:33:02.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e285e700 1 -- 172.21.15.120:0/2060875176 learned_addr learned my addr 172.21.15.120:0/2060875176 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:02.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e305f700 1 --2- 172.21.15.120:0/2060875176 >> v2:172.21.15.120:3300/0 conn(0x7f00e40ffd60 0x7f00e41aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e205d700 1 --2- 172.21.15.120:0/2060875176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e40d75e0 0x7f00e40ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.364 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e185c700 1 -- 172.21.15.120:0/2060875176 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552899875 0 0) 0x7f00d4001060 con 0x7f00e40d8870 2021-04-09T18:33:02.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e185c700 1 -- 172.21.15.120:0/2060875176 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d0002fe0 con 0x7f00e40d8870 2021-04-09T18:33:02.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e305f700 1 -- 172.21.15.120:0/2060875176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e40d75e0 msgr2=0x7f00e40ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:02.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e305f700 1 --2- 172.21.15.120:0/2060875176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e40d75e0 0x7f00e40ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e305f700 1 -- 172.21.15.120:0/2060875176 >> v1:172.21.15.120:6789/0 conn(0x7f00e40d8870 legacy=0x7f00e40d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.365 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e305f700 1 -- 172.21.15.120:0/2060875176 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e419f900 con 0x7f00e40ffd60 2021-04-09T18:33:02.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e305f700 1 --2- 172.21.15.120:0/2060875176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e40ffd60 0x7f00e41aadb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f00dc006ab0 tx=0x7f00dc009b40).ready entity=mon.0 client_cookie=b3d169c023aaa46 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e185c700 1 -- 172.21.15.120:0/2060875176 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00dc0022e0 con 0x7f00e40ffd60 2021-04-09T18:33:02.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e185c700 1 -- 172.21.15.120:0/2060875176 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc002660 con 0x7f00e40ffd60 2021-04-09T18:33:02.366 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.356 7f00e185c700 1 -- 172.21.15.120:0/2060875176 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00dc002b40 con 0x7f00e40ffd60 2021-04-09T18:33:02.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.357 7f00e8bca700 1 -- 172.21.15.120:0/2060875176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e40ffd60 msgr2=0x7f00e41aadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.357 7f00e8bca700 1 --2- 172.21.15.120:0/2060875176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e40ffd60 0x7f00e41aadb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f00dc006ab0 tx=0x7f00dc009b40).stop 2021-04-09T18:33:02.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.357 7f00e8bca700 1 -- 172.21.15.120:0/2060875176 shutdown_connections 2021-04-09T18:33:02.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.357 7f00e8bca700 1 --2- 172.21.15.120:0/2060875176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e40ffd60 0x7f00e41aadb0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.367 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.357 7f00e8bca700 1 --2- 172.21.15.120:0/2060875176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e40d75e0 0x7f00e40ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.357 7f00e8bca700 1 -- 172.21.15.120:0/2060875176 >> 172.21.15.120:0/2060875176 conn(0x7f00e40d1580 msgr2=0x7f00e40d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:02.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.357 7f00e8bca700 1 -- 172.21.15.120:0/2060875176 shutdown_connections 2021-04-09T18:33:02.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.357 7f00e8bca700 1 -- 172.21.15.120:0/2060875176 wait complete. 2021-04-09T18:33:02.368 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.376 7f00e8bca700 1 Processor -- start 2021-04-09T18:33:02.369 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.376 7f00e8bca700 1 -- start start 2021-04-09T18:33:02.371 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e8bca700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e408e2e0 0x7f00e4191fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e8bca700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e408e6e0 0x7f00e4190ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e8bca700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e41910d0 0x7f00e40bc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e8bca700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4191a40 con 0x7f00e408e6e0 2021-04-09T18:33:02.372 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e8bca700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e41925e0 con 0x7f00e41910d0 2021-04-09T18:33:02.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e8bca700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e41914d0 con 0x7f00e408e2e0 2021-04-09T18:33:02.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e205d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e408e6e0 0x7f00e4190ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e205d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e408e6e0 0x7f00e4190ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60258/0 (socket says 172.21.15.120:60258) 2021-04-09T18:33:02.373 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e205d700 1 -- 172.21.15.120:0/115034834 learned_addr learned my addr 172.21.15.120:0/115034834 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:02.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e285e700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e408e2e0 0x7f00e4191fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e305f700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e41910d0 0x7f00e40bc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e205d700 1 -- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e408e2e0 msgr2=0x7f00e4191fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e205d700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e408e2e0 0x7f00e4191fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.374 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e205d700 1 -- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e41910d0 msgr2=0x7f00e40bc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e205d700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e41910d0 0x7f00e40bc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e205d700 1 -- 172.21.15.120:0/115034834 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e41916f0 con 0x7f00e408e6e0 2021-04-09T18:33:02.375 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e285e700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00e408e2e0 0x7f00e4191fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:02.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e205d700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e408e6e0 0x7f00e4190ab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f00cc006f60 tx=0x7f00cc00b970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00db7fe700 1 -- 172.21.15.120:0/115034834 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00cc00bd60 con 0x7f00e408e6e0 2021-04-09T18:33:02.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00db7fe700 1 -- 172.21.15.120:0/115034834 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc000c90 con 0x7f00e408e6e0 2021-04-09T18:33:02.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e8bca700 1 -- 172.21.15.120:0/115034834 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e41916f0 con 0x7f00e408e6e0 2021-04-09T18:33:02.376 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00db7fe700 1 -- 172.21.15.120:0/115034834 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f00cc002220 con 0x7f00e408e6e0 2021-04-09T18:33:02.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.377 7f00e8bca700 1 -- 172.21.15.120:0/115034834 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e41916f0 con 0x7f00e408e6e0 2021-04-09T18:33:02.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.378 7f00db7fe700 1 -- 172.21.15.120:0/115034834 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f00cc0052e0 con 0x7f00e408e6e0 2021-04-09T18:33:02.377 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.378 7f00db7fe700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00c80188c0 0x7f00c801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.378 7f00db7fe700 1 -- 172.21.15.120:0/115034834 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f00cc032c40 con 0x7f00e408e6e0 2021-04-09T18:33:02.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.379 7f00e285e700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00c80188c0 0x7f00c801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.378 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.379 7f00e285e700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00c80188c0 0x7f00c801adc0 crc :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.401 7f00e8bca700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f00e4062a70 0x7f00e4062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.387 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.401 7f00e8bca700 1 -- 172.21.15.120:0/115034834 --> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00e4191a40 con 0x7f00e4062a70 2021-04-09T18:33:02.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.401 7f00e305f700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f00e4062a70 0x7f00e4062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.402 7f00e305f700 1 -- 172.21.15.120:0/115034834 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f00e4062a70 msgr2=0x7f00e4062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:33:02.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.402 7f00e305f700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f00e4062a70 0x7f00e4062e70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.388 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.402 7f00db7fe700 1 -- 172.21.15.120:0/115034834 <== osd.2 v2:172.21.15.120:6816/24603 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f00dc0093a0 con 0x7f00e4062a70 2021-04-09T18:33:02.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.410 7f00e8bca700 1 -- 172.21.15.120:0/115034834 --> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f00e4191a40 con 0x7f00e4062a70 2021-04-09T18:33:02.395 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.410 7f00db7fe700 1 -- 172.21.15.120:0/115034834 <== osd.2 v2:172.21.15.120:6816/24603 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7f00dc0093a0 con 0x7f00e4062a70 2021-04-09T18:33:02.396 INFO:teuthology.orchestra.run.smithi120.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:33:02.397 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 -- 172.21.15.120:0/115034834 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f00e4062a70 msgr2=0x7f00e4062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.120:6816/24603,v1:172.21.15.120:6817/24603] conn(0x7f00e4062a70 0x7f00e4062e70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 -- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00c80188c0 msgr2=0x7f00c801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f00c80188c0 0x7f00c801adc0 crc :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.398 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 -- 172.21.15.120:0/115034834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e408e6e0 msgr2=0x7f00e4190ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 --2- 172.21.15.120:0/115034834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00e408e6e0 0x7f00e4190ab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f00cc006f60 tx=0x7f00cc00b970).stop 2021-04-09T18:33:02.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e305f700 1 -- 172.21.15.120:0/115034834 reap_dead start 2021-04-09T18:33:02.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 -- 172.21.15.120:0/115034834 shutdown_connections 2021-04-09T18:33:02.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 -- 172.21.15.120:0/115034834 >> 172.21.15.120:0/115034834 conn(0x7f00e418d490 msgr2=0x7f00e41833b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:02.399 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 -- 172.21.15.120:0/115034834 shutdown_connections 2021-04-09T18:33:02.400 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.411 7f00e8bca700 1 -- 172.21.15.120:0/115034834 wait complete. 2021-04-09T18:33:02.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-04-09T18:33:02.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.564 7f3d0a273700 1 Processor -- start 2021-04-09T18:33:02.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.564 7f3d0a273700 1 -- start start 2021-04-09T18:33:02.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.564 7f3d0a273700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3d0407e700 0x7f3d04100210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.564 7f3d0a273700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3d041a9160 0x7f3d041ab570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.564 7f3d0a273700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d040ffc90 con 0x7f3d04100830 2021-04-09T18:33:02.571 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.564 7f3d0a273700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d040d80e0 con 0x7f3d0407e700 2021-04-09T18:33:02.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.564 7f3d0a273700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d040d2040 con 0x7f3d041a9160 2021-04-09T18:33:02.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d03fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3d0407e700 0x7f3d04100210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.572 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d03fff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3d0407e700 0x7f3d04100210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60266/0 (socket says 172.21.15.120:60266) 2021-04-09T18:33:02.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d03fff700 1 -- 172.21.15.120:0/3608897526 learned_addr learned my addr 172.21.15.120:0/3608897526 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:02.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d08890700 1 --2- 172.21.15.120:0/3608897526 >> v2:172.21.15.134:3300/0 conn(0x7f3d041a9160 0x7f3d041ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d03fff700 1 -- 172.21.15.120:0/3608897526 >> v2:172.21.15.134:3300/0 conn(0x7f3d041a9160 msgr2=0x7f3d041ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:02.573 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d03fff700 1 --2- 172.21.15.120:0/3608897526 >> v2:172.21.15.134:3300/0 conn(0x7f3d041a9160 0x7f3d041ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d03fff700 1 -- 172.21.15.120:0/3608897526 >> v1:172.21.15.134:6789/0 conn(0x7f3d04100830 legacy=0x7f3d040ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d03fff700 1 -- 172.21.15.120:0/3608897526 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0407eb00 con 0x7f3d0407e700 2021-04-09T18:33:02.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d03fff700 1 --2- 172.21.15.120:0/3608897526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d0407e700 0x7f3d04100210 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f3cf4006700 tx=0x7f3cf4009b80).ready entity=mon.0 client_cookie=a2a536750ea250d8 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d037fe700 1 -- 172.21.15.120:0/3608897526 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cf400c0c0 con 0x7f3d0407e700 2021-04-09T18:33:02.574 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d037fe700 1 -- 172.21.15.120:0/3608897526 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf400c440 con 0x7f3d0407e700 2021-04-09T18:33:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d037fe700 1 -- 172.21.15.120:0/3608897526 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cf400c920 con 0x7f3d0407e700 2021-04-09T18:33:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d0a273700 1 -- 172.21.15.120:0/3608897526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d0407e700 msgr2=0x7f3d04100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.565 7f3d0a273700 1 --2- 172.21.15.120:0/3608897526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d0407e700 0x7f3d04100210 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f3cf4006700 tx=0x7f3cf4009b80).stop 2021-04-09T18:33:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.566 7f3d0a273700 1 -- 172.21.15.120:0/3608897526 shutdown_connections 2021-04-09T18:33:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.566 7f3d0a273700 1 --2- 172.21.15.120:0/3608897526 >> v2:172.21.15.134:3300/0 conn(0x7f3d041a9160 0x7f3d041ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.566 7f3d0a273700 1 --2- 172.21.15.120:0/3608897526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d0407e700 0x7f3d04100210 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.566 7f3d0a273700 1 -- 172.21.15.120:0/3608897526 >> 172.21.15.120:0/3608897526 conn(0x7f3d040f0050 msgr2=0x7f3d040d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.566 7f3d0a273700 1 -- 172.21.15.120:0/3608897526 shutdown_connections 2021-04-09T18:33:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.566 7f3d0a273700 1 -- 172.21.15.120:0/3608897526 wait complete. 2021-04-09T18:33:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d0a273700 1 Processor -- start 2021-04-09T18:33:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d0a273700 1 -- start start 2021-04-09T18:33:02.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d0a273700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d04098a80 0x7f3d041969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d0a273700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d04098e80 0x7f3d04195520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.580 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d0a273700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d04195b40 0x7f3d0408dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d0a273700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04196420 con 0x7f3d04195b40 2021-04-09T18:33:02.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d0a273700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04196fc0 con 0x7f3d04098e80 2021-04-09T18:33:02.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d0a273700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04195f40 con 0x7f3d04098a80 2021-04-09T18:33:02.581 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d08890700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d04195b40 0x7f3d0408dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d08890700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d04195b40 0x7f3d0408dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60274/0 (socket says 172.21.15.120:60274) 2021-04-09T18:33:02.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.585 7f3d08890700 1 -- 172.21.15.120:0/1316087605 learned_addr learned my addr 172.21.15.120:0/1316087605 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:02.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d03fff700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d04098a80 0x7f3d041969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.582 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3cfbfff700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d04098e80 0x7f3d04195520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d08890700 1 -- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d04098a80 msgr2=0x7f3d041969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d08890700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d04098a80 0x7f3d041969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d08890700 1 -- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d04098e80 msgr2=0x7f3d04195520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d08890700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d04098e80 0x7f3d04195520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d08890700 1 -- 172.21.15.120:0/1316087605 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04196160 con 0x7f3d04195b40 2021-04-09T18:33:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d08890700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d04195b40 0x7f3d0408dca0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f3cfc00b970 tx=0x7f3cfc00bd10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d017fa700 1 -- 172.21.15.120:0/1316087605 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cfc000f90 con 0x7f3d04195b40 2021-04-09T18:33:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d017fa700 1 -- 172.21.15.120:0/1316087605 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc006aa0 con 0x7f3d04195b40 2021-04-09T18:33:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d04196160 con 0x7f3d04195b40 2021-04-09T18:33:02.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d017fa700 1 -- 172.21.15.120:0/1316087605 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3cfc0015f0 con 0x7f3d04195b40 2021-04-09T18:33:02.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.586 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d04196160 con 0x7f3d04195b40 2021-04-09T18:33:02.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.587 7f3d017fa700 1 -- 172.21.15.120:0/1316087605 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f3cfc006aa0 con 0x7f3d04195b40 2021-04-09T18:33:02.585 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.587 7f3d017fa700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3ce80188c0 0x7f3ce801adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.587 7f3d017fa700 1 -- 172.21.15.120:0/1316087605 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3cfc032ec0 con 0x7f3d04195b40 2021-04-09T18:33:02.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.587 7f3d03fff700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3ce80188c0 0x7f3ce801adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.586 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.588 7f3d03fff700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3ce80188c0 0x7f3ce801adc0 crc :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.595 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.610 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d040af1f0 con 0x7f3d04195b40 2021-04-09T18:33:02.599 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.614 7f3d017fa700 1 -- 172.21.15.120:0/1316087605 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f3cfc0066f0 con 0x7f3d04195b40 2021-04-09T18:33:02.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.783 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mgr", ""]}) v1 -- 0x7f3d04196fc0 con 0x7f3ce80188c0 2021-04-09T18:33:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.784 7f3d017fa700 1 -- 172.21.15.120:0/1316087605 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f3cf4006430 con 0x7f3ce80188c0 2021-04-09T18:33:02.770 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 2 to deep-scrub 2021-04-09T18:33:02.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3ce80188c0 msgr2=0x7f3ce801adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.773 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3ce80188c0 0x7f3ce801adc0 crc :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.774 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d04195b40 msgr2=0x7f3d0408dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.774 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d04195b40 0x7f3d0408dca0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f3cfc00b970 tx=0x7f3cfc00bd10).stop 2021-04-09T18:33:02.774 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 shutdown_connections 2021-04-09T18:33:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d04195b40 0x7f3d0408dca0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d04098e80 0x7f3d04195520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f3ce80188c0 0x7f3ce801adc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 --2- 172.21.15.120:0/1316087605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d04098a80 0x7f3d041969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 >> 172.21.15.120:0/1316087605 conn(0x7f3d0418dce0 msgr2=0x7f3d040942c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:02.777 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 shutdown_connections 2021-04-09T18:33:02.778 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.786 7f3d0a273700 1 -- 172.21.15.120:0/1316087605 wait complete. 2021-04-09T18:33:02.782 INFO:tasks.ceph:Scrubbing osd.3 2021-04-09T18:33:02.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:33:02.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.940 7f5b8631d700 1 Processor -- start 2021-04-09T18:33:02.953 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.940 7f5b8631d700 1 -- start start 2021-04-09T18:33:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b8631d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5b800d8870 0x7f5b800d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b8631d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b800d75e0 0x7f5b800ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b8631d700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800ff1c0 con 0x7f5b800ffd60 2021-04-09T18:33:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b8631d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b800d80f0 con 0x7f5b800d8870 2021-04-09T18:33:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b8631d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8019f900 con 0x7f5b800d75e0 2021-04-09T18:33:02.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b8493a700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5b800ffd60 0x7f5b801a9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55194/0 (socket says 172.21.15.120:55194) 2021-04-09T18:33:02.956 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b8493a700 1 -- 172.21.15.120:0/3117733974 learned_addr learned my addr 172.21.15.120:0/3117733974 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:02.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b77fff700 1 --2- 172.21.15.120:0/3117733974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b800d75e0 0x7f5b800ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b7ffff700 1 --2- 172.21.15.120:0/3117733974 >> v2:172.21.15.134:3300/0 conn(0x7f5b800d8870 0x7f5b800d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.957 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b7f7fe700 1 -- 172.21.15.120:0/3117733974 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629230019 0 0) 0x7f5b78000d30 con 0x7f5b800ffd60 2021-04-09T18:33:02.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.941 7f5b7f7fe700 1 -- 172.21.15.120:0/3117733974 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b6c002fe0 con 0x7f5b800ffd60 2021-04-09T18:33:02.958 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b7f7fe700 1 -- 172.21.15.120:0/3117733974 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3941373274 0 0) 0x7f5b78001270 con 0x7f5b800ffd60 2021-04-09T18:33:02.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b77fff700 1 -- 172.21.15.120:0/3117733974 >> v2:172.21.15.134:3300/0 conn(0x7f5b800d8870 msgr2=0x7f5b800d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:02.959 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b77fff700 1 --2- 172.21.15.120:0/3117733974 >> v2:172.21.15.134:3300/0 conn(0x7f5b800d8870 0x7f5b800d8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b77fff700 1 -- 172.21.15.120:0/3117733974 >> v1:172.21.15.120:6789/0 conn(0x7f5b800ffd60 legacy=0x7f5b801a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b77fff700 1 -- 172.21.15.120:0/3117733974 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800d93b0 con 0x7f5b800d75e0 2021-04-09T18:33:02.960 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b7ffff700 1 --2- 172.21.15.120:0/3117733974 >> v2:172.21.15.134:3300/0 conn(0x7f5b800d8870 0x7f5b800d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:02.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b77fff700 1 --2- 172.21.15.120:0/3117733974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b800d75e0 0x7f5b800ff740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f5b68006650 tx=0x7f5b68009a80).ready entity=mon.2 client_cookie=ef1388dd9ab2afe5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.961 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b7f7fe700 1 -- 172.21.15.120:0/3117733974 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b680009b0 con 0x7f5b800d75e0 2021-04-09T18:33:02.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b7f7fe700 1 -- 172.21.15.120:0/3117733974 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6800c0c0 con 0x7f5b800d75e0 2021-04-09T18:33:02.962 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b7f7fe700 1 -- 172.21.15.120:0/3117733974 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b6800c510 con 0x7f5b800d75e0 2021-04-09T18:33:02.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b8631d700 1 -- 172.21.15.120:0/3117733974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b800d75e0 msgr2=0x7f5b800ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.942 7f5b8631d700 1 --2- 172.21.15.120:0/3117733974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b800d75e0 0x7f5b800ff740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f5b68006650 tx=0x7f5b68009a80).stop 2021-04-09T18:33:02.963 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.943 7f5b8631d700 1 -- 172.21.15.120:0/3117733974 shutdown_connections 2021-04-09T18:33:02.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.943 7f5b8631d700 1 --2- 172.21.15.120:0/3117733974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b800d75e0 0x7f5b800ff740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.964 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.943 7f5b8631d700 1 --2- 172.21.15.120:0/3117733974 >> v2:172.21.15.134:3300/0 conn(0x7f5b800d8870 0x7f5b800d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.943 7f5b8631d700 1 -- 172.21.15.120:0/3117733974 >> 172.21.15.120:0/3117733974 conn(0x7f5b800d1580 msgr2=0x7f5b800d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:02.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.943 7f5b8631d700 1 -- 172.21.15.120:0/3117733974 shutdown_connections 2021-04-09T18:33:02.965 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.943 7f5b8631d700 1 -- 172.21.15.120:0/3117733974 wait complete. 2021-04-09T18:33:02.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.962 7f5b8631d700 1 Processor -- start 2021-04-09T18:33:02.966 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.962 7f5b8631d700 1 -- start start 2021-04-09T18:33:02.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.962 7f5b8631d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b80196740 0x7f5b80195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.962 7f5b8631d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b80095c30 0x7f5b80094ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.967 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.962 7f5b8631d700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b80096030 0x7f5b800bc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.962 7f5b8631d700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80196420 con 0x7f5b80196740 2021-04-09T18:33:02.968 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.962 7f5b8631d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800956f0 con 0x7f5b80095c30 2021-04-09T18:33:02.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.962 7f5b8631d700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80196b40 con 0x7f5b80096030 2021-04-09T18:33:02.969 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b80196740 0x7f5b80195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7ffff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b80196740 0x7f5b80195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60286/0 (socket says 172.21.15.120:60286) 2021-04-09T18:33:02.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7ffff700 1 -- 172.21.15.120:0/3684528122 learned_addr learned my addr 172.21.15.120:0/3684528122 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:02.970 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b77fff700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b80095c30 0x7f5b80094ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b8493a700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b80096030 0x7f5b800bc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.971 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7ffff700 1 -- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b80096030 msgr2=0x7f5b800bc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7ffff700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b80096030 0x7f5b800bc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.972 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7ffff700 1 -- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b80095c30 msgr2=0x7f5b80094ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7ffff700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b80095c30 0x7f5b80094ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7ffff700 1 -- 172.21.15.120:0/3684528122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80095300 con 0x7f5b80196740 2021-04-09T18:33:02.973 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7ffff700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b80196740 0x7f5b80195e00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f5b70006f40 tx=0x7f5b7000b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7d7fa700 1 -- 172.21.15.120:0/3684528122 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b7000bd80 con 0x7f5b80196740 2021-04-09T18:33:02.974 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7d7fa700 1 -- 172.21.15.120:0/3684528122 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70000c90 con 0x7f5b80196740 2021-04-09T18:33:02.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b80095300 con 0x7f5b80196740 2021-04-09T18:33:02.975 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b7d7fa700 1 -- 172.21.15.120:0/3684528122 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b70002220 con 0x7f5b80196740 2021-04-09T18:33:02.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.963 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b80095300 con 0x7f5b80196740 2021-04-09T18:33:02.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.964 7f5b7d7fa700 1 -- 172.21.15.120:0/3684528122 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f5b7000a000 con 0x7f5b80196740 2021-04-09T18:33:02.976 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.964 7f5b7d7fa700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5b64018930 0x7f5b6401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.964 7f5b7d7fa700 1 -- 172.21.15.120:0/3684528122 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f5b70032df0 con 0x7f5b80196740 2021-04-09T18:33:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.964 7f5b77fff700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5b64018930 0x7f5b6401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.978 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.964 7f5b77fff700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5b64018930 0x7f5b6401ae10 crc :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.979 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.986 7f5b8631d700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f5b80062a70 0x7f5b80062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:02.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.986 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 --> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b80196420 con 0x7f5b80062a70 2021-04-09T18:33:02.980 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.986 7f5b8493a700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f5b80062a70 0x7f5b80062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:02.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.987 7f5b8493a700 1 -- 172.21.15.120:0/3684528122 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f5b80062a70 msgr2=0x7f5b80062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:33:02.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.987 7f5b8493a700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f5b80062a70 0x7f5b80062e70 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:02.981 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.987 7f5b7d7fa700 1 -- 172.21.15.120:0/3684528122 <== osd.3 v2:172.21.15.120:6824/24612 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f5b78001580 con 0x7f5b80062a70 2021-04-09T18:33:02.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.995 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 --> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f5b80183180 con 0x7f5b80062a70 2021-04-09T18:33:02.985 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.995 7f5b7d7fa700 1 -- 172.21.15.120:0/3684528122 <== osd.3 v2:172.21.15.120:6824/24612 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7f5b78001580 con 0x7f5b80062a70 2021-04-09T18:33:02.985 INFO:teuthology.orchestra.run.smithi120.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:33:02.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f5b80062a70 msgr2=0x7f5b80062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.986 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.120:6824/24612,v1:172.21.15.120:6825/24612] conn(0x7f5b80062a70 0x7f5b80062e70 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5b64018930 msgr2=0x7f5b6401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.987 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f5b64018930 0x7f5b6401ae10 crc :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:02.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b80196740 msgr2=0x7f5b80195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:02.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 --2- 172.21.15.120:0/3684528122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b80196740 0x7f5b80195e00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f5b70006f40 tx=0x7f5b7000b990).stop 2021-04-09T18:33:02.988 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8493a700 1 -- 172.21.15.120:0/3684528122 reap_dead start 2021-04-09T18:33:02.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 shutdown_connections 2021-04-09T18:33:02.989 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 >> 172.21.15.120:0/3684528122 conn(0x7f5b8018e430 msgr2=0x7f5b80091240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:02.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 shutdown_connections 2021-04-09T18:33:02.990 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:02.996 7f5b8631d700 1 -- 172.21.15.120:0/3684528122 wait complete. 2021-04-09T18:33:02.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-04-09T18:33:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.149 7f7dd1580700 1 Processor -- start 2021-04-09T18:33:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.149 7f7dd1580700 1 -- start start 2021-04-09T18:33:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dd1580700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7dcc0d6580 0x7f7dcc1ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dd1580700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dcc0d7960 con 0x7f7dcc0d7560 2021-04-09T18:33:03.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dd1580700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dcc0d6980 con 0x7f7dcc0d7160 2021-04-09T18:33:03.163 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dd1580700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dcc0d6be0 con 0x7f7dcc0d6580 2021-04-09T18:33:03.164 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dcbac0700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7dcc0d6580 0x7f7dcc1ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.164 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dcaabe700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7dcc0d7560 0x7f7dcc0d5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55212/0 (socket says 172.21.15.120:55212) 2021-04-09T18:33:03.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dcaabe700 1 -- 172.21.15.120:0/3712261525 learned_addr learned my addr 172.21.15.120:0/3712261525 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:03.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dcbac0700 1 -- 172.21.15.120:0/3712261525 >> v1:172.21.15.134:6789/0 conn(0x7f7dcc0d7160 legacy=0x7f7dcc0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.165 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dcbac0700 1 -- 172.21.15.120:0/3712261525 >> v1:172.21.15.120:6789/0 conn(0x7f7dcc0d7560 legacy=0x7f7dcc0d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dcbac0700 1 -- 172.21.15.120:0/3712261525 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc1a2ac0 con 0x7f7dcc0d6580 2021-04-09T18:33:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dca2bd700 1 -- 172.21.15.120:0/3712261525 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512898496 0 0) 0x7f7dc0000ce0 con 0x7f7dcc0d7560 2021-04-09T18:33:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dcbac0700 1 --2- 172.21.15.120:0/3712261525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc0d6580 0x7f7dcc1ac1f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f7dc4006e30 tx=0x7f7dc4009de0).ready entity=mon.0 client_cookie=4a6a0734445703f5 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.150 7f7dca2bd700 1 -- 172.21.15.120:0/3712261525 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7dc400b300 con 0x7f7dcc0d6580 2021-04-09T18:33:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.151 7f7dca2bd700 1 -- 172.21.15.120:0/3712261525 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc400b680 con 0x7f7dcc0d6580 2021-04-09T18:33:03.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.151 7f7dca2bd700 1 -- 172.21.15.120:0/3712261525 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7dc400bb60 con 0x7f7dcc0d6580 2021-04-09T18:33:03.168 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.151 7f7dd1580700 1 -- 172.21.15.120:0/3712261525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc0d6580 msgr2=0x7f7dcc1ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.151 7f7dd1580700 1 --2- 172.21.15.120:0/3712261525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc0d6580 0x7f7dcc1ac1f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f7dc4006e30 tx=0x7f7dc4009de0).stop 2021-04-09T18:33:03.169 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.151 7f7dd1580700 1 -- 172.21.15.120:0/3712261525 shutdown_connections 2021-04-09T18:33:03.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.151 7f7dd1580700 1 --2- 172.21.15.120:0/3712261525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc0d6580 0x7f7dcc1ac1f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.151 7f7dd1580700 1 -- 172.21.15.120:0/3712261525 >> 172.21.15.120:0/3712261525 conn(0x7f7dcc0d1590 msgr2=0x7f7dcc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:03.170 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.151 7f7dd1580700 1 -- 172.21.15.120:0/3712261525 shutdown_connections 2021-04-09T18:33:03.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.151 7f7dd1580700 1 -- 172.21.15.120:0/3712261525 wait complete. 2021-04-09T18:33:03.171 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.170 7f7dd1580700 1 Processor -- start 2021-04-09T18:33:03.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.170 7f7dd1580700 1 -- start start 2021-04-09T18:33:03.172 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dd1580700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc19d420 0x7f7dcc192a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dd1580700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dcc19d940 0x7f7dcc19dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dd1580700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dcc19e360 0x7f7dcc19e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.173 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dd1580700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc192500 con 0x7f7dcc19d420 2021-04-09T18:33:03.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dd1580700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc1930a0 con 0x7f7dcc19e360 2021-04-09T18:33:03.174 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dd1580700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc19f120 con 0x7f7dcc19d940 2021-04-09T18:33:03.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcb2bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc19d420 0x7f7dcc192a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.175 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcb2bf700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc19d420 0x7f7dcc192a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60304/0 (socket says 172.21.15.120:60304) 2021-04-09T18:33:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcb2bf700 1 -- 172.21.15.120:0/4249256256 learned_addr learned my addr 172.21.15.120:0/4249256256 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcbac0700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dcc19e360 0x7f7dcc19e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcaabe700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dcc19d940 0x7f7dcc19dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcb2bf700 1 -- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dcc19d940 msgr2=0x7f7dcc19dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.177 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcb2bf700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dcc19d940 0x7f7dcc19dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcb2bf700 1 -- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dcc19e360 msgr2=0x7f7dcc19e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcb2bf700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dcc19e360 0x7f7dcc19e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.178 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcb2bf700 1 -- 172.21.15.120:0/4249256256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc19ed80 con 0x7f7dcc19d420 2021-04-09T18:33:03.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcbac0700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dcc19e360 0x7f7dcc19e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:03.179 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcaabe700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dcc19d940 0x7f7dcc19dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:03.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dcb2bf700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc19d420 0x7f7dcc192a80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f7dbc00b5b0 tx=0x7f7dbc00b950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7db3fff700 1 -- 172.21.15.120:0/4249256256 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7dbc00bd40 con 0x7f7dcc19d420 2021-04-09T18:33:03.180 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7db3fff700 1 -- 172.21.15.120:0/4249256256 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc006240 con 0x7f7dcc19d420 2021-04-09T18:33:03.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.171 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dcc19ed80 con 0x7f7dcc19d420 2021-04-09T18:33:03.181 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.172 7f7db3fff700 1 -- 172.21.15.120:0/4249256256 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7dbc005690 con 0x7f7dcc19d420 2021-04-09T18:33:03.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.172 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dcc19ed80 con 0x7f7dcc19d420 2021-04-09T18:33:03.182 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.172 7f7db3fff700 1 -- 172.21.15.120:0/4249256256 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f7dbc0054a0 con 0x7f7dcc19d420 2021-04-09T18:33:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.172 7f7db3fff700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7dac018930 0x7f7dac01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.172 7f7db3fff700 1 -- 172.21.15.120:0/4249256256 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f7dbc032e40 con 0x7f7dcc19d420 2021-04-09T18:33:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.172 7f7dcaabe700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7dac018930 0x7f7dac01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.184 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.173 7f7dcaabe700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7dac018930 0x7f7dac01ae10 crc :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.185 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.196 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dcc0def40 con 0x7f7dcc19d420 2021-04-09T18:33:03.186 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.199 7f7db3fff700 1 -- 172.21.15.120:0/4249256256 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f7dbc000c60 con 0x7f7dcc19d420 2021-04-09T18:33:03.355 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.370 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mgr", ""]}) v1 -- 0x7f7dcc0def40 con 0x7f7dac018930 2021-04-09T18:33:03.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.370 7f7db3fff700 1 -- 172.21.15.120:0/4249256256 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f7dc0006bc0 con 0x7f7dac018930 2021-04-09T18:33:03.356 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 3 to deep-scrub 2021-04-09T18:33:03.358 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.372 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7dac018930 msgr2=0x7f7dac01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.372 7f7dd1580700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7dac018930 0x7f7dac01ae10 crc :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.372 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc19d420 msgr2=0x7f7dcc192a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.372 7f7dd1580700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc19d420 0x7f7dcc192a80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f7dbc00b5b0 tx=0x7f7dbc00b950).stop 2021-04-09T18:33:03.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.373 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 shutdown_connections 2021-04-09T18:33:03.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.373 7f7dd1580700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dcc19e360 0x7f7dcc19e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.373 7f7dd1580700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7dac018930 0x7f7dac01ae10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.373 7f7dd1580700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dcc19d940 0x7f7dcc19dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.360 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.373 7f7dd1580700 1 --2- 172.21.15.120:0/4249256256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dcc19d420 0x7f7dcc192a80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.373 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 >> 172.21.15.120:0/4249256256 conn(0x7f7dcc0df9c0 msgr2=0x7f7dcc09ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:03.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.373 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 shutdown_connections 2021-04-09T18:33:03.361 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.373 7f7dd1580700 1 -- 172.21.15.120:0/4249256256 wait complete. 2021-04-09T18:33:03.369 INFO:tasks.ceph:Scrubbing osd.4 2021-04-09T18:33:03.369 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:33:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.526 7f72b861f700 1 Processor -- start 2021-04-09T18:33:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.526 7f72b861f700 1 -- start start 2021-04-09T18:33:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.526 7f72b861f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f72b00d8870 0x7f72b00d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.526 7f72b861f700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f72b01a8da0 0x7f72b01ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.526 7f72b861f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00ff1c0 con 0x7f72b00d75e0 2021-04-09T18:33:03.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.526 7f72b861f700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00d80f0 con 0x7f72b01a8da0 2021-04-09T18:33:03.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.526 7f72b861f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b019f900 con 0x7f72b00d8870 2021-04-09T18:33:03.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b6c3c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f72b01a8da0 0x7f72b01ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b6c3c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f72b01a8da0 0x7f72b01ab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60312/0 (socket says 172.21.15.120:60312) 2021-04-09T18:33:03.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b6c3c700 1 -- 172.21.15.120:0/2428512729 learned_addr learned my addr 172.21.15.120:0/2428512729 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:03.542 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b643b700 1 --2- 172.21.15.120:0/2428512729 >> v2:172.21.15.134:3300/0 conn(0x7f72b00d8870 0x7f72b00d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b6c3c700 1 -- 172.21.15.120:0/2428512729 >> v2:172.21.15.134:3300/0 conn(0x7f72b00d8870 msgr2=0x7f72b00d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b6c3c700 1 --2- 172.21.15.120:0/2428512729 >> v2:172.21.15.134:3300/0 conn(0x7f72b00d8870 0x7f72b00d8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b6c3c700 1 -- 172.21.15.120:0/2428512729 >> v1:172.21.15.134:6789/0 conn(0x7f72b00d75e0 legacy=0x7f72b00ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b6c3c700 1 -- 172.21.15.120:0/2428512729 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00fff30 con 0x7f72b01a8da0 2021-04-09T18:33:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b6c3c700 1 --2- 172.21.15.120:0/2428512729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b01a8da0 0x7f72b01ab1b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f72a8006b80 tx=0x7f72a8009b90).ready entity=mon.0 client_cookie=215ff67440db3f10 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.544 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b5439700 1 -- 172.21.15.120:0/2428512729 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72a80022e0 con 0x7f72b01a8da0 2021-04-09T18:33:03.544 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b5439700 1 -- 172.21.15.120:0/2428512729 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8002620 con 0x7f72b01a8da0 2021-04-09T18:33:03.544 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b5439700 1 -- 172.21.15.120:0/2428512729 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72a8002b00 con 0x7f72b01a8da0 2021-04-09T18:33:03.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b861f700 1 -- 172.21.15.120:0/2428512729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b01a8da0 msgr2=0x7f72b01ab1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.527 7f72b861f700 1 --2- 172.21.15.120:0/2428512729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b01a8da0 0x7f72b01ab1b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f72a8006b80 tx=0x7f72a8009b90).stop 2021-04-09T18:33:03.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.528 7f72b861f700 1 -- 172.21.15.120:0/2428512729 shutdown_connections 2021-04-09T18:33:03.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.528 7f72b861f700 1 --2- 172.21.15.120:0/2428512729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b01a8da0 0x7f72b01ab1b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.545 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.528 7f72b861f700 1 --2- 172.21.15.120:0/2428512729 >> v2:172.21.15.134:3300/0 conn(0x7f72b00d8870 0x7f72b00d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.528 7f72b861f700 1 -- 172.21.15.120:0/2428512729 >> 172.21.15.120:0/2428512729 conn(0x7f72b00d1580 msgr2=0x7f72b00d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:03.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.529 7f72b861f700 1 -- 172.21.15.120:0/2428512729 shutdown_connections 2021-04-09T18:33:03.546 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.529 7f72b861f700 1 -- 172.21.15.120:0/2428512729 wait complete. 2021-04-09T18:33:03.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.555 7f72b861f700 1 Processor -- start 2021-04-09T18:33:03.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.555 7f72b861f700 1 -- start start 2021-04-09T18:33:03.549 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b861f700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b0095940 0x7f72b008e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b861f700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b0095d40 0x7f72b0096320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b861f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72b0096940 0x7f72b0096d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.550 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b861f700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0097360 con 0x7f72b0095d40 2021-04-09T18:33:03.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b861f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b008e790 con 0x7f72b0096940 2021-04-09T18:33:03.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b861f700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b008bdb0 con 0x7f72b0095940 2021-04-09T18:33:03.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b5c3a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b0095d40 0x7f72b0096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.551 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b643b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b0095940 0x7f72b008e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b643b700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b0095940 0x7f72b008e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:46978/0 (socket says 172.21.15.120:46978) 2021-04-09T18:33:03.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b5c3a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b0095d40 0x7f72b0096320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60316/0 (socket says 172.21.15.120:60316) 2021-04-09T18:33:03.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b643b700 1 -- 172.21.15.120:0/3209910803 learned_addr learned my addr 172.21.15.120:0/3209910803 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:03.552 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b6c3c700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72b0096940 0x7f72b0096d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b5c3a700 1 -- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b0095940 msgr2=0x7f72b008e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b5c3a700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b0095940 0x7f72b008e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b5c3a700 1 -- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72b0096940 msgr2=0x7f72b0096d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.553 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b5c3a700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72b0096940 0x7f72b0096d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.554 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b5c3a700 1 -- 172.21.15.120:0/3209910803 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b008bfd0 con 0x7f72b0095d40 2021-04-09T18:33:03.554 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b643b700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72b0095940 0x7f72b008e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:03.554 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.556 7f72b5c3a700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b0095d40 0x7f72b0096320 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f72a0009fa0 tx=0x7f72a000b840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.557 7f72a6ffd700 1 -- 172.21.15.120:0/3209910803 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72a0000960 con 0x7f72b0095d40 2021-04-09T18:33:03.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.557 7f72a6ffd700 1 -- 172.21.15.120:0/3209910803 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a000bc30 con 0x7f72b0095d40 2021-04-09T18:33:03.555 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.557 7f72a6ffd700 1 -- 172.21.15.120:0/3209910803 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72a0002280 con 0x7f72b0095d40 2021-04-09T18:33:03.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.557 7f72b861f700 1 -- 172.21.15.120:0/3209910803 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b008bfd0 con 0x7f72b0095d40 2021-04-09T18:33:03.556 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.557 7f72b861f700 1 -- 172.21.15.120:0/3209910803 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b008bfd0 con 0x7f72b0095d40 2021-04-09T18:33:03.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.558 7f72a6ffd700 1 -- 172.21.15.120:0/3209910803 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f72a0006230 con 0x7f72b0095d40 2021-04-09T18:33:03.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.558 7f72a6ffd700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7298018930 0x7f729801ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.557 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.558 7f72a6ffd700 1 -- 172.21.15.120:0/3209910803 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f72a0032da0 con 0x7f72b0095d40 2021-04-09T18:33:03.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.558 7f72b643b700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7298018930 0x7f729801ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.558 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.559 7f72b643b700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7298018930 0x7f729801ae10 crc :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.572 7f72b861f700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f72b008cb40 0x7f72b008cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.572 7f72b861f700 1 -- 172.21.15.120:0/3209910803 --> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72b0097360 con 0x7f72b008cb40 2021-04-09T18:33:03.560 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.572 7f72b6c3c700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f72b008cb40 0x7f72b008cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.572 7f72b6c3c700 1 -- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f72b008cb40 msgr2=0x7f72b008cf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:33:03.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.572 7f72b6c3c700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f72b008cb40 0x7f72b008cf40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.561 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.573 7f72a6ffd700 1 -- 172.21.15.120:0/3209910803 <== osd.4 v2:172.21.15.134:6802/24855 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f72a8009100 con 0x7f72b008cb40 2021-04-09T18:33:03.565 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.580 7f72b861f700 1 -- 172.21.15.120:0/3209910803 --> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f72b008e9f0 con 0x7f72b008cb40 2021-04-09T18:33:03.566 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.580 7f72a6ffd700 1 -- 172.21.15.120:0/3209910803 <== osd.4 v2:172.21.15.134:6802/24855 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7f72a8006820 con 0x7f72b008cb40 2021-04-09T18:33:03.566 INFO:teuthology.orchestra.run.smithi120.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:33:03.567 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.581 7f72b861f700 1 -- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f72b008cb40 msgr2=0x7f72b008cf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.581 7f72b861f700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6802/24855,v1:172.21.15.134:6803/24855] conn(0x7f72b008cb40 0x7f72b008cf40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.581 7f72b861f700 1 -- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7298018930 msgr2=0x7f729801ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.581 7f72b861f700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f7298018930 0x7f729801ae10 crc :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.568 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.581 7f72b861f700 1 -- 172.21.15.120:0/3209910803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b0095d40 msgr2=0x7f72b0096320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.581 7f72b861f700 1 --2- 172.21.15.120:0/3209910803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72b0095d40 0x7f72b0096320 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f72a0009fa0 tx=0x7f72a000b840).stop 2021-04-09T18:33:03.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.581 7f72b6c3c700 1 -- 172.21.15.120:0/3209910803 reap_dead start 2021-04-09T18:33:03.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.581 7f72b861f700 1 -- 172.21.15.120:0/3209910803 shutdown_connections 2021-04-09T18:33:03.569 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.582 7f72b861f700 1 -- 172.21.15.120:0/3209910803 >> 172.21.15.120:0/3209910803 conn(0x7f72b018d490 msgr2=0x7f72b01833b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:03.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.582 7f72b861f700 1 -- 172.21.15.120:0/3209910803 shutdown_connections 2021-04-09T18:33:03.570 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.582 7f72b861f700 1 -- 172.21.15.120:0/3209910803 wait complete. 2021-04-09T18:33:03.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-04-09T18:33:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.734 7f6054140700 1 Processor -- start 2021-04-09T18:33:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.734 7f6054140700 1 -- start start 2021-04-09T18:33:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.734 7f6054140700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c0d7160 0x7f604c0e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.734 7f6054140700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f604c0e70a0 0x7f604c0d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.734 7f6054140700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604c0d6be0 con 0x7f604c0d7560 2021-04-09T18:33:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.734 7f6054140700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604c0d80f0 con 0x7f604c0e70a0 2021-04-09T18:33:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.734 7f6054140700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c0e7f00 con 0x7f604c0d7160 2021-04-09T18:33:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f605275d700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f604c0e70a0 0x7f604c0d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f605175b700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f604c0d7560 0x7f604c0d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55240/0 (socket says 172.21.15.120:55240) 2021-04-09T18:33:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f605175b700 1 -- 172.21.15.120:0/4164705544 learned_addr learned my addr 172.21.15.120:0/4164705544 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f6051f5c700 1 --2- 172.21.15.120:0/4164705544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c0d7160 0x7f604c0e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f605275d700 1 -- 172.21.15.120:0/4164705544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c0d7160 msgr2=0x7f604c0e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f605275d700 1 --2- 172.21.15.120:0/4164705544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c0d7160 0x7f604c0e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f605275d700 1 -- 172.21.15.120:0/4164705544 >> v1:172.21.15.120:6789/0 conn(0x7f604c0d7560 legacy=0x7f604c0d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f605275d700 1 -- 172.21.15.120:0/4164705544 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c1a2ac0 con 0x7f604c0e70a0 2021-04-09T18:33:03.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f6050f5a700 1 -- 172.21.15.120:0/4164705544 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594356751 0 0) 0x7f6040000d30 con 0x7f604c0d7560 2021-04-09T18:33:03.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f6051f5c700 1 --2- 172.21.15.120:0/4164705544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c0d7160 0x7f604c0e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:03.744 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f605275d700 1 --2- 172.21.15.120:0/4164705544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0e70a0 0x7f604c0d5d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f6044006ab0 tx=0x7f6044009b40).ready entity=mon.0 client_cookie=410b2d438565e954 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f6050f5a700 1 -- 172.21.15.120:0/4164705544 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60440022e0 con 0x7f604c0e70a0 2021-04-09T18:33:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f6050f5a700 1 -- 172.21.15.120:0/4164705544 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6044002660 con 0x7f604c0e70a0 2021-04-09T18:33:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f6050f5a700 1 -- 172.21.15.120:0/4164705544 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6044002b40 con 0x7f604c0e70a0 2021-04-09T18:33:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f6054140700 1 -- 172.21.15.120:0/4164705544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0e70a0 msgr2=0x7f604c0d5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.735 7f6054140700 1 --2- 172.21.15.120:0/4164705544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0e70a0 0x7f604c0d5d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f6044006ab0 tx=0x7f6044009b40).stop 2021-04-09T18:33:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.736 7f6054140700 1 -- 172.21.15.120:0/4164705544 shutdown_connections 2021-04-09T18:33:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.736 7f6054140700 1 --2- 172.21.15.120:0/4164705544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0e70a0 0x7f604c0d5d90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.736 7f6054140700 1 --2- 172.21.15.120:0/4164705544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c0d7160 0x7f604c0e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.736 7f6054140700 1 -- 172.21.15.120:0/4164705544 >> 172.21.15.120:0/4164705544 conn(0x7f604c0d1590 msgr2=0x7f604c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:03.747 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.736 7f6054140700 1 -- 172.21.15.120:0/4164705544 shutdown_connections 2021-04-09T18:33:03.747 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.736 7f6054140700 1 -- 172.21.15.120:0/4164705544 wait complete. 2021-04-09T18:33:03.747 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f6054140700 1 Processor -- start 2021-04-09T18:33:03.747 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f6054140700 1 -- start start 2021-04-09T18:33:03.750 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f6054140700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f604c19e010 0x7f604c182720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.750 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f6054140700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c188540 0x7f604c188940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f6054140700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0ab9b0 0x7f604c0abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f6054140700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c0a2530 con 0x7f604c0ab9b0 2021-04-09T18:33:03.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f6054140700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c19e680 con 0x7f604c19e010 2021-04-09T18:33:03.751 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f6054140700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c182d40 con 0x7f604c188540 2021-04-09T18:33:03.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f605275d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0ab9b0 0x7f604c0abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f605275d700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0ab9b0 0x7f604c0abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60332/0 (socket says 172.21.15.120:60332) 2021-04-09T18:33:03.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f605275d700 1 -- 172.21.15.120:0/187864658 learned_addr learned my addr 172.21.15.120:0/187864658 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:03.752 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f605175b700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c188540 0x7f604c188940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.755 7f605275d700 1 -- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c188540 msgr2=0x7f604c188940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f6051f5c700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f604c19e010 0x7f604c182720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f605275d700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c188540 0x7f604c188940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f605275d700 1 -- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f604c19e010 msgr2=0x7f604c182720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f605275d700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f604c19e010 0x7f604c182720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f605275d700 1 -- 172.21.15.120:0/187864658 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c188f60 con 0x7f604c0ab9b0 2021-04-09T18:33:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f605275d700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0ab9b0 0x7f604c0abdb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f604400b580 tx=0x7f604400b920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f603e7fc700 1 -- 172.21.15.120:0/187864658 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6044009070 con 0x7f604c0ab9b0 2021-04-09T18:33:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f603e7fc700 1 -- 172.21.15.120:0/187864658 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6044002280 con 0x7f604c0ab9b0 2021-04-09T18:33:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f603e7fc700 1 -- 172.21.15.120:0/187864658 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60440027a0 con 0x7f604c0ab9b0 2021-04-09T18:33:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f6054140700 1 -- 172.21.15.120:0/187864658 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604c188f60 con 0x7f604c0ab9b0 2021-04-09T18:33:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f6054140700 1 -- 172.21.15.120:0/187864658 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604c188f60 con 0x7f604c0ab9b0 2021-04-09T18:33:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.756 7f603e7fc700 1 -- 172.21.15.120:0/187864658 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f6044006a20 con 0x7f604c0ab9b0 2021-04-09T18:33:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.757 7f603e7fc700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6034018930 0x7f603401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.757 7f603e7fc700 1 -- 172.21.15.120:0/187864658 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f6044032e10 con 0x7f604c0ab9b0 2021-04-09T18:33:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.757 7f6051f5c700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6034018930 0x7f603401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.757 7f6051f5c700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6034018930 0x7f603401adc0 crc :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:03.766 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.780 7f6054140700 1 -- 172.21.15.120:0/187864658 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604c0d8ee0 con 0x7f604c0ab9b0 2021-04-09T18:33:03.769 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.784 7f603e7fc700 1 -- 172.21.15.120:0/187864658 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f6044000ef0 con 0x7f604c0ab9b0 2021-04-09T18:33:03.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.958 7f6054140700 1 -- 172.21.15.120:0/187864658 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mgr", ""]}) v1 -- 0x7f604c0d8ee0 con 0x7f6034018930 2021-04-09T18:33:03.944 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.959 7f603e7fc700 1 -- 172.21.15.120:0/187864658 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f6048006e50 con 0x7f6034018930 2021-04-09T18:33:03.945 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 4 to deep-scrub 2021-04-09T18:33:03.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.961 7f6054140700 1 -- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6034018930 msgr2=0x7f603401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.961 7f6054140700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6034018930 0x7f603401adc0 crc :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.961 7f6054140700 1 -- 172.21.15.120:0/187864658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0ab9b0 msgr2=0x7f604c0abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:03.948 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.961 7f6054140700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0ab9b0 0x7f604c0abdb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f604400b580 tx=0x7f604400b920).stop 2021-04-09T18:33:03.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.962 7f6054140700 1 -- 172.21.15.120:0/187864658 shutdown_connections 2021-04-09T18:33:03.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.962 7f6054140700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f604c0ab9b0 0x7f604c0abdb0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.962 7f6054140700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f6034018930 0x7f603401adc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.962 7f6054140700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f604c188540 0x7f604c188940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.949 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.962 7f6054140700 1 --2- 172.21.15.120:0/187864658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f604c19e010 0x7f604c182720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:03.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.962 7f6054140700 1 -- 172.21.15.120:0/187864658 >> 172.21.15.120:0/187864658 conn(0x7f604c19f210 msgr2=0x7f604c0d9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:03.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.962 7f6054140700 1 -- 172.21.15.120:0/187864658 shutdown_connections 2021-04-09T18:33:03.950 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:03.962 7f6054140700 1 -- 172.21.15.120:0/187864658 wait complete. 2021-04-09T18:33:03.957 INFO:tasks.ceph:Scrubbing osd.5 2021-04-09T18:33:03.958 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:33:04.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.114 7f17d1886700 1 Processor -- start 2021-04-09T18:33:04.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.114 7f17d1886700 1 -- start start 2021-04-09T18:33:04.128 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.114 7f17d1886700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc0d8870 0x7f17cc0ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.114 7f17d1886700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f17cc1a8da0 0x7f17cc1ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.114 7f17d1886700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0ff1c0 con 0x7f17cc0d75e0 2021-04-09T18:33:04.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.114 7f17d1886700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc0d95b0 con 0x7f17cc1a8da0 2021-04-09T18:33:04.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.114 7f17d1886700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1000c0 con 0x7f17cc0d8870 2021-04-09T18:33:04.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.114 7f17cad73700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f17cc0d75e0 0x7f17cc0d8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55254/0 (socket says 172.21.15.120:55254) 2021-04-09T18:33:04.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.114 7f17cad73700 1 -- 172.21.15.120:0/198522192 learned_addr learned my addr 172.21.15.120:0/198522192 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:04.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cb574700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc0d8870 0x7f17cc0ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cbd75700 1 --2- 172.21.15.120:0/198522192 >> v2:172.21.15.134:3300/0 conn(0x7f17cc1a8da0 0x7f17cc1ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291462685 0 0) 0x7f17c00009b0 con 0x7f17cc0d75e0 2021-04-09T18:33:04.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17b4002fe0 con 0x7f17cc0d75e0 2021-04-09T18:33:04.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2036714428 0 0) 0x7f17c0000e20 con 0x7f17cc0d75e0 2021-04-09T18:33:04.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc0d8870 msgr2=0x7f17cc0ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:04.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc0d8870 0x7f17cc0ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 >> v2:172.21.15.134:3300/0 conn(0x7f17cc1a8da0 msgr2=0x7f17cc1ab1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:04.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 --2- 172.21.15.120:0/198522192 >> v2:172.21.15.134:3300/0 conn(0x7f17cc1a8da0 0x7f17cc1ab1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0d80f0 con 0x7f17cc0d75e0 2021-04-09T18:33:04.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f17c0001530 con 0x7f17cc0d75e0 2021-04-09T18:33:04.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cbd75700 1 --2- 172.21.15.120:0/198522192 >> v2:172.21.15.134:3300/0 conn(0x7f17cc1a8da0 0x7f17cc1ab1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:04.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cb574700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc0d8870 0x7f17cc0ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:04.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 >> v1:172.21.15.120:6789/0 conn(0x7f17cc0d75e0 legacy=0x7f17cc0d8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.133 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17b4047aa0 0x7f17b4049ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17b404a790 0x7f17b404cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b404d500 0x7f17b404fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40502d0 con 0x7f17b404d500 2021-04-09T18:33:04.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40504f0 con 0x7f17b4047aa0 2021-04-09T18:33:04.134 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17ca572700 1 -- 172.21.15.120:0/198522192 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4050710 con 0x7f17b404a790 2021-04-09T18:33:04.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cbd75700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b404d500 0x7f17b404fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cad73700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17b404a790 0x7f17b404cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cb574700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17b4047aa0 0x7f17b4049ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.135 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cbd75700 1 -- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17b404a790 msgr2=0x7f17b404cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cbd75700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17b404a790 0x7f17b404cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cbd75700 1 -- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17b4047aa0 msgr2=0x7f17b4049ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.115 7f17cbd75700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17b4047aa0 0x7f17b4049ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17cbd75700 1 -- 172.21.15.120:0/198522192 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40509b0 con 0x7f17b404d500 2021-04-09T18:33:04.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17cad73700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17b404a790 0x7f17b404cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:04.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17cbd75700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b404d500 0x7f17b404fa20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f17c4009ec0 tx=0x7f17c400c370).ready entity=mon.0 client_cookie=c1227e91fac06127 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17ca572700 1 -- 172.21.15.120:0/198522192 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17c400c760 con 0x7f17b404d500 2021-04-09T18:33:04.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17ca572700 1 -- 172.21.15.120:0/198522192 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c400caa0 con 0x7f17b404d500 2021-04-09T18:33:04.137 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17ca572700 1 -- 172.21.15.120:0/198522192 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17c4007070 con 0x7f17b404d500 2021-04-09T18:33:04.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17d1886700 1 -- 172.21.15.120:0/198522192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b404d500 msgr2=0x7f17b404fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17d1886700 1 --2- 172.21.15.120:0/198522192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b404d500 0x7f17b404fa20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f17c4009ec0 tx=0x7f17c400c370).stop 2021-04-09T18:33:04.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17cbd75700 1 -- 172.21.15.120:0/198522192 reap_dead start 2021-04-09T18:33:04.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17d1886700 1 -- 172.21.15.120:0/198522192 shutdown_connections 2021-04-09T18:33:04.138 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17d1886700 1 -- 172.21.15.120:0/198522192 >> 172.21.15.120:0/198522192 conn(0x7f17cc0d1580 msgr2=0x7f17cc0d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:04.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17d1886700 1 -- 172.21.15.120:0/198522192 shutdown_connections 2021-04-09T18:33:04.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.116 7f17d1886700 1 -- 172.21.15.120:0/198522192 wait complete. 2021-04-09T18:33:04.139 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.135 7f17d1886700 1 Processor -- start 2021-04-09T18:33:04.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.135 7f17d1886700 1 -- start start 2021-04-09T18:33:04.140 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17d1886700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc188e70 0x7f17cc191ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17d1886700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17cc190ac0 0x7f17cc190ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17d1886700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17cc0ba410 0x7f17cc0ba810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.141 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17d1886700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc19f400 con 0x7f17cc0ba410 2021-04-09T18:33:04.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17d1886700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc188b20 con 0x7f17cc190ac0 2021-04-09T18:33:04.142 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17d1886700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1920d0 con 0x7f17cc188e70 2021-04-09T18:33:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cbd75700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17cc0ba410 0x7f17cc0ba810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cbd75700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17cc0ba410 0x7f17cc0ba810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60352/0 (socket says 172.21.15.120:60352) 2021-04-09T18:33:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cbd75700 1 -- 172.21.15.120:0/581001138 learned_addr learned my addr 172.21.15.120:0/581001138 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cb574700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc188e70 0x7f17cc191ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cad73700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17cc190ac0 0x7f17cc190ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cbd75700 1 -- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc188e70 msgr2=0x7f17cc191ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cbd75700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc188e70 0x7f17cc191ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cbd75700 1 -- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17cc190ac0 msgr2=0x7f17cc190ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.144 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cbd75700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17cc190ac0 0x7f17cc190ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cbd75700 1 -- 172.21.15.120:0/581001138 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc189270 con 0x7f17cc0ba410 2021-04-09T18:33:04.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cb574700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17cc188e70 0x7f17cc191ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:04.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cad73700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17cc190ac0 0x7f17cc190ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:04.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17cbd75700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17cc0ba410 0x7f17cc0ba810 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f17c40095d0 tx=0x7f17c400bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.145 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17b3fff700 1 -- 172.21.15.120:0/581001138 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17c4000df0 con 0x7f17cc0ba410 2021-04-09T18:33:04.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17b3fff700 1 -- 172.21.15.120:0/581001138 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c4001110 con 0x7f17cc0ba410 2021-04-09T18:33:04.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17d1886700 1 -- 172.21.15.120:0/581001138 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc189270 con 0x7f17cc0ba410 2021-04-09T18:33:04.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.136 7f17b3fff700 1 -- 172.21.15.120:0/581001138 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f17c4001560 con 0x7f17cc0ba410 2021-04-09T18:33:04.146 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.137 7f17d1886700 1 -- 172.21.15.120:0/581001138 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc189270 con 0x7f17cc0ba410 2021-04-09T18:33:04.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.137 7f17b3fff700 1 -- 172.21.15.120:0/581001138 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f17c40056b0 con 0x7f17cc0ba410 2021-04-09T18:33:04.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.137 7f17b3fff700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17ac018930 0x7f17ac01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.137 7f17b3fff700 1 -- 172.21.15.120:0/581001138 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f17c40332c0 con 0x7f17cc0ba410 2021-04-09T18:33:04.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.138 7f17cb574700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17ac018930 0x7f17ac01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.147 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.138 7f17cb574700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17ac018930 0x7f17ac01ae10 crc :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.148 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.160 7f17d1886700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7f17cc062f80 0x7f17cc063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.160 7f17d1886700 1 -- 172.21.15.120:0/581001138 --> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17cc192240 con 0x7f17cc062f80 2021-04-09T18:33:04.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.160 7f17cad73700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7f17cc062f80 0x7f17cc063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.161 7f17cad73700 1 -- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7f17cc062f80 msgr2=0x7f17cc063380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:33:04.149 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.161 7f17cad73700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7f17cc062f80 0x7f17cc063380 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.150 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.161 7f17b3fff700 1 -- 172.21.15.120:0/581001138 <== osd.5 v2:172.21.15.134:6810/24879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f17c0000e20 con 0x7f17cc062f80 2021-04-09T18:33:04.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.170 7f17d1886700 1 -- 172.21.15.120:0/581001138 --> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f17cc1831f0 con 0x7f17cc062f80 2021-04-09T18:33:04.156 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.171 7f17b3fff700 1 -- 172.21.15.120:0/581001138 <== osd.5 v2:172.21.15.134:6810/24879 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7f17c0001a30 con 0x7f17cc062f80 2021-04-09T18:33:04.158 INFO:teuthology.orchestra.run.smithi120.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:33:04.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 -- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7f17cc062f80 msgr2=0x7f17cc063380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6810/24879,v1:172.21.15.134:6811/24879] conn(0x7f17cc062f80 0x7f17cc063380 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.158 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 -- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17ac018930 msgr2=0x7f17ac01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f17ac018930 0x7f17ac01ae10 crc :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 -- 172.21.15.120:0/581001138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17cc0ba410 msgr2=0x7f17cc0ba810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 --2- 172.21.15.120:0/581001138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17cc0ba410 0x7f17cc0ba810 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f17c40095d0 tx=0x7f17c400bcf0).stop 2021-04-09T18:33:04.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17cbd75700 1 -- 172.21.15.120:0/581001138 reap_dead start 2021-04-09T18:33:04.159 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 -- 172.21.15.120:0/581001138 shutdown_connections 2021-04-09T18:33:04.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 -- 172.21.15.120:0/581001138 >> 172.21.15.120:0/581001138 conn(0x7f17cc18e440 msgr2=0x7f17cc18a500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:04.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 -- 172.21.15.120:0/581001138 shutdown_connections 2021-04-09T18:33:04.160 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.172 7f17d1886700 1 -- 172.21.15.120:0/581001138 wait complete. 2021-04-09T18:33:04.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-04-09T18:33:04.330 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.324 7f01fb2a8700 1 Processor -- start 2021-04-09T18:33:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.324 7f01fb2a8700 1 -- start start 2021-04-09T18:33:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01fb2a8700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f01f40d7560 0x7f01f40d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01fb2a8700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f01f40d63b0 0x7f01f41ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01fb2a8700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40d7960 con 0x7f01f40d7160 2021-04-09T18:33:04.332 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01fb2a8700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40d80f0 con 0x7f01f40d63b0 2021-04-09T18:33:04.332 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01fb2a8700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40d6be0 con 0x7f01f40d7560 2021-04-09T18:33:04.332 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01f98c5700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f01f40d63b0 0x7f01f41ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.332 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01f90c4700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f01f40d7160 0x7f01f40d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55272/0 (socket says 172.21.15.120:55272) 2021-04-09T18:33:04.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01f90c4700 1 -- 172.21.15.120:0/245429486 learned_addr learned my addr 172.21.15.120:0/245429486 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:04.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01f88c3700 1 --2- 172.21.15.120:0/245429486 >> v2:172.21.15.134:3300/0 conn(0x7f01f40d7560 0x7f01f40d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01f98c5700 1 -- 172.21.15.120:0/245429486 >> v2:172.21.15.134:3300/0 conn(0x7f01f40d7560 msgr2=0x7f01f40d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:04.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01f98c5700 1 --2- 172.21.15.120:0/245429486 >> v2:172.21.15.134:3300/0 conn(0x7f01f40d7560 0x7f01f40d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.333 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01f98c5700 1 -- 172.21.15.120:0/245429486 >> v1:172.21.15.120:6789/0 conn(0x7f01f40d7160 legacy=0x7f01f40d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01f98c5700 1 -- 172.21.15.120:0/245429486 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f41a2ac0 con 0x7f01f40d63b0 2021-04-09T18:33:04.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01ebfff700 1 -- 172.21.15.120:0/245429486 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43979863 0 0) 0x7f01f0001060 con 0x7f01f40d7160 2021-04-09T18:33:04.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.325 7f01f88c3700 1 --2- 172.21.15.120:0/245429486 >> v2:172.21.15.134:3300/0 conn(0x7f01f40d7560 0x7f01f40d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:04.334 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01f98c5700 1 --2- 172.21.15.120:0/245429486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40d63b0 0x7f01f41ab1e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f01ec006ab0 tx=0x7f01ec009b40).ready entity=mon.0 client_cookie=860d183f7336667 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01ebfff700 1 -- 172.21.15.120:0/245429486 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01ec0022e0 con 0x7f01f40d63b0 2021-04-09T18:33:04.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01ebfff700 1 -- 172.21.15.120:0/245429486 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec002660 con 0x7f01f40d63b0 2021-04-09T18:33:04.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01ebfff700 1 -- 172.21.15.120:0/245429486 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01ec002b40 con 0x7f01f40d63b0 2021-04-09T18:33:04.335 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01fb2a8700 1 -- 172.21.15.120:0/245429486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40d63b0 msgr2=0x7f01f41ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01fb2a8700 1 --2- 172.21.15.120:0/245429486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40d63b0 0x7f01f41ab1e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f01ec006ab0 tx=0x7f01ec009b40).stop 2021-04-09T18:33:04.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01fb2a8700 1 -- 172.21.15.120:0/245429486 shutdown_connections 2021-04-09T18:33:04.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01fb2a8700 1 --2- 172.21.15.120:0/245429486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40d63b0 0x7f01f41ab1e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01fb2a8700 1 --2- 172.21.15.120:0/245429486 >> v2:172.21.15.134:3300/0 conn(0x7f01f40d7560 0x7f01f40d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.336 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.326 7f01fb2a8700 1 -- 172.21.15.120:0/245429486 >> 172.21.15.120:0/245429486 conn(0x7f01f40d1590 msgr2=0x7f01f40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:04.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.327 7f01fb2a8700 1 -- 172.21.15.120:0/245429486 shutdown_connections 2021-04-09T18:33:04.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.327 7f01fb2a8700 1 -- 172.21.15.120:0/245429486 wait complete. 2021-04-09T18:33:04.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.345 7f01fb2a8700 1 Processor -- start 2021-04-09T18:33:04.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.345 7f01fb2a8700 1 -- start start 2021-04-09T18:33:04.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01fb2a8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4184c40 0x7f01f40b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01fb2a8700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f4185040 0x7f01f40b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01fb2a8700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40b5b80 0x7f01f40e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01fb2a8700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f41846c0 con 0x7f01f40b5b80 2021-04-09T18:33:04.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01fb2a8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f41a1470 con 0x7f01f4184c40 2021-04-09T18:33:04.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01fb2a8700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f417fa90 con 0x7f01f4185040 2021-04-09T18:33:04.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f98c5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40b5b80 0x7f01f40e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f98c5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40b5b80 0x7f01f40e34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60368/0 (socket says 172.21.15.120:60368) 2021-04-09T18:33:04.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f98c5700 1 -- 172.21.15.120:0/1390015245 learned_addr learned my addr 172.21.15.120:0/1390015245 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:04.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f88c3700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f4185040 0x7f01f40b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f90c4700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4184c40 0x7f01f40b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f98c5700 1 -- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f4185040 msgr2=0x7f01f40b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f98c5700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f4185040 0x7f01f40b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f98c5700 1 -- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4184c40 msgr2=0x7f01f40b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f98c5700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4184c40 0x7f01f40b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.343 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f98c5700 1 -- 172.21.15.120:0/1390015245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40e3af0 con 0x7f01f40b5b80 2021-04-09T18:33:04.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f90c4700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4184c40 0x7f01f40b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:04.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01f98c5700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40b5b80 0x7f01f40e34d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f01ec00b570 tx=0x7f01ec00b910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01e9ffb700 1 -- 172.21.15.120:0/1390015245 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01ec0093e0 con 0x7f01f40b5b80 2021-04-09T18:33:04.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.346 7f01e9ffb700 1 -- 172.21.15.120:0/1390015245 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec00bd00 con 0x7f01f40b5b80 2021-04-09T18:33:04.344 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.347 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f40e3af0 con 0x7f01f40b5b80 2021-04-09T18:33:04.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.347 7f01e9ffb700 1 -- 172.21.15.120:0/1390015245 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01ec0062a0 con 0x7f01f40b5b80 2021-04-09T18:33:04.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.347 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f40e3af0 con 0x7f01f40b5b80 2021-04-09T18:33:04.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.348 7f01e9ffb700 1 -- 172.21.15.120:0/1390015245 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f01ec006020 con 0x7f01f40b5b80 2021-04-09T18:33:04.345 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.348 7f01e9ffb700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d40188c0 0x7f01d401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.348 7f01e9ffb700 1 -- 172.21.15.120:0/1390015245 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f01ec032bf0 con 0x7f01f40b5b80 2021-04-09T18:33:04.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.348 7f01f90c4700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d40188c0 0x7f01d401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.346 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.348 7f01f90c4700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d40188c0 0x7f01d401adc0 crc :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.356 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.371 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f41a1470 con 0x7f01f40b5b80 2021-04-09T18:33:04.359 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.374 7f01e9ffb700 1 -- 172.21.15.120:0/1390015245 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f01ec006820 con 0x7f01f40b5b80 2021-04-09T18:33:04.530 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.544 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mgr", ""]}) v1 -- 0x7f01f41846c0 con 0x7f01d40188c0 2021-04-09T18:33:04.531 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.545 7f01e9ffb700 1 -- 172.21.15.120:0/1390015245 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f01f0004720 con 0x7f01d40188c0 2021-04-09T18:33:04.531 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 5 to deep-scrub 2021-04-09T18:33:04.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d40188c0 msgr2=0x7f01d401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d40188c0 0x7f01d401adc0 crc :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40b5b80 msgr2=0x7f01f40e34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.533 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40b5b80 0x7f01f40e34d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f01ec00b570 tx=0x7f01ec00b910).stop 2021-04-09T18:33:04.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 shutdown_connections 2021-04-09T18:33:04.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01f40b5b80 0x7f01f40e34d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f01d40188c0 0x7f01d401adc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.534 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f4185040 0x7f01f40b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 --2- 172.21.15.120:0/1390015245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4184c40 0x7f01f40b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 >> 172.21.15.120:0/1390015245 conn(0x7f01f4182270 msgr2=0x7f01f40e2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:04.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 shutdown_connections 2021-04-09T18:33:04.535 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.547 7f01fb2a8700 1 -- 172.21.15.120:0/1390015245 wait complete. 2021-04-09T18:33:04.543 INFO:tasks.ceph:Scrubbing osd.6 2021-04-09T18:33:04.544 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:33:04.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.700 7f0ab395a700 1 Processor -- start 2021-04-09T18:33:04.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.700 7f0ab395a700 1 -- start start 2021-04-09T18:33:04.707 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.700 7f0ab395a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac0d8870 0x7f0aac0ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab395a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0aac0d75e0 0x7f0aac0d8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab395a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aac0ff1c0 con 0x7f0aac1a7d90 2021-04-09T18:33:04.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab395a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aac1000c0 con 0x7f0aac0d75e0 2021-04-09T18:33:04.708 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab395a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac0d80f0 con 0x7f0aac0d8870 2021-04-09T18:33:04.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab1776700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac0d8870 0x7f0aac0ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab0f75700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0aac0d75e0 0x7f0aac0d8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab1776700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac0d8870 0x7f0aac0ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:47038/0 (socket says 172.21.15.120:47038) 2021-04-09T18:33:04.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab1776700 1 -- 172.21.15.120:0/72694149 learned_addr learned my addr 172.21.15.120:0/72694149 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:04.709 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab1776700 1 -- 172.21.15.120:0/72694149 >> v2:172.21.15.134:3300/0 conn(0x7f0aac0d75e0 msgr2=0x7f0aac0d8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:04.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab1776700 1 --2- 172.21.15.120:0/72694149 >> v2:172.21.15.134:3300/0 conn(0x7f0aac0d75e0 0x7f0aac0d8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab1776700 1 -- 172.21.15.120:0/72694149 >> v1:172.21.15.134:6789/0 conn(0x7f0aac1a7d90 legacy=0x7f0aac1aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab1776700 1 -- 172.21.15.120:0/72694149 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac19f900 con 0x7f0aac0d8870 2021-04-09T18:33:04.710 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.701 7f0ab1776700 1 --2- 172.21.15.120:0/72694149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac0d8870 0x7f0aac0ff740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f0aa0006700 tx=0x7f0aa0009b80).ready entity=mon.2 client_cookie=bc0447a589e93463 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.702 7f0a9ffff700 1 -- 172.21.15.120:0/72694149 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0aa000c0c0 con 0x7f0aac0d8870 2021-04-09T18:33:04.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.702 7f0a9ffff700 1 -- 172.21.15.120:0/72694149 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa000c440 con 0x7f0aac0d8870 2021-04-09T18:33:04.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.702 7f0a9ffff700 1 -- 172.21.15.120:0/72694149 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0aa000c920 con 0x7f0aac0d8870 2021-04-09T18:33:04.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.702 7f0ab395a700 1 -- 172.21.15.120:0/72694149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac0d8870 msgr2=0x7f0aac0ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.711 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.702 7f0ab395a700 1 --2- 172.21.15.120:0/72694149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac0d8870 0x7f0aac0ff740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f0aa0006700 tx=0x7f0aa0009b80).stop 2021-04-09T18:33:04.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.702 7f0ab395a700 1 -- 172.21.15.120:0/72694149 shutdown_connections 2021-04-09T18:33:04.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.702 7f0ab395a700 1 --2- 172.21.15.120:0/72694149 >> v2:172.21.15.134:3300/0 conn(0x7f0aac0d75e0 0x7f0aac0d8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.702 7f0ab395a700 1 --2- 172.21.15.120:0/72694149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac0d8870 0x7f0aac0ff740 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.702 7f0ab395a700 1 -- 172.21.15.120:0/72694149 >> 172.21.15.120:0/72694149 conn(0x7f0aac0d1580 msgr2=0x7f0aac0d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:04.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.703 7f0ab395a700 1 -- 172.21.15.120:0/72694149 shutdown_connections 2021-04-09T18:33:04.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.703 7f0ab395a700 1 -- 172.21.15.120:0/72694149 wait complete. 2021-04-09T18:33:04.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.721 7f0ab395a700 1 Processor -- start 2021-04-09T18:33:04.713 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.721 7f0ab395a700 1 -- start start 2021-04-09T18:33:04.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab395a700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac08e350 0x7f0aac191fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab395a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0aac08e750 0x7f0aac190ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab395a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aac1910d0 0x7f0aac0bc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab395a700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac191a50 con 0x7f0aac08e750 2021-04-09T18:33:04.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab395a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac1925f0 con 0x7f0aac1910d0 2021-04-09T18:33:04.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab395a700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac1914d0 con 0x7f0aac08e350 2021-04-09T18:33:04.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab0f75700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0aac08e750 0x7f0aac190ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab0f75700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0aac08e750 0x7f0aac190ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60382/0 (socket says 172.21.15.120:60382) 2021-04-09T18:33:04.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab0f75700 1 -- 172.21.15.120:0/2788215991 learned_addr learned my addr 172.21.15.120:0/2788215991 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:04.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab1776700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac08e350 0x7f0aac191fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab1f77700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aac1910d0 0x7f0aac0bc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab0f75700 1 -- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac08e350 msgr2=0x7f0aac191fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab0f75700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0aac08e350 0x7f0aac191fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.719 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab0f75700 1 -- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aac1910d0 msgr2=0x7f0aac0bc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab0f75700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aac1910d0 0x7f0aac0bc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab0f75700 1 -- 172.21.15.120:0/2788215991 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac1916f0 con 0x7f0aac08e750 2021-04-09T18:33:04.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.722 7f0ab0f75700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0aac08e750 0x7f0aac190ab0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f0aa80099e0 tx=0x7f0aa800bd40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.723 7f0a9dffb700 1 -- 172.21.15.120:0/2788215991 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0aa800c2f0 con 0x7f0aac08e750 2021-04-09T18:33:04.720 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.723 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aac1916f0 con 0x7f0aac08e750 2021-04-09T18:33:04.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.723 7f0a9dffb700 1 -- 172.21.15.120:0/2788215991 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa800c2f0 con 0x7f0aac08e750 2021-04-09T18:33:04.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.723 7f0a9dffb700 1 -- 172.21.15.120:0/2788215991 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0aa800c5f0 con 0x7f0aac08e750 2021-04-09T18:33:04.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.723 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac1916f0 con 0x7f0aac08e750 2021-04-09T18:33:04.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.723 7f0a9dffb700 1 -- 172.21.15.120:0/2788215991 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f0aa800a020 con 0x7f0aac08e750 2021-04-09T18:33:04.721 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.723 7f0a9dffb700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0a8c018930 0x7f0a8c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.723 7f0a9dffb700 1 -- 172.21.15.120:0/2788215991 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f0aa80331d0 con 0x7f0aac08e750 2021-04-09T18:33:04.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.724 7f0ab1776700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0a8c018930 0x7f0a8c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.722 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.724 7f0ab1776700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0a8c018930 0x7f0a8c01ae10 crc :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.732 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.746 7f0ab395a700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f0aac062a70 0x7f0aac062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.746 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 --> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0aac183180 con 0x7f0aac062a70 2021-04-09T18:33:04.733 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.747 7f0ab1f77700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f0aac062a70 0x7f0aac062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.747 7f0ab1f77700 1 -- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f0aac062a70 msgr2=0x7f0aac062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:33:04.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.747 7f0ab1f77700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f0aac062a70 0x7f0aac062e70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.734 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.748 7f0a9dffb700 1 -- 172.21.15.120:0/2788215991 <== osd.6 v2:172.21.15.134:6818/24918 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f0aa400c180 con 0x7f0aac062a70 2021-04-09T18:33:04.742 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.757 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 --> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f0aac183180 con 0x7f0aac062a70 2021-04-09T18:33:04.743 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.757 7f0a9dffb700 1 -- 172.21.15.120:0/2788215991 <== osd.6 v2:172.21.15.134:6818/24918 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7f0aa4006a30 con 0x7f0aac062a70 2021-04-09T18:33:04.743 INFO:teuthology.orchestra.run.smithi120.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:33:04.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.758 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f0aac062a70 msgr2=0x7f0aac062e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.758 7f0ab395a700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6818/24918,v1:172.21.15.134:6819/24918] conn(0x7f0aac062a70 0x7f0aac062e70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.758 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0a8c018930 msgr2=0x7f0a8c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.745 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.758 7f0ab395a700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f0a8c018930 0x7f0a8c01ae10 crc :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.758 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0aac08e750 msgr2=0x7f0aac190ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.758 7f0ab395a700 1 --2- 172.21.15.120:0/2788215991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0aac08e750 0x7f0aac190ab0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f0aa80099e0 tx=0x7f0aa800bd40).stop 2021-04-09T18:33:04.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.758 7f0ab1f77700 1 -- 172.21.15.120:0/2788215991 reap_dead start 2021-04-09T18:33:04.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.759 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 shutdown_connections 2021-04-09T18:33:04.746 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.759 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 >> 172.21.15.120:0/2788215991 conn(0x7f0aac18d490 msgr2=0x7f0aac1833b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:04.747 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.759 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 shutdown_connections 2021-04-09T18:33:04.747 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.759 7f0ab395a700 1 -- 172.21.15.120:0/2788215991 wait complete. 2021-04-09T18:33:04.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-04-09T18:33:04.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.912 7f06ec36e700 1 Processor -- start 2021-04-09T18:33:04.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.912 7f06ec36e700 1 -- start start 2021-04-09T18:33:04.919 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ec36e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f06e40d7160 0x7f06e40d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ec36e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e40d55a0 0x7f06e40d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ec36e700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f06e40d5fc0 0x7f06e40d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ec36e700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e40e80a0 con 0x7f06e40d5fc0 2021-04-09T18:33:04.920 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ec36e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e40d80f0 con 0x7f06e40d7160 2021-04-09T18:33:04.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ec36e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40d6be0 con 0x7f06e40d55a0 2021-04-09T18:33:04.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea98b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f06e40d5fc0 0x7f06e40d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea98b700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f06e40d5fc0 0x7f06e40d63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60394/0 (socket says 172.21.15.120:60394) 2021-04-09T18:33:04.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea98b700 1 -- 172.21.15.120:0/1558050481 learned_addr learned my addr 172.21.15.120:0/1558050481 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:04.921 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06e9989700 1 --2- 172.21.15.120:0/1558050481 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e40d55a0 0x7f06e40d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea18a700 1 --2- 172.21.15.120:0/1558050481 >> v2:172.21.15.134:3300/0 conn(0x7f06e40d7160 0x7f06e40d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea98b700 1 -- 172.21.15.120:0/1558050481 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e40d55a0 msgr2=0x7f06e40d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:04.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea98b700 1 --2- 172.21.15.120:0/1558050481 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e40d55a0 0x7f06e40d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea98b700 1 -- 172.21.15.120:0/1558050481 >> v2:172.21.15.134:3300/0 conn(0x7f06e40d7160 msgr2=0x7f06e40d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:04.922 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea98b700 1 --2- 172.21.15.120:0/1558050481 >> v2:172.21.15.134:3300/0 conn(0x7f06e40d7160 0x7f06e40d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea98b700 1 -- 172.21.15.120:0/1558050481 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e41a2ac0 con 0x7f06e40d5fc0 2021-04-09T18:33:04.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06ea98b700 1 --2- 172.21.15.120:0/1558050481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40d5fc0 0x7f06e40d63c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f06dc006f00 tx=0x7f06dc009e90).ready entity=mon.0 client_cookie=9dc4819f292483fb server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.913 7f06e9188700 1 -- 172.21.15.120:0/1558050481 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06dc00b300 con 0x7f06e40d5fc0 2021-04-09T18:33:04.923 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.914 7f06e9188700 1 -- 172.21.15.120:0/1558050481 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc00b640 con 0x7f06e40d5fc0 2021-04-09T18:33:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.914 7f06e9188700 1 -- 172.21.15.120:0/1558050481 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06dc00bb20 con 0x7f06e40d5fc0 2021-04-09T18:33:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.914 7f06ec36e700 1 -- 172.21.15.120:0/1558050481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40d5fc0 msgr2=0x7f06e40d63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.914 7f06ec36e700 1 --2- 172.21.15.120:0/1558050481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40d5fc0 0x7f06e40d63c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f06dc006f00 tx=0x7f06dc009e90).stop 2021-04-09T18:33:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.914 7f06ec36e700 1 -- 172.21.15.120:0/1558050481 shutdown_connections 2021-04-09T18:33:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.914 7f06ec36e700 1 --2- 172.21.15.120:0/1558050481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40d5fc0 0x7f06e40d63c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.914 7f06ec36e700 1 --2- 172.21.15.120:0/1558050481 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e40d55a0 0x7f06e40d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.914 7f06ec36e700 1 --2- 172.21.15.120:0/1558050481 >> v2:172.21.15.134:3300/0 conn(0x7f06e40d7160 0x7f06e40d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.914 7f06ec36e700 1 -- 172.21.15.120:0/1558050481 >> 172.21.15.120:0/1558050481 conn(0x7f06e40d1590 msgr2=0x7f06e40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:04.925 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.915 7f06ec36e700 1 -- 172.21.15.120:0/1558050481 shutdown_connections 2021-04-09T18:33:04.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.915 7f06ec36e700 1 -- 172.21.15.120:0/1558050481 wait complete. 2021-04-09T18:33:04.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.933 7f06ec36e700 1 Processor -- start 2021-04-09T18:33:04.926 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.933 7f06ec36e700 1 -- start start 2021-04-09T18:33:04.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ec36e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40b2430 0x7f06e41971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.929 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ec36e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e417b2f0 0x7f06e417b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ec36e700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e417bd10 0x7f06e417c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ec36e700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41977e0 con 0x7f06e40b2430 2021-04-09T18:33:04.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ec36e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e417c730 con 0x7f06e417b2f0 2021-04-09T18:33:04.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ec36e700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e417c950 con 0x7f06e417bd10 2021-04-09T18:33:04.930 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea18a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40b2430 0x7f06e41971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea18a700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40b2430 0x7f06e41971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60396/0 (socket says 172.21.15.120:60396) 2021-04-09T18:33:04.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea18a700 1 -- 172.21.15.120:0/768910096 learned_addr learned my addr 172.21.15.120:0/768910096 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:04.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06e9989700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e417b2f0 0x7f06e417b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.931 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea98b700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e417bd10 0x7f06e417c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea18a700 1 -- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e417bd10 msgr2=0x7f06e417c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea18a700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e417bd10 0x7f06e417c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea18a700 1 -- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e417b2f0 msgr2=0x7f06e417b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:04.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea18a700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e417b2f0 0x7f06e417b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:04.932 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea18a700 1 -- 172.21.15.120:0/768910096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e417cb70 con 0x7f06e40b2430 2021-04-09T18:33:04.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06e9989700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e417b2f0 0x7f06e417b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:04.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea98b700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e417bd10 0x7f06e417c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:04.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ea18a700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40b2430 0x7f06e41971c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f06d4006f60 tx=0x7f06d400b970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06e2ffd700 1 -- 172.21.15.120:0/768910096 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06d400bd60 con 0x7f06e40b2430 2021-04-09T18:33:04.933 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06e2ffd700 1 -- 172.21.15.120:0/768910096 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d4000c90 con 0x7f06e40b2430 2021-04-09T18:33:04.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.934 7f06ec36e700 1 -- 172.21.15.120:0/768910096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e417cb70 con 0x7f06e40b2430 2021-04-09T18:33:04.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.935 7f06e2ffd700 1 -- 172.21.15.120:0/768910096 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06d4002220 con 0x7f06e40b2430 2021-04-09T18:33:04.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.935 7f06ec36e700 1 -- 172.21.15.120:0/768910096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e417cb70 con 0x7f06e40b2430 2021-04-09T18:33:04.934 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.935 7f06e2ffd700 1 -- 172.21.15.120:0/768910096 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f06d40052e0 con 0x7f06e40b2430 2021-04-09T18:33:04.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.935 7f06e2ffd700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06c4018930 0x7f06c401ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:04.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.935 7f06e2ffd700 1 -- 172.21.15.120:0/768910096 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f06d4032e00 con 0x7f06e40b2430 2021-04-09T18:33:04.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.935 7f06e9989700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06c4018930 0x7f06c401ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:04.935 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.936 7f06e9989700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06c4018930 0x7f06c401ae10 crc :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:04.943 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.958 7f06ec36e700 1 -- 172.21.15.120:0/768910096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4196c90 con 0x7f06e40b2430 2021-04-09T18:33:04.946 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:04.961 7f06e2ffd700 1 -- 172.21.15.120:0/768910096 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f06d4000c90 con 0x7f06e40b2430 2021-04-09T18:33:05.126 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.140 7f06ec36e700 1 -- 172.21.15.120:0/768910096 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mgr", ""]}) v1 -- 0x7f06e4196c90 con 0x7f06c4018930 2021-04-09T18:33:05.127 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.141 7f06e2ffd700 1 -- 172.21.15.120:0/768910096 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f06d80009f0 con 0x7f06c4018930 2021-04-09T18:33:05.127 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 6 to deep-scrub 2021-04-09T18:33:05.129 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.143 7f06ec36e700 1 -- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06c4018930 msgr2=0x7f06c401ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.143 7f06ec36e700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06c4018930 0x7f06c401ae10 crc :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.143 7f06ec36e700 1 -- 172.21.15.120:0/768910096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40b2430 msgr2=0x7f06e41971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.143 7f06ec36e700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40b2430 0x7f06e41971c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f06d4006f60 tx=0x7f06d400b970).stop 2021-04-09T18:33:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.144 7f06ec36e700 1 -- 172.21.15.120:0/768910096 shutdown_connections 2021-04-09T18:33:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.144 7f06ec36e700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f06c4018930 0x7f06c401ae10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.144 7f06ec36e700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e417bd10 0x7f06e417c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.144 7f06ec36e700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e417b2f0 0x7f06e417b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.144 7f06ec36e700 1 --2- 172.21.15.120:0/768910096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06e40b2430 0x7f06e41971c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.144 7f06ec36e700 1 -- 172.21.15.120:0/768910096 >> 172.21.15.120:0/768910096 conn(0x7f06e419cd90 msgr2=0x7f06e40e27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:05.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.144 7f06ec36e700 1 -- 172.21.15.120:0/768910096 shutdown_connections 2021-04-09T18:33:05.132 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.144 7f06ec36e700 1 -- 172.21.15.120:0/768910096 wait complete. 2021-04-09T18:33:05.139 INFO:tasks.ceph:Scrubbing osd.7 2021-04-09T18:33:05.140 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-04-09T18:33:05.303 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.297 7f4de4d34700 1 Processor -- start 2021-04-09T18:33:05.303 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.297 7f4de4d34700 1 -- start start 2021-04-09T18:33:05.304 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.297 7f4de4d34700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de007e700 0x7f4de0100210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.304 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.297 7f4de4d34700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4de00ff480 0x7f4de01ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.304 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.297 7f4de4d34700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de00ffc90 con 0x7f4de00ff080 2021-04-09T18:33:05.304 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.297 7f4de4d34700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de00d80e0 con 0x7f4de00ff480 2021-04-09T18:33:05.305 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.297 7f4de4d34700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de00d2040 con 0x7f4de007e700 2021-04-09T18:33:05.305 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddeb13700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de007e700 0x7f4de0100210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.305 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddf314700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4de00ff480 0x7f4de01ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.305 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddf314700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4de00ff480 0x7f4de01ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.120:49242/0 (socket says 172.21.15.120:49242) 2021-04-09T18:33:05.305 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddeb13700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de007e700 0x7f4de0100210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.120:47068/0 (socket says 172.21.15.120:47068) 2021-04-09T18:33:05.306 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddf314700 1 -- 172.21.15.120:0/3916333608 learned_addr learned my addr 172.21.15.120:0/3916333608 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:05.306 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddf314700 1 -- 172.21.15.120:0/3916333608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de007e700 msgr2=0x7f4de0100210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:05.306 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddf314700 1 --2- 172.21.15.120:0/3916333608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de007e700 0x7f4de0100210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.306 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddf314700 1 -- 172.21.15.120:0/3916333608 >> v1:172.21.15.134:6789/0 conn(0x7f4de00ff080 legacy=0x7f4de01a8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.307 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddf314700 1 -- 172.21.15.120:0/3916333608 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de007eb00 con 0x7f4de00ff480 2021-04-09T18:33:05.307 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4dddb11700 1 -- 172.21.15.120:0/3916333608 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004905902 0 0) 0x7f4dc8000ff0 con 0x7f4de00ff080 2021-04-09T18:33:05.307 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddeb13700 1 --2- 172.21.15.120:0/3916333608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de007e700 0x7f4de0100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:05.307 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4ddf314700 1 --2- 172.21.15.120:0/3916333608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de00ff480 0x7f4de01ab960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f4dd8006720 tx=0x7f4dd8009ba0).ready entity=mon.1 client_cookie=9f5c68f95a7073a1 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.308 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4dddb11700 1 -- 172.21.15.120:0/3916333608 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dd80022e0 con 0x7f4de00ff480 2021-04-09T18:33:05.308 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4dddb11700 1 -- 172.21.15.120:0/3916333608 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd8002660 con 0x7f4de00ff480 2021-04-09T18:33:05.308 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.298 7f4dddb11700 1 -- 172.21.15.120:0/3916333608 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dd8002b40 con 0x7f4de00ff480 2021-04-09T18:33:05.308 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.299 7f4de4d34700 1 -- 172.21.15.120:0/3916333608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de00ff480 msgr2=0x7f4de01ab960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.308 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.299 7f4de4d34700 1 --2- 172.21.15.120:0/3916333608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de00ff480 0x7f4de01ab960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f4dd8006720 tx=0x7f4dd8009ba0).stop 2021-04-09T18:33:05.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.299 7f4de4d34700 1 -- 172.21.15.120:0/3916333608 shutdown_connections 2021-04-09T18:33:05.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.299 7f4de4d34700 1 --2- 172.21.15.120:0/3916333608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de00ff480 0x7f4de01ab960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.299 7f4de4d34700 1 --2- 172.21.15.120:0/3916333608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de007e700 0x7f4de0100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.309 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.299 7f4de4d34700 1 -- 172.21.15.120:0/3916333608 >> 172.21.15.120:0/3916333608 conn(0x7f4de00f0050 msgr2=0x7f4de00d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:05.310 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.299 7f4de4d34700 1 -- 172.21.15.120:0/3916333608 shutdown_connections 2021-04-09T18:33:05.310 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.299 7f4de4d34700 1 -- 172.21.15.120:0/3916333608 wait complete. 2021-04-09T18:33:05.310 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.318 7f4de4d34700 1 Processor -- start 2021-04-09T18:33:05.310 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.318 7f4de4d34700 1 -- start start 2021-04-09T18:33:05.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.318 7f4de4d34700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de0092ea0 0x7f4de009d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.313 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.318 7f4de4d34700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de00932a0 0x7f4de009bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.318 7f4de4d34700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de009c160 0x7f4de00a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.318 7f4de4d34700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de009cab0 con 0x7f4de0092ea0 2021-04-09T18:33:05.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.318 7f4de4d34700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de009d650 con 0x7f4de009c160 2021-04-09T18:33:05.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.318 7f4de4d34700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0093810 con 0x7f4de00932a0 2021-04-09T18:33:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.318 7f4ddeb13700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de0092ea0 0x7f4de009d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4ddeb13700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de0092ea0 0x7f4de009d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60412/0 (socket says 172.21.15.120:60412) 2021-04-09T18:33:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4ddeb13700 1 -- 172.21.15.120:0/3497849483 learned_addr learned my addr 172.21.15.120:0/3497849483 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4ddf314700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de009c160 0x7f4de00a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4dde312700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de00932a0 0x7f4de009bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4ddeb13700 1 -- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de00932a0 msgr2=0x7f4de009bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4ddeb13700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4de00932a0 0x7f4de009bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4ddeb13700 1 -- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de009c160 msgr2=0x7f4de00a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.316 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4ddeb13700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4de009c160 0x7f4de00a04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4ddeb13700 1 -- 172.21.15.120:0/3497849483 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de009c560 con 0x7f4de0092ea0 2021-04-09T18:33:05.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4ddeb13700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de0092ea0 0x7f4de009d030 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f4dd000b910 tx=0x7f4dd000bcb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4dd77fe700 1 -- 172.21.15.120:0/3497849483 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dd000c2f0 con 0x7f4de0092ea0 2021-04-09T18:33:05.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4dd77fe700 1 -- 172.21.15.120:0/3497849483 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd000c5f0 con 0x7f4de0092ea0 2021-04-09T18:33:05.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de009c560 con 0x7f4de0092ea0 2021-04-09T18:33:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4dd77fe700 1 -- 172.21.15.120:0/3497849483 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4dd000cad0 con 0x7f4de0092ea0 2021-04-09T18:33:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.319 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de009c560 con 0x7f4de0092ea0 2021-04-09T18:33:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.320 7f4dd77fe700 1 -- 172.21.15.120:0/3497849483 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f4dd0001010 con 0x7f4de0092ea0 2021-04-09T18:33:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.320 7f4dd77fe700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4dc40188c0 0x7f4dc401adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.320 7f4dd77fe700 1 -- 172.21.15.120:0/3497849483 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4dd0033320 con 0x7f4de0092ea0 2021-04-09T18:33:05.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.320 7f4dde312700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4dc40188c0 0x7f4dc401adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.319 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.321 7f4dde312700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4dc40188c0 0x7f4dc401adc0 crc :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.328 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.343 7f4de4d34700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7f4de00a13a0 0x7f4de00a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.329 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.343 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 --> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4de0182b10 con 0x7f4de00a13a0 2021-04-09T18:33:05.329 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.343 7f4ddf314700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7f4de00a13a0 0x7f4de00a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.330 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.343 7f4ddf314700 1 -- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7f4de00a13a0 msgr2=0x7f4de00a17a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-04-09T18:33:05.330 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.343 7f4ddf314700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7f4de00a13a0 0x7f4de00a17a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.330 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.344 7f4dd77fe700 1 -- 172.21.15.120:0/3497849483 <== osd.7 v2:172.21.15.134:6826/24925 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (crc 0 0 0) 0x7f4dd8006c50 con 0x7f4de00a13a0 2021-04-09T18:33:05.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.351 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 --> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f4de009c560 con 0x7f4de00a13a0 2021-04-09T18:33:05.337 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.352 7f4dd77fe700 1 -- 172.21.15.120:0/3497849483 <== osd.7 v2:172.21.15.134:6826/24925 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (crc 0 0 0) 0x7f4dd80020c0 con 0x7f4de00a13a0 2021-04-09T18:33:05.338 INFO:teuthology.orchestra.run.smithi120.stderr:Set osd_debug_deep_scrub_sleep to 0 2021-04-09T18:33:05.339 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7f4de00a13a0 msgr2=0x7f4de00a17a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6826/24925,v1:172.21.15.134:6827/24925] conn(0x7f4de00a13a0 0x7f4de00a17a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4dc40188c0 msgr2=0x7f4dc401adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f4dc40188c0 0x7f4dc401adc0 crc :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.340 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de0092ea0 msgr2=0x7f4de009d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 --2- 172.21.15.120:0/3497849483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de0092ea0 0x7f4de009d030 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f4dd000b910 tx=0x7f4dd000bcb0).stop 2021-04-09T18:33:05.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4ddf314700 1 -- 172.21.15.120:0/3497849483 reap_dead start 2021-04-09T18:33:05.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 shutdown_connections 2021-04-09T18:33:05.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 >> 172.21.15.120:0/3497849483 conn(0x7f4de018dd60 msgr2=0x7f4de0182d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:05.341 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 shutdown_connections 2021-04-09T18:33:05.342 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.353 7f4de4d34700 1 -- 172.21.15.120:0/3497849483 wait complete. 2021-04-09T18:33:05.348 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-04-09T18:33:05.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.506 7f1a9d1f5700 1 Processor -- start 2021-04-09T18:33:05.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.506 7f1a9d1f5700 1 -- start start 2021-04-09T18:33:05.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a9d1f5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980d7160 0x7f1a980e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.513 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a9d1f5700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980d6be0 con 0x7f1a980d7560 2021-04-09T18:33:05.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a9d1f5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980e7f00 con 0x7f1a980e70a0 2021-04-09T18:33:05.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a9d1f5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980d80f0 con 0x7f1a980d7160 2021-04-09T18:33:05.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a9659c700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1a980d7560 0x7f1a980d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55336/0 (socket says 172.21.15.120:55336) 2021-04-09T18:33:05.514 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a9659c700 1 -- 172.21.15.120:0/2111138773 learned_addr learned my addr 172.21.15.120:0/2111138773 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:05.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a96d9d700 1 --2- 172.21.15.120:0/2111138773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980d7160 0x7f1a980e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a95d9b700 1 -- 172.21.15.120:0/2111138773 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990921949 0 0) 0x7f1a800009b0 con 0x7f1a980d7560 2021-04-09T18:33:05.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a95d9b700 1 -- 172.21.15.120:0/2111138773 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a84002fe0 con 0x7f1a980d7560 2021-04-09T18:33:05.515 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a95d9b700 1 -- 172.21.15.120:0/2111138773 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811040239 0 0) 0x7f1a90000d30 con 0x7f1a980e70a0 2021-04-09T18:33:05.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a95d9b700 1 -- 172.21.15.120:0/2111138773 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a840042c0 con 0x7f1a980e70a0 2021-04-09T18:33:05.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a96d9d700 1 -- 172.21.15.120:0/2111138773 >> v1:172.21.15.134:6789/0 conn(0x7f1a980e70a0 legacy=0x7f1a980d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a96d9d700 1 -- 172.21.15.120:0/2111138773 >> v1:172.21.15.120:6789/0 conn(0x7f1a980d7560 legacy=0x7f1a980d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.507 7f1a96d9d700 1 -- 172.21.15.120:0/2111138773 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a981a2ac0 con 0x7f1a980d7160 2021-04-09T18:33:05.516 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.508 7f1a96d9d700 1 --2- 172.21.15.120:0/2111138773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980d7160 0x7f1a980e78e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1a88006650 tx=0x7f1a88009a00).ready entity=mon.2 client_cookie=10e45719ba938cd9 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.508 7f1a95d9b700 1 -- 172.21.15.120:0/2111138773 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1a88009df0 con 0x7f1a980d7160 2021-04-09T18:33:05.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.508 7f1a95d9b700 1 -- 172.21.15.120:0/2111138773 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a880009b0 con 0x7f1a980d7160 2021-04-09T18:33:05.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.508 7f1a95d9b700 1 -- 172.21.15.120:0/2111138773 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1a8800c2b0 con 0x7f1a980d7160 2021-04-09T18:33:05.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.508 7f1a9d1f5700 1 -- 172.21.15.120:0/2111138773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980d7160 msgr2=0x7f1a980e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.517 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.508 7f1a9d1f5700 1 --2- 172.21.15.120:0/2111138773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980d7160 0x7f1a980e78e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1a88006650 tx=0x7f1a88009a00).stop 2021-04-09T18:33:05.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.509 7f1a9d1f5700 1 -- 172.21.15.120:0/2111138773 shutdown_connections 2021-04-09T18:33:05.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.509 7f1a9d1f5700 1 --2- 172.21.15.120:0/2111138773 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980d7160 0x7f1a980e78e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.509 7f1a9d1f5700 1 -- 172.21.15.120:0/2111138773 >> 172.21.15.120:0/2111138773 conn(0x7f1a980d1590 msgr2=0x7f1a980d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:05.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.509 7f1a9d1f5700 1 -- 172.21.15.120:0/2111138773 shutdown_connections 2021-04-09T18:33:05.518 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.509 7f1a9d1f5700 1 -- 172.21.15.120:0/2111138773 wait complete. 2021-04-09T18:33:05.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.527 7f1a9d1f5700 1 Processor -- start 2021-04-09T18:33:05.519 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.527 7f1a9d1f5700 1 -- start start 2021-04-09T18:33:05.521 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9d1f5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a98184c40 0x7f1a980b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9d1f5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a98185040 0x7f1a980b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9d1f5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980b5b80 0x7f1a980e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9d1f5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a981846c0 con 0x7f1a98185040 2021-04-09T18:33:05.522 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9d1f5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a981a1470 con 0x7f1a98184c40 2021-04-09T18:33:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9d1f5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9817fa90 con 0x7f1a980b5b80 2021-04-09T18:33:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9659c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a98185040 0x7f1a980b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9659c700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a98185040 0x7f1a980b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60428/0 (socket says 172.21.15.120:60428) 2021-04-09T18:33:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9659c700 1 -- 172.21.15.120:0/3085960385 learned_addr learned my addr 172.21.15.120:0/3085960385 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:05.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a96d9d700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a98184c40 0x7f1a980b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9759e700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980b5b80 0x7f1a980e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9659c700 1 -- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980b5b80 msgr2=0x7f1a980e34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9659c700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980b5b80 0x7f1a980e34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.524 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9659c700 1 -- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a98184c40 msgr2=0x7f1a980b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9659c700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a98184c40 0x7f1a980b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9659c700 1 -- 172.21.15.120:0/3085960385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980e3af0 con 0x7f1a98185040 2021-04-09T18:33:05.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a96d9d700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a98184c40 0x7f1a980b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-04-09T18:33:05.525 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9659c700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a98185040 0x7f1a980b5560 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f1a8000a4c0 tx=0x7f1a8000a860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a8f7fe700 1 -- 172.21.15.120:0/3085960385 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1a8000ac50 con 0x7f1a98185040 2021-04-09T18:33:05.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a8f7fe700 1 -- 172.21.15.120:0/3085960385 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a80004140 con 0x7f1a98185040 2021-04-09T18:33:05.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a980e3af0 con 0x7f1a98185040 2021-04-09T18:33:05.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.528 7f1a8f7fe700 1 -- 172.21.15.120:0/3085960385 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1a80004620 con 0x7f1a98185040 2021-04-09T18:33:05.526 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.529 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a980e3af0 con 0x7f1a98185040 2021-04-09T18:33:05.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.529 7f1a8f7fe700 1 -- 172.21.15.120:0/3085960385 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f1a80004570 con 0x7f1a98185040 2021-04-09T18:33:05.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.529 7f1a8f7fe700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1a7c018930 0x7f1a7c01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.529 7f1a8f7fe700 1 -- 172.21.15.120:0/3085960385 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f1a80032e10 con 0x7f1a98185040 2021-04-09T18:33:05.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.529 7f1a96d9d700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1a7c018930 0x7f1a7c01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.527 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.530 7f1a96d9d700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1a7c018930 0x7f1a7c01adc0 crc :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.538 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.552 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a981a1470 con 0x7f1a98185040 2021-04-09T18:33:05.541 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.556 7f1a8f7fe700 1 -- 172.21.15.120:0/3085960385 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f1a80004360 con 0x7f1a98185040 2021-04-09T18:33:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.726 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mgr", ""]}) v1 -- 0x7f1a981846c0 con 0x7f1a7c018930 2021-04-09T18:33:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.727 7f1a8f7fe700 1 -- 172.21.15.120:0/3085960385 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f1a88009360 con 0x7f1a7c018930 2021-04-09T18:33:05.713 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 7 to deep-scrub 2021-04-09T18:33:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.729 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1a7c018930 msgr2=0x7f1a7c01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.729 7f1a9d1f5700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1a7c018930 0x7f1a7c01adc0 crc :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.729 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a98185040 msgr2=0x7f1a980b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.729 7f1a9d1f5700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a98185040 0x7f1a980b5560 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f1a8000a4c0 tx=0x7f1a8000a860).stop 2021-04-09T18:33:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.730 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 shutdown_connections 2021-04-09T18:33:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.730 7f1a9d1f5700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f1a7c018930 0x7f1a7c01adc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.730 7f1a9d1f5700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a980b5b80 0x7f1a980e34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.730 7f1a9d1f5700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a98185040 0x7f1a980b5560 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.730 7f1a9d1f5700 1 --2- 172.21.15.120:0/3085960385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a98184c40 0x7f1a980b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.730 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 >> 172.21.15.120:0/3085960385 conn(0x7f1a98182270 msgr2=0x7f1a980e2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.730 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 shutdown_connections 2021-04-09T18:33:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.730 7f1a9d1f5700 1 -- 172.21.15.120:0/3085960385 wait complete. 2021-04-09T18:33:05.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:33:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.879 7f447ddf5700 1 Processor -- start 2021-04-09T18:33:05.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.879 7f447ddf5700 1 -- start start 2021-04-09T18:33:05.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f447ddf5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44780d6580 0x7f44781ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f447ddf5700 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780d7960 con 0x7f44780d7160 2021-04-09T18:33:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f447ddf5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780d6980 con 0x7f44780d7560 2021-04-09T18:33:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f447ddf5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44780d6be0 con 0x7f44780d6580 2021-04-09T18:33:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44777fe700 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f44780d7160 0x7f44780d55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55346/0 (socket says 172.21.15.120:55346) 2021-04-09T18:33:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44777fe700 1 -- 172.21.15.120:0/1690213585 learned_addr learned my addr 172.21.15.120:0/1690213585 (peer_addr_for_me v1:172.21.15.120:0/0) 2021-04-09T18:33:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f4477fff700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44780d6580 0x7f44781ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327160181 0 0) 0x7f4468000ce0 con 0x7f44780d7160 2021-04-09T18:33:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4464002fe0 con 0x7f44780d7160 2021-04-09T18:33:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 274122875 0 0) 0x7f44680010e0 con 0x7f44780d7160 2021-04-09T18:33:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44780d6580 msgr2=0x7f44781ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44780d6580 0x7f44781ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 >> v1:172.21.15.134:6789/0 conn(0x7f44780d7560 legacy=0x7f44780d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44781a2ac0 con 0x7f44780d7160 2021-04-09T18:33:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 937150729 0 0) 0x7f4468001600 con 0x7f44780d7160 2021-04-09T18:33:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 >> v1:172.21.15.120:6789/0 conn(0x7f44780d7160 legacy=0x7f44780d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4464003a60 0x7f4464005eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4464006750 0x7f4464008c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44640094f0 0x7f446400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446400c2c0 con 0x7f4464006750 2021-04-09T18:33:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.880 7f44767fc700 1 -- 172.21.15.120:0/1690213585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446400c4e0 con 0x7f44640094f0 2021-04-09T18:33:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4476ffd700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4464006750 0x7f4464008c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f44767fc700 1 -- 172.21.15.120:0/1690213585 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4464050710 con 0x7f4464003a60 2021-04-09T18:33:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f44777fe700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4464003a60 0x7f4464005eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4477fff700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44640094f0 0x7f446400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4476ffd700 1 -- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4464003a60 msgr2=0x7f4464005eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:05.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4476ffd700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4464003a60 0x7f4464005eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4476ffd700 1 -- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44640094f0 msgr2=0x7f446400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:05.896 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4476ffd700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44640094f0 0x7f446400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4476ffd700 1 -- 172.21.15.120:0/1690213585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464050970 con 0x7f4464006750 2021-04-09T18:33:05.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4477fff700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44640094f0 0x7f446400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:05.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4476ffd700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4464006750 0x7f4464008c50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f4460006ab0 tx=0x7f4460009ac0).ready entity=mon.0 client_cookie=ef29af4576c1020c server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f44767fc700 1 -- 172.21.15.120:0/1690213585 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44600066d0 con 0x7f4464006750 2021-04-09T18:33:05.897 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f44767fc700 1 -- 172.21.15.120:0/1690213585 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44600022e0 con 0x7f4464006750 2021-04-09T18:33:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f44767fc700 1 -- 172.21.15.120:0/1690213585 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4460002740 con 0x7f4464006750 2021-04-09T18:33:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f447ddf5700 1 -- 172.21.15.120:0/1690213585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4464006750 msgr2=0x7f4464008c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f447ddf5700 1 --2- 172.21.15.120:0/1690213585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4464006750 0x7f4464008c50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f4460006ab0 tx=0x7f4460009ac0).stop 2021-04-09T18:33:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.881 7f4477fff700 1 -- 172.21.15.120:0/1690213585 reap_dead start 2021-04-09T18:33:05.899 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.882 7f447ddf5700 1 -- 172.21.15.120:0/1690213585 shutdown_connections 2021-04-09T18:33:05.899 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.882 7f447ddf5700 1 -- 172.21.15.120:0/1690213585 >> 172.21.15.120:0/1690213585 conn(0x7f44780d1590 msgr2=0x7f44780d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:05.899 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.882 7f447ddf5700 1 -- 172.21.15.120:0/1690213585 shutdown_connections 2021-04-09T18:33:05.899 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.882 7f447ddf5700 1 -- 172.21.15.120:0/1690213585 wait complete. 2021-04-09T18:33:05.899 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.900 7f447ddf5700 1 Processor -- start 2021-04-09T18:33:05.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f447ddf5700 1 -- start start 2021-04-09T18:33:05.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f447ddf5700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f447808a9b0 0x7f447808b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f447ddf5700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44780b1fe0 0x7f44780b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f447ddf5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4478183f10 0x7f4478184310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.900 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f447ddf5700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4478197600 con 0x7f44780b1fe0 2021-04-09T18:33:05.901 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f447ddf5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447808ae30 con 0x7f4478183f10 2021-04-09T18:33:05.901 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f447ddf5700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447808b990 con 0x7f447808a9b0 2021-04-09T18:33:05.901 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f4476ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44780b1fe0 0x7f44780b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.901 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f4476ffd700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44780b1fe0 0x7f44780b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60448/0 (socket says 172.21.15.120:60448) 2021-04-09T18:33:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f4476ffd700 1 -- 172.21.15.120:0/4163359296 learned_addr learned my addr 172.21.15.120:0/4163359296 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.901 7f44777fe700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f447808a9b0 0x7f447808b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f4477fff700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4478183f10 0x7f4478184310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f4476ffd700 1 -- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f447808a9b0 msgr2=0x7f447808b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f4476ffd700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f447808a9b0 0x7f447808b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f4476ffd700 1 -- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4478183f10 msgr2=0x7f4478184310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f4476ffd700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4478183f10 0x7f4478184310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f4476ffd700 1 -- 172.21.15.120:0/4163359296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44781971c0 con 0x7f44780b1fe0 2021-04-09T18:33:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f44777fe700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f447808a9b0 0x7f447808b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f4476ffd700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44780b1fe0 0x7f44780b23e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f4460000bf0 tx=0x7f446000b9f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f446ffff700 1 -- 172.21.15.120:0/4163359296 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44600093e0 con 0x7f44780b1fe0 2021-04-09T18:33:05.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f446ffff700 1 -- 172.21.15.120:0/4163359296 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4460006560 con 0x7f44780b1fe0 2021-04-09T18:33:05.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44781971c0 con 0x7f44780b1fe0 2021-04-09T18:33:05.904 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f446ffff700 1 -- 172.21.15.120:0/4163359296 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4460002280 con 0x7f44780b1fe0 2021-04-09T18:33:05.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44781971c0 con 0x7f44780b1fe0 2021-04-09T18:33:05.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.902 7f446ffff700 1 -- 172.21.15.120:0/4163359296 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7f44600054a0 con 0x7f44780b1fe0 2021-04-09T18:33:05.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.903 7f446ffff700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f445c018930 0x7f445c01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:05.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.903 7f446ffff700 1 -- 172.21.15.120:0/4163359296 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4460032e10 con 0x7f44780b1fe0 2021-04-09T18:33:05.905 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.903 7f44777fe700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f445c018930 0x7f445c01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:05.906 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.903 7f44777fe700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f445c018930 0x7f445c01ae10 crc :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:05.911 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.925 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4478182a20 con 0x7f44780b1fe0 2021-04-09T18:33:05.914 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:05.929 7f446ffff700 1 -- 172.21.15.120:0/4163359296 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7f446001f740 con 0x7f44780b1fe0 2021-04-09T18:33:06.092 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.107 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f4478182a20 con 0x7f445c018930 2021-04-09T18:33:06.096 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.111 7f446ffff700 1 -- 172.21.15.120:0/4163359296 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+101298 (crc 0 0 0) 0x7f4468001c10 con 0x7f445c018930 2021-04-09T18:33:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2021-04-09T18:33:06.101 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:33:06.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f445c018930 msgr2=0x7f445c01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:06.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f445c018930 0x7f445c01ae10 crc :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:06.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44780b1fe0 msgr2=0x7f44780b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:06.103 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44780b1fe0 0x7f44780b23e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f4460000bf0 tx=0x7f446000b9f0).stop 2021-04-09T18:33:06.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 shutdown_connections 2021-04-09T18:33:06.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4478183f10 0x7f4478184310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:06.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44780b1fe0 0x7f44780b23e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:06.104 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7f445c018930 0x7f445c01ae10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:06.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 --2- 172.21.15.120:0/4163359296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f447808a9b0 0x7f447808b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:06.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 >> 172.21.15.120:0/4163359296 conn(0x7f447818dcd0 msgr2=0x7f4478187f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:06.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 shutdown_connections 2021-04-09T18:33:06.105 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:06.116 7f447ddf5700 1 -- 172.21.15.120:0/4163359296 wait complete. 2021-04-09T18:33:06.112 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2021-04-09 18:33:04.907691","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":155716345,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":14381,"num_read_kb":2102932,"num_write":36489,"num_write_kb":4615424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38041,"ondisk_log_size":38041,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8584880,"kb_used_data":196208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746389840,"statfs":{"total":773094113280,"available":764303196160,"internally_reserved":8589934592,"allocated":200916992,"data_stored":312515434,"data_compressed":50837928,"data_compressed_allocated":113205248,"data_compressed_original":226410368,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1081408,"num_objects":-197,"num_object_clones":0,"num_object_copies":-788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-197,"num_whiteouts":0,"num_read":9,"num_read_kb":29,"num_write":230,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002662"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.820189","last_change":"2021-04-09 18:19:48.659214","last_active":"2021-04-09 18:30:00.820189","last_peered":"2021-04-09 18:30:00.820189","last_clean":"2021-04-09 18:30:00.820189","last_became_active":"2021-04-09 18:19:48.658812","last_became_peered":"2021-04-09 18:19:48.658812","last_unstale":"2021-04-09 18:30:00.820189","last_undegraded":"2021-04-09 18:30:00.820189","last_fullsized":"2021-04-09 18:30:00.820189","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"30'1617","reported_seq":"1688","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:49.968902","last_change":"2021-04-09 18:19:51.674918","last_active":"2021-04-09 18:32:49.968902","last_peered":"2021-04-09 18:32:49.968902","last_clean":"2021-04-09 18:32:49.968902","last_became_active":"2021-04-09 18:19:51.674416","last_became_peered":"2021-04-09 18:19:51.674416","last_unstale":"2021-04-09 18:32:49.968902","last_undegraded":"2021-04-09 18:32:49.968902","last_fullsized":"2021-04-09 18:32:49.968902","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1617,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16777850,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":83,"num_read_kb":62902,"num_write":1388,"num_write_kb":17176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'3134","reported_seq":"4729","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.531320","last_change":"2021-04-09 18:19:54.682596","last_active":"2021-04-09 18:32:50.531320","last_peered":"2021-04-09 18:32:50.531320","last_clean":"2021-04-09 18:32:50.531320","last_became_active":"2021-04-09 18:19:54.682305","last_became_peered":"2021-04-09 18:19:54.682305","last_unstale":"2021-04-09 18:32:50.531320","last_undegraded":"2021-04-09 18:32:50.531320","last_fullsized":"2021-04-09 18:32:50.531320","mapping_epoch":20,"log_start":"23'100","ondisk_log_start":"23'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3034,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1576,"num_read_kb":167745,"num_write":2984,"num_write_kb":612887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.820142","last_change":"2021-04-09 18:19:48.659288","last_active":"2021-04-09 18:30:00.820142","last_peered":"2021-04-09 18:30:00.820142","last_clean":"2021-04-09 18:30:00.820142","last_became_active":"2021-04-09 18:19:48.658917","last_became_peered":"2021-04-09 18:19:48.658917","last_unstale":"2021-04-09 18:30:00.820142","last_undegraded":"2021-04-09 18:30:00.820142","last_fullsized":"2021-04-09 18:30:00.820142","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'2463","reported_seq":"2545","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:51.961712","last_change":"2021-04-09 18:19:51.675020","last_active":"2021-04-09 18:32:51.961712","last_peered":"2021-04-09 18:32:51.961712","last_clean":"2021-04-09 18:32:51.961712","last_became_active":"2021-04-09 18:19:51.674681","last_became_peered":"2021-04-09 18:19:51.674681","last_unstale":"2021-04-09 18:32:51.961712","last_undegraded":"2021-04-09 18:32:51.961712","last_fullsized":"2021-04-09 18:32:51.961712","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":2463,"ondisk_log_size":2463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165984,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":94,"num_read_kb":122944,"num_write":2221,"num_write_kb":25929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'3105","reported_seq":"4746","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.971120","last_change":"2021-04-09 18:19:54.681265","last_active":"2021-04-09 18:32:50.971120","last_peered":"2021-04-09 18:32:50.971120","last_clean":"2021-04-09 18:32:50.971120","last_became_active":"2021-04-09 18:19:54.680726","last_became_peered":"2021-04-09 18:19:54.680726","last_unstale":"2021-04-09 18:32:50.971120","last_undegraded":"2021-04-09 18:32:50.971120","last_fullsized":"2021-04-09 18:32:50.971120","mapping_epoch":20,"log_start":"23'100","ondisk_log_start":"23'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3005,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1622,"num_read_kb":187246,"num_write":2949,"num_write_kb":537587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"30'3074","reported_seq":"4785","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.972594","last_change":"2021-04-09 18:19:54.680273","last_active":"2021-04-09 18:32:50.972594","last_peered":"2021-04-09 18:32:50.972594","last_clean":"2021-04-09 18:32:50.972594","last_became_active":"2021-04-09 18:19:54.679793","last_became_peered":"2021-04-09 18:19:54.679793","last_unstale":"2021-04-09 18:32:50.972594","last_undegraded":"2021-04-09 18:32:50.972594","last_fullsized":"2021-04-09 18:32:50.972594","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3074,"ondisk_log_size":3074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1692,"num_read_kb":232958,"num_write":2932,"num_write_kb":526773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.948322","last_change":"2021-04-09 18:19:48.670446","last_active":"2021-04-09 18:30:00.948322","last_peered":"2021-04-09 18:30:00.948322","last_clean":"2021-04-09 18:30:00.948322","last_became_active":"2021-04-09 18:19:48.670077","last_became_peered":"2021-04-09 18:19:48.670077","last_unstale":"2021-04-09 18:30:00.948322","last_undegraded":"2021-04-09 18:30:00.948322","last_fullsized":"2021-04-09 18:30:00.948322","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'1659","reported_seq":"1708","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:49.927230","last_change":"2021-04-09 18:19:51.668684","last_active":"2021-04-09 18:32:49.927230","last_peered":"2021-04-09 18:32:49.927230","last_clean":"2021-04-09 18:32:49.927230","last_became_active":"2021-04-09 18:19:51.668425","last_became_peered":"2021-04-09 18:19:51.668425","last_unstale":"2021-04-09 18:32:49.927230","last_undegraded":"2021-04-09 18:32:49.927230","last_fullsized":"2021-04-09 18:32:49.927230","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1659,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":54038,"num_write":1625,"num_write_kb":14281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"30'3405","reported_seq":"5209","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.973677","last_change":"2021-04-09 18:19:54.678757","last_active":"2021-04-09 18:32:50.973677","last_peered":"2021-04-09 18:32:50.973677","last_clean":"2021-04-09 18:32:50.973677","last_became_active":"2021-04-09 18:19:54.678420","last_became_peered":"2021-04-09 18:19:54.678420","last_unstale":"2021-04-09 18:32:50.973677","last_undegraded":"2021-04-09 18:32:50.973677","last_fullsized":"2021-04-09 18:32:50.973677","mapping_epoch":20,"log_start":"23'400","ondisk_log_start":"23'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3005,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1785,"num_read_kb":229797,"num_write":3237,"num_write_kb":745712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:03.809772","last_change":"2021-04-09 18:33:03.809822","last_active":"2021-04-09 18:33:03.809772","last_peered":"2021-04-09 18:33:03.809772","last_clean":"2021-04-09 18:33:03.809772","last_became_active":"2021-04-09 18:19:48.660038","last_became_peered":"2021-04-09 18:19:48.660038","last_unstale":"2021-04-09 18:33:03.809772","last_undegraded":"2021-04-09 18:33:03.809772","last_fullsized":"2021-04-09 18:33:03.809772","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:03.809772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:03.809772","last_clean_scrub_stamp":"2021-04-09 18:33:03.809772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"30'1237","reported_seq":"1302","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:44.507912","last_change":"2021-04-09 18:19:51.670965","last_active":"2021-04-09 18:32:44.507912","last_peered":"2021-04-09 18:32:44.507912","last_clean":"2021-04-09 18:32:44.507912","last_became_active":"2021-04-09 18:19:51.670767","last_became_peered":"2021-04-09 18:19:51.670767","last_unstale":"2021-04-09 18:32:44.507912","last_undegraded":"2021-04-09 18:32:44.507912","last_fullsized":"2021-04-09 18:32:44.507912","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1237,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12583478,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":77,"num_read_kb":49216,"num_write":1015,"num_write_kb":12937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.829416","last_change":"2021-04-09 18:19:48.668518","last_active":"2021-04-09 18:30:00.829416","last_peered":"2021-04-09 18:30:00.829416","last_clean":"2021-04-09 18:30:00.829416","last_became_active":"2021-04-09 18:19:48.668225","last_became_peered":"2021-04-09 18:19:48.668225","last_unstale":"2021-04-09 18:30:00.829416","last_undegraded":"2021-04-09 18:30:00.829416","last_fullsized":"2021-04-09 18:30:00.829416","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"30'817","reported_seq":"895","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.475536","last_change":"2021-04-09 18:19:51.675432","last_active":"2021-04-09 18:32:50.475536","last_peered":"2021-04-09 18:32:50.475536","last_clean":"2021-04-09 18:32:50.475536","last_became_active":"2021-04-09 18:19:51.675161","last_became_peered":"2021-04-09 18:19:51.675161","last_unstale":"2021-04-09 18:32:50.475536","last_undegraded":"2021-04-09 18:32:50.475536","last_fullsized":"2021-04-09 18:32:50.475536","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":817,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":82,"num_read_kb":135240,"num_write":591,"num_write_kb":20834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'3228","reported_seq":"4840","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:51.289759","last_change":"2021-04-09 18:19:54.680136","last_active":"2021-04-09 18:32:51.289759","last_peered":"2021-04-09 18:32:51.289759","last_clean":"2021-04-09 18:32:51.289759","last_became_active":"2021-04-09 18:19:54.679654","last_became_peered":"2021-04-09 18:19:54.679654","last_unstale":"2021-04-09 18:32:51.289759","last_undegraded":"2021-04-09 18:32:51.289759","last_fullsized":"2021-04-09 18:32:51.289759","mapping_epoch":20,"log_start":"23'200","ondisk_log_start":"23'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3028,"ondisk_log_size":3028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1593,"num_read_kb":140394,"num_write":3081,"num_write_kb":627737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.820426","last_change":"2021-04-09 18:19:48.659172","last_active":"2021-04-09 18:30:00.820426","last_peered":"2021-04-09 18:30:00.820426","last_clean":"2021-04-09 18:30:00.820426","last_became_active":"2021-04-09 18:19:48.658788","last_became_peered":"2021-04-09 18:19:48.658788","last_unstale":"2021-04-09 18:30:00.820426","last_undegraded":"2021-04-09 18:30:00.820426","last_fullsized":"2021-04-09 18:30:00.820426","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"30'1932","reported_seq":"1987","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:51.002990","last_change":"2021-04-09 18:19:51.675238","last_active":"2021-04-09 18:32:51.002990","last_peered":"2021-04-09 18:32:51.002990","last_clean":"2021-04-09 18:32:51.002990","last_became_active":"2021-04-09 18:19:51.674810","last_became_peered":"2021-04-09 18:19:51.674810","last_unstale":"2021-04-09 18:32:51.002990","last_undegraded":"2021-04-09 18:32:51.002990","last_fullsized":"2021-04-09 18:32:51.002990","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":1932,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":133210,"num_write":1688,"num_write_kb":25534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"30'3187","reported_seq":"4797","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.522190","last_change":"2021-04-09 18:19:54.680226","last_active":"2021-04-09 18:32:50.522190","last_peered":"2021-04-09 18:32:50.522190","last_clean":"2021-04-09 18:32:50.522190","last_became_active":"2021-04-09 18:19:54.679836","last_became_peered":"2021-04-09 18:19:54.679836","last_unstale":"2021-04-09 18:32:50.522190","last_undegraded":"2021-04-09 18:32:50.522190","last_fullsized":"2021-04-09 18:32:50.522190","mapping_epoch":20,"log_start":"23'100","ondisk_log_start":"23'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3087,"ondisk_log_size":3087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1591,"num_read_kb":159111,"num_write":3021,"num_write_kb":405224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"30'1644","reported_seq":"2321","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:03.564073","last_change":"2021-04-09 18:33:03.564143","last_active":"2021-04-09 18:33:03.564073","last_peered":"2021-04-09 18:33:03.564073","last_clean":"2021-04-09 18:33:03.564073","last_became_active":"2021-04-09 18:19:51.679689","last_became_peered":"2021-04-09 18:19:51.679689","last_unstale":"2021-04-09 18:33:03.564073","last_undegraded":"2021-04-09 18:33:03.564073","last_fullsized":"2021-04-09 18:33:03.564073","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1644","last_scrub_stamp":"2021-04-09 18:33:03.564073","last_deep_scrub":"30'1644","last_deep_scrub_stamp":"2021-04-09 18:33:03.564073","last_clean_scrub_stamp":"2021-04-09 18:33:03.564073","log_size":1644,"ondisk_log_size":1644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9816456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":654,"num_read_kb":13580,"num_write":1392,"num_write_kb":10592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"23","reported_epoch":"29","state":"active+clean","last_fresh":"2021-04-09 18:30:00.829391","last_change":"2021-04-09 18:19:48.668812","last_active":"2021-04-09 18:30:00.829391","last_peered":"2021-04-09 18:30:00.829391","last_clean":"2021-04-09 18:30:00.829391","last_became_active":"2021-04-09 18:19:48.668474","last_became_peered":"2021-04-09 18:19:48.668474","last_unstale":"2021-04-09 18:30:00.829391","last_undegraded":"2021-04-09 18:30:00.829391","last_fullsized":"2021-04-09 18:30:00.829391","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:47.641887","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:47.641887","last_clean_scrub_stamp":"2021-04-09 18:19:47.641887","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"30'3348","reported_seq":"5061","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.997501","last_change":"2021-04-09 18:19:54.681340","last_active":"2021-04-09 18:32:50.997501","last_peered":"2021-04-09 18:32:50.997501","last_clean":"2021-04-09 18:32:50.997501","last_became_active":"2021-04-09 18:19:54.680877","last_became_peered":"2021-04-09 18:19:54.680877","last_unstale":"2021-04-09 18:32:50.997501","last_undegraded":"2021-04-09 18:32:50.997501","last_fullsized":"2021-04-09 18:32:50.997501","mapping_epoch":20,"log_start":"23'300","ondisk_log_start":"23'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3048,"ondisk_log_size":3048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1694,"num_read_kb":164019,"num_write":3172,"num_write_kb":529088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"30'2362","reported_seq":"2450","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:54.931046","last_change":"2021-04-09 18:19:51.675129","last_active":"2021-04-09 18:32:54.931046","last_peered":"2021-04-09 18:32:54.931046","last_clean":"2021-04-09 18:32:54.931046","last_became_active":"2021-04-09 18:19:51.674771","last_became_peered":"2021-04-09 18:19:51.674771","last_unstale":"2021-04-09 18:32:54.931046","last_undegraded":"2021-04-09 18:32:54.931046","last_fullsized":"2021-04-09 18:32:54.931046","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:50.657332","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:50.657332","last_clean_scrub_stamp":"2021-04-09 18:19:50.657332","log_size":2362,"ondisk_log_size":2362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32652287,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":132,"num_read_kb":131070,"num_write":2126,"num_write_kb":33047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:03.049273","last_change":"2021-04-09 18:33:03.049321","last_active":"2021-04-09 18:33:03.049273","last_peered":"2021-04-09 18:33:03.049273","last_clean":"2021-04-09 18:33:03.049273","last_became_active":"2021-04-09 18:19:48.660180","last_became_peered":"2021-04-09 18:19:48.660180","last_unstale":"2021-04-09 18:33:03.049273","last_undegraded":"2021-04-09 18:33:03.049273","last_fullsized":"2021-04-09 18:33:03.049273","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:03.049272","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:03.049272","last_clean_scrub_stamp":"2021-04-09 18:33:03.049272","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"30'3229","reported_seq":"4866","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:32:50.971782","last_change":"2021-04-09 18:19:54.679817","last_active":"2021-04-09 18:32:50.971782","last_peered":"2021-04-09 18:32:50.971782","last_clean":"2021-04-09 18:32:50.971782","last_became_active":"2021-04-09 18:19:54.679420","last_became_peered":"2021-04-09 18:19:54.679420","last_unstale":"2021-04-09 18:32:50.971782","last_undegraded":"2021-04-09 18:32:50.971782","last_fullsized":"2021-04-09 18:32:50.971782","mapping_epoch":20,"log_start":"23'200","ondisk_log_start":"23'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:19:53.665748","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:19:53.665748","last_clean_scrub_stamp":"2021-04-09 18:19:53.665748","log_size":3029,"ondisk_log_size":3029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1618,"num_read_kb":119462,"num_write":3067,"num_write_kb":470086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13171,"num_read_kb":1400732,"num_write":24443,"num_write_kb":4455094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24310,"ondisk_log_size":24310,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":155716345,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1210,"num_read_kb":702200,"num_write":12046,"num_write_kb":160330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":198295552,"data_stored":311432690,"data_compressed":50837928,"data_compressed_allocated":113205248,"data_compressed_original":226410368,"omap_allocated":0,"internal_metadata":0},"log_size":13731,"ondisk_log_size":13731,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575013,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1093440,"kb_used_data":44856,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93278400,"statfs":{"total":96636764160,"available":95517081600,"internally_reserved":1073741824,"allocated":45932544,"data_stored":70537092,"data_compressed":11033403,"data_compressed_allocated":24817664,"data_compressed_original":49635264,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":18.991,"5min":4.141,"15min":7.9960000000000004},"min":{"1min":0.23499999999999999,"5min":0.189,"15min":0.189},"max":{"1min":353.71100000000001,"5min":353.71100000000001,"15min":552.03099999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":5.742,"15min":5.2149999999999999},"min":{"1min":0.248,"5min":0.23000000000000001,"15min":0.19500000000000001},"max":{"1min":0.72199999999999998,"5min":582.798,"15min":582.798},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.40899999999999997,"15min":3.7349999999999999},"min":{"1min":0.218,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.68799999999999994,"5min":1.359,"15min":243.08699999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":16.545000000000002,"15min":9.0990000000000002},"min":{"1min":0.217,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76500000000000001,"5min":974.39400000000001,"15min":974.39400000000001},"last":0.48599999999999999}]},{"osd":2,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":13.374000000000001,"15min":6.5570000000000004},"min":{"1min":0.29199999999999998,"5min":0.27300000000000002,"15min":0.246},"max":{"1min":0.69599999999999995,"5min":603.80899999999997,"15min":603.80899999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":2.472},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.224},"max":{"1min":0.70899999999999996,"5min":1.135,"15min":635.03700000000003},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":15.914999999999999,"15min":10.885},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.623,"5min":959.947,"15min":959.947},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":5.7320000000000002,"15min":4.4909999999999997},"min":{"1min":0.315,"5min":0.29099999999999998,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":501.96600000000001,"15min":545.40899999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":4.4459999999999997,"15min":1.7370000000000001},"min":{"1min":0.219,"5min":0.183,"15min":0.183},"max":{"1min":0.498,"5min":451.887,"15min":451.887},"last":0.498},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":3.4969999999999999},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":1.786,"5min":1.984,"15min":676.46900000000005},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":13.151,"5min":2.9500000000000002,"15min":1.25},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":255.71899999999999,"5min":255.71899999999999,"15min":255.71899999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":4.7949999999999999,"15min":4.4889999999999999},"min":{"1min":0.27000000000000002,"5min":0.251,"15min":0.23200000000000001},"max":{"1min":0.78200000000000003,"5min":350.24599999999998,"15min":741.22199999999998},"last":0.504}]},{"osd":6,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":6.4770000000000003,"15min":6.2530000000000001},"min":{"1min":0.23999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":610.43899999999996,"15min":766.49300000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40300000000000002,"15min":0.432},"min":{"1min":0.245,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.53500000000000003,"5min":1.361,"15min":5.4050000000000002},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575011,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1065240,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93306600,"statfs":{"total":96636764160,"available":95545958400,"internally_reserved":1073741824,"allocated":17055744,"data_stored":25301733,"data_compressed":3840529,"data_compressed_allocated":8450048,"data_compressed_original":16900032,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":18.530999999999999,"5min":4.0039999999999996,"15min":4.3209999999999997},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.17999999999999999},"max":{"1min":363.27499999999998,"5min":363.27499999999998,"15min":592.09900000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":10.096,"15min":4.2039999999999997},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.19700000000000001},"max":{"1min":0.59799999999999998,"5min":728.14300000000003,"15min":728.14300000000003},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.371,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.47799999999999998,"5min":0.63500000000000001,"15min":2.3140000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":2.8479999999999999},"min":{"1min":0.32400000000000001,"5min":0.22800000000000001,"15min":0.217},"max":{"1min":0.54600000000000004,"5min":1.1499999999999999,"15min":692.18100000000004},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":3.637,"15min":3.5409999999999999},"min":{"1min":0.24199999999999999,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.58499999999999996,"5min":212.816,"15min":416.06900000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.433},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.23400000000000001},"max":{"1min":0.56899999999999995,"5min":0.66500000000000004,"15min":1.665},"last":0.443}]},{"osd":3,"last update":"Fri Apr 9 18:32:06 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":5.7329999999999997,"15min":5.2409999999999997},"min":{"1min":0.29999999999999999,"5min":0.26200000000000001,"15min":0.23100000000000001},"max":{"1min":0.59399999999999997,"5min":532.06899999999996,"15min":860.98099999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":3.8940000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.23699999999999999},"max":{"1min":0.61399999999999999,"5min":0.86399999999999999,"15min":675.61300000000006},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":8.2240000000000002,"15min":6.048},"min":{"1min":0.248,"5min":0.191,"15min":0.17299999999999999},"max":{"1min":0.496,"5min":670.02200000000005,"15min":670.02200000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":50.018000000000001,"5min":28.960999999999999,"15min":14.472},"min":{"1min":0.23799999999999999,"5min":0.23200000000000001,"15min":0.19900000000000001},"max":{"1min":993.46400000000006,"5min":993.46400000000006,"15min":993.46400000000006},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Apr 9 18:32:09 2021","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":17.515999999999998,"15min":6.8250000000000002},"min":{"1min":0.245,"5min":0.215,"15min":0.21299999999999999},"max":{"1min":0.53800000000000003,"5min":865.55600000000004,"15min":865.55600000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":3.073},"min":{"1min":0.26300000000000001,"5min":0.249,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.57899999999999996,"15min":924.65300000000002},"last":0.47999999999999998}]},{"osd":7,"last update":"Fri Apr 9 18:32:06 2021","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":13.430999999999999,"15min":5.1719999999999997},"min":{"1min":0.25600000000000001,"5min":0.23200000000000001,"15min":0.19400000000000001},"max":{"1min":0.55400000000000005,"5min":597.70600000000002,"15min":597.70600000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":2.5379999999999998,"15min":1.3859999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60899999999999999,"5min":195.625,"15min":195.625},"last":0.52100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575014,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1075676,"kb_used_data":27092,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93296164,"statfs":{"total":96636764160,"available":95535271936,"internally_reserved":1073741824,"allocated":27742208,"data_stored":46272721,"data_compressed":8418247,"data_compressed_allocated":18726912,"data_compressed_original":37453824,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.41599999999999998,"15min":0.505},"min":{"1min":0.27300000000000002,"5min":0.19,"15min":0.19},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":21.654},"last":0.59099999999999997},{"interface":"front","average":{"1min":6.6749999999999998,"5min":3.149,"15min":3.9169999999999998},"min":{"1min":0.27000000000000002,"5min":0.248,"15min":0.218},"max":{"1min":137.06999999999999,"5min":176.75200000000001,"15min":519.08100000000002},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.39500000000000002,"15min":0.41299999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20399999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.3839999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":35.027999999999999,"5min":7.3700000000000001,"15min":3.4039999999999999},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.19900000000000001},"max":{"1min":761.06899999999996,"5min":761.06899999999996,"15min":761.06899999999996},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":3.6280000000000001,"15min":4.3029999999999999},"min":{"1min":0.23699999999999999,"5min":0.22900000000000001,"15min":0.214},"max":{"1min":1.282,"5min":384.24000000000001,"15min":786.34900000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":15.673,"5min":3.5089999999999999,"15min":1.5049999999999999},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":335.99200000000002,"5min":335.99200000000002,"15min":335.99200000000002},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":14.919,"15min":5.274},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.4279999999999999,"5min":785.99199999999996,"15min":785.99199999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.45300000000000001,"15min":16.681999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.65000000000000002,"5min":2.323,"15min":643.62},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":7.6420000000000003,"15min":2.899},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19},"max":{"1min":1.9910000000000001,"5min":500.91800000000001,"15min":500.91800000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":5.468,"15min":5.4400000000000004},"min":{"1min":0.23000000000000001,"5min":0.22700000000000001,"15min":0.192},"max":{"1min":0.56599999999999995,"5min":405.11700000000002,"15min":437.25599999999997},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":3.7959999999999998,"15min":13.470000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19600000000000001},"max":{"1min":1.222,"5min":209.929,"15min":840.71699999999998},"last":0.379},{"interface":"front","average":{"1min":0.41699999999999998,"5min":5.6159999999999997,"15min":10.382},"min":{"1min":0.26700000000000002,"5min":0.23000000000000001,"15min":0.185},"max":{"1min":1.3500000000000001,"5min":575.17200000000003,"15min":681.07500000000005},"last":0.41399999999999998}]},{"osd":7,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":33.874000000000002,"5min":7.0890000000000004,"15min":8.9809999999999999},"min":{"1min":0.23699999999999999,"5min":0.22500000000000001,"15min":0.19800000000000001},"max":{"1min":703.91499999999996,"5min":703.91499999999996,"15min":703.91499999999996},"last":0.505},{"interface":"front","average":{"1min":30.684999999999999,"5min":8.9280000000000008,"15min":7.3630000000000004},"min":{"1min":0.248,"5min":0.23599999999999999,"15min":0.224},"max":{"1min":635.601,"5min":635.601,"15min":635.601},"last":0.52500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575012,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048904,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322936,"statfs":{"total":96636764160,"available":95562686464,"internally_reserved":1073741824,"allocated":327680,"data_stored":135343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":1.3220000000000001,"15min":9.3670000000000009},"min":{"1min":0.26300000000000001,"5min":0.23200000000000001,"15min":0.184},"max":{"1min":0.64500000000000002,"5min":83.387,"15min":1084.748},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.40100000000000002,"15min":1.137},"min":{"1min":0.28499999999999998,"5min":0.24199999999999999,"15min":0.23400000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":112.58199999999999},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":5.9969999999999999,"15min":2.2669999999999999},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.54000000000000004,"5min":558.18799999999999,"15min":558.18799999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.438,"15min":5.2729999999999997},"min":{"1min":0.26200000000000001,"5min":0.23499999999999999,"15min":0.21299999999999999},"max":{"1min":0.54200000000000004,"5min":2.141,"15min":720.49000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40200000000000002,"15min":6.3819999999999997},"min":{"1min":0.26200000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.655,"5min":1.655,"15min":1100.546},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":1.262,"15min":6.9050000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22600000000000001},"max":{"1min":1.506,"5min":74.540999999999997,"15min":1100.5699999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.432,"15min":3.4489999999999998},"min":{"1min":0.28399999999999997,"5min":0.26800000000000002,"15min":0.246},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":955.88499999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":1.619,"15min":0.82799999999999996},"min":{"1min":0.33800000000000002,"5min":0.28899999999999998,"15min":0.23899999999999999},"max":{"1min":1.5629999999999999,"5min":107.729,"15min":107.729},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":10.08,"15min":3.7450000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":0.82799999999999996,"5min":500.57999999999998,"15min":500.57999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.378,"5min":20.699000000000002,"15min":9.5909999999999993},"min":{"1min":0.23499999999999999,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":1.623,"5min":904.89400000000001,"15min":904.89400000000001},"last":0.38}]},{"osd":6,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.39700000000000002,"15min":1.206},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.21099999999999999},"max":{"1min":0.52400000000000002,"5min":2.177,"15min":235.71000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":24.959,"5min":5.2949999999999999,"15min":2.0099999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.20899999999999999},"max":{"1min":492.97000000000003,"5min":492.97000000000003,"15min":492.97000000000003},"last":0.42699999999999999}]},{"osd":7,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.41499999999999998,"15min":3.3940000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.20899999999999999},"max":{"1min":0.51100000000000001,"5min":2.1869999999999998,"15min":993.75300000000004},"last":0.441},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.48199999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.21199999999999999},"max":{"1min":1.641,"5min":1.641,"15min":32.991},"last":0.39000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575012,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1075556,"kb_used_data":26972,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93296284,"statfs":{"total":96636764160,"available":95535394816,"internally_reserved":1073741824,"allocated":27619328,"data_stored":42079177,"data_compressed":6498995,"data_compressed_allocated":14667776,"data_compressed_original":29335552,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.28199999999999997,"15min":2.9049999999999998},"min":{"1min":0.183,"5min":0.151,"15min":0.14199999999999999},"max":{"1min":0.45800000000000002,"5min":1.8859999999999999,"15min":370.23200000000003},"last":0.249},{"interface":"front","average":{"1min":0.29299999999999998,"5min":20.943999999999999,"15min":9.7560000000000002},"min":{"1min":0.17399999999999999,"5min":0.17000000000000001,"15min":0.152},"max":{"1min":0.58999999999999997,"5min":949.67999999999995,"15min":980.14200000000005},"last":0.24199999999999999}]},{"osd":2,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":11.308999999999999,"15min":7.7949999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.159},"max":{"1min":1.1080000000000001,"5min":935.36599999999999,"15min":935.36599999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":9.1820000000000004,"15min":6.8250000000000002},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.16600000000000001},"max":{"1min":2.258,"5min":707.76800000000003,"15min":763.25900000000001},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":4.7329999999999997,"15min":2.2250000000000001},"min":{"1min":0.23499999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.54300000000000004,"5min":374.58499999999998,"15min":374.58499999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":8.6400000000000006,"15min":6.2320000000000002},"min":{"1min":0.253,"5min":0.17999999999999999,"15min":0.159},"max":{"1min":0.51200000000000001,"5min":706.14999999999998,"15min":706.14999999999998},"last":0.371}]},{"osd":4,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":4.8710000000000004,"15min":5.7249999999999996},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23000000000000001},"max":{"1min":0.67300000000000004,"5min":356.02300000000002,"15min":797.23199999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":19.209,"5min":20.712,"15min":9.8949999999999996},"min":{"1min":0.25600000000000001,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":339.25700000000001,"5min":926.05899999999997,"15min":926.05899999999997},"last":0.38400000000000001}]},{"osd":5,"last update":"Fri Apr 9 18:32:08 2021","interfaces":[{"interface":"back","average":{"1min":50.677999999999997,"5min":11.989000000000001,"15min":5.3789999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":855.36000000000001,"5min":855.36000000000001,"15min":855.36000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":10.542999999999999,"15min":4.0590000000000002},"min":{"1min":0.33000000000000002,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":0.86599999999999999,"5min":858.15300000000002,"15min":858.15300000000002},"last":0.41099999999999998}]},{"osd":6,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":43.277000000000001,"5min":16.277000000000001,"15min":6.3890000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.252},"max":{"1min":771.98699999999997,"5min":798.38699999999994,"15min":798.38699999999994},"last":0.34399999999999997},{"interface":"front","average":{"1min":42.238,"5min":18.111000000000001,"15min":7.1749999999999998},"min":{"1min":0.308,"5min":0.29799999999999999,"15min":0.27200000000000002},"max":{"1min":753.20699999999999,"5min":753.20699999999999,"15min":753.20699999999999},"last":0.42799999999999999}]},{"osd":7,"last update":"Fri Apr 9 18:32:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":5.1139999999999999},"min":{"1min":0.317,"5min":0.245,"15min":0.245},"max":{"1min":1.0920000000000001,"5min":1.5840000000000001,"15min":983.08600000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":14.292999999999999,"15min":5.085},"min":{"1min":0.313,"5min":0.312,"15min":0.27600000000000002},"max":{"1min":0.78700000000000003,"5min":825.28099999999995,"15min":825.28099999999995},"last":0.40300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575013,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1102804,"kb_used_data":54220,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93269036,"statfs":{"total":96636764160,"available":95507492864,"internally_reserved":1073741824,"allocated":55521280,"data_stored":87314216,"data_compressed":14545655,"data_compressed_allocated":31993856,"data_compressed_original":63987712,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.28100000000000003,"15min":0.39700000000000002},"min":{"1min":0.159,"5min":0.159,"15min":0.14499999999999999},"max":{"1min":0.501,"5min":1.748,"15min":26.109000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.316,"15min":2.1259999999999999},"min":{"1min":0.17999999999999999,"5min":0.151,"15min":0.14899999999999999},"max":{"1min":0.41599999999999998,"5min":1.347,"15min":537.42399999999998},"last":0.23599999999999999}]},{"osd":2,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":8.3469999999999995,"15min":10.035},"min":{"1min":0.16800000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.47499999999999998,"5min":843.40599999999995,"15min":984.54499999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.63700000000000001,"15min":22.808},"min":{"1min":0.20499999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.52000000000000002,"5min":35.290999999999997,"15min":803.20399999999995},"last":0.247}]},{"osd":3,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":17.965,"5min":5.9640000000000004,"15min":5.1520000000000001},"min":{"1min":0.20200000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":335.904,"5min":335.904,"15min":335.904},"last":0.33800000000000002},{"interface":"front","average":{"1min":43.740000000000002,"5min":24.318000000000001,"15min":12.151},"min":{"1min":0.245,"5min":0.19500000000000001,"15min":0.16},"max":{"1min":825.78300000000002,"5min":868.67700000000002,"15min":868.67700000000002},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Apr 9 18:32:04 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42999999999999999,"15min":2.9670000000000001},"min":{"1min":0.29699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.65500000000000003,"5min":0.85099999999999998,"15min":208.495},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.45100000000000001,"15min":6.4050000000000002},"min":{"1min":0.27800000000000002,"5min":0.26300000000000001,"15min":0.245},"max":{"1min":0.64800000000000002,"5min":1.488,"15min":707.65899999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":14.994,"15min":16.943000000000001},"min":{"1min":0.28199999999999997,"5min":0.247,"15min":0.247},"max":{"1min":0.51500000000000001,"5min":588.13699999999994,"15min":997.548},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.49299999999999999,"15min":10.696},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.63400000000000001,"5min":3.5310000000000001,"15min":933.71600000000001},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Apr 9 18:32:15 2021","interfaces":[{"interface":"back","average":{"1min":18.605,"5min":12.630000000000001,"15min":6.1289999999999996},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":327.71100000000001,"5min":639.91200000000003,"15min":639.91200000000003},"last":366.29000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":18.478000000000002,"15min":12.032},"min":{"1min":0.28799999999999998,"5min":0.28199999999999997,"15min":0.27700000000000002},"max":{"1min":0.65600000000000003,"5min":957.94899999999996,"15min":957.94899999999996},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Apr 9 18:32:10 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":5.71,"15min":5.7649999999999997},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.253},"max":{"1min":0.71599999999999997,"5min":500.83999999999997,"15min":500.83999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.438,"5min":4.6269999999999998,"15min":3.9249999999999998},"min":{"1min":0.32000000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.627,"5min":500.82999999999998,"15min":500.82999999999998},"last":0.44}]}]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1067332,"kb_used_data":18748,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93304508,"statfs":{"total":96636764160,"available":95543816192,"internally_reserved":1073741824,"allocated":19197952,"data_stored":30923353,"data_compressed":5307282,"data_compressed_allocated":11923456,"data_compressed_original":23846912,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.27300000000000002,"15min":2.2810000000000001},"min":{"1min":0.19700000000000001,"5min":0.14499999999999999,"15min":0.13800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":568.56600000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":7.7709999999999999,"5min":7.9050000000000002,"15min":7.3879999999999999},"min":{"1min":0.183,"5min":0.17999999999999999,"15min":0.16200000000000001},"max":{"1min":119.66500000000001,"5min":311.89699999999999,"15min":400.709},"last":0.27000000000000002}]},{"osd":1,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.314,"15min":13.382},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.41499999999999998,"5min":1.292,"15min":981.71000000000004},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.317,"15min":0.34000000000000002},"min":{"1min":0.188,"5min":0.17599999999999999,"15min":0.17499999999999999},"max":{"1min":0.58899999999999997,"5min":0.97499999999999998,"15min":2.6509999999999998},"last":0.28799999999999998}]},{"osd":3,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":6.8710000000000004,"15min":2.516},"min":{"1min":0.224,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":0.56599999999999995,"5min":438.19499999999999,"15min":438.19499999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.317,"15min":1.3009999999999999},"min":{"1min":0.20599999999999999,"5min":0.192,"15min":0.16500000000000001},"max":{"1min":0.59599999999999997,"5min":0.626,"15min":256.45299999999997},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.69799999999999995},"min":{"1min":0.27500000000000002,"5min":0.249,"15min":0.22900000000000001},"max":{"1min":0.67900000000000005,"5min":0.79000000000000004,"15min":64.497},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":18.603000000000002,"15min":10.135999999999999},"min":{"1min":0.29999999999999999,"5min":0.27400000000000002,"15min":0.24299999999999999},"max":{"1min":0.71799999999999997,"5min":672.15800000000002,"15min":672.15800000000002},"last":0.39300000000000002}]},{"osd":5,"last update":"Fri Apr 9 18:32:18 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":16.571000000000002,"15min":14.084},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.25},"max":{"1min":0.65400000000000003,"5min":944.35000000000002,"15min":944.35000000000002},"last":0.38},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":11.064},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70499999999999996,"5min":1.4630000000000001,"15min":500.64699999999999},"last":0.374}]},{"osd":6,"last update":"Fri Apr 9 18:32:18 2021","interfaces":[{"interface":"back","average":{"1min":62.701999999999998,"5min":12.898,"15min":4.6219999999999999},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.26000000000000001},"max":{"1min":996.5,"5min":996.5,"15min":996.5},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.35999999999999999,"5min":0.28199999999999997,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":1.4750000000000001,"15min":3.6080000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":3.399,"15min":5.5099999999999998},"min":{"1min":0.30199999999999999,"5min":0.27800000000000002,"15min":0.26700000000000002},"max":{"1min":0.64900000000000002,"5min":235.40700000000001,"15min":847.73000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.73099999999999998},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.28399999999999997},"max":{"1min":0.746,"5min":1.486,"15min":63.689999999999998},"last":0.441}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1055928,"kb_used_data":7344,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315912,"statfs":{"total":96636764160,"available":95555493888,"internally_reserved":1073741824,"allocated":7520256,"data_stored":9951799,"data_compressed":1193817,"data_compressed_allocated":2625536,"data_compressed_original":5251072,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.29999999999999999,"15min":10.824},"min":{"1min":0.17899999999999999,"5min":0.16400000000000001,"15min":0.13900000000000001},"max":{"1min":0.48399999999999999,"5min":1.875,"15min":790.36000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":54.048999999999999,"5min":12.827999999999999,"15min":6.7439999999999998},"min":{"1min":0.17699999999999999,"5min":0.154,"15min":0.14699999999999999},"max":{"1min":914.44100000000003,"5min":914.44100000000003,"15min":914.44100000000003},"last":0.28199999999999997}]},{"osd":1,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.29999999999999999,"15min":3.7850000000000001},"min":{"1min":0.21199999999999999,"5min":0.16,"15min":0.158},"max":{"1min":0.59299999999999997,"5min":0.78400000000000003,"15min":565.56600000000003},"last":0.315},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":5.2050000000000001},"min":{"1min":0.20000000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.92400000000000004,"5min":2.2200000000000002,"15min":500.68299999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":30.271999999999998,"5min":6.3390000000000004,"15min":9.8849999999999998},"min":{"1min":0.23999999999999999,"5min":0.20699999999999999,"15min":0.19800000000000001},"max":{"1min":509.69499999999999,"5min":509.69499999999999,"15min":742.48699999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.36199999999999999,"15min":4.8029999999999999},"min":{"1min":0.221,"5min":0.19,"15min":0.19},"max":{"1min":0.89700000000000002,"5min":2.2519999999999998,"15min":500.53899999999999},"last":0.247}]},{"osd":4,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":2.3490000000000002,"15min":14.544},"min":{"1min":0.28499999999999998,"5min":0.252,"15min":0.23400000000000001},"max":{"1min":0.56999999999999995,"5min":113.149,"15min":959.31799999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":11.412000000000001,"15min":5.1050000000000004},"min":{"1min":0.29999999999999999,"5min":0.246,"15min":0.22700000000000001},"max":{"1min":15.391,"5min":973.16399999999999,"15min":973.16399999999999},"last":0.45700000000000002}]},{"osd":5,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":5.4649999999999999,"15min":4.3570000000000002},"min":{"1min":0.31900000000000001,"5min":0.26700000000000002,"15min":0.22800000000000001},"max":{"1min":0.88300000000000001,"5min":500.66699999999997,"15min":728.46199999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.442,"5min":15.743,"15min":11.685},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.752,"5min":884.28700000000003,"15min":884.28700000000003},"last":0.34899999999999998}]},{"osd":6,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":25.808,"5min":7.75,"15min":3.673},"min":{"1min":0.33400000000000002,"5min":0.251,"15min":0.251},"max":{"1min":430.43400000000003,"5min":430.43400000000003,"15min":430.43400000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.5,"5min":15.512,"15min":17.364000000000001},"min":{"1min":0.33500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72999999999999998,"5min":975.39700000000005,"15min":975.39700000000005},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Apr 9 18:32:12 2021","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50900000000000001,"15min":6.6219999999999999},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.27300000000000002},"max":{"1min":0.93000000000000005,"5min":2.371,"15min":830.30999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.27800000000000002},"max":{"1min":0.90400000000000003,"5min":1.218,"15min":3.5550000000000002},"last":0.378}]}]}]}} 2021-04-09T18:33:06.118 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2021-04-09 18:19:47.641887 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=47, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.119 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-04-09 18:19:50.657332 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=50, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.119 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2021-04-09 18:19:53.665748 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=53, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.119 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2021-04-09 18:19:47.641887 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=47, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.120 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-04-09 18:19:50.657332 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=50, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.120 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2021-04-09 18:19:53.665748 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=53, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.120 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2021-04-09 18:19:53.665748 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=53, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.121 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2021-04-09 18:19:47.641887 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=47, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.121 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-04-09 18:19:50.657332 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=50, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.121 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2021-04-09 18:19:53.665748 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=53, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.122 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-04-09 18:19:50.657332 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=50, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.122 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-04-09 18:19:47.641887 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=47, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.122 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-04-09 18:19:50.657332 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=50, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.123 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2021-04-09 18:19:53.665748 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=53, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.123 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2021-04-09 18:19:47.641887 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=47, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.123 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-04-09 18:19:50.657332 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=50, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.124 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2021-04-09 18:19:53.665748 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=53, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.124 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2021-04-09 18:19:47.641887 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=47, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.124 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2021-04-09 18:19:53.665748 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=53, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.125 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-04-09 18:19:50.657332 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=50, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.125 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2021-04-09 18:19:53.665748 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=19, tm_sec=53, tm_wday=4, tm_yday=99, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=9, tm_hour=18, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=99, tm_isdst=0) 2021-04-09T18:33:06.125 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-04-09T18:33:12.104 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:12.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:26.126 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-04-09T18:33:26.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.282 7fdec2120700 1 Processor -- start 2021-04-09T18:33:26.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.282 7fdec2120700 1 -- start start 2021-04-09T18:33:26.288 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdec2120700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdebc0d7160 0x7fdebc0d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdec2120700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdebc0d6190 0x7fdebc0d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdec2120700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdebc0d6be0 con 0x7fdebc0d55a0 2021-04-09T18:33:26.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdec2120700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdebc0d80f0 con 0x7fdebc0d6190 2021-04-09T18:33:26.289 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdec2120700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdebc1a2ac0 con 0x7fdebc0d7160 2021-04-09T18:33:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebbfff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdebc0d6190 0x7fdebc0d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebbfff700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdebc0d6190 0x7fdebc0d6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60458/0 (socket says 172.21.15.120:60458) 2021-04-09T18:33:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebbfff700 1 -- 172.21.15.120:0/304112165 learned_addr learned my addr 172.21.15.120:0/304112165 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebb7fe700 1 --2- 172.21.15.120:0/304112165 >> v2:172.21.15.134:3300/0 conn(0x7fdebc0d7160 0x7fdebc0d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebbfff700 1 -- 172.21.15.120:0/304112165 >> v2:172.21.15.134:3300/0 conn(0x7fdebc0d7160 msgr2=0x7fdebc0d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebbfff700 1 --2- 172.21.15.120:0/304112165 >> v2:172.21.15.134:3300/0 conn(0x7fdebc0d7160 0x7fdebc0d7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebbfff700 1 -- 172.21.15.120:0/304112165 >> v1:172.21.15.134:6789/0 conn(0x7fdebc0d55a0 legacy=0x7fdebc0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebbfff700 1 -- 172.21.15.120:0/304112165 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc1ac1f0 con 0x7fdebc0d6190 2021-04-09T18:33:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebb7fe700 1 --2- 172.21.15.120:0/304112165 >> v2:172.21.15.134:3300/0 conn(0x7fdebc0d7160 0x7fdebc0d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-04-09T18:33:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.283 7fdebbfff700 1 --2- 172.21.15.120:0/304112165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc0d6190 0x7fdebc0d6590 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fdeb4006b80 tx=0x7fdeb4009b90).ready entity=mon.0 client_cookie=d60b13e58a659ce2 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdeba7fc700 1 -- 172.21.15.120:0/304112165 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdeb40022e0 con 0x7fdebc0d6190 2021-04-09T18:33:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdeba7fc700 1 -- 172.21.15.120:0/304112165 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4002620 con 0x7fdebc0d6190 2021-04-09T18:33:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdeba7fc700 1 -- 172.21.15.120:0/304112165 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdeb4002b00 con 0x7fdebc0d6190 2021-04-09T18:33:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdec2120700 1 -- 172.21.15.120:0/304112165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc0d6190 msgr2=0x7fdebc0d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdec2120700 1 --2- 172.21.15.120:0/304112165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc0d6190 0x7fdebc0d6590 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fdeb4006b80 tx=0x7fdeb4009b90).stop 2021-04-09T18:33:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdec2120700 1 -- 172.21.15.120:0/304112165 shutdown_connections 2021-04-09T18:33:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdec2120700 1 --2- 172.21.15.120:0/304112165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc0d6190 0x7fdebc0d6590 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdec2120700 1 --2- 172.21.15.120:0/304112165 >> v2:172.21.15.134:3300/0 conn(0x7fdebc0d7160 0x7fdebc0d7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdec2120700 1 -- 172.21.15.120:0/304112165 >> 172.21.15.120:0/304112165 conn(0x7fdebc0d1590 msgr2=0x7fdebc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.284 7fdec2120700 1 -- 172.21.15.120:0/304112165 shutdown_connections 2021-04-09T18:33:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.285 7fdec2120700 1 -- 172.21.15.120:0/304112165 wait complete. 2021-04-09T18:33:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.303 7fdec2120700 1 Processor -- start 2021-04-09T18:33:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.303 7fdec2120700 1 -- start start 2021-04-09T18:33:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdec2120700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc184550 0x7fdebc183710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdec2120700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc18a140 0x7fdebc0ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdec2120700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc17c1f0 0x7fdebc0acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdec2120700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc183fd0 con 0x7fdebc17c1f0 2021-04-09T18:33:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdec2120700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc183d30 con 0x7fdebc184550 2021-04-09T18:33:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdec2120700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0ad270 con 0x7fdebc18a140 2021-04-09T18:33:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebbfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc17c1f0 0x7fdebc0acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebbfff700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc17c1f0 0x7fdebc0acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60462/0 (socket says 172.21.15.120:60462) 2021-04-09T18:33:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebbfff700 1 -- 172.21.15.120:0/228912234 learned_addr learned my addr 172.21.15.120:0/228912234 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebb7fe700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc184550 0x7fdebc183710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebaffd700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc18a140 0x7fdebc0ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebbfff700 1 -- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc18a140 msgr2=0x7fdebc0ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebbfff700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc18a140 0x7fdebc0ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebbfff700 1 -- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc184550 msgr2=0x7fdebc183710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebbfff700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc184550 0x7fdebc183710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebbfff700 1 -- 172.21.15.120:0/228912234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc0ad490 con 0x7fdebc17c1f0 2021-04-09T18:33:26.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdebbfff700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc17c1f0 0x7fdebc0acc50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fdeb4006f10 tx=0x7fdeb400b8e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdeb3fff700 1 -- 172.21.15.120:0/228912234 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdeb4000b90 con 0x7fdebc17c1f0 2021-04-09T18:33:26.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdeb3fff700 1 -- 172.21.15.120:0/228912234 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb400bcd0 con 0x7fdebc17c1f0 2021-04-09T18:33:26.302 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdeb3fff700 1 -- 172.21.15.120:0/228912234 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdeb4000b90 con 0x7fdebc17c1f0 2021-04-09T18:33:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.304 7fdec2120700 1 -- 172.21.15.120:0/228912234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdebc0ad490 con 0x7fdebc17c1f0 2021-04-09T18:33:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.305 7fdec2120700 1 -- 172.21.15.120:0/228912234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdebc0ad490 con 0x7fdebc17c1f0 2021-04-09T18:33:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.305 7fdeb3fff700 1 -- 172.21.15.120:0/228912234 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fdeb40054a0 con 0x7fdebc17c1f0 2021-04-09T18:33:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.305 7fdeb3fff700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdea0018930 0x7fdea001ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.304 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.305 7fdeb3fff700 1 -- 172.21.15.120:0/228912234 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fdeb4032e00 con 0x7fdebc17c1f0 2021-04-09T18:33:26.304 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.305 7fdebb7fe700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdea0018930 0x7fdea001ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.304 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.306 7fdebb7fe700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdea0018930 0x7fdea001ae10 crc :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.329 7fdec2120700 1 -- 172.21.15.120:0/228912234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdebc17a6c0 con 0x7fdebc17c1f0 2021-04-09T18:33:26.317 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.332 7fdeb3fff700 1 -- 172.21.15.120:0/228912234 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fdeb4009310 con 0x7fdebc17c1f0 2021-04-09T18:33:26.495 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.510 7fdec2120700 1 -- 172.21.15.120:0/228912234 --> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fdebc183d30 con 0x7fdea0018930 2021-04-09T18:33:26.498 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.514 7fdeb3fff700 1 -- 172.21.15.120:0/228912234 <== mgr.4106 v2:172.21.15.134:6800/23529 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+101593 (crc 0 0 0) 0x7fdea4000ce0 con 0x7fdea0018930 2021-04-09T18:33:26.502 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2021-04-09T18:33:26.504 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T18:33:26.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 -- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdea0018930 msgr2=0x7fdea001ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdea0018930 0x7fdea001ae10 crc :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.505 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 -- 172.21.15.120:0/228912234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc17c1f0 msgr2=0x7fdebc0acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc17c1f0 0x7fdebc0acc50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fdeb4006f10 tx=0x7fdeb400b8e0).stop 2021-04-09T18:33:26.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 -- 172.21.15.120:0/228912234 shutdown_connections 2021-04-09T18:33:26.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdebc17c1f0 0x7fdebc0acc50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.506 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fdea0018930 0x7fdea001ae10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdebc18a140 0x7fdebc0ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 --2- 172.21.15.120:0/228912234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdebc184550 0x7fdebc183710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 -- 172.21.15.120:0/228912234 >> 172.21.15.120:0/228912234 conn(0x7fdebc184a20 msgr2=0x7fdebc189230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 -- 172.21.15.120:0/228912234 shutdown_connections 2021-04-09T18:33:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.519 7fdec2120700 1 -- 172.21.15.120:0/228912234 wait complete. 2021-04-09T18:33:26.515 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2021-04-09 18:33:24.912174","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":155716345,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":14381,"num_read_kb":2102932,"num_write":36489,"num_write_kb":4615424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38093,"ondisk_log_size":38093,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8584880,"kb_used_data":196208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746389840,"statfs":{"total":773094113280,"available":764303196160,"internally_reserved":8589934592,"allocated":200916992,"data_stored":312515434,"data_compressed":50837928,"data_compressed_allocated":113205248,"data_compressed_original":226410368,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002462"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:18.884404","last_change":"2021-04-09 18:33:18.884468","last_active":"2021-04-09 18:33:18.884404","last_peered":"2021-04-09 18:33:18.884404","last_clean":"2021-04-09 18:33:18.884404","last_became_active":"2021-04-09 18:19:48.658812","last_became_peered":"2021-04-09 18:19:48.658812","last_unstale":"2021-04-09 18:33:18.884404","last_undegraded":"2021-04-09 18:33:18.884404","last_fullsized":"2021-04-09 18:33:18.884404","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:18.884404","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:18.884404","last_clean_scrub_stamp":"2021-04-09 18:33:18.884404","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"30'1624","reported_seq":"1698","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:05.068413","last_change":"2021-04-09 18:33:05.068450","last_active":"2021-04-09 18:33:05.068413","last_peered":"2021-04-09 18:33:05.068413","last_clean":"2021-04-09 18:33:05.068413","last_became_active":"2021-04-09 18:19:51.674416","last_became_peered":"2021-04-09 18:19:51.674416","last_unstale":"2021-04-09 18:33:05.068413","last_undegraded":"2021-04-09 18:33:05.068413","last_fullsized":"2021-04-09 18:33:05.068413","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1624","last_scrub_stamp":"2021-04-09 18:33:05.068413","last_deep_scrub":"30'1624","last_deep_scrub_stamp":"2021-04-09 18:33:05.068413","last_clean_scrub_stamp":"2021-04-09 18:33:05.068413","log_size":1624,"ondisk_log_size":1624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16777850,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":83,"num_read_kb":62902,"num_write":1388,"num_write_kb":17176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'3134","reported_seq":"4732","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:19.202931","last_change":"2021-04-09 18:33:19.202979","last_active":"2021-04-09 18:33:19.202931","last_peered":"2021-04-09 18:33:19.202931","last_clean":"2021-04-09 18:33:19.202931","last_became_active":"2021-04-09 18:19:54.682305","last_became_peered":"2021-04-09 18:19:54.682305","last_unstale":"2021-04-09 18:33:19.202931","last_undegraded":"2021-04-09 18:33:19.202931","last_fullsized":"2021-04-09 18:33:19.202931","mapping_epoch":20,"log_start":"23'100","ondisk_log_start":"23'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3134","last_scrub_stamp":"2021-04-09 18:33:19.202930","last_deep_scrub":"30'3134","last_deep_scrub_stamp":"2021-04-09 18:33:19.202930","last_clean_scrub_stamp":"2021-04-09 18:33:19.202930","log_size":3034,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1576,"num_read_kb":167745,"num_write":2984,"num_write_kb":612887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:11.973554","last_change":"2021-04-09 18:33:11.973619","last_active":"2021-04-09 18:33:11.973554","last_peered":"2021-04-09 18:33:11.973554","last_clean":"2021-04-09 18:33:11.973554","last_became_active":"2021-04-09 18:19:48.658917","last_became_peered":"2021-04-09 18:19:48.658917","last_unstale":"2021-04-09 18:33:11.973554","last_undegraded":"2021-04-09 18:33:11.973554","last_fullsized":"2021-04-09 18:33:11.973554","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:11.973553","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:11.973553","last_clean_scrub_stamp":"2021-04-09 18:33:11.973553","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'2472","reported_seq":"2557","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:09.276182","last_change":"2021-04-09 18:33:09.276218","last_active":"2021-04-09 18:33:09.276182","last_peered":"2021-04-09 18:33:09.276182","last_clean":"2021-04-09 18:33:09.276182","last_became_active":"2021-04-09 18:19:51.674681","last_became_peered":"2021-04-09 18:19:51.674681","last_unstale":"2021-04-09 18:33:09.276182","last_undegraded":"2021-04-09 18:33:09.276182","last_fullsized":"2021-04-09 18:33:09.276182","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2472","last_scrub_stamp":"2021-04-09 18:33:09.276182","last_deep_scrub":"30'2472","last_deep_scrub_stamp":"2021-04-09 18:33:09.276182","last_clean_scrub_stamp":"2021-04-09 18:33:09.276182","log_size":2472,"ondisk_log_size":2472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165984,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":94,"num_read_kb":122944,"num_write":2221,"num_write_kb":25929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'3105","reported_seq":"4749","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:14.936974","last_change":"2021-04-09 18:33:14.937037","last_active":"2021-04-09 18:33:14.936974","last_peered":"2021-04-09 18:33:14.936974","last_clean":"2021-04-09 18:33:14.936974","last_became_active":"2021-04-09 18:19:54.680726","last_became_peered":"2021-04-09 18:19:54.680726","last_unstale":"2021-04-09 18:33:14.936974","last_undegraded":"2021-04-09 18:33:14.936974","last_fullsized":"2021-04-09 18:33:14.936974","mapping_epoch":20,"log_start":"23'100","ondisk_log_start":"23'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3105","last_scrub_stamp":"2021-04-09 18:33:14.936974","last_deep_scrub":"30'3105","last_deep_scrub_stamp":"2021-04-09 18:33:14.936974","last_clean_scrub_stamp":"2021-04-09 18:33:14.936974","log_size":3005,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1622,"num_read_kb":187246,"num_write":2949,"num_write_kb":537587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"30'3074","reported_seq":"4788","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:09.811054","last_change":"2021-04-09 18:33:09.811105","last_active":"2021-04-09 18:33:09.811054","last_peered":"2021-04-09 18:33:09.811054","last_clean":"2021-04-09 18:33:09.811054","last_became_active":"2021-04-09 18:19:54.679793","last_became_peered":"2021-04-09 18:19:54.679793","last_unstale":"2021-04-09 18:33:09.811054","last_undegraded":"2021-04-09 18:33:09.811054","last_fullsized":"2021-04-09 18:33:09.811054","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3074","last_scrub_stamp":"2021-04-09 18:33:09.811054","last_deep_scrub":"30'3074","last_deep_scrub_stamp":"2021-04-09 18:33:09.811054","last_clean_scrub_stamp":"2021-04-09 18:33:09.811054","log_size":3074,"ondisk_log_size":3074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1692,"num_read_kb":232958,"num_write":2932,"num_write_kb":526773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:04.189959","last_change":"2021-04-09 18:33:04.190017","last_active":"2021-04-09 18:33:04.189959","last_peered":"2021-04-09 18:33:04.189959","last_clean":"2021-04-09 18:33:04.189959","last_became_active":"2021-04-09 18:19:48.670077","last_became_peered":"2021-04-09 18:19:48.670077","last_unstale":"2021-04-09 18:33:04.189959","last_undegraded":"2021-04-09 18:33:04.189959","last_fullsized":"2021-04-09 18:33:04.189959","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:04.189959","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:04.189959","last_clean_scrub_stamp":"2021-04-09 18:33:04.189959","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'1663","reported_seq":"1715","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:07.976513","last_change":"2021-04-09 18:33:07.976545","last_active":"2021-04-09 18:33:07.976513","last_peered":"2021-04-09 18:33:07.976513","last_clean":"2021-04-09 18:33:07.976513","last_became_active":"2021-04-09 18:19:51.668425","last_became_peered":"2021-04-09 18:19:51.668425","last_unstale":"2021-04-09 18:33:07.976513","last_undegraded":"2021-04-09 18:33:07.976513","last_fullsized":"2021-04-09 18:33:07.976513","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1663","last_scrub_stamp":"2021-04-09 18:33:07.976512","last_deep_scrub":"30'1663","last_deep_scrub_stamp":"2021-04-09 18:33:07.976512","last_clean_scrub_stamp":"2021-04-09 18:33:07.976512","log_size":1663,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":54038,"num_write":1625,"num_write_kb":14281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"30'3405","reported_seq":"5212","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:06.489617","last_change":"2021-04-09 18:33:06.489667","last_active":"2021-04-09 18:33:06.489617","last_peered":"2021-04-09 18:33:06.489617","last_clean":"2021-04-09 18:33:06.489617","last_became_active":"2021-04-09 18:19:54.678420","last_became_peered":"2021-04-09 18:19:54.678420","last_unstale":"2021-04-09 18:33:06.489617","last_undegraded":"2021-04-09 18:33:06.489617","last_fullsized":"2021-04-09 18:33:06.489617","mapping_epoch":20,"log_start":"23'400","ondisk_log_start":"23'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3405","last_scrub_stamp":"2021-04-09 18:33:06.489617","last_deep_scrub":"30'3405","last_deep_scrub_stamp":"2021-04-09 18:33:06.489617","last_clean_scrub_stamp":"2021-04-09 18:33:06.489617","log_size":3005,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1785,"num_read_kb":229797,"num_write":3237,"num_write_kb":745712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:03.809772","last_change":"2021-04-09 18:33:03.809822","last_active":"2021-04-09 18:33:03.809772","last_peered":"2021-04-09 18:33:03.809772","last_clean":"2021-04-09 18:33:03.809772","last_became_active":"2021-04-09 18:19:48.660038","last_became_peered":"2021-04-09 18:19:48.660038","last_unstale":"2021-04-09 18:33:03.809772","last_undegraded":"2021-04-09 18:33:03.809772","last_fullsized":"2021-04-09 18:33:03.809772","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:03.809772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:03.809772","last_clean_scrub_stamp":"2021-04-09 18:33:03.809772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"30'1244","reported_seq":"1312","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:21.980756","last_change":"2021-04-09 18:33:21.980796","last_active":"2021-04-09 18:33:21.980756","last_peered":"2021-04-09 18:33:21.980756","last_clean":"2021-04-09 18:33:21.980756","last_became_active":"2021-04-09 18:19:51.670767","last_became_peered":"2021-04-09 18:19:51.670767","last_unstale":"2021-04-09 18:33:21.980756","last_undegraded":"2021-04-09 18:33:21.980756","last_fullsized":"2021-04-09 18:33:21.980756","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1244","last_scrub_stamp":"2021-04-09 18:33:21.980756","last_deep_scrub":"30'1244","last_deep_scrub_stamp":"2021-04-09 18:33:21.980756","last_clean_scrub_stamp":"2021-04-09 18:33:21.980756","log_size":1244,"ondisk_log_size":1244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12583478,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":77,"num_read_kb":49216,"num_write":1015,"num_write_kb":12937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:06.149290","last_change":"2021-04-09 18:33:06.149350","last_active":"2021-04-09 18:33:06.149290","last_peered":"2021-04-09 18:33:06.149290","last_clean":"2021-04-09 18:33:06.149290","last_became_active":"2021-04-09 18:19:48.668225","last_became_peered":"2021-04-09 18:19:48.668225","last_unstale":"2021-04-09 18:33:06.149290","last_undegraded":"2021-04-09 18:33:06.149290","last_fullsized":"2021-04-09 18:33:06.149290","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:06.149289","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:06.149289","last_clean_scrub_stamp":"2021-04-09 18:33:06.149289","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"30'825","reported_seq":"906","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:15.253646","last_change":"2021-04-09 18:33:15.253680","last_active":"2021-04-09 18:33:15.253646","last_peered":"2021-04-09 18:33:15.253646","last_clean":"2021-04-09 18:33:15.253646","last_became_active":"2021-04-09 18:19:51.675161","last_became_peered":"2021-04-09 18:19:51.675161","last_unstale":"2021-04-09 18:33:15.253646","last_undegraded":"2021-04-09 18:33:15.253646","last_fullsized":"2021-04-09 18:33:15.253646","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'825","last_scrub_stamp":"2021-04-09 18:33:15.253645","last_deep_scrub":"30'825","last_deep_scrub_stamp":"2021-04-09 18:33:15.253645","last_clean_scrub_stamp":"2021-04-09 18:33:15.253645","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":82,"num_read_kb":135240,"num_write":591,"num_write_kb":20834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'3228","reported_seq":"4843","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:07.827313","last_change":"2021-04-09 18:33:07.827392","last_active":"2021-04-09 18:33:07.827313","last_peered":"2021-04-09 18:33:07.827313","last_clean":"2021-04-09 18:33:07.827313","last_became_active":"2021-04-09 18:19:54.679654","last_became_peered":"2021-04-09 18:19:54.679654","last_unstale":"2021-04-09 18:33:07.827313","last_undegraded":"2021-04-09 18:33:07.827313","last_fullsized":"2021-04-09 18:33:07.827313","mapping_epoch":20,"log_start":"23'200","ondisk_log_start":"23'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3228","last_scrub_stamp":"2021-04-09 18:33:07.827312","last_deep_scrub":"30'3228","last_deep_scrub_stamp":"2021-04-09 18:33:07.827312","last_clean_scrub_stamp":"2021-04-09 18:33:07.827312","log_size":3028,"ondisk_log_size":3028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1593,"num_read_kb":140394,"num_write":3081,"num_write_kb":627737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:05.092310","last_change":"2021-04-09 18:33:05.092365","last_active":"2021-04-09 18:33:05.092310","last_peered":"2021-04-09 18:33:05.092310","last_clean":"2021-04-09 18:33:05.092310","last_became_active":"2021-04-09 18:19:48.658788","last_became_peered":"2021-04-09 18:19:48.658788","last_unstale":"2021-04-09 18:33:05.092310","last_undegraded":"2021-04-09 18:33:05.092310","last_fullsized":"2021-04-09 18:33:05.092310","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:05.092309","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:05.092309","last_clean_scrub_stamp":"2021-04-09 18:33:05.092309","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"30'1938","reported_seq":"1996","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:10.164134","last_change":"2021-04-09 18:33:10.164165","last_active":"2021-04-09 18:33:10.164134","last_peered":"2021-04-09 18:33:10.164134","last_clean":"2021-04-09 18:33:10.164134","last_became_active":"2021-04-09 18:19:51.674810","last_became_peered":"2021-04-09 18:19:51.674810","last_unstale":"2021-04-09 18:33:10.164134","last_undegraded":"2021-04-09 18:33:10.164134","last_fullsized":"2021-04-09 18:33:10.164134","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1938","last_scrub_stamp":"2021-04-09 18:33:10.164134","last_deep_scrub":"30'1938","last_deep_scrub_stamp":"2021-04-09 18:33:10.164134","last_clean_scrub_stamp":"2021-04-09 18:33:10.164134","log_size":1938,"ondisk_log_size":1938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":133210,"num_write":1688,"num_write_kb":25534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"30'3187","reported_seq":"4800","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:05.205674","last_change":"2021-04-09 18:33:05.205728","last_active":"2021-04-09 18:33:05.205674","last_peered":"2021-04-09 18:33:05.205674","last_clean":"2021-04-09 18:33:05.205674","last_became_active":"2021-04-09 18:19:54.679836","last_became_peered":"2021-04-09 18:19:54.679836","last_unstale":"2021-04-09 18:33:05.205674","last_undegraded":"2021-04-09 18:33:05.205674","last_fullsized":"2021-04-09 18:33:05.205674","mapping_epoch":20,"log_start":"23'100","ondisk_log_start":"23'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3187","last_scrub_stamp":"2021-04-09 18:33:05.205674","last_deep_scrub":"30'3187","last_deep_scrub_stamp":"2021-04-09 18:33:05.205674","last_clean_scrub_stamp":"2021-04-09 18:33:05.205674","log_size":3087,"ondisk_log_size":3087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1591,"num_read_kb":159111,"num_write":3021,"num_write_kb":405224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"30'1644","reported_seq":"2321","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:03.564073","last_change":"2021-04-09 18:33:03.564143","last_active":"2021-04-09 18:33:03.564073","last_peered":"2021-04-09 18:33:03.564073","last_clean":"2021-04-09 18:33:03.564073","last_became_active":"2021-04-09 18:19:51.679689","last_became_peered":"2021-04-09 18:19:51.679689","last_unstale":"2021-04-09 18:33:03.564073","last_undegraded":"2021-04-09 18:33:03.564073","last_fullsized":"2021-04-09 18:33:03.564073","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1644","last_scrub_stamp":"2021-04-09 18:33:03.564073","last_deep_scrub":"30'1644","last_deep_scrub_stamp":"2021-04-09 18:33:03.564073","last_clean_scrub_stamp":"2021-04-09 18:33:03.564073","log_size":1644,"ondisk_log_size":1644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9816456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":654,"num_read_kb":13580,"num_write":1392,"num_write_kb":10592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:07.148916","last_change":"2021-04-09 18:33:07.148978","last_active":"2021-04-09 18:33:07.148916","last_peered":"2021-04-09 18:33:07.148916","last_clean":"2021-04-09 18:33:07.148916","last_became_active":"2021-04-09 18:19:48.668474","last_became_peered":"2021-04-09 18:19:48.668474","last_unstale":"2021-04-09 18:33:07.148916","last_undegraded":"2021-04-09 18:33:07.148916","last_fullsized":"2021-04-09 18:33:07.148916","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:07.148916","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:07.148916","last_clean_scrub_stamp":"2021-04-09 18:33:07.148916","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"30'3348","reported_seq":"5064","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:09.880915","last_change":"2021-04-09 18:33:09.880966","last_active":"2021-04-09 18:33:09.880915","last_peered":"2021-04-09 18:33:09.880915","last_clean":"2021-04-09 18:33:09.880915","last_became_active":"2021-04-09 18:19:54.680877","last_became_peered":"2021-04-09 18:19:54.680877","last_unstale":"2021-04-09 18:33:09.880915","last_undegraded":"2021-04-09 18:33:09.880915","last_fullsized":"2021-04-09 18:33:09.880915","mapping_epoch":20,"log_start":"23'300","ondisk_log_start":"23'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3348","last_scrub_stamp":"2021-04-09 18:33:09.880915","last_deep_scrub":"30'3348","last_deep_scrub_stamp":"2021-04-09 18:33:09.880915","last_clean_scrub_stamp":"2021-04-09 18:33:09.880915","log_size":3048,"ondisk_log_size":3048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1694,"num_read_kb":164019,"num_write":3172,"num_write_kb":529088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"30'2373","reported_seq":"2464","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:08.287874","last_change":"2021-04-09 18:33:08.287912","last_active":"2021-04-09 18:33:08.287874","last_peered":"2021-04-09 18:33:08.287874","last_clean":"2021-04-09 18:33:08.287874","last_became_active":"2021-04-09 18:19:51.674771","last_became_peered":"2021-04-09 18:19:51.674771","last_unstale":"2021-04-09 18:33:08.287874","last_undegraded":"2021-04-09 18:33:08.287874","last_fullsized":"2021-04-09 18:33:08.287874","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2373","last_scrub_stamp":"2021-04-09 18:33:08.287873","last_deep_scrub":"30'2373","last_deep_scrub_stamp":"2021-04-09 18:33:08.287873","last_clean_scrub_stamp":"2021-04-09 18:33:08.287873","log_size":2373,"ondisk_log_size":2373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32652287,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":132,"num_read_kb":131070,"num_write":2126,"num_write_kb":33047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:03.049273","last_change":"2021-04-09 18:33:03.049321","last_active":"2021-04-09 18:33:03.049273","last_peered":"2021-04-09 18:33:03.049273","last_clean":"2021-04-09 18:33:03.049273","last_became_active":"2021-04-09 18:19:48.660180","last_became_peered":"2021-04-09 18:19:48.660180","last_unstale":"2021-04-09 18:33:03.049273","last_undegraded":"2021-04-09 18:33:03.049273","last_fullsized":"2021-04-09 18:33:03.049273","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-04-09 18:33:03.049272","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-04-09 18:33:03.049272","last_clean_scrub_stamp":"2021-04-09 18:33:03.049272","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"30'3229","reported_seq":"4869","reported_epoch":"30","state":"active+clean","last_fresh":"2021-04-09 18:33:05.460740","last_change":"2021-04-09 18:33:05.460792","last_active":"2021-04-09 18:33:05.460740","last_peered":"2021-04-09 18:33:05.460740","last_clean":"2021-04-09 18:33:05.460740","last_became_active":"2021-04-09 18:19:54.679420","last_became_peered":"2021-04-09 18:19:54.679420","last_unstale":"2021-04-09 18:33:05.460740","last_undegraded":"2021-04-09 18:33:05.460740","last_fullsized":"2021-04-09 18:33:05.460740","mapping_epoch":20,"log_start":"23'200","ondisk_log_start":"23'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3229","last_scrub_stamp":"2021-04-09 18:33:05.460739","last_deep_scrub":"30'3229","last_deep_scrub_stamp":"2021-04-09 18:33:05.460739","last_clean_scrub_stamp":"2021-04-09 18:33:05.460739","log_size":3029,"ondisk_log_size":3029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1618,"num_read_kb":119462,"num_write":3067,"num_write_kb":470086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13171,"num_read_kb":1400732,"num_write":24443,"num_write_kb":4455094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24310,"ondisk_log_size":24310,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":155716345,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1210,"num_read_kb":702200,"num_write":12046,"num_write_kb":160330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":198295552,"data_stored":311432690,"data_compressed":50837928,"data_compressed_allocated":113205248,"data_compressed_original":226410368,"omap_allocated":0,"internal_metadata":0},"log_size":13783,"ondisk_log_size":13783,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575017,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1093440,"kb_used_data":44856,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93278400,"statfs":{"total":96636764160,"available":95517081600,"internally_reserved":1073741824,"allocated":45932544,"data_stored":70537092,"data_compressed":11033403,"data_compressed_allocated":24817664,"data_compressed_original":49635264,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":18.991,"5min":4.141,"15min":7.9960000000000004},"min":{"1min":0.23499999999999999,"5min":0.189,"15min":0.189},"max":{"1min":353.71100000000001,"5min":353.71100000000001,"15min":552.03099999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.39800000000000002,"5min":5.742,"15min":5.2149999999999999},"min":{"1min":0.248,"5min":0.23000000000000001,"15min":0.19500000000000001},"max":{"1min":0.72199999999999998,"5min":582.798,"15min":582.798},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.40899999999999997,"15min":3.7349999999999999},"min":{"1min":0.218,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.68799999999999994,"5min":1.359,"15min":243.08699999999999},"last":20.652999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":16.545000000000002,"15min":9.0990000000000002},"min":{"1min":0.217,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76500000000000001,"5min":974.39400000000001,"15min":974.39400000000001},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":13.374000000000001,"15min":6.5570000000000004},"min":{"1min":0.29199999999999998,"5min":0.27300000000000002,"15min":0.246},"max":{"1min":0.69599999999999995,"5min":603.80899999999997,"15min":603.80899999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":2.472},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.224},"max":{"1min":0.70899999999999996,"5min":1.135,"15min":635.03700000000003},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":15.914999999999999,"15min":10.885},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.623,"5min":959.947,"15min":959.947},"last":0.501},{"interface":"front","average":{"1min":0.44600000000000001,"5min":5.7320000000000002,"15min":4.4909999999999997},"min":{"1min":0.315,"5min":0.29099999999999998,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":501.96600000000001,"15min":545.40899999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":4.4459999999999997,"15min":1.7370000000000001},"min":{"1min":0.219,"5min":0.183,"15min":0.183},"max":{"1min":0.498,"5min":451.887,"15min":451.887},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":3.4969999999999999},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":1.786,"5min":1.984,"15min":676.46900000000005},"last":0.33700000000000002}]},{"osd":5,"last update":"Fri Apr 9 18:33:02 2021","interfaces":[{"interface":"back","average":{"1min":13.151,"5min":2.9500000000000002,"15min":1.25},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":255.71899999999999,"5min":255.71899999999999,"15min":255.71899999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":4.7949999999999999,"15min":4.4889999999999999},"min":{"1min":0.27000000000000002,"5min":0.251,"15min":0.23200000000000001},"max":{"1min":0.78200000000000003,"5min":350.24599999999998,"15min":741.22199999999998},"last":0.372}]},{"osd":6,"last update":"Fri Apr 9 18:33:13 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":6.4909999999999997,"15min":6.2569999999999997},"min":{"1min":0.27800000000000002,"5min":0.217,"15min":0.20999999999999999},"max":{"1min":1.7170000000000001,"5min":610.43899999999996,"15min":766.49300000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40600000000000003,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.79000000000000004,"5min":1.361,"15min":5.4050000000000002},"last":0.441}]}]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1065240,"kb_used_data":16656,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93306600,"statfs":{"total":96636764160,"available":95545958400,"internally_reserved":1073741824,"allocated":17055744,"data_stored":25301733,"data_compressed":3840529,"data_compressed_allocated":8450048,"data_compressed_original":16900032,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:33:13 2021","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":4.0179999999999998,"15min":4.3170000000000002},"min":{"1min":0.222,"5min":0.20399999999999999,"15min":0.17999999999999999},"max":{"1min":0.83399999999999996,"5min":363.27499999999998,"15min":592.09900000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":10.112,"15min":4.2039999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.19700000000000001},"max":{"1min":0.86299999999999999,"5min":728.14300000000003,"15min":728.14300000000003},"last":0.439}]},{"osd":1,"last update":"Fri Apr 9 18:33:13 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.42999999999999999},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.191},"max":{"1min":0.60999999999999999,"5min":0.63500000000000001,"15min":2.3140000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.40300000000000002,"15min":2.8479999999999999},"min":{"1min":0.23999999999999999,"5min":0.22800000000000001,"15min":0.217},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":692.18100000000004},"last":0.372}]},{"osd":2,"last update":"Fri Apr 9 18:33:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":3.6560000000000001,"15min":3.5390000000000001},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":0.874,"5min":212.816,"15min":416.06900000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.307,"5min":0.255,"15min":0.23400000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.665},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Apr 9 18:33:08 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":5.7460000000000004,"15min":5.2400000000000002},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.23100000000000001},"max":{"1min":0.89800000000000002,"5min":532.06899999999996,"15min":860.98099999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":22.210000000000001,"5min":4.7809999999999997,"15min":5.3440000000000003},"min":{"1min":0.29399999999999998,"5min":0.28399999999999997,"15min":0.23699999999999999},"max":{"1min":370.55200000000002,"5min":370.55200000000002,"15min":675.61300000000006},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Apr 9 18:33:13 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34899999999999998,"15min":5.2880000000000003},"min":{"1min":0.20999999999999999,"5min":0.191,"15min":0.17299999999999999},"max":{"1min":0.56799999999999995,"5min":1.1779999999999999,"15min":670.02200000000005},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":25.856000000000002,"15min":14.474},"min":{"1min":0.24199999999999999,"5min":0.23200000000000001,"15min":0.19900000000000001},"max":{"1min":0.84399999999999997,"5min":993.46400000000006,"15min":993.46400000000006},"last":0.246}]},{"osd":5,"last update":"Fri Apr 9 18:33:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":17.521000000000001,"15min":6.8239999999999998},"min":{"1min":0.24299999999999999,"5min":0.215,"15min":0.21299999999999999},"max":{"1min":0.58699999999999997,"5min":865.55600000000004,"15min":865.55600000000004},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":3.0750000000000002},"min":{"1min":0.27700000000000002,"5min":0.249,"15min":0.224},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":924.65300000000002},"last":0.28399999999999997}]},{"osd":7,"last update":"Fri Apr 9 18:33:08 2021","interfaces":[{"interface":"back","average":{"1min":20.158000000000001,"5min":17.388999999999999,"15min":6.4889999999999999},"min":{"1min":0.26100000000000001,"5min":0.23200000000000001,"15min":0.19400000000000001},"max":{"1min":334.87599999999998,"5min":597.70600000000002,"15min":597.70600000000002},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38,"15min":1.3879999999999999},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":195.625},"last":0.27400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575018,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1075676,"kb_used_data":27092,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93296164,"statfs":{"total":96636764160,"available":95535271936,"internally_reserved":1073741824,"allocated":27742208,"data_stored":46272721,"data_compressed":8418247,"data_compressed_allocated":18726912,"data_compressed_original":37453824,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:33:09 2021","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.503},"min":{"1min":0.23100000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.59099999999999997,"5min":1.4630000000000001,"15min":21.654},"last":0.377},{"interface":"front","average":{"1min":0.63,"5min":3.1789999999999998,"15min":3.9289999999999998},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.218},"max":{"1min":3.8849999999999998,"5min":176.75200000000001,"15min":519.08100000000002},"last":0.40999999999999998}]},{"osd":1,"last update":"Fri Apr 9 18:33:09 2021","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.41099999999999998},"min":{"1min":0.22800000000000001,"5min":0.21199999999999999,"15min":0.20399999999999999},"max":{"1min":0.63,"5min":1.2729999999999999,"15min":1.3839999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":7.375,"15min":3.4079999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.19900000000000001},"max":{"1min":1.601,"5min":761.06899999999996,"15min":761.06899999999996},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Apr 9 18:33:09 2021","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":3.6389999999999998,"15min":4.3070000000000004},"min":{"1min":0.27900000000000003,"5min":0.22900000000000001,"15min":0.214},"max":{"1min":1.6419999999999999,"5min":384.24000000000001,"15min":786.34900000000005},"last":0.374},{"interface":"front","average":{"1min":0.50800000000000001,"5min":3.5129999999999999,"15min":1.5109999999999999},"min":{"1min":0.29699999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.806,"5min":335.99200000000002,"15min":335.99200000000002},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Apr 9 18:33:09 2021","interfaces":[{"interface":"back","average":{"1min":56.314,"5min":18.148,"15min":8.9979999999999993},"min":{"1min":0.34699999999999998,"5min":0.217,"15min":0.217},"max":{"1min":950.38900000000001,"5min":950.38900000000001,"15min":950.38900000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.46400000000000002,"15min":13.159000000000001},"min":{"1min":0.33300000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.484,"5min":2.484,"15min":643.62},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Apr 9 18:33:09 2021","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":7.6399999999999997,"15min":2.903},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19},"max":{"1min":1.71,"5min":500.91800000000001,"15min":500.91800000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.40200000000000002,"15min":5.4429999999999996},"min":{"1min":0.26900000000000002,"5min":0.22700000000000001,"15min":0.192},"max":{"1min":1.728,"5min":2.306,"15min":437.25599999999997},"last":0.36799999999999999}]},{"osd":6,"last update":"Fri Apr 9 18:33:09 2021","interfaces":[{"interface":"back","average":{"1min":38.024999999999999,"5min":11.308999999999999,"15min":13.776999999999999},"min":{"1min":0.21199999999999999,"5min":0.20100000000000001,"15min":0.19600000000000001},"max":{"1min":565.61000000000001,"5min":565.61000000000001,"15min":840.71699999999998},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":5.609,"15min":8.3170000000000002},"min":{"1min":0.30199999999999999,"5min":0.24399999999999999,"15min":0.185},"max":{"1min":0.48899999999999999,"5min":575.17200000000003,"15min":681.07500000000005},"last":0.313}]},{"osd":7,"last update":"Fri Apr 9 18:33:10 2021","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":7.0960000000000001,"15min":7.4020000000000001},"min":{"1min":0.29399999999999998,"5min":0.23400000000000001,"15min":0.19800000000000001},"max":{"1min":1.7729999999999999,"5min":703.91499999999996,"15min":703.91499999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":8.9120000000000008,"15min":7.3639999999999999},"min":{"1min":0.27300000000000002,"5min":0.23599999999999999,"15min":0.224},"max":{"1min":0.77800000000000002,"5min":635.601,"15min":635.601},"last":0.29699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575016,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048904,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322936,"statfs":{"total":96636764160,"available":95562686464,"internally_reserved":1073741824,"allocated":327680,"data_stored":135343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:33:18 2021","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":9.3030000000000008},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.184},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":1084.748},"last":0.45500000000000002},{"interface":"front","average":{"1min":45.405000000000001,"5min":9.4049999999999994,"15min":4.1399999999999997},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.23400000000000001},"max":{"1min":810.65599999999995,"5min":810.65599999999995,"15min":810.65599999999995},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Apr 9 18:33:18 2021","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":5.9790000000000001,"15min":2.266},"min":{"1min":0.28499999999999998,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.61199999999999999,"5min":558.18799999999999,"15min":558.18799999999999},"last":0.372},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":5.2720000000000002},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.21299999999999999},"max":{"1min":0.70099999999999996,"5min":1.7549999999999999,"15min":720.49000000000001},"last":0.436}]},{"osd":2,"last update":"Fri Apr 9 18:33:18 2021","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39700000000000002,"15min":6.3789999999999996},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.221},"max":{"1min":0.60299999999999998,"5min":1.655,"15min":1100.546},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":1.2410000000000001,"15min":6.9059999999999997},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.22600000000000001},"max":{"1min":0.68899999999999995,"5min":74.540999999999997,"15min":1100.5699999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Apr 9 18:33:18 2021","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42799999999999999,"15min":3.4500000000000002},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.246},"max":{"1min":0.65800000000000003,"5min":1.5700000000000001,"15min":955.88499999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":77.783000000000001,"5min":17.071999999999999,"15min":5.9850000000000003},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.23899999999999999},"max":{"1min":848.75800000000004,"5min":848.75800000000004,"15min":848.75800000000004},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Apr 9 18:33:18 2021","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":10.071999999999999,"15min":3.7440000000000002},"min":{"1min":0.249,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":0.55300000000000005,"5min":500.57999999999998,"15min":500.57999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.316,"5min":20.698,"15min":9.5890000000000004},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":0.45400000000000001,"5min":904.89400000000001,"15min":904.89400000000001},"last":0.30099999999999999}]},{"osd":6,"last update":"Fri Apr 9 18:33:18 2021","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38200000000000001,"15min":1.204},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.21099999999999999},"max":{"1min":0.66800000000000004,"5min":1.7889999999999999,"15min":235.71000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.377,"5min":5.2939999999999996,"15min":2.008},"min":{"1min":0.22800000000000001,"5min":0.21099999999999999,"15min":0.20899999999999999},"max":{"1min":0.67700000000000005,"5min":492.97000000000003,"15min":492.97000000000003},"last":0.29199999999999998}]},{"osd":7,"last update":"Fri Apr 9 18:33:18 2021","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":3.3959999999999999},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.20899999999999999},"max":{"1min":0.64600000000000002,"5min":1.7270000000000001,"15min":993.75300000000004},"last":0.28100000000000003},{"interface":"front","average":{"1min":27.948,"5min":5.9080000000000004,"15min":2.319},"min":{"1min":0.28100000000000003,"5min":0.253,"15min":0.21199999999999999},"max":{"1min":496.66199999999998,"5min":496.66199999999998,"15min":496.66199999999998},"last":0.251}]}]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1075556,"kb_used_data":26972,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93296284,"statfs":{"total":96636764160,"available":95535394816,"internally_reserved":1073741824,"allocated":27619328,"data_stored":42079177,"data_compressed":6498995,"data_compressed_allocated":14667776,"data_compressed_original":29335552,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 9 18:33:17 2021","interfaces":[{"interface":"back","average":{"1min":36.054000000000002,"5min":7.4409999999999998,"15min":5.2889999999999997},"min":{"1min":0.17899999999999999,"5min":0.17499999999999999,"15min":0.14199999999999999},"max":{"1min":643.93499999999995,"5min":643.93499999999995,"15min":643.93499999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.26700000000000002,"5min":20.943000000000001,"15min":9.7560000000000002},"min":{"1min":0.157,"5min":0.157,"15min":0.152},"max":{"1min":0.46400000000000002,"5min":949.67999999999995,"15min":980.14200000000005},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Apr 9 18:33:17 2021","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.309,"15min":7.7949999999999999},"min":{"1min":0.19400000000000001,"5min":0.18099999999999999,"15min":0.159},"max":{"1min":0.45600000000000002,"5min":1.1080000000000001,"15min":935.36599999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":40.463999999999999,"5min":17.216000000000001,"15min":9.5020000000000007},"min":{"1min":0.22600000000000001,"5min":0.18099999999999999,"15min":0.16600000000000001},"max":{"1min":723.14300000000003,"5min":723.14300000000003,"15min":763.25900000000001},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Apr 9 18:33:17 2021","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":4.7309999999999999,"15min":2.2269999999999999},"min":{"1min":0.20399999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.49099999999999999,"5min":374.58499999999998,"15min":374.58499999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.35699999999999998,"15min":6.2350000000000003},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.159},"max":{"1min":1.0760000000000001,"5min":1.52,"15min":706.14999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Apr 9 18:33:17 2021","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":4.8600000000000003,"15min":5.7210000000000001},"min":{"1min":0.25800000000000001,"5min":0.24399999999999999,"15min":0.23000000000000001},"max":{"1min":0.73299999999999998,"5min":356.02300000000002,"15min":797.23199999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":20.712,"15min":9.8919999999999995},"min":{"1min":0.28699999999999998,"5min":0.25600000000000001,"15min":0.23799999999999999},"max":{"1min":1.288,"5min":926.05899999999997,"15min":926.05899999999997},"last":0.627}]},{"osd":5,"last update":"Fri Apr 9 18:33:12 2021","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":10.505000000000001,"15min":5.1180000000000003},"min":{"1min":0.27900000000000003,"5min":0.255,"15min":0.255},"max":{"1min":1.863,"5min":855.36000000000001,"15min":855.36000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.44600000000000001,"15min":4.0540000000000003},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":0.66800000000000004,"5min":0.94199999999999995,"15min":858.15300000000002},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Apr 9 18:33:17 2021","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":16.277000000000001,"15min":6.3890000000000002},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.252},"max":{"1min":1.726,"5min":798.38699999999994,"15min":798.38699999999994},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":18.103000000000002,"15min":7.1710000000000003},"min":{"1min":0.309,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.67800000000000005,"5min":753.20699999999999,"15min":753.20699999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Apr 9 18:33:17 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":5.117},"min":{"1min":0.33500000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.74,"5min":1.74,"15min":983.08600000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":14.308,"15min":5.0890000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27600000000000002},"max":{"1min":2.3399999999999999,"5min":825.28099999999995,"15min":825.28099999999995},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575017,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1102804,"kb_used_data":54220,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93269036,"statfs":{"total":96636764160,"available":95507492864,"internally_reserved":1073741824,"allocated":55521280,"data_stored":87314216,"data_compressed":14545655,"data_compressed_allocated":31993856,"data_compressed_original":63987712,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:33:12 2021","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.29799999999999999,"15min":0.40300000000000002},"min":{"1min":0.154,"5min":0.154,"15min":0.14499999999999999},"max":{"1min":1.5009999999999999,"5min":1.748,"15min":26.109000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.311,"15min":2.1240000000000001},"min":{"1min":0.16900000000000001,"5min":0.151,"15min":0.14899999999999999},"max":{"1min":0.48099999999999998,"5min":1.347,"15min":537.42399999999998},"last":0.378}]},{"osd":2,"last update":"Fri Apr 9 18:33:12 2021","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":8.3450000000000006,"15min":10.032999999999999},"min":{"1min":0.16900000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.54200000000000004,"5min":843.40599999999995,"15min":984.54499999999996},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.65100000000000002,"15min":18.960999999999999},"min":{"1min":0.20399999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":1.5409999999999999,"5min":35.290999999999997,"15min":803.20399999999995},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Apr 9 18:33:12 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":5.9770000000000003,"15min":4.423},"min":{"1min":0.23999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":1.522,"5min":335.904,"15min":335.904},"last":0.432},{"interface":"front","average":{"1min":0.32300000000000001,"5min":24.317,"15min":12.151},"min":{"1min":0.221,"5min":0.19500000000000001,"15min":0.16},"max":{"1min":0.69899999999999995,"5min":868.67700000000002,"15min":868.67700000000002},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Apr 9 18:33:07 2021","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.441,"15min":2.3399999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.532,"5min":1.532,"15min":208.495},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44600000000000001,"15min":6.4029999999999996},"min":{"1min":0.25,"5min":0.25,"15min":0.245},"max":{"1min":0.72599999999999998,"5min":1.488,"15min":707.65899999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Apr 9 18:33:12 2021","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":14.962999999999999,"15min":14.051},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.73699999999999999,"5min":588.13699999999994,"15min":997.548},"last":405.86099999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46000000000000002,"15min":8.9580000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26600000000000001},"max":{"1min":1.119,"5min":1.502,"15min":933.71600000000001},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Apr 9 18:33:20 2021","interfaces":[{"interface":"back","average":{"1min":19.692,"5min":16.478000000000002,"15min":7.4100000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":366.29000000000002,"5min":639.91200000000003,"15min":639.91200000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":18.486000000000001,"15min":12.037000000000001},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.27700000000000002},"max":{"1min":1.645,"5min":957.94899999999996,"15min":957.94899999999996},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Apr 9 18:33:12 2021","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":5.7969999999999997,"15min":5.7939999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.253},"max":{"1min":8.9860000000000007,"5min":500.83999999999997,"15min":500.83999999999997},"last":0.626},{"interface":"front","average":{"1min":0.52800000000000002,"5min":4.6340000000000003,"15min":3.927},"min":{"1min":0.28899999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.635,"5min":500.82999999999998,"15min":500.82999999999998},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575016,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1067332,"kb_used_data":18748,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93304508,"statfs":{"total":96636764160,"available":95543816192,"internally_reserved":1073741824,"allocated":19197952,"data_stored":30923353,"data_compressed":5307282,"data_compressed_allocated":11923456,"data_compressed_original":23846912,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:33:14 2021","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.27300000000000002,"15min":2.2799999999999998},"min":{"1min":0.159,"5min":0.14499999999999999,"15min":0.13800000000000001},"max":{"1min":0.39700000000000002,"5min":0.72699999999999998,"15min":568.56600000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.26600000000000001,"5min":7.9039999999999999,"15min":6.5860000000000003},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.41399999999999998,"5min":311.89699999999999,"15min":400.709},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Apr 9 18:33:14 2021","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.30399999999999999,"15min":11.023},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.52100000000000002,"5min":1.292,"15min":981.71000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":45.710999999999999,"5min":9.4019999999999992,"15min":3.3639999999999999},"min":{"1min":0.186,"5min":0.17599999999999999,"15min":0.17499999999999999},"max":{"1min":999.62,"5min":999.62,"15min":999.62},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Apr 9 18:33:14 2021","interfaces":[{"interface":"back","average":{"1min":25.236999999999998,"5min":11.864000000000001,"15min":4.1779999999999999},"min":{"1min":0.20699999999999999,"5min":0.186,"15min":0.17399999999999999},"max":{"1min":548.96900000000005,"5min":548.96900000000005,"15min":548.96900000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.314,"15min":1.3},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.16500000000000001},"max":{"1min":0.41399999999999998,"5min":0.626,"15min":256.45299999999997},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Apr 9 18:33:14 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42599999999999999,"15min":0.69399999999999995},"min":{"1min":0.26200000000000001,"5min":0.249,"15min":0.22900000000000001},"max":{"1min":0.55000000000000004,"5min":0.79000000000000004,"15min":64.497},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":3.4260000000000002,"15min":10.131},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.24299999999999999},"max":{"1min":0.66900000000000004,"5min":267.483,"15min":672.15800000000002},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Apr 9 18:33:21 2021","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":6.0839999999999996,"15min":12.698},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.25},"max":{"1min":0.71399999999999997,"5min":451.31299999999999,"15min":944.35000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.45200000000000001,"15min":8.7899999999999991},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69099999999999995,"5min":1.4630000000000001,"15min":500.64699999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Apr 9 18:33:21 2021","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":12.901,"15min":4.6159999999999997},"min":{"1min":0.29499999999999998,"5min":0.26500000000000001,"15min":0.26000000000000001},"max":{"1min":0.78800000000000003,"5min":996.5,"15min":996.5},"last":0.78800000000000003},{"interface":"front","average":{"1min":23.91,"5min":5.1550000000000002,"15min":2.044},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.251},"max":{"1min":540.26800000000003,"5min":540.26800000000003,"15min":540.26800000000003},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Apr 9 18:33:14 2021","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":3.3959999999999999,"15min":5.5039999999999996},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.26700000000000002},"max":{"1min":0.60599999999999998,"5min":235.40700000000001,"15min":847.73000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47999999999999998,"15min":0.72999999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28399999999999997},"max":{"1min":0.65200000000000002,"5min":1.486,"15min":63.689999999999998},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1055928,"kb_used_data":7344,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315912,"statfs":{"total":96636764160,"available":95555493888,"internally_reserved":1073741824,"allocated":7520256,"data_stored":9951799,"data_compressed":1193817,"data_compressed_allocated":2625536,"data_compressed_original":5251072,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 9 18:33:12 2021","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":8.1920000000000002},"min":{"1min":0.153,"5min":0.153,"15min":0.13900000000000001},"max":{"1min":0.65600000000000003,"5min":0.66400000000000003,"15min":790.36000000000001},"last":0.25},{"interface":"front","average":{"1min":10.981,"5min":14.967000000000001,"15min":7.2530000000000001},"min":{"1min":0.17199999999999999,"5min":0.154,"15min":0.14699999999999999},"max":{"1min":213.88800000000001,"5min":914.44100000000003,"15min":914.44100000000003},"last":0.29699999999999999}]},{"osd":1,"last update":"Fri Apr 9 18:33:16 2021","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30299999999999999,"15min":3.7869999999999999},"min":{"1min":0.221,"5min":0.17299999999999999,"15min":0.158},"max":{"1min":0.47199999999999998,"5min":0.78400000000000003,"15min":565.56600000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32100000000000001,"15min":5.2069999999999999},"min":{"1min":0.23400000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.53800000000000003,"5min":2.2200000000000002,"15min":500.68299999999999},"last":0.29099999999999998}]},{"osd":2,"last update":"Fri Apr 9 18:33:16 2021","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":6.3360000000000003,"15min":9.3599999999999994},"min":{"1min":0.221,"5min":0.20699999999999999,"15min":0.19800000000000001},"max":{"1min":0.55100000000000005,"5min":509.69499999999999,"15min":742.48699999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36099999999999999,"15min":4.1109999999999998},"min":{"1min":0.21099999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.52300000000000002,"5min":2.2519999999999998,"15min":500.53899999999999},"last":0.44}]},{"osd":4,"last update":"Fri Apr 9 18:33:16 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":1.375,"15min":11.180999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23400000000000001},"max":{"1min":0.68899999999999995,"5min":100.94799999999999,"15min":959.31799999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":11.420999999999999,"15min":5.1079999999999997},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.22700000000000001},"max":{"1min":1.581,"5min":973.16399999999999,"15min":973.16399999999999},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Apr 9 18:33:16 2021","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":5.4610000000000003,"15min":4.3559999999999999},"min":{"1min":0.26800000000000002,"5min":0.26700000000000002,"15min":0.22800000000000001},"max":{"1min":0.64100000000000001,"5min":500.66699999999997,"15min":728.46199999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":8.0510000000000002,"15min":11.683999999999999},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.67300000000000004,"5min":500.72399999999999,"15min":884.28700000000003},"last":0.375}]},{"osd":6,"last update":"Fri Apr 9 18:33:16 2021","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":7.7539999999999996,"15min":3.6779999999999999},"min":{"1min":0.29099999999999998,"5min":0.251,"15min":0.251},"max":{"1min":2.004,"5min":430.43400000000003,"15min":430.43400000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":15.515000000000001,"15min":15.093},"min":{"1min":0.28000000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.028,"5min":975.39700000000005,"15min":975.39700000000005},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Apr 9 18:33:16 2021","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.50700000000000001,"15min":6.6230000000000002},"min":{"1min":0.32700000000000001,"5min":0.29199999999999998,"15min":0.27300000000000002},"max":{"1min":0.63200000000000001,"5min":2.371,"15min":830.30999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":50.944000000000003,"5min":10.586,"15min":3.8559999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.27800000000000002},"max":{"1min":500.89600000000002,"5min":500.89600000000002,"15min":500.89600000000002},"last":0.41999999999999998}]}]}]}} 2021-04-09T18:33:26.518 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell mon.* injectargs -- --no-mon-health-to-clog 2021-04-09T18:33:26.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.669 7fc28d0ba700 1 Processor -- start 2021-04-09T18:33:26.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.669 7fc28d0ba700 1 -- start start 2021-04-09T18:33:26.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.669 7fc28d0ba700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2881004c0 0x7fc2880ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.675 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.669 7fc28d0ba700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2880e4d60 0x7fc2880ff6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.669 7fc28d0ba700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2880fff40 con 0x7fc2881008c0 2021-04-09T18:33:26.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.669 7fc28d0ba700 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880ffd10 con 0x7fc2880e4d60 2021-04-09T18:33:26.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.669 7fc28d0ba700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880d8150 con 0x7fc2881004c0 2021-04-09T18:33:26.676 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.669 7fc28659c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2880e4d60 0x7fc2880ff6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc28659c700 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2880e4d60 0x7fc2880ff6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60474/0 (socket says 172.21.15.120:60474) 2021-04-09T18:33:26.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc28659c700 1 -- 172.21.15.120:0/664649323 learned_addr learned my addr 172.21.15.120:0/664649323 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:26.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc286d9d700 1 --2- 172.21.15.120:0/664649323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2881004c0 0x7fc2880ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.677 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc28659c700 1 -- 172.21.15.120:0/664649323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2881004c0 msgr2=0x7fc2880ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-04-09T18:33:26.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc28659c700 1 --2- 172.21.15.120:0/664649323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2881004c0 0x7fc2880ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc28659c700 1 -- 172.21.15.120:0/664649323 >> v1:172.21.15.134:6789/0 conn(0x7fc2881008c0 legacy=0x7fc2881a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc28659c700 1 -- 172.21.15.120:0/664649323 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880d7930 con 0x7fc2880e4d60 2021-04-09T18:33:26.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc28659c700 1 --2- 172.21.15.120:0/664649323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880e4d60 0x7fc2880ff6f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc270006700 tx=0x7fc270009b80).ready entity=mon.0 client_cookie=aa861ce9eb92d5bf server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.678 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc285d9b700 1 -- 172.21.15.120:0/664649323 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc27000c0c0 con 0x7fc2880e4d60 2021-04-09T18:33:26.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc285d9b700 1 -- 172.21.15.120:0/664649323 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27000c440 con 0x7fc2880e4d60 2021-04-09T18:33:26.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc285d9b700 1 -- 172.21.15.120:0/664649323 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc27000c920 con 0x7fc2880e4d60 2021-04-09T18:33:26.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc28d0ba700 1 -- 172.21.15.120:0/664649323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880e4d60 msgr2=0x7fc2880ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.679 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.670 7fc28d0ba700 1 --2- 172.21.15.120:0/664649323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880e4d60 0x7fc2880ff6f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc270006700 tx=0x7fc270009b80).stop 2021-04-09T18:33:26.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.671 7fc28d0ba700 1 -- 172.21.15.120:0/664649323 shutdown_connections 2021-04-09T18:33:26.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.671 7fc28d0ba700 1 --2- 172.21.15.120:0/664649323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880e4d60 0x7fc2880ff6f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.671 7fc28d0ba700 1 --2- 172.21.15.120:0/664649323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2881004c0 0x7fc2880ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.671 7fc28d0ba700 1 -- 172.21.15.120:0/664649323 >> 172.21.15.120:0/664649323 conn(0x7fc2880d15d0 msgr2=0x7fc2880d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:26.680 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.671 7fc28d0ba700 1 -- 172.21.15.120:0/664649323 shutdown_connections 2021-04-09T18:33:26.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.671 7fc28d0ba700 1 -- 172.21.15.120:0/664649323 wait complete. 2021-04-09T18:33:26.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28d0ba700 1 Processor -- start 2021-04-09T18:33:26.681 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28d0ba700 1 -- start start 2021-04-09T18:33:26.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28d0ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880967b0 0x7fc288096bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28d0ba700 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880b4f40 0x7fc2880b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.684 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28d0ba700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880baa90 0x7fc2880bae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28d0ba700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881904f0 con 0x7fc2880baa90 2021-04-09T18:33:26.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28d0ba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881906e0 con 0x7fc2880967b0 2021-04-09T18:33:26.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28d0ba700 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880bb4e0 con 0x7fc2880b4f40 2021-04-09T18:33:26.685 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28759e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880baa90 0x7fc2880bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28759e700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880baa90 0x7fc2880bae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60478/0 (socket says 172.21.15.120:60478) 2021-04-09T18:33:26.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.690 7fc28759e700 1 -- 172.21.15.120:0/3866033745 learned_addr learned my addr 172.21.15.120:0/3866033745 (peer_addr_for_me v2:172.21.15.120:0/0) 2021-04-09T18:33:26.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28659c700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880b4f40 0x7fc2880b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc286d9d700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880967b0 0x7fc288096bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.686 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28759e700 1 -- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880b4f40 msgr2=0x7fc2880b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28759e700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880b4f40 0x7fc2880b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28759e700 1 -- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880967b0 msgr2=0x7fc288096bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28759e700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880967b0 0x7fc288096bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:26.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28759e700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880b99e0 con 0x7fc2880baa90 2021-04-09T18:33:26.687 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28659c700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880b4f40 0x7fc2880b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:26.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc286d9d700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880967b0 0x7fc288096bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-04-09T18:33:26.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28759e700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880baa90 0x7fc2880bae90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fc280009940 tx=0x7fc28000bcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc280000f40 con 0x7fc2880baa90 2021-04-09T18:33:26.688 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28000c2f0 con 0x7fc2880baa90 2021-04-09T18:33:26.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2880b99e0 con 0x7fc2880baa90 2021-04-09T18:33:26.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc28000c7d0 con 0x7fc2880baa90 2021-04-09T18:33:26.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.691 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2880b99e0 con 0x7fc2880baa90 2021-04-09T18:33:26.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.692 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc280001220 con 0x7fc2880baa90 2021-04-09T18:33:26.689 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.692 7fc27f7fe700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc26c018930 0x7fc26c01adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.692 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fc280033190 con 0x7fc2880baa90 2021-04-09T18:33:26.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.692 7fc286d9d700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc26c018930 0x7fc26c01adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.690 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.692 7fc286d9d700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc26c018930 0x7fc26c01adc0 crc :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.700 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.715 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc288094150 con 0x7fc2880baa90 2021-04-09T18:33:26.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.715 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+980 (secure 0 0 0) 0x7fc28000be30 con 0x7fc2880baa90 2021-04-09T18:33:26.701 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.716 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc288094150 con 0x7fc2880baa90 2021-04-09T18:33:26.704 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.720 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc280001220 con 0x7fc2880baa90 2021-04-09T18:33:26.883 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.898 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"injected_args": ["--no-mon-health-to-clog"], "prefix": "injectargs"} v 0) v1 -- 0x7fc288094150 con 0x7fc2880baa90 2021-04-09T18:33:26.884 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.899 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"injected_args": ["--no-mon-health-to-clog"], "prefix": "injectargs"}]=0 injectargs:mon_health_to_clog = 'false' v0) v1 ==== 144+0+0 (secure 0 0 0) 0x7fc28000be30 con 0x7fc2880baa90 2021-04-09T18:33:26.888 INFO:teuthology.orchestra.run.smithi120.stderr:mon.a: injectargs:mon_health_to_clog = 'false' 2021-04-09T18:33:26.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.901 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880baa90 msgr2=0x7fc2880bae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:26.889 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.901 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880baa90 0x7fc2880bae90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fc280009940 tx=0x7fc28000bcf0).stop 2021-04-09T18:33:26.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.901 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880c4ae0 0x7fc2880bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:26.890 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.901 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288094150 con 0x7fc2880c4ae0 2021-04-09T18:33:26.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.901 7fc28659c700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880c4ae0 0x7fc2880bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:26.891 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.902 7fc28659c700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) v3 -- 0x7fc2880ccc30 con 0x7fc2880c4ae0 2021-04-09T18:33:26.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.902 7fc28659c700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27000b680 con 0x7fc2880c4ae0 2021-04-09T18:33:26.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.902 7fc28659c700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880c4ae0 0x7fc2880bbba0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc27000bdb0 tx=0x7fc27000bcc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:26.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.902 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2700009b0 con 0x7fc2880c4ae0 2021-04-09T18:33:26.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.902 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27000b680 con 0x7fc2880c4ae0 2021-04-09T18:33:26.892 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.903 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc270000940 con 0x7fc2880c4ae0 2021-04-09T18:33:26.893 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:26.906 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc27000b680 con 0x7fc2880c4ae0 2021-04-09T18:33:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.084 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"injected_args": ["--no-mon-health-to-clog"], "prefix": "injectargs"} v 0) v1 -- 0x7fc2880ccc30 con 0x7fc2880c4ae0 2021-04-09T18:33:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.086 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.1 v2:172.21.15.134:3300/0 5 ==== mon_command_ack([{"injected_args": ["--no-mon-health-to-clog"], "prefix": "injectargs"}]=0 injectargs:mon_health_to_clog = 'false' v0) v1 ==== 144+0+0 (secure 0 0 0) 0x7fc27000b680 con 0x7fc2880c4ae0 2021-04-09T18:33:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:mon.b: injectargs:mon_health_to_clog = 'false' 2021-04-09T18:33:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.087 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880c4ae0 msgr2=0x7fc2880bbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.087 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880c4ae0 0x7fc2880bbba0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc27000bdb0 tx=0x7fc27000bcc0).stop 2021-04-09T18:33:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.087 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880bb4e0 0x7fc2880b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-04-09T18:33:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.087 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc288094150 con 0x7fc2880bb4e0 2021-04-09T18:33:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.088 7fc28659c700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880bb4e0 0x7fc2880b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-04-09T18:33:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.088 7fc28659c700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) v3 -- 0x7fc2880ccc30 con 0x7fc2880bb4e0 2021-04-09T18:33:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.088 7fc28659c700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27000b680 con 0x7fc2880bb4e0 2021-04-09T18:33:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.088 7fc28659c700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880bb4e0 0x7fc2880b4f40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc270022170 tx=0x7fc270022420).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-04-09T18:33:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.089 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc270006d10 con 0x7fc2880bb4e0 2021-04-09T18:33:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.089 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27000bcc0 con 0x7fc2880bb4e0 2021-04-09T18:33:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.089 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mgrmap(e 3) v1 ==== 33430+0+0 (secure 0 0 0) 0x7fc27000bea0 con 0x7fc2880bb4e0 2021-04-09T18:33:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.092 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111559 (secure 0 0 0) 0x7fc270008040 con 0x7fc2880bb4e0 2021-04-09T18:33:27.252 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.268 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"injected_args": ["--no-mon-health-to-clog"], "prefix": "injectargs"} v 0) v1 -- 0x7fc288094150 con 0x7fc2880bb4e0 2021-04-09T18:33:27.254 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.269 7fc27f7fe700 1 -- 172.21.15.120:0/3866033745 <== mon.2 v2:172.21.15.134:3301/0 5 ==== mon_command_ack([{"injected_args": ["--no-mon-health-to-clog"], "prefix": "injectargs"}]=0 injectargs:mon_health_to_clog = 'false' v0) v1 ==== 144+0+0 (secure 0 0 0) 0x7fc270025070 con 0x7fc2880bb4e0 2021-04-09T18:33:27.255 INFO:teuthology.orchestra.run.smithi120.stderr:mon.c: injectargs:mon_health_to_clog = 'false' 2021-04-09T18:33:27.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.273 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc26c018930 msgr2=0x7fc26c01adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.273 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc26c018930 0x7fc26c01adc0 crc :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.259 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.273 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880bb4e0 msgr2=0x7fc2880b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-04-09T18:33:27.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.273 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880bb4e0 0x7fc2880b4f40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc270022170 tx=0x7fc270022420).stop 2021-04-09T18:33:27.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.273 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 shutdown_connections 2021-04-09T18:33:27.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.273 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2880c4ae0 0x7fc2880bbba0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.273 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2880baa90 0x7fc2880bae90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.260 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.273 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2880bb4e0 0x7fc2880b4f40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.273 7fc28d0ba700 1 --2- 172.21.15.120:0/3866033745 >> [v2:172.21.15.134:6800/23529,v1:172.21.15.134:6801/23529] conn(0x7fc26c018930 0x7fc26c01adc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-04-09T18:33:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.274 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 >> 172.21.15.120:0/3866033745 conn(0x7fc28809d300 msgr2=0x7fc2880bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-04-09T18:33:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.274 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 shutdown_connections 2021-04-09T18:33:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2021-04-09 18:33:27.274 7fc28d0ba700 1 -- 172.21.15.120:0/3866033745 wait complete. 2021-04-09T18:33:27.269 INFO:teuthology.misc:Shutting down mds daemons... 2021-04-09T18:33:27.270 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-04-09T18:33:27.271 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.278 INFO:tasks.ceph.mds.a:Stopped 2021-04-09T18:33:27.279 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-04-09T18:33:27.279 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.289 INFO:tasks.ceph.mds.b:Stopped 2021-04-09T18:33:27.290 INFO:teuthology.misc:Shutting down osd daemons... 2021-04-09T18:33:27.290 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-04-09T18:33:27.290 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.358 INFO:tasks.ceph.osd.0:Stopped 2021-04-09T18:33:27.358 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-04-09T18:33:27.359 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.432 INFO:tasks.ceph.osd.1:Stopped 2021-04-09T18:33:27.433 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-04-09T18:33:27.434 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.511 INFO:tasks.ceph.osd.2:Stopped 2021-04-09T18:33:27.511 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-04-09T18:33:27.512 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.585 INFO:tasks.ceph.osd.3:Stopped 2021-04-09T18:33:27.586 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-04-09T18:33:27.587 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.622 INFO:tasks.ceph.osd.4:Stopped 2021-04-09T18:33:27.623 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-04-09T18:33:27.623 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.707 INFO:tasks.ceph.osd.5:Stopped 2021-04-09T18:33:27.707 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-04-09T18:33:27.708 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.745 INFO:tasks.ceph.osd.6:Stopped 2021-04-09T18:33:27.746 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-04-09T18:33:27.746 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.820 INFO:tasks.ceph.osd.7:Stopped 2021-04-09T18:33:27.820 INFO:teuthology.misc:Shutting down mgr daemons... 2021-04-09T18:33:27.821 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-04-09T18:33:27.821 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.839 INFO:tasks.ceph.mgr.y:Stopped 2021-04-09T18:33:27.840 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-04-09T18:33:27.840 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.877 INFO:tasks.ceph.mgr.x:Stopped 2021-04-09T18:33:27.878 INFO:teuthology.misc:Shutting down mon daemons... 2021-04-09T18:33:27.878 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-04-09T18:33:27.878 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.889 INFO:tasks.ceph.mon.a:Stopped 2021-04-09T18:33:27.889 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-04-09T18:33:27.889 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.926 INFO:tasks.ceph.mon.b:Stopped 2021-04-09T18:33:27.927 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-04-09T18:33:27.928 INFO:teuthology.orchestra.run:waiting for 300 2021-04-09T18:33:27.975 INFO:tasks.ceph.mon.c:Stopped 2021-04-09T18:33:27.976 INFO:tasks.ceph:Checking cluster log for badness... 2021-04-09T18:33:27.977 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'not responding, replacing' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2021-04-09T18:33:28.036 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:33:28.037 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-04-09T18:33:28.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:33:28.462 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-04-09T18:33:28.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:33:28.600 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-04-09T18:33:28.706 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T18:33:28.706 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-04-09T18:33:28.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:33:28.826 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-04-09T18:33:29.145 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:33:29.145 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-04-09T18:33:29.261 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:33:29.261 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-04-09T18:33:29.378 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi134.front.sepia.ceph.com 2021-04-09T18:33:29.378 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-04-09T18:33:29.510 INFO:tasks.ceph:Archiving mon data... 2021-04-09T18:33:29.511 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728/data/mon.a.tgz 2021-04-09T18:33:29.512 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T18:33:29.559 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.tordUkbpO2 2021-04-09T18:33:29.559 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.tordUkbpO2 2021-04-09T18:33:29.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.tordUkbpO2 2021-04-09T18:33:29.844 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.tordUkbpO2 is 677KB 2021-04-09T18:33:29.943 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.tordUkbpO2 2021-04-09T18:33:29.985 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728/data/mon.b.tgz 2021-04-09T18:33:29.986 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:33:30.028 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.WTa30V20mP 2021-04-09T18:33:30.028 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WTa30V20mP 2021-04-09T18:33:30.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.WTa30V20mP 2021-04-09T18:33:30.358 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.WTa30V20mP is 690KB 2021-04-09T18:33:30.460 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.WTa30V20mP 2021-04-09T18:33:30.501 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728/data/mon.c.tgz 2021-04-09T18:33:30.502 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-04-09T18:33:30.587 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.OG6B1twkB2 2021-04-09T18:33:30.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.OG6B1twkB2 2021-04-09T18:33:30.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.OG6B1twkB2 2021-04-09T18:33:30.919 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.OG6B1twkB2 is 690KB 2021-04-09T18:33:31.022 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.OG6B1twkB2 2021-04-09T18:33:31.063 INFO:tasks.ceph:Cleaning ceph cluster... 2021-04-09T18:33:31.063 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-04-09T18:33:31.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-04-09T18:33:31.153 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-04-09T18:33:31.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-04-09T18:33:31.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-04-09T18:33:31.210 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-04-09T18:33:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-04-09T18:33:31.217 INFO:tasks.ceph:Archiving crash dumps... 2021-04-09T18:33:31.220 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728/remote/smithi120/crash 2021-04-09T18:33:31.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-04-09T18:33:31.277 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728/remote/smithi134/crash 2021-04-09T18:33:31.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-04-09T18:33:31.332 INFO:tasks.ceph:Shutting down logrotate 2021-04-09T18:33:31.333 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:31.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:31.408 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:31.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-04-09T18:33:31.515 INFO:tasks.ceph:Compressing logs... 2021-04-09T18:33:31.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-04-09T18:33:31.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-04-09T18:35:36.857 INFO:tasks.ceph:Archiving logs... 2021-04-09T18:35:36.858 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728/remote/smithi120/log 2021-04-09T18:35:36.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/log/ceph -- . 2021-04-09T18:36:00.236 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-04-09_17:56:50-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6031728/remote/smithi134/log 2021-04-09T18:36:00.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/log/ceph -- . 2021-04-09T18:36:02.697 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-04-09T18:36:02.701 DEBUG:teuthology.task.console_log:Killing console logger for smithi120 2021-04-09T18:36:02.702 DEBUG:teuthology.task.console_log:Killing console logger for smithi134 2021-04-09T18:36:02.702 DEBUG:teuthology.exit:Finished running handlers